Sr. Data Engineer - san Jose

Senior Data Engineer

We're seeking Senior Data Engineers with expertise in large-scale data migration, real-time streaming, and cloud-native architecture. You'll play a key role in designing and implementing data pipelines using GCP technologies and ensuring data quality, performance, and reliability.

Key Responsibilities:

• Design and implement scalable ETL/ELT pipelines using GCP tools
• Lead large-scale data migration efforts from legacy systems to cloud platforms
• Develop real-time streaming solutions using Kafka and Pub/Sub
• Work with Cloud Dataflow, BigQuery, Bigtable, and Cloud Storage
• Ensure data validation, quality assurance, and monitoring
• Deliver cloud-native architecture documentation and code through SCRUM processes
• Build comprehensive monitoring and alerting systems
• Optimize performance through benchmarking and tuning
• Contribute to knowledge transfer and internal documentation

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.

Skills and Requirements:

• 5+ years of experience in data engineering
• Strong hands-on experience with GCP data services (Dataflow, BigQuery, Bigtable)
• Expertise in streaming architectures (Kafka, Pub/Sub)
• Proven track record in data migration and pipeline development
• Experience with cloud-native architecture and containerized environments
• Familiarity with SCRUM and agile delivery practices
• Experience in FinTech or regulated data environments
• Knowledge of data governance and compliance standards
• Familiarity with CI/CD and DevOps for data workflows