Staff Software Engineer - Credit Karma

Data Engineer IV

The Lightbox Engineering team is responsible for enabling our partners to build and host their proprietary models on Credit Karma. We provide various applications and data, hosted on Google Cloud Platform, which help our partners to build their models, analyze performance and iterate. As a Data Engineer IV, you will own engineering efforts to provide streaming and batch data to our partners with low latency and high data quality.

Responsibilities

1. Build scalable data pipelines leveraging Cloud Composer and Airflow.
2. Work on critical efforts designing and building our next generation streaming data pipeline, leveraging PubSub, Scala, Dataflow, Spark and Google Cloud Platform.
3. Design, build and launch extremely efficient & reliable data warehouse solutions and data pipelines to make large volumes of data usable for our partners to build models.
4. Build critical data quality checks to ensure that the data we provide to our partners meets security and compliance requirements.
5. Participate in code and technical design reviews
6. Take an active role in the technical growth of other team members and the processes that support overall team growth
7. Scope and plan work across multi-team efforts, working with collaborators to establish a product vision in technical terms, and plan implementation and delivery

Qualifications

• 5+ years of significant professional experience in server-side development written in Scala, Java, Go, or Python
• 5+ years of professional experience developing large-scale, high-volume services
• 5+ years of experience managing data pipelines and infrastructure using Dataflow, Spark, Hadoop, Flink, and Airflow.
• Professional experience across the entire software development process, from development environment, to CI & CD including CircleCi, Jenkins, or TravisCi, to production deployment, product and application performance measurement
• Confident articulating complex technical content to peers and partners across the organization via Technical Design Documents.
• Proven ability and interest in mentorship of junior engineers.

Preferred Qualifications:

• DevOps experience with Google Cloud Platform, AWS, or Azure
• Data quality experience especially using & improving internal tools to automatically detect issues.
• Experience building data pipelines that deal with sensitive information
• Have owned a part of or entire data pipeline at previous position

Intuit provides a competitive compensation package with a strong pay for performance rewards approach. This position may be eligible for a cash bonus, equity rewards and benefits, in accordance with our applicable plans and programs. Pay offered is based on factors such as job-related knowledge, skills, experience, and work location. The expected base pay range for this position is: