Software Engineer 2, Data Engineering

Software Engineer 2

Come join the Data Engineering Team as a Software Engineer 2. We are leveraging big data technologies to gain new insights into our customer experiences; building data frameworks, ingestion pipelines and tools. Some of the technologies we are leveraging include Google Cloud, Hive and AWS Big Data Systems. Participate in the entire product lifecycle for data, software products and services that are broad in scope and complexity, applying a full understanding of software engineering methodologies and industry best practices for data products. Work with industry experts; senior, staff and principal engineers, utilize specialized knowledge to develop, and maintain Intuit's data solutions.

What You'll Bring:

• BS or MS in Computer Science, Data Engineering or related field
• 2+ years of core development experience
• Proficiency in developing software for Java (Spring & Springboot), Scala for spark streaming & spark applications, or other JVM based languages
• Working knowledge of SQL, XML, JSON, YML, very strong Python and Linux
• Knowledgeable with tools and frameworks Docker, Spark, Scala, Jupiter Notebook, Databricks Notebook, Kubernetes, Feature Management Platforms, SageMaker
• Advanced experience with scripting language – Python or Shell is a must have
• Strong knowledge of software development methodologies and practices
• Experience with cloud platforms such as AWS, Azure or GCP - Amazon web services: EC2, S3, and EMR (Elastic Map Reduce) or equivalent cloud computing approaches
• Strong expertise in data warehousing and analytic architecture
• Experience working with large data volumes, data visualization
• Experience with low-latency NoSQL datastores (such as DynamoDB, HBase, Cassandra, MongoDB) is a plus
• Experience with building stream-processing applications using Spark Streaming, Flink, etc. is a plus

How You Will Lead:

• 70-85% hands-on development in all phases of the software life cycle
• Rapidly fix bugs and solve problems
• Code reviews and defect remediation
• Clean, transform and validate data for use in analytics and reporting
• Monitor data quality and pipeline performance, troubleshoot and resolve data issues
• Collaborates effectively with senior engineers and architects to solve problems spanning their respective areas to deliver end-to-end quality in our technology and customer experience
• Influences and communicates effectively
• Designing/developing ETL jobs across multiple big data platforms and tools including S3, EMR, Hive, Spark SQL, PYSpark
• Experience with Agile Development, SRUM, and/or Extreme Programming methodologies
• Actively stay abreast of industry best practices, share learnings, and experiment and apply cutting edge technologies while proactively identifying opportunities to enhance software applications with AI technology

Intuit provides a competitive compensation package with a strong pay for performance rewards approach. The expected base pay range for this position is: Bay Area California $137,500.00 - 186,500.00Southern California $124,500.00 - 168,500.00. This position will be eligible for a cash bonus, equity rewards and benefits, in accordance with our applicable plans and programs (see more about our compensation and benefits at Intuit®: Careers | Benefits). Pay offered is based on factors such as job-related knowledge, skills, experience, and work location. To drive ongoing pay equity for employees, Intuit conducts regular comparisons across categories of ethnicity and gender. EOE AA M/F/Vet/Disability. Intuit will consider for employment qualified applicants with criminal histories in a manner consistent with requirements of local law.