Staff Data Engineer - Trust And Safety

Staff Data Engineer

Come join the Trust & Safety Data Engineering Team in New York as a Staff Data Engineer (Staff Software Engineer role). We are leveraging big data technologies to develop solutions to detect and combat fraudulent activities initiated by external users across all Intuit's products. Some of the technologies we are leveraging include Apache Spark, Athena, Redshift, Kafka, Hive, S3, EMR, AWS, and GCP. We foster an open team environment where we value direct interactions and working code above working in a cave.

You will lead the entire product lifecycle for multiple big data solutions that are broad in scope and complexity, applying a full understanding of software engineering methodologies and industry best practices for data products. Work with Industry Experts; Senior, Staff and Principal Engineers, utilize specialized knowledge to develop, and maintain Intuit's data solutions.

Responsibilities include:

Owning the tech vision and strategy for multiple domains or capabilities

Driving strategic impact. Focus on the direct and strategic application of data to deliver measurable business outcomes, even if it means working with imperfect data to capture significant value.

Hands-on development in all phases of the software life cycle.

Building batch and real-time/streaming data pipelines that are able to handle large volumes of data

Designing data models

Gathering data needs from internal customers like product and analysts and translating those requirements into a working big data solution design.

Partnering with product managers, fraud analysts, data scientists, data architects, software engineers, and other data engineers from around the world.

Participating in design and code reviews

Designing/developing ETL jobs across multiple big data platforms and tools including S3, EMR, Hive, Spark SQL, PYSpark.

Rapidly fixing bugs and solving problems; effectively remediating defects

Cleaning, transforming and validating data for use in analytics and reporting

Proactively monitoring data quality and pipeline performance, troubleshooting and resolving data issues

Collaborating effectively with senior engineers and architects to solve problems spanning their respective areas to deliver end-to-end quality in our technology and customer experience.

Helping to align to overall strategies and reconcile competing priorities across the organization.

Contributing to the design and architecture of projects across the data landscape.

Actively staying abreast of industry best practices, sharing learnings, and experimenting and applying cutting edge technologies while proactively identifying opportunities to enhance software applications with AI technology

Participating in a scheduled on-call rotation to handle production incidents outside of business hours

Mentoring other team members and contributing to the growth of the team

Being available to work in a hybrid mode (3 days in the office and 2 days remote per week)

Qualifications include:

8+ years of hand-on experience building big data solutions and ETL data pipelines using Apache Spark or similar technologies

BS or MS in Computer Science, Data Engineering or related field

Hands-on experience developing data solutions on the AWS platform (preferred), GCP, or Azure

Experience with Agile Development, SCRUM, and/or Extreme Programming methodologies

Expert in SQL, Python and Linux, and strong working knowledge of XML, JSON, YAML.

Knowledgeable with tools and frameworks Docker, Spark, Jupiter Notebook, Databricks Notebook, Kubernetes, Feature Management Platforms, SageMaker

Advanced experience with scripting language - Python or Shell is a must have

Expert knowledge of software development methodologies and practices

Experience with cloud platforms such as AWS, Azure or GCP - Amazon web services: EC2, S3, EMR, and Redshift or equivalent cloud computing approaches

Strong expertise in Data Warehousing and analytic architecture

Experience working with large data volumes, data visualization

Experience with low-latency NoSQL datastores (such as DynamoDB, HBase, Redshift) is a plus

Experience with building stream-processing applications using Spark Streaming, Flink, etc. is a plus

Hands on experience in AI

Solid communication skills

Demonstrated expertise in Software design and architecture process.

Experience with unit testing and data quality automation checks

Should be results oriented, self-motivated, accountable and work under minimal supervision.

Intuit provides a competitive compensation package with a strong pay for performance rewards approach. This position will be eligible for a cash bonus, equity rewards and benefits, in accordance with our applicable plans and programs. Pay offered is based on factors such as job-related knowledge, skills, experience, and work location. To drive ongoing fair pay for employees, Intuit conducts regular comparisons across categories of ethnicity and gender. The expected base pay range for this position is: 197k -266.5K

EOE AA M/F/Vet/Disability. Intuit will consider for employment qualified applicants with criminal histories in a manner consistent with requirements of local law.