Data Pipeline Engineer

Data Pipeline Engineer

FocusKPI is seeking a Data Pipeline Engineer to join one of our clients, a high-tech SaaS company. The team is seeking world-class server software engineers with experience in Big Data Infrastructure and Data warehousing to join their technology innovation group, which focuses on rapidly developing AI-driven, cloud-based end-to-end mobile applications and services.

Work Location: Mountain View, CA (Hybrid role, 4 days/week onsite mandatorily) Duration: 12-month contract with potential to convert depending on the candidate's performance Pay Range: $85/hr to $95/hr No C2C resumes are considered Responsibilities:

• Implement, maintain, and evolve the big data platform and infrastructure
• Responsible for designing, implementing, and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence systems
• Perform extensive research and analysis to make optimal architecture and design decisions
• Write large amounts of code, perform code reviews, write unit tests, and documentation
• Interface with other groups, including Product Management, QA, and Operations · Create quick proof-of-concept prototypes
• Work in a scrum team with ML & Cloud Engineers

Qualifications:

• Minimum of 3 years of hands-on experience in Big Data technologies like Apache Iceberg, Spark, Spark ML, & KafkaAn
• MS in Computer Science or equivalent experience is preferred
• Strong skills in statistical analysis: correlation analysis, regression analysis, univariate and multivariate analysis
• Programming Language: Python
• Strong skills in algorithms, Data structures, UNIX/Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and Networking
• Hands-on experience in building REST API's
• Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering
• Desire to learn fast and pick up the latest and greatest technologies

Preferred qualifications:

• Preferred 7+ years of experience in Big Data Technologies: AWS EMR, Iceberg, Spark, Kafka, & YARN
• Machine Learning: PyTorch, TensorFlow, Spark ML
• REST API: Flask, FastAPI, or Django
• Data Quality tools such as Monte Carlo, Great Expectations, or Databand
• Experience with teams using MLflow

No C2C resumes are considered