Lead Engineer Data Platform - US Based Remote

Lead Platform Engineer

Anywhere is at the forefront of driving the digital transformation and building best-in-class products that help our agents and brokers sell more homes, make more money, and work more efficiently. Data & Analytics (DNA) is Anywhere's data arm. We create innovative analytics, data science, and robust data foundation capabilities to generate data-driven insights that serve the heart of Anywhere Advisor and Anywhere Brand business. Together with our business counterparts in the real estate business, we work daily to deliver differentiating insights (AI & BI) for Strategy and AA & AB Operations.

About the Role

We're seeking a talented, creative, and motivated Lead Engineer who enjoys building data platform tools and is eager to collaborate with a team of individuals who share your passion. With a related degree under your belt--and relevant experience--you're ready to take your programming and data knowledge to the next level. You enjoy building tools such as the Data Ingestion Service to ingest data from diverse sources into the Data Platform, as well as building tools for monitoring and observability. With your unwavering commitment to quality, excellent data/cloud skills, and collaborative work ethic, you'll do great things here at Anywhere.

What You'll Do:

You'll work with other Data Engineers for the build-out of the Next Generation Data Platform. You'll design and develop a Data Ingestion Service for real-time streaming of data from SQL Server, MySQL, and Oracle using CDC-based technologies. You'll design and develop a Data Ingestion Service for real-time streaming of data from third-party APIs, internal micro-services, and files stored in S3/SFTP servers. You'll work with the team to design and develop a Data Platform Storage Optimization & Delta Detection Service using Apache Iceberg. You'll work with the team to design and develop a Data Catalog Service using Snowflake Horizon and Polaris. You'll work with the team to design and develop Data Observability using DataDog and Data Recon to detect data anomalies. You will design and develop a CI/CD process for continuous delivery in AWS Cloud and Snowflake. You'll design, develop, and test robust, scalable data platform components.

About You

The ideal candidate will possess extensive experience in building a data platform at an enterprise scale. You will possess strong analytical skills, attention to detail, and the ability to thrive in a fast-paced environment. Excellent communication and collaboration skills are essential for communicating with both technical and non-technical partners. The candidate must demonstrate a proactive and results-driven approach to problem-solving, with a focus on driving continuous improvement and innovation in data quality and operational processes.

Your Experience

Bachelor in computer science, Engineering, or related technical discipline, or equivalent combination of training and experience 10+ years of programming experience: building application frameworks and back-end systems for high-volume pipelines using Java/Python. 10+ years of experience building data frameworks and platforms, scaling them to handle large volumes of data. 5+ years of experience building streaming platforms using Apache Kafka, Confluent Kafka, and AWS Managed Kafka Service. 5 years' experience using AWS Data Services: DMS, EMR, Glue, Athena, S3, and Lambda. 2 years' experience building Platform Monitoring using DataDog. 2 years' experience building Data Observability using Monte Carlo. 2 years' experience building data solutions using Apache Iceberg and Apache Hudi. 1-year experience with data architecture, ETL, and processing of structured and unstructured data. 5 years' experience with DevOps tools (any combination of GitLab, Bitbucket) and methodologies (Lean, Agile, Scrum, Test Driven Development)

Behavioral Competences

Excellent communication skills to convey information on various levels of seniority. Team player, enjoying being part of a cross-functional setup. Ability to perform well on time-critical endeavors and on multiple fronts at the same time. Strong dedication to quality and a 'client' mindset. A passion for learning and continuous improvement.