Senior Staff Software Engineer , Data Platform

Job Opportunity At Uber

The Batch Data team is revolutionizing Uber's data infrastructure, enhancing data freshness and cost efficiency, and developing a cutting-edge metadata management service for unstructured data. The successful candidate will play a pivotal role in designing and implementing solutions that handle exabytes of data, directly impacting critical Uber data platform services, with unified catalog and storage being two primary focus areas. This role offers the opportunity to drive significant improvements in user experience, quality, innovations, cost & operational efficiency, and system reliability across the organization.

What the Candidate Will Do:

• Lead the design, development, and deployment of new features for the large scale cloud data storage platform.
• Drive the architecture and implementation of a unified catalog, focusing on creating a lightweight metadata layer, leveraging native cloud object store capabilities, and on behalf of Uber, to engage the community and contribute to open source projects.
• Collaborate on the development and rollout of uFlash, including implementing full S3 API support, integrating with existing clients, and onboarding new customers.
• Contribute to strategic Data for AI initiatives.

Basic Qualifications:

• Proven experience in designing and building large-scale data storage and unified data catalog solutions.
• Strong understanding of data platform technologies, including data lakehouse architecture and cloud infrastructure (preferably GCP or OCI).
• Demonstrated expertise in data infrastructure components such as data catalog and storage systems.

Preferred Qualifications:

• Extensive experience with technologies like Apache Spark, Flink, Kafka, and Table Formats (Hudi, Iceberg, Delta).
• Deep knowledge of data catalog/metadata management.
• Experience developing and implementing S3-compatible APIs and managing large-scale tabular and unstructured data.
• Familiarity with multi-cloud environments (OCI/GCP) and strategies for resource efficiency, including developing intelligent scheduling and portable data solutions.

For Sunnyvale, CA-based roles: The base salary range for this role is $257,000 per year - $285,500 per year. You will be eligible to participate in Uber's bonus program, and may be offered an equity award & other types of comp. You will also be eligible for various benefits. More details can be found at the following link. Uber is proud to be an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you have a disability or special need that requires accommodation, please let us know by completing this form.