View All Jobs 155783

Senior Data Engineer

Build and optimize large-scale Hadoop data pipelines for real-time analytics
Dublin
Senior
21 hours agoBe an early applicant
Ebay

Ebay

An online marketplace for buying and selling a wide variety of goods, both new and used.

Data Engineer

At eBay, we're more than a global ecommerce leader — we're changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We're committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.

Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work — every day. We're in this together, sustaining the future of our customers, our company, and our planet.

Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all.

About The Team

The Cloud Data Technologies (CDT) team at eBay oversees data infrastructure and the management of the end-to-end data lifecycle. As a Data Engineer on our Dublin team, you will work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This is a hands-on role focused on building, optimizing, and maintaining large data pipelines and warehouse infrastructure.

What You Will Accomplish

  1. Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
  2. Implement data ETL processes for batch and streaming analytics requirements.
  3. Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
  4. Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
  5. Ensure data security, integrity, and compliance throughout the infrastructure.
  6. Maintain documentation and contribute to architecture reviews.
  7. Participate in incident response and operational excellence initiatives for the data warehouse.
  8. Continuously learn and apply new Hadoop ecosystem tools and data technologies.

What You Will Bring

  • Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies.
  • Proficiency in Hadoop ecosystems such as Hive, Iceberg, Spark SQL.
  • Good understanding of Apache Airflow tool for orchestrating complex computational workflows and data processing pipelines.
  • Proven ability to design and implement automated data pipelines and materialized views.
  • Proficiency in Python, Unix or similar languages.
  • Good understanding of SQL Oracle, SQL Server or similar languages.
  • Java + Spring Boot: Build and maintain microservices.
  • Ops & CI/CD: Monitoring (Prometheus/Grafana), logging, pipelines (Jenkins/GitHub Actions).
  • Core Engineering: Data structures/algorithms, testing (JUnit/pytest), Git, clean code.
  • Cloud Native: Docker, Kubernetes (deploy, network, scale, troubleshoot).
  • 6+ years of directly applicable experience.
  • BS in Computer Science, Engineering, or equivalent experience.
+ Show Original Job Post
























Senior Data Engineer
Dublin
Engineering
About Ebay
An online marketplace for buying and selling a wide variety of goods, both new and used.