View All Jobs 138208
Senior Data Engineer (spark/scala) - Relocation To Spain
Develop and optimize data pipelines supporting enterprise analytics and reporting
Madrid
Senior
1 week ago
Talan
Provides consulting and technology services specializing in digital transformation, data, and innovation for businesses across various industries.
13 Similar Jobs at Talan
Senior Data Engineer (Spark/Scala) - Relocation to Spain
We are looking for a highly skilled Senior Data Engineer with strong experience in designing, building, and maintaining scalable data solutions. The ideal candidate has a deep understanding of ETL processes, big data technologies, and modern analytics platforms, and is comfortable working in fast-paced, data-driven environments.
Key Responsibilities
- Design, develop, and optimize robust ETL pipelines to support data ingestion, transformation, and processing at scale.
- Build and maintain high-performance data models to support analytics, reporting, and data science initiatives.
- Work with large-scale distributed systems and data lake architectures (Apache Hive, AWS S3, etc.).
- Ensure data quality through strong validation practices and automated testing.
- Collaborate closely with cross-functional teams to deliver secure, clean, and reliable data to downstream consumers.
- Implement and maintain CI/CD pipelines and align code to static analysis tools such as Sonar or Fortify.
- Work with BI tools and platforms (Databricks, Power BI, Starburst, etc.) to enable effective data visualization and insights.
Required Experience & Skills
- 5+ years of experience in implementing ETL pipelines.
- 3+ years of experience working with Apache Spark.
- 3+ years of hands-on experience with Scala programming.
- 2+ years of experience with BI tools (Databricks, Power BI, Starburst, or similar).
- Strong expertise in SQL and relational database systems.
- Experience designing and implementing data models for enterprise use cases.
- Familiarity with data lakes and cloud-based storage environments (Apache Hive, AWS S3).
- Strong background in data validation, unit testing, and best practices for code quality.
- Solid understanding of CI/CD principles and experience delivering high-quality code in production environments.
About Talan
Provides consulting and technology services specializing in digital transformation, data, and innovation for businesses across various industries.