[job - 24393 ] Senior Data Engineer (databricks)

Senior Data Engineer (Databricks)

We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 7,400 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.

Job Purpose

We are seeking a Senior Data Engineer with extensive hands-on experience in Data Architecture and Engineering to serve as a technical contributor within our team. This role focuses on working primarily with Australian clients and the broader APAC region. As a Senior Data Engineer, you will be responsible for designing, building, and deploying cutting-edge data solutions while contributing to the establishment of CI&T's data practice in Australia.

Key Accountabilities

• Contribute to technical engagements and proactively identify opportunities to expand CI&T's business with clients.
• Collaborate on multiple projects across various domains, providing diverse subject matter expertise.
• Participate in technical design and architecture discussions to ensure robust and scalable solutions.
• Ensure adherence to security, compliance, and performance best practices in all solutions.
• Create and maintain technical documentation required by clients.
• Communicate effectively with customer team members to ensure alignment and clarity of technical solutions.
• Understand client requirements and develop viable technical solutions by selecting appropriate frameworks and tools.
• Guarantee a stable and productive development environment for all team members.

Knowledge and Experience

• 6+ years of experience in software development with a focus on data engineering.
• Proven expertise in Data Warehousing and Data Analytics projects, covering data acquisition, transformation, and data science initiatives.
• Familiarity with modern data file formats such as Delta Tables, Apache Iceberg, and Parquet.
• Proficiency in Python, Spark, DBT, and other data transformation frameworks.
• Strong skills in data modelling (conceptual, logical, and physical) using methodologies such as Data Vault 2.0 and Dimensional Modelling.
• Experience with cloud data services (Microsoft Intelligent Data Platform, AWS Data Services, or Google Cloud Data Analytics).
• Hands-on experience with cloud data platforms like Databricks and/or Snowflake (certifications a plus).
• Skilled in data pipeline orchestration tools (Azure Data Factory, AWS Glue, Apache Airflow, or Prefect).
• Experience with CI/CD and MLOps pipelines for development and deployment automation.
• Proficiency in Infrastructure as Code (IaC) for efficient infrastructure management.
• Expertise in data migration, performance tuning, and SQL query optimisation.
• Understanding of Data Governance and Data Management principles.
• Knowledge of design patterns, clean architecture, and clean coding principles.
• Familiarity with unit, integration, and end-to-end testing.

Personal Attributes

• Mentorship: Ability to mentor and share knowledge with junior team members to foster growth.
• Consulting Mindset: Adaptability in diverse situations with the ability to manage shifting priorities and thrive in ambiguity.
• Communication: Strong communication skills to clearly convey technical concepts to team members, clients, and stakeholders.
• Non-functional Awareness: Deep understanding of non-functional requirements including performance, security, privacy, and data protection.
• Passion for Data: Genuine enthusiasm for working with data, problem-solving, and continuous learning.
• Innovative Spirit: Excited by deploying pipelines, dashboards, and continuously driving improvements.
• AI Enthusiast: Interest in AI technologies, including Generative AI, to enhance personal and team performance.

Culture & Values

Collaboration is our superpower, diversity unites us, and excellence is our standard. We value diverse identities and life experiences, fostering an inclusive, supportive, and safe workplace. We encourage applications from diverse and underrepresented groups for this position.

₱115,000 - ₱150,000 a month

Collaboration is our superpower, diversity unites us, and excellence is our standard. We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.