View All Jobs 148070
Data Engineer DBT
Automate deployment of data pipelines using Airflow, Docker, and cloud platforms
Chennai, Tamil Nādu, India
Senior
yesterday
Virtusa
A global provider of digital strategy, digital engineering, and IT services and solutions for Global 2000 enterprises.
100 Similar Jobs at Virtusa
Lead Software Engineer
We are seeking a highly motivated and experienced Senior DevOps Engineer to join our growing team. You will play a pivotal role in automating and streamlining our data infrastructure, ensuring reliable and efficient data pipelines built with Airflow, Python, and DBT. This role demands both technical expertise in these tools and a passion for DevOps practices.
Responsibilities:
- Design and implement robust CI/CD pipelines for data workflows using Airflow.
- Develop and maintain custom Python scripts for data processing and transformation tasks.
- Utilize DBT for building and managing data models within the data warehouse.
- Configure and manage infrastructure on cloud platforms (e.g., AWS, Azure, GCP).
- Implement containerization technologies like Docker and Kubernetes.
- Monitor and troubleshoot data pipelines and infrastructure for performance and stability.
- Implement security best practices and ensure data governance compliance.
- Collaborate with data engineers to understand their needs and translate them into technical solutions.
- Stay up-to-date with the latest advancements in DevOps tools and technologies.
Technical Skills:
- 7+ years of experience in a DevOps or related role.
- Extensive hands-on experience with Airflow, Python, and DBT.
- Proficiency in scripting languages like Bash, Shell, etc.
- Experience with cloud platforms (AWS, Azure, GCP preferred).
- Familiarity with containerization technologies (Docker, Kubernetes).
- Strong understanding of CI/CD principles and practices.
- Knowledge of data security and governance best practices.
Bonus Points:
- Experience with data lineage and data quality tools.
- Experience with cloud-based data warehousing solutions.
About Virtusa
A global provider of digital strategy, digital engineering, and IT services and solutions for Global 2000 enterprises.