Python Data Engineer
Virtusa
Senior Software Engineer
Job Description: Data Engineer Location: Chennai Hybrid and Remote options as applicable About the Role: We are looking for a passionate and skilled Data Engineer to join our dynamic US OBU Pelican report engineering team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and workflows that support critical business reporting and analytics. Key Responsibilities Design, develop, and optimize scalable data pipelines using SQL and Python. Work with Databricks to process large datasets and implement data transformation logic. Collaborate with cross-functional teams to understand data requirements and deliver high quality solutions. Develop and maintain Airflow DAGs for orchestrating data workflows (good to have). Ensure data quality, integrity, and consistency across systems. Monitor and troubleshoot data pipeline issues and performance bottlenecks. Document technical solutions and maintain best practices in data engineering. Required Skills & Qualifications: 3 to 5 years of experience in a Data Engineering or similar role. Strong proficiency in SQL for data extraction, transformation, and analysis. Hands-on experience with Python for data manipulation and scripting. Experience working with Databricks or similar big data platforms. Familiarity with Apache Airflow and DAG development is a plus. Solid understanding of data warehousing concepts and ETL/ELT processes. Strong problem-solving skills and attention to detail. Excellent communication and collaboration abilities. Preferred Qualifications: Experience in the healthcare or pharmaceutical domain. Exposure to cloud platforms like Azure or AWS. Knowledge of CI/CD practices in data engineering.