Azure Data Engineer

Azure Data Engineer

Company Name: Confidential

Job Title: Azure Data Engineer

Qualification: Any Graduation

Experience: 5 to 11 years

Must Have Skills: AWS/Azure/SAP - Master, ELT - Master, Data Modeling - Master, Data Integration & Ingestion - Skill

Good to Have Skills: Data Manipulation and Processing - Skill, GITHUB, Action, Azure DevOps - Skill, Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest - Skill

Roles and Responsibilities:

Develop and Maintain Data Pipelines: Design, implement, and manage scalable ETL pipelines using AWS Glue, Apache Airflow, and Amazon Kinesis to support real-time and batch data ingestion and transformation.

Data Warehousing & Analytics:

Automation & Testing: Implement robust automated testing frameworks using PyTest to ensure the integrity of data processing workflows and application logic.

Code Quality & DevOps Integration: Integrate SonarQube for static code analysis and continuous quality checks within the CI/CD pipeline, enforcing best practices and code maintainability standards.

Monitoring, Troubleshooting, and Documentation: Monitor pipeline performance, troubleshoot failures, and ensure proper logging and alerting across workflows, while maintaining comprehensive documentation for all data processes and architecture decisions.

Location: Bangalore

CTC Range: 190000 monthly including vendor margin

Notice period: 15 days

Mode of Interview: Virtual