Azure Data Engineer - w

Azure Data Engineer

Company Name:

Job Title: Azure Data Engineer

Qualification: Any graduation

Experience: 7 to 10 years

Must Have Skills:

Azure Data Platform Expertise

• Hands-on experience with Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Data Lake (ADLS).
• ETL/ELT Development
• Strong skills in building and optimizing ETL/ELT data pipelines using ADF and SQL-based transformations.
• SQL & Database Skills
• Proficiency in T-SQL, data modeling, stored procedures, and working with Azure SQL Database or SQL Server.
• Data Integration & Transformation
• Experience in ingesting data from on-premise and cloud sources using connectors, APIs, and Azure services.
• Data Governance & Security
• Understanding of data security, encryption, access management, and compliance within Azure environment.

Good to Have Skills:

Python / PySpark Knowledge

• Experience in data processing or scripting for automation using Python, PySpark, or Databricks notebooks.
• Azure Certifications
• Microsoft Certified: Azure Data Engineer Associate or equivalent certification.
• DevOps for Data
• Familiarity with CI/CD pipelines for data workloads using Azure DevOps or GitHub Actions.
• Power BI Integration
• Understanding of how to prepare data for consumption in Power BI and optimize Datasets for performance.
• Big Data & Streaming
• Exposure to tools like Azure Event Hub, Stream Analytics, or Kafka for real-time data processing.

Roles and Responsibilities:

• Data Pipeline Development
• Design, build, and maintain scalable data pipelines for batch and real-time data ingestion and processing.
• Data Modeling & Architecture
• Develop and optimize data models for analytics, ensuring alignment with business requirements and standards.
• Performance Optimization
• Monitor and tune data pipeline performance, troubleshoot bottlenecks, and ensure efficient resource utilization.
• Collaboration & Requirement Gathering
• Work with data analysts, business stakeholders, and data architects to understand data needs and deliver reliable solutions.
• Data Quality & Governance
• Implement data validation, cleansing, and lineage tracking to ensure accuracy and consistency.
• Automation & CI/CD
• Automate data workflows, deployments, and monitoring through Azure DevOps and Infrastructure as Code (IaC) tools.
• Documentation & Support
• Maintain detailed documentation of data pipelines, schemas, and processes. Provide production support as needed.
• Continuous Improvement
• Evaluate new Azure data services and technologies to enhance platform scalability, performance, and cost-efficiency.

Location: Bangalore and Chennai

CTC Range: 25 LPA

Notice period: Immediate

Shift Timings: General

Mode of Interview: Virtual

Mode of Work: Hybrid

Mode of Hire: Permanent

Note: