View All Jobs 156992

Azure Data Engineer - w

Build and optimize end-to-end data pipelines for enterprise analytics solutions
Bangalore
Senior
12 hours agoBe an early applicant

Azure Data Engineer

Company Name:

Job Title: Azure Data Engineer

Qualification: Any graduation

Experience: 7 to 10 years

Must Have Skills:

Azure Data Platform Expertise

  • Hands-on experience with Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Data Lake (ADLS).
  • ETL/ELT Development
  • Strong skills in building and optimizing ETL/ELT data pipelines using ADF and SQL-based transformations.
  • SQL & Database Skills
  • Proficiency in T-SQL, data modeling, stored procedures, and working with Azure SQL Database or SQL Server.
  • Data Integration & Transformation
  • Experience in ingesting data from on-premise and cloud sources using connectors, APIs, and Azure services.
  • Data Governance & Security
  • Understanding of data security, encryption, access management, and compliance within Azure environment.

Good to Have Skills:

Python / PySpark Knowledge

  • Experience in data processing or scripting for automation using Python, PySpark, or Databricks notebooks.
  • Azure Certifications
  • Microsoft Certified: Azure Data Engineer Associate or equivalent certification.
  • DevOps for Data
  • Familiarity with CI/CD pipelines for data workloads using Azure DevOps or GitHub Actions.
  • Power BI Integration
  • Understanding of how to prepare data for consumption in Power BI and optimize Datasets for performance.
  • Big Data & Streaming
  • Exposure to tools like Azure Event Hub, Stream Analytics, or Kafka for real-time data processing.

Roles and Responsibilities:

  • Data Pipeline Development
  • Design, build, and maintain scalable data pipelines for batch and real-time data ingestion and processing.
  • Data Modeling & Architecture
  • Develop and optimize data models for analytics, ensuring alignment with business requirements and standards.
  • Performance Optimization
  • Monitor and tune data pipeline performance, troubleshoot bottlenecks, and ensure efficient resource utilization.
  • Collaboration & Requirement Gathering
  • Work with data analysts, business stakeholders, and data architects to understand data needs and deliver reliable solutions.
  • Data Quality & Governance
  • Implement data validation, cleansing, and lineage tracking to ensure accuracy and consistency.
  • Automation & CI/CD
  • Automate data workflows, deployments, and monitoring through Azure DevOps and Infrastructure as Code (IaC) tools.
  • Documentation & Support
  • Maintain detailed documentation of data pipelines, schemas, and processes. Provide production support as needed.
  • Continuous Improvement
  • Evaluate new Azure data services and technologies to enhance platform scalability, performance, and cost-efficiency.

Location: Bangalore and Chennai

CTC Range: 25 LPA

Notice period: Immediate

Shift Timings: General

Mode of Interview: Virtual

Mode of Work: Hybrid

Mode of Hire: Permanent

Note:

+ Show Original Job Post
























Azure Data Engineer - w
Bangalore
Engineering
About Black & White