Azure Data Engineer Weekend Drive

Azure Data Engineer

Company Name:

Job Title: Azure Data Engineer

Qualification: Any graduation

Experience: 4 to 8 years

Must Have Skills: Strong hands-on experience with Python for data manipulation, transformation, and scripting. Proficiency in PySpark – working with RDDs, DataFrames, Spark SQL, performance tuning. Experience developing and deploying scalable pipelines using Azure Databricks. Knowledge of Delta Lake, data versioning, and Lakehouse architecture on Azure. Good understanding of Azure Data Services like Data Lake Storage (ADLS), Azure Blob, and Azure Data Factory.

Good to Have Skills: Experience with CI/CD pipelines using Azure DevOps or GitHub Actions. Familiarity with data orchestration and scheduling tools like Apache Airflow. Understanding of data governance and security best practices in cloud environments. Exposure to SQL and NoSQL databases such as Synapse, Cosmos DB, or PostgreSQL. Knowledge of monitoring and logging in Azure (Log Analytics, Application Insights).

Roles and Responsibilities: Design and develop robust ETL/ELT pipelines using PySpark and Azure Databricks. Collaborate with data architects and analysts to deliver high-performance data solutions. Optimize and troubleshoot Spark jobs and manage large-scale data processing workloads. Implement data quality checks, transformation logic, and manage metadata. Ensure proper integration with upstream/downstream systems and participate in code reviews.

Location: Pune, Bangalore, Chennai

CTC Range: 20 LPA

Notice Period: 15 days

Shift Timings: 1 pm to 10 pm

Mode of Interview: Virtual

Mode of Work: Hybrid (2 days work from office)