Company Name: Company Name
Job Type: Permanent
Date Opened: 03/09/2025
Industry: Technology
Location: Karnataka, Bangalore North, Postal Code 560001, Country India
Qualification: Any graduation
Experience: 4 to 8 years
Must Have Skills: 3-5 years of experience in Apache Spark / PySpark. 3-5 years working with Azure Databricks and Azure Data Services (ADLS Gen2, ADF, Synapse). Strong understanding of data warehousing, ETL, and data lake architectures.
Good to Have Skills: Proficiency in Python and SQL. Experience with Git, CI/CD tools, and version control practices.
Roles and Responsibilities: Design and implement ETL/ELT pipelines using Azure Databricks and PySpark. Work with structured and unstructured data from diverse sources (e.g., ADLS Gen2, SQL DBs, APIs). Optimize Spark jobs for performance and cost-efficiency. Collaborate with data analysts, architects, and business stakeholders to understand data needs. Develop reusable code components and automate workflows using Azure Data Factory (ADF). Implement data quality checks, logging, and monitoring. Participate in code reviews and adhere to software engineering best practices.
Location: Pune / Bangalore / Chennai / Hyderabad
CTC Range: 13 to 20 LPA
Notice Period: Immediate
Shift Timings: 1pm to 10pm
Mode of Interview: Virtual