Data Engineer
Accenture
Data Engineer
Design, develop, and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform, and load) processes to migrate and deploy data across systems.
Must have skills: PySpark
Minimum 5 year(s) of experience is required. 15 years full time education required.
Roles and Responsibilities:
- Lead Development and Implementation of ETL Processes Using PYSpark
- Design and Maintain Data Warehouse Solutions
- Provide Technical Guidance and Mentorship to Junior Developers
- Collaborate with Stakeholders to Understand Data Requirements
- Troubleshoot and Resolve Issues
- Contribute to the Development of Data Governance Policies
Skills and Experience: Extensive Experience with PYSpark, Strong Knowledge of Data Warehousing Principles, SQL Proficiency, Experience with Cloud Platforms, Leadership and Communication Skills, Problem-Solving and Analytical Skills, Proven Ability to Deliver Data Solutions
Minimum Experience: At least 8 years of experience in data engineering or a related field.
Professional & Technical Skills:
- Must To Have Skills: Proficiency in PySpark
- Strong understanding of data pipeline architecture and design
- Experience with ETL processes and data integration techniques
- Familiarity with data quality frameworks and best practices
- Knowledge of cloud platforms and their data services
Additional Information:
- The candidate should have minimum 5 years of experience in PySpark.
- This position is based at our Pune office.