ETIC, Azure Data Engineer, Associate

Data Engineering Associate

The Data Engineering Associate helps evaluate requirements, assist in design discussions and sprint planning for the construction of data pipelines, Extraction, and Transformation logic. They will be competent in Python Programming, SOLID, and DRY Design principles. The SA Data Engineer will leverage their skills in relational databases, cloud storage, and data wrangling to support business decisions and insights. The role requires a strong foundation in data management practices and the ability to mentor junior engineers.

Key Responsibilities:

• Build, and maintain scalable data pipelines and architectures to process large volumes of data efficiently.
• Implement and manage relational databases and relational database management systems (RDBMS) using Python, SQL and other languages. Engage in data wrangling and cleaning processes to ensure data quality and consistency.
• Conduct code reviews and adhere to coding standards to maintain the quality and integrity of data engineering solutions.
• Collaborate with cross-functional teams to identify data requirements and implement appropriate data solutions.
• Mentor junior engineers and provide guidance on best practices in data engineering.

Required Skills & Experience:

• 2 years experience.
• SOLID and DRY Programming principles - The ability to plan, execute, and evaluate code for compliance with industry best practices
• Python Programing - The ability to write efficient, executable code for the creation of Data Pipelines.
• Restful APIs - The ability to integrate API calls into data streams.
• Azure Databricks or similar product (Microsoft Fabric, etc.) - Create Jupyter Notebooks using Python Libraries, create and manage workflows and pipeline.
• Set Theory - foundational principles for handling data organization, relationships, and operations within large data sets. This knowledge allows them to efficiently manipulate, query, and integrate data, ensuring accurate and scalable solutions for complex data engineering tasks.