Manager – Data Engineering

Job Opportunity

Prudential's purpose is to be partners for every life and protectors for every future. Our purpose encourages everything we do by creating a culture in which diversity is celebrated and inclusion assured, for our people, customers, and partners. We provide a platform for our people to do their best work and make an impact to the business, and we support our people's career ambitions. We pledge to make Prudential a place where you can Connect, Grow, and Succeed.

Responsibilities:

• Design, build, and maintain data pipelines to ingest data from multiple sources into our cloud data platform.
• Ensure pipelines are built using defined standards and maintain comprehensive documentation.
• Adhere to and enforce data governance standards to maintain data integrity and compliance.
• Implement data quality rules to ensure the accuracy and reliability of data.
• Implement data security and protection control's around Databricks Unity Catalog
• Utilize Azure Data Factory, Azure Databricks, and other Azure services to build and optimize data pipelines.
• Leverage SQL, Python/ PySpark and other programming languages for data processing and transformation.
• Stay updated with the latest Azure technologies and best practices.
• Provide technical guidance and support to team members and stakeholders.
• Maintain detailed documentation of data pipelines, processes, and data quality rules.
• Debug, fine tune and optimize large scale data processing jobs
• Generate reports and dashboards to monitor data pipeline performance and data quality metrics.
• Work collaboratively with data teams across Asia and Africa to understand data requirements and deliver solutions.

Prudential is an equal opportunity employer. We provide equality of opportunity of benefits for all who apply and who perform work for our organisation irrespective of sex, race, age, ethnic origin, educational, social and cultural background, marital status, pregnancy and maternity, religion or belief, disability or part-time / fixed-term work, or any other status protected by applicable law. We encourage the same standards from our recruitment and third-party suppliers taking into account the context of grade, job and location. We also allow for reasonable adjustments to support people with individual physical or mental health requirements.