Senior Product Engineer (data Engineer)

Senior Product Engineer (Data Engineer)

Job Summary: We are seeking a skilled and motivated Data Engineer to design, develop, and maintain scalable data pipelines and backend services using cutting-edge technologies. You will work with AWS services, PySpark, Python, and Java to implement efficient data processing solutions and APIs. Collaborating with cross-functional teams, you will gather requirements, optimize data workflows, troubleshoot performance issues, and ensure data quality across platforms. As a mentor to junior engineers, you will provide technical guidance and contribute to the team's success.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and systems using AWS services.
• Implement data processing solutions using PySpark and Python.
• Develop and maintain backend services and APIs using Java.
• Collaborate with cross-functional teams to gather requirements and deliver data solutions.
• Optimize and troubleshoot data workflows and performance issues.
• Ensure data quality and integrity across various data sources and platforms.
• Mentor junior engineers and provide technical guidance.

Required Skills:

• Extensive experience with AWS services such as EC2, S3, Lambda, Glue, and EMR.
• Proficiency in PySpark for large-scale data processing.
• Strong programming skills in Python.
• At least 2+ years of experience in Java.
• Experience with data warehousing solutions and ETL processes.
• Knowledge of both relational and NoSQL databases.
• Familiarity with CI/CD pipelines and version control systems like Git.
• Excellent problem-solving and analytical skills.
• Strong communication and teamwork abilities.

Preferred Qualifications:

• Experience with machine learning frameworks and tools.
• Knowledge of data security and compliance best practices.
• Certification in AWS or related technologies.

Qualifications:

• AWS: EC2, S3, Lambda, Glue, EMR. Proficiency in PySpark & Python for large-scale data processing, 2+years of Java experience.
• Familiarity with ETL processes and data warehousing concepts, Understanding of relational databases and NoSQL databases.
• Familiarity with CI/CD pipelines and version control systems like Git.

Additional Information:

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together