Lead Data Engineer (Hadoop) - R01549620

Lead Data Engineer

MapReduce, HDFS, Spark - Pyspark, ETL Fundamentals, SQL, SQL (Basic + Advanced), Spark - Scala, Python, Data Warehousing, Hive, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures, Oozie

Primary Skills (Must Have): Programming language: Python / Java / Scala, Framework: Spark, Hadoop, Declarative language: SQL. Secondary Skills (Good to Have): Databricks, AWS Scope of Work:
Developing and maintaining Big Data ETL jobs.
Conducting data analysis and profiling.
Collaborating with cross-functional teams (e.g., data scientists, business analysts) to align data engineering solutions with business objectives.
Automating data workflows to increase system efficiency and reduce manual intervention.
Monitoring, troubleshooting, and optimizing data pipelines to ensure high performance and reliability.
Ensuring data security and compliance with Mastercard policies and industry standards.
Role of Resource: Senior Data Engineer Role USP: Opportunity to work on cutting-edge Big Data technologies like Spark, Databricks, Cloud services with a focus on optimizing and scaling data processing pipelines.
If Domain knowledge required: Banking / Mastercard data knowledge is an added advantage and preferable.
Experience Range: 5 to 10 years

Lead Data Engineer ( Hadoop) - R01549620