Data Engineer

Data Engineer

You will deliver:

• Hands on development on Nexus Platform
• Monitoring daily BAU data pipelines and ensure our data solution is refreshed up to date every day
• Enhance the daily BAU process. Making it easier to monitor and less likely to fail and hands on development on Data Lake build, change and defect fix
• Building new data pipelines using existing frameworks and patterns
• Working with the team within an Agile framework using agile methodology tooling that controls our development and CI/CD release processes
• Contributing to the new Data Lake technology across the organisation to address a broad set of use cases across data science and data warehousing

Skills and Experience:

Essential:

• Experience with data solution BAU processes (ETL, table refresh etc.)
• Experience with integration of data from multiple data sources
• Experience in Big Data data integration technologies such as Spark, Scala, Kafka
• Experience in programming language such as Python or Scala. Experience using AWS, DBT and Snowflake.
• Analytical and problem-solving skills, applied to data solution
• Experience of CI/CD
• Good aptitude in multi-threading and concurrency concepts
• Familiarity with the fundamentals of Linux scripting language

Desirable:

• Experience of ETL technologies
• AWS exposure (Athena, Glue, EMR, Step functions)
• Experience of Snowflake and DBT
• Experience with data solution BAU processes (ETL, table refresh etc)
• Previous proficiency with ETL technologies (e.g. Talend, Informatica, Abinitio)
• Previous exposure to Python
• Previous exposure to own data solution BAU monitoring and enhancement
• Exposure to building applications for a cloud environment

We work with Textio to make our job design and hiring inclusive.