Cloud Data Engineer - (hybrid)

Data Engineer Opportunity

We are looking for a hands-on Data Engineer who is passionate about solving business problems through innovation and engineering practices. As a Data Engineer, you will leverage your deep technical knowledge to drive the creation of high-quality software products. You will also be expected to share your technical expertise and promote a culture of technical excellence within the team. The Data Engineer will work with a Team Lead and will be a code-contributing member of the team that will deliver solutions against the sprint-level commitments.

Responsibilities

• Code contributing member of an Agile team, working to deliver sprint goals.
• Demonstrating technical knowledge and expertise in software development, including programming languages, frameworks, and best practices.
• Actively contributes to the implementation of features and technical solutions. Write clean, efficient, and maintainable code that meets the highest standards of quality.
• Collaborate with other Engineers to define and evolve the overall system architecture and design.
• Provide guidance on scalable, robust, and efficient solutions that align with business requirements and industry best practices.
• Offer expert engineering guidance and support to multiple teams, helping them overcome technical challenges, make informed decisions, and deliver high-quality software solutions. Foster a culture of technical excellence and continuous improvement.
• Stay up to date with emerging technologies, tools, and industry trends. Evaluate their potential impact on the organization and provide recommendations for technology adoption and innovation.

Required Qualifications

• 3+ years' experience of implementing data-intensive solutions using agile methodologies.
• Proficient in one or more programming languages commonly used in data engineering such as Python, Java, or Scala.
• Multiple years of experience with software engineering best practices (unit testing, automation, design patterns, peer review, etc.)
• Strong proficiency in working with relational databases and using SQL for data querying, transformation, and manipulation.
• Clear understanding of Data Structures and Object Oriented Principles.
• Experience of modelling data for analytical consumers.
• Ability to automate and streamline the build, test and deployment of data pipelines.
• Proven experience of providing technical vision and guidance to a data team.
• Thrives in a dynamic environment, capable of managing multiple tasks simultaneously while maintaining a high standard of work.

Preferred Qualifications

• Experience with Hadoop and S3 for data storage and Pyspark processing is valuable, as is exposure to modern data platforms such as AWS Glue, Terraform, spark on EKS.
• Experience architecting and building horizontally scalable, highly available, highly resilient, and low latency applications.
• Experience with Cloud-native development and Container Orchestration tools (Serverless, Docker, Kubernetes, OpenShift, etc.).
• Familiarity with open-source data engineering tools and frameworks (e.g. Spark , Kafka, Airflow, DBT) is a valuable asset.
• Exposure to a range of table and file formats including Iceberg, Hive, Avro, Parquet and JSON.
• Experience in cloud native technologies and patterns (AWS, Google Cloud).
• Exposure to Infrastructure as Code tools (i.e., Terraform, Cloudformation, etc.).
• Experience of driving and/or influencing the data strategy of your team or organization.

Education: BA/BS degree or equivalent work experience.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.