Data Platform Engineer

The Role

Lyst is looking for a Software Engineer to join their Data Platform team. The engineer will help build upon and improve our customer facing analytics ingestion pipelines that power our business intelligence and decision making.

You will work in a fast-paced environment with a high level of autonomy. While your work will be peer reviewed and subject to approvals, it is important that you are able to liaise with both team members and wider partners in the organisation to gather requirements and lead on appropriate solutions.

You will be maintaining and improving a system that handles a high volume of traffic so experience with cloud and data warehouse infrastructure will help you in this role (we use AWS, Cloudflare and Snowflake). Familiarity with infrastructure as code will also help when updating our cloud architecture (we use Terraform).

We place a large focus on data quality so you'll be expected to review the small picture (data contracts via versioned schemas) and the wider picture (data integrity and data completeness across tables and databases). We also value the ability for team members to think of ways we can improve data quality and drive those initiatives across the business.

Within the first three months, you will be able to:

• Contribute to every part of our system, ranging from code and tests to infrastructure changes.
• Ensure the stability of our system by implementing and improving monitoring and observability tools.
• Write resilient code that is well tested.
• Be curious — not just the code, but the architecture of our platforms and everything that enables the business to thrive.
• Gain expertise over our tools and services: Python, Docker, Github Actions, Snowflake, AWS
• Participate in all team ceremonies and have direct input in the team's ways of working.

This is a high-trust, supportive, and collaborative environment where you will have plenty of opportunities to make an impact on your team and the wider company. We value attitude as much as we do direct experience—we want to hire people to grow into the role and beyond.

About the team:

• Python is our bread and butter.
• The wider data platform team uses dbt, Snowflake, and Looker to model, transform, and expose data for analytics and reporting across the business.
• We use Docker and Kubernetes to manage our production services.
• We use Github Actions for continuous integration and deployment. Lyst deploys new changes to production more than 500 times a month.
• The Data Platform team is one of Lyst's fundamental teams, and the data we manage is critical for the business. We have a strong relationship across the rest of the organisation, and almost all of Lyst engineering engages with us on a regular basis.
• We care about robustness and integrity in our pipelines and use observability tools to monitor.