Principal Platform Engineer

Role Summary

You will work on a modern, cloud-native data platform built on Microsoft Azure, and you'll have substantial input into how the platform evolves over time. The environment supports large-scale, business-critical workloads and is developed for both real-time and batch processing.

The platform makes extensive use of Azure Databricks, Apache Spark, and Delta Lake to support high-throughput data pipelines. Kafka and Azure Event Hubs are used to implement reliable, event-driven architectures, with schema management and stream processing forming core parts of the system.

Datasets are stored and served primarily using ADLS Gen2 and Delta tables, with additional technologies such as Azure Data Explorer, Cosmos DB, or Synapse used where they are the right fit. Engineers work closely with SQL, Python, and Scala to model data, optimize query performance, and support high-QPS analytical use cases.

The platform places a strong emphasis on reliability, observability, and secure delivery. Teams use Datadog and Azure Monitor, follow Open Telemetry standards, and handle environments using Git-based workflows and Infrastructure as Code. Automated testing and well-defined release strategies are central to how changes are built and shipped.

What You'll Bring

You will bring 5–10+ years of experience building and operating highly scalable systems in production, ideally within data-intensive or analytics-heavy environments. You've worked hands-on with Azure and have experience operating Databricks platforms supporting both streaming and batch workloads.

You will have practical experience working with Kafka or Azure Event Hubs, including designing partitions, managing consumer groups, and understanding delivery semantics. You're confident working with SQL, have experience with data modeling, and know how to diagnose and improve query performance on large datasets.

A proven understanding of distributed systems fundamentals, such as fault tolerance, stateful processing, and system resilience. You've worked with event-driven architectures and have supported systems that handle high request volumes and low-latency analytical workloads.

You're comfortable working in at least one data-focused programming language, such as Python or Scala, and you bring a good sense of ownership. You enjoy influencing technical direction, mentoring other specialists, and helping teams converge on shared standards and guidelines.

Desirable's

While not required, experience in some of the following areas would be advantageous. This could include working with Delta Live Tables, Unity Catalog, or broader Lakehouse governance approaches, or exposure to additional data and streaming technologies such as Flink, Azure Data Explorer (Kusto), or Cosmos DB.

Experience crafting serving layers, stream-out patterns, or feature stores for analytics or machine learning is also valuable. Familiarity with SRE practices, such as defining SLOs and handling error budgets in data-intensive systems, is a plus.

Career Stage: Manager

London Stock Exchange Group (LSEG) Information:

Join us and be part of a team that values innovation, quality, and continuous improvement. If you're ready to take your career to the next level and make a significant impact, we'd love to hear from you.

LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth.

Our purpose is the foundation on which our culture is built. Our values of Integrity, Partnership, Excellence and Change underpin our purpose and set the standard for everything we do, every day. They go to the heart of who we are and guide our decision making and everyday actions.

Working with us means that you will be part of a dynamic organization of 25,000 people across 65 countries. However, we will value your individuality and enable you to bring your true self to work so you can help enrich our diverse workforce.

We are proud to be an equal opportunities employer. This means that we do not discriminate on the basis of anyone's race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital status, veteran status, pregnancy or disability, or any other basis protected under applicable law. Conforming with applicable law, we can reasonably accommodate applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.

You will be part of a collaborative and creative culture where we encourage new ideas. We are committed to sustainability across our global business and we are proud to partner with our customers to help them meet their sustainability objectives. Our charity, the LSEG Foundation provides charitable grants to community groups that help people access economic opportunities and build a secure future with financial independence. Colleagues can get involved through fundraising and volunteering.

LSEG offers a range of tailored benefits and support, including healthcare, retirement planning, paid volunteering days and wellbeing initiatives.