View All Jobs 171280

Senior Software Engineer - Remote Eligible

Build scalable systems to evaluate and measure AI model performance at enterprise scale
Remote
Senior
2 days ago
Microsoft

Microsoft

A global technology leader known for its software products, cloud services, and hardware like Windows OS and Xbox consoles.

Senior Software Engineer

Join Microsoft Turing Team to build the core of Microsoft Copilot for enterprise with a collaborative group of applied scientists and engineers pushing the frontier of large language models (LLMs) to improve the productivity of hundreds of millions of users around the world.

Our team is responsible for the core systems that power Microsoft 365 Copilot Chat delivering intelligence, quality, and transformative new features. We work at the intersection of research and engineering—advancing orchestrator reasoning, training next-generation models, and shipping impactful, model-driven experiences in Microsoft 365 Copilot.

Shape the way the world measures and trusts AI. In the Experimentation & Evaluation area, you’ll define what “good” means for Copilot, by working on metrics, scorecards, and eval pipelines across offline, shadow, and online experiments. You’ll work at the intersection of science and engineering, gaining a front-row seat to how AI impacts millions of users and help steer one of Microsoft’s most important products forward.

As a Senior Software Engineer in the Experimentation & Evaluation area, you will build pipelines that power Copilot’s measurement and experimentation. You will design reliable systems for offline, shadow, and online scorecards, enabling fast and trustworthy evaluation of AI models and features. Through scalable engineering, you will turn complex data into actionable insights that accelerate Copilot’s innovation and impact.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

+ Show Original Job Post
























Senior Software Engineer - Remote Eligible
Remote
Engineering
About Microsoft
A global technology leader known for its software products, cloud services, and hardware like Windows OS and Xbox consoles.