View All Jobs 113801

Senior Software Engineer - Coreai

Build scalable AI inference services for large language models at Microsoft
Redmond, Washington, United States
Senior
yesterday
Microsoft

Microsoft

A global technology leader known for its software products, cloud services, and hardware like Windows OS and Xbox consoles.

Senior Software Engineer - CoreAI

Join our team within CoreAI, where we are building the AI data-plane that powers all LLM inferencing workloads across Microsoft and Azure customers—from cutting-edge startups to Fortune 500 enterprises. Our converged AI fabric delivers inference capabilities for all LLMs in Microsoft catalog, including OpenAI, Mistral, Cohere, Llama, and more.

As a Senior Software Engineer - CoreAI, you will help build one of the largest and fastest-growing services in Azure, foundational to Microsoft’s AI strategy. Our mission is to serve models at scale—reliably, efficiently, and with ultra-low latency—enabling a rich set of AI-powered product experiences. This is a rapidly evolving space with immense opportunities to learn, innovate, and drive industry-wide impact.

At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. We embrace a growth mindset, foster innovation, and work together to realize our shared goals. Every day, we build on our values of respect, integrity, and accountability to create a culture where everyone can thrive.

+ Show Original Job Post
























Senior Software Engineer - Coreai
Redmond, Washington, United States
Engineering
About Microsoft
A global technology leader known for its software products, cloud services, and hardware like Windows OS and Xbox consoles.