Data Engineer II

Azure Compute Capacity And Efficiency Team

Azure is Microsoft’s central cloud infrastructure hosting both our public cloud offerings as well as a vast number of Microsoft-internal cloud scale services. Cloud computing is a highly competitive and rapidly growing market, and it is Azure’s aim to be an industry leader in all relevant aspects and dimensions across its platform and services.

Within Azure, the Azure Compute team is the core infrastructure team responsible for hosting VMs, containers, and other workloads.

One of the fundamental core disciplines in cloud computing is capacity management. Capacity management needs to ensure that on the one hand, there is sufficient capacity across all regions, allocation domains, and hardware infrastructure to meet all customer demand; while on the other hand ensuring that capacity is provisioned efficiently thereby avoiding overspending and COGS/CAPEX impact. At the scale of Azure’s business, managing this trade-off across the entire Azure Compute fleet is an enormously complex and challenging task, where improvements can make the difference between customer allocation failures on the one hand, and gargantuan savings on the other.

The Azure Compute Capacity and Efficiency (AC2E) team is the team in Azure Compute tasked with managing all aspects of capacity and efficiency management across the fleet. Our primary task is to provide a fully automated and highly optimized tracking and management system. This system – of which CMAS (Capacity Management Automation System) is a core piece – uses numerous state-of-the-art algorithms. We use artificial intelligence to automatically predict capacity risk and execute the correct mitigation actions directly into the Azure Compute platform.

As a Data Engineer in the team, you will work closely with our software engineers, program managers, and data scientists across different teams within Azure Core. You will also collaborate with a variety of internal partner teams across Azure and Microsoft. You will build reliable, secured, highly scalable, performant data pipelines to enhance the Azure Compute allocation, deliver capacity management and efficiency improvements. The value of your work will be reflected in improvements to the Azure platform, Azure service capacity fulfillment rate, customer satisfaction, and various efficiency metrics, including COGS reduction. You will have opportunities for mentorship, accelerate your career growth, and work on truly high-business impact areas.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.