This role pays more than
82%
of similar roles. Most pay
$175,300–$223,700
— the shaded band above.
At the midpoint, this role pays about
$231k
versus about
$200k
for comparable roles.
Based on 239 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
622 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 559 roles with salary data.
As a Principal Software Engineering Manager at Microsoft’s M365 Copilot inference team, you will lead a strategic initiative to enhance the efficiency of AI inference platforms by optimizing model execution and runtime performance. Your day-to-day responsibilities include building and leading a high-performing engineering team focused on improving throughput per GPU, reducing cost per query, and enhancing live-site performance reliability. You will collaborate with cross-functional teams such as M365 Core, AI Core, Azure, and Microsoft Research to co-design and implement advanced optimizations, establish metrics for efficiency gains, and drive alignment across partner teams on optimization priorities. The ideal candidate has extensive experience in leading engineering teams building backend or distributed systems, hands-on expertise in improving system throughput and resource utilization, and familiarity with GPU-based workloads and AI/ML inference runtime optimization techniques. This role operates at massive scale, pushing the boundaries of performance and efficiency in one of the world’s largest AI inference platforms.