This role pays more than
76%
of similar roles. Most pay
$155,000–$207,350
— the shaded band above.
At the midpoint, this role pays about
$207k
versus about
$181k
for comparable roles.
Based on 238 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
1103 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 985 roles with salary data.
As a Principal Software Engineering Manager for AI Frameworks, you will lead and grow a team of engineers working on fundamental abstractions, runtimes, libraries, and APIs across the AI software stack to enable large-scale model training and inference. Your responsibilities include setting technical direction, prioritizing investments, and driving performance optimization efforts for OpenAI and other LLMs across GPUs and Microsoft hardware. You will partner with researchers, product teams, and platform owners to translate insights into production-ready improvements that reduce hardware footprint and support Azure’s capex efficiency goals. The role requires strong technical expertise in software engineering principles, GPU architecture, and AI infrastructure, as well as experience leading cross-team initiatives and building high-performing, inclusive teams. Familiarity with tools like CUDA, ROCm, Triton, and modern deep learning frameworks such as PyTorch or TensorFlow is essential.