below marketmost similar roles pay hereabove market
This role pays more than
79%
of similar roles. Most pay
$174,600–$228,062
— the blue band above.
At the midpoint, this role pays about
$231k
versus about
$201k
for comparable roles.
Based on 240 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
634 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 612 roles with salary data.
The Principal Software Engineer - AI Frameworks joins the AI Frameworks team to develop software and performance systems for running state-of-the-art AI models at cloud scale. This role involves leading high-impact initiatives for the serving stack of OpenAI models, establishing technical direction, and making architectural decisions for optimizations across model architectures, frameworks, compilers, runtimes, and libraries. You will build scalable platform capabilities, improve model onboarding velocity, and enhance hardware utilization for NVIDIA and AMD GPUs and Microsoft silicon. The position requires expertise in C++ and Python, along with a deep foundation in software architecture, computer architecture, and accelerator-aware optimization. You will solve complex cross-stack challenges by designing high-performance distributed systems and developing LLM inference frameworks and AI accelerator kernel optimizations.
What does a Software Engineer earn in Remote?
Median $208800 from 350 postings across 49 companies.
Own the technical vision, architecture, roadmap, and multi-release execution strategy for critical AI framework and performance capabilities.
Lead technical alignment across teams to resolve competing requirements and hold partners accountable to measurable outcomes.
Steer cross-stack investigations spanning models, frameworks, compilers, runtimes, systems, and silicon to set technical priorities.
Provide hands-on leadership by contributing to prototypes, critical-path implementation, design reviews, and complex debugging.
Spearhead common measurement, automation, and observability mechanisms to turn one-off analyses into scalable platform capabilities.
Drive measurable improvements in model onboarding velocity, runtime performance, reliability, and hardware utilization.
Build technical leadership capacity by mentoring engineers and establishing high standards for quality and maintainability.
What we're looking for
Bachelor’s Degree in Computer Science or a related technical field and 8+ years of technical engineering experience coding in C++ or Python, or equivalent experience.
Master's Degree in Computer Science or related technical field and 12+ years of technical engineering experience coding in C++ or Python (preferred).
Bachelor's Degree in Computer Science or related technical field and 15+ years of technical engineering experience coding in C++ or Python (preferred).
Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
Demonstrated experience serving as a technical lead for complex cross-team initiatives, including setting strategy and making architectural decisions (preferred).
Robust or extensive experience designing and shipping complex, high-performance, or distributed software systems (preferred).
Deep foundation in software architecture, computer architecture, and accelerator-aware optimization (preferred).
Advanced experience with LLM inference frameworks or AI accelerator kernel optimizations (preferred).