Principal Software Engineer, AI Frameworks

Microsoft

Confirmed live 2 days ago High trust

Quick summary

Work type
On-site
Location
Salary
$165,600–$296,400 / yr
Posted
8 days ago
Freshness
Confirmed live 2 days ago
Closes
Mar 2, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $203k
This role $231k
$124k most similar roles pay here $315k

This role pays more than 81% of similar roles. Most pay $174,600–$231,000 — the shaded band above. At the midpoint, this role pays about $231k versus about $203k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 598 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 586 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Principal Software Engineer, AI Frameworks

As a Principal Software Engineer - AI Frameworks on the AI Frameworks team, you will provide technical leadership for high-impact initiatives involving performance engineering, benchmarking, and developer productivity. You will define technical visions, make critical architectural decisions, and lead teams through complex, cross-stack investigations involving models, compilers, runtimes, and silicon. Your daily work involves building scalable platform capabilities from one-off analyses, improving model onboarding velocity, and optimizing runtime performance and hardware utilization. The role requires expertise in C++ or Python to solve challenges related to making state-of-the-art AI models run reliably at scale across various hardware platforms like NVIDIA and AMD GPUs. You will navigate ambiguous systems challenges while mentoring engineers and establishing high standards for quality. This role focuses on the technical infrastructure required to improve model performance, reliability, and efficiency in production environments.

What does a Software Engineer earn?

Median $197500 from 2196 postings across 133 companies.

See salary data

What you'll do

  • Own the technical vision, architecture, roadmap, and execution strategy for critical AI framework and performance capabilities.
  • Lead cross-team alignment by resolving competing requirements and holding partners accountable to clear decisions and outcomes.
  • Resolve trade-offs and drive teams toward decisions during complex investigations across models, compilers, runtimes, and silicon.
  • Provide hands-on technical leadership through prototyping, code reviews, complex debugging, and critical-path implementation.
  • Develop scalable platform capabilities by spearheading common measurement, automation, and observability mechanisms.
  • Improve model onboarding velocity, runtime performance, reliability, and hardware utilization across the Azure infrastructure.
  • Build organizational capacity by mentoring engineers and establishing high standards for software quality and maintainability.

What we're looking for

  • Bachelor's Degree in Computer Science or a related technical field and 8+ years of experience coding in C++ or Python (or equivalent experience).
  • Ability to pass Microsoft Cloud background checks and other required security screenings.
  • Experience serving as a technical lead for complex cross-team initiatives, including strategy, architecture, and stakeholder alignment.
  • Extensive experience designing and shipping complex, high-performance, or distributed software systems.
  • Deep foundation in software architecture, computer architecture, and accelerator-aware optimization.
  • Advanced experience with AI/ML workloads and frameworks (preferred).
  • Proven track record of creating reusable platforms, influencing stakeholders, developing other leaders, and scaling engineering practices (preferred).
  • Master's Degree and 12+ years of experience or Bachelor's Degree and 15+ years of experience in C++ or Python (preferred).

More like this

Similar roles

Principal Software Engineer

Microsoft

Redmond, WA 14 days ago $142,800$274,800
C# JavaScript Python TypeScript React Next.js C++ Java C Distributed Systems APIs Observability Web Technologies
6+ yrs exp

Principal Software Engineer

Microsoft

Redmond, WA 31 days ago $142,800$274,800
C C++ C# Java JavaScript Python Azure Virtual Desktop Windows 365 client-engineering Test Automation Performance Measurement Observability Monitoring Diagnostics
6+ yrs exp

Principal Software Engineer, Performance

Microsoft

11 days ago $165,600$296,400
C++ Python AI Frameworks Performance Engineering Benchmarking Azure Compiler Computer Architecture Observability Software Architecture
8+ yrs exp

Principal Software Engineer - FDE

Microsoft

31 days ago $142,800$274,800
Python C++ C# Java JavaScript C AI LLM Azure ML OpenAI Prompt Engineering CI/CD Automated Testing Observability System Design Security Threat Modeling
6+ yrs exp

Principal Software Engineer

Autodesk

Atlanta, GA 29 days ago $139,000$249,260
Distributed Systems Data Pipelines NoSQL Serverless API Design ETL Cloud Platform Schema Validation Search Relevance
8+ yrs exp Hybrid

Principal Software Engineer

CVS Health

Remote (Massachusetts) +4 63 days ago $144,200$288,400
Python GCP Vertex AI LLM MLOps Microservices RAG Vector Search React Angular CI/CD Pub/Sub BigQuery GKE Cloud Run FHIR HL7 SRE
10+ yrs exp Remote