Senior and Principal Software Engineer, AI Frameworks

Microsoft

Confirmed live yesterday High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Salary
$142,800–$274,800 / yr
Posted
4 days ago
Freshness
Confirmed live yesterday
Closes
Mar 14, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $179k
This role $209k
$101k most similar roles pay here $293k

This role pays more than 78% of similar roles. Most pay $150,187–$208,668 — the shaded band above. At the midpoint, this role pays about $209k versus about $179k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 657 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 642 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Senior and Principal Software Engineer, AI Frameworks

Senior and/or Principal Software Engineer- AI Frameworks joins the Microsoft AI Frameworks team to develop software, performance systems, and engineering tools that enable state-of-the-art AI models to run reliably at cloud scale. This individual contributor role involves designing, implementing, and operating production-quality components across AI frameworks, runtimes, benchmarking systems, and performance tooling. The engineer will benchmark, profile, and optimize large language model training and inference workloads while building automation and observability to detect regressions and accelerate hardware onboarding. Candidates must possess experience in C++ or Python and familiarity with PyTorch, TensorFlow, or ONNX Runtime. Technical expertise may include CUDA, ROCm, Triton, and accelerator-aware optimization. The role addresses the critical challenge of improving model velocity, runtime performance, and infrastructure efficiency across various architectures including NVIDIA and AMD GPUs and Microsoft silicon.

What does a Software Engineer earn?

Median $197750 from 2137 postings across 141 companies.

See salary data

What you'll do

  • Design, implement, and operate production-quality components across AI frameworks, runtimes, and benchmarking systems.
  • Benchmark, profile, debug, and optimize large language model training and inference workloads on GPUs and Microsoft hardware.
  • Build automation and observability tools to detect regressions and accelerate model and hardware onboarding.
  • Translate complex model and platform requirements into robust software solutions for production environments.
  • Investigate cross-stack issues involving compilers, runtimes, and silicon to improve performance and reliability.
  • Establish scalable platform capabilities by turning one-off analyses into automated engineering mechanisms.
  • Drive improvements in model onboarding velocity, runtime performance, and hardware utilization efficiency.
  • Lead technical strategy and architecture for high-impact initiatives across AI framework and developer productivity tools.

What we're looking for

  • Bachelor’s Degree in Computer Science or a related technical field.
  • 4+ years of technical engineering experience coding in languages such as C++ or Python (or equivalent experience).
  • Ability to pass Microsoft Cloud background checks and other required security screenings.
  • Experience building and operating complex software systems (preferred).
  • Practical knowledge of performance analysis, benchmarking, automation, or developer tooling (preferred).
  • Familiarity with AI/ML frameworks such as PyTorch, TensorFlow, or ONNX Runtime (preferred).
  • Familiarity with GPU software and profiling technologies such as CUDA, ROCm, Triton, or equivalent (preferred).
  • Experience in software architecture, computer architecture, and accelerator-aware optimization (preferred).

More like this

Similar roles

Senior Software Engineer, AI Frameworks

Microsoft

Remote 4 days ago $119,800$234,700
C++ Python CUDA Triton vLLM SGLang Kernel Optimization Benchmarking Profiling AI Frameworks Observability
4+ yrs exp Remote

Principal Software Engineer, AI Frameworks

Microsoft

16 days ago $165,600$296,400
C++ Python AI Frameworks Compiler Runtime Azure AMD GPUs Performance Engineering Benchmarking Observability Architecture Automation
8+ yrs exp