Senior and Principal Software Engineer, AI Frameworks

Microsoft

Confirmed live yesterday High trust
Remote

Quick summary

Work type
Remote
Location
Remote
Salary
$142,800–$274,800 / yr
Posted
4 days ago
Freshness
Confirmed live yesterday
Closes
Mar 14, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $179k
This role $209k
$101k most similar roles pay here $293k

This role pays more than 78% of similar roles. Most pay $150,187–$208,668 — the shaded band above. At the midpoint, this role pays about $209k versus about $179k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 657 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 642 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Senior and Principal Software Engineer, AI Frameworks

Senior and/or Principal Software Engineer- AI Frameworks joins the Microsoft AI Frameworks team to develop software, performance systems, and engineering tools that enable state-of-the-art AI models to run reliably at cloud scale. This individual-contributor role involves designing, implementing, and operating production-quality components across AI frameworks, runtimes, benchmarking systems, and developer tooling. The engineer will benchmark, profile, and optimize large language model training and inference workloads while building automation and observability to detect regressions and accelerate hardware onboarding. Candidates should possess expertise in C++ or Python and experience with PyTorch, TensorFlow, or ONNX Runtime. Technical skills include familiarity with CUDA, ROCm, Triton, and collective operations. The role addresses the technical challenge of improving model velocity, runtime performance, and infrastructure efficiency across diverse architectures including NVIDIA and AMD GPUs and Microsoft silicon.

What does a Software Engineer earn in Remote?

Median $204475 from 374 postings across 53 companies.

See salary data

What you'll do

  • Design, implement, and operate production-quality components for AI frameworks, runtimes, and benchmarking systems.
  • Benchmark, profile, debug, and optimize large language model training and inference workloads across various hardware platforms.
  • Build automation and observability tools to detect regressions and accelerate model and hardware onboarding.
  • Translate complex model and platform requirements into robust software solutions and durable infrastructure capabilities.
  • Investigate cross-stack performance and reliability issues in collaboration with research, hardware, and infrastructure teams.
  • Define technical vision and multi-release strategies for critical AI framework and developer productivity tools.
  • Establish scalable measurement and engineering mechanisms to turn one-off analyses into platform features.
  • Improve model onboarding velocity, runtime performance, and Azure capacity efficiency through high-impact initiatives.

What we're looking for

  • Bachelor's Degree in Computer Science or a related technical field.
  • 4+ years of technical engineering experience coding in languages such as C++ or Python (or equivalent experience).
  • Ability to pass Microsoft Cloud background check and other required security screenings.
  • Experience building and operating complex software systems (preferred).
  • Practical knowledge of performance analysis, benchmarking, automation, or developer tooling (preferred).
  • Familiarity with AI/ML frameworks such as PyTorch, TensorFlow, or ONNX Runtime (preferred).
  • Familiarity with GPU software and profiling technologies such as CUDA, ROCm, Triton, or equivalent (preferred).
  • Experience designing and shipping high-performance distributed systems and leading cross-team initiatives (preferred).

More like this

Similar roles

Senior Software Engineer, AI Frameworks

Microsoft

Remote 4 days ago $119,800$234,700
C++ Python CUDA Triton vLLM SGLang Kernel Optimization Benchmarking Profiling AI Frameworks Observability
4+ yrs exp Remote

Principal Software Engineer, AI Frameworks

Microsoft

16 days ago $165,600$296,400
C++ Python AI Frameworks Compiler Runtime Azure AMD GPUs Performance Engineering Benchmarking Observability Architecture Automation
8+ yrs exp