Senior and/or Principal Software Engineer, AI Frameworks

Microsoft

Confirmed live today Trusted
Remote

Quick summary

Work type
Remote
Location
Remote
Salary
$142,800–$274,800 / yr
Posted
5 days ago
Freshness
Confirmed live today
Closes
Apr 3, 2027

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $173k
This role $209k
$101k $293k
below market most similar roles pay here above market

This role pays more than 82% of similar roles. Most pay $149,500–$196,750 — the blue band above. At the midpoint, this role pays about $209k versus about $173k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 648 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 624 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Senior and/or Principal Software Engineer, AI Frameworks

JOB TITLE: Senior and/or Principal Software Engineer - AI Frameworks The Microsoft AI Frameworks team seeks a Senior and/or Principal Software Engineer to develop software, performance systems, and engineering tools for running state-of-the-art AI models at cloud scale. In this hands-on individual-contributor role, you will design, implement, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, and performance tooling. You will benchmark, profile, and optimize large language model training and inference workloads across NVIDIA and AMD GPUs and Microsoft silicon. Key responsibilities include building automation and observability to detect regressions and accelerating model onboarding. Required skills include proficiency in C++ or Python, with preferred experience in PyTorch, TensorFlow, ONNX Runtime, CUDA, ROCm, or Triton. You will solve complex cross-stack issues to improve model velocity, platform efficiency, and production reliability.

What does a Software Engineer earn in Remote?

Median $208800 from 367 postings across 50 companies.

See salary data

What you'll do

  • Design, implement, and operate production-quality components for AI frameworks, runtimes, and benchmarking systems.
  • Benchmark, profile, debug, and optimize large language model training and inference workloads across various hardware.
  • Build automation and observability tools to detect regressions and accelerate model and hardware onboarding.
  • Drive projects from problem definition through deployment to improve model velocity and platform efficiency.
  • Diagnose cross-stack issues by partnering with researchers, infrastructure owners, and hardware vendors.
  • Define technical vision and multi-release strategies for critical AI framework and performance capabilities.
  • Establish scalable platform mechanisms that turn one-off performance analyses into durable engineering capabilities.
  • Provide hands-on technical leadership through prototyping, complex debugging, and critical-path implementation.

What we're looking for

  • Bachelor’s Degree in Computer Science or a related technical field.
  • 4+ years of technical engineering experience coding in languages such as C++ or Python, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including a Microsoft Cloud Background Check.
  • Experience building and operating complex software systems (preferred).
  • Practical knowledge of performance analysis, benchmarking, automation, or developer tooling (preferred).
  • Familiarity with AI/ML frameworks such as PyTorch, TensorFlow, or ONNX Runtime (preferred).
  • Familiarity with GPU software and profiling technologies such as CUDA, ROCm, Triton, or equivalent (preferred).
  • Extensive experience designing and shipping complex, high-performance, or distributed software systems (preferred).

More like this

Similar roles

Principal Software Engineering Manager, AI Frameworks

Microsoft

Remote 9 days ago $142,800–$274,800
Python C++ C C# Java JavaScript PyTorch TensorFlow ONNX Runtime CUDA ROCm Triton Bazel CI/CD GPU Architecture HPC LLMs Azure Release Engineering Benchmarking
6+ yrs exp Remote

Senior Software Engineer

CoStar Group

Richmond, VA 76 days ago $130,500–$170,000
React TypeScript Tailwind CSS JavaScript HTML CSS Node.js .NET Core SQL Server AWS Elastic Search Kafka Redis Redux Jest React Testing Library Webpack Babel Git CI/CD RESTful APIs LLMs Prompt Engineering
5+ yrs exp Hybrid

Senior Software Engineer

Adobe

San Jose, CA 23 days ago
Python SQL PyTorch TensorFlow scikit-learn Spark Databricks Java Go LLMs Agentic AI APIs Distributed Services Data Pipelines Feature Stores Anomaly Detection Supervised Learning Unsupervised Learning
5+ yrs exp

Senior Software Engineer

Mastercard

O'Fallon, MO 40 days ago $115,000–$184,000
Java Spring Boot REST APIs AWS Azure GCP Docker Kubernetes CI/CD Kafka Microservices Secure Coding Event-Driven Architecture Agile Scrum