Senior Software Engineer, CoreAI | Microsoft Careers

Microsoft

Quick summary

Work type
On-site
Location
Redmond, WA
Salary
$119,800–$234,700 / yr
Posted
16 days ago
Closes
Nov 17, 2026

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $164k
This role $177k
$106k most similar roles pay here $248k

This role pays more than 75% of similar roles. Most pay $148,356–$178,850 — the shaded band above. At the midpoint, this role pays about $177k versus about $164k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 728 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 664 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Senior Software Engineer, CoreAI | Microsoft Careers

As a Senior Software Engineer on the AI Core Infrastructure team within the CoreAI Organization at Microsoft, you will play a pivotal role in developing cutting-edge GPU management infrastructure and training platforms that support large-scale model pre-training and fine-tuning for state-of-the-art language, multimodal, and code-specific models. Your responsibilities include architecting and designing core AI services using Go, Rust, Python, C++, and C#, which are deployed on Kubernetes clusters to ensure high stability, low latency, and strong security in complex training environments across Azure and partner clouds. You will collaborate with engineers, researchers, and external partners to enhance system reliability and efficiency while providing operational support and technical leadership for the continuous improvement of engineering practices. This role requires extensive experience with distributed systems, cloud infrastructure, DevOps practices, and production ML systems, including hands-on knowledge of containerization tools like Docker and Kubernetes, as well as CUDA libraries and NCCL.

What you'll do

  • Design and develop core AI Infrastructure services in Go, Rust, Python, C++, and C# for large-scale Kubernetes clusters.
  • Debug and diagnose issues to improve the stability of large-scale model training runs on GPUs.
  • Enhance systems to ensure high stability, low latency, strong security, and maintainability in complex training environments.
  • Provide operational support and technical leadership for deployment and monitoring of engineering systems and practices.
  • Collaborate with researchers and partners to continuously improve large-scale AI training infrastructure.

What we're looking for

  • Bachelor's Degree in Computer Science or related field with 4+ years of technical engineering experience.
  • Experience coding in C#, C++, Python, or similar languages for software development.
  • At least 3 years of designing, developing, and shipping high-quality software.
  • 2+ years of experience with distributed systems and cloud-based infrastructure.
  • Knowledge and hands-on experience with production ML systems and large-scale training infrastructure.

More like this

Similar roles

| Microsoft Careers

Microsoft

US 80 days ago $142,800$274,800
Kubernetes Python C C++ Java JavaScript Terraform AWS Azure PostgreSQL CI/CD Prometheus Grafana Docker RDMA InfiniBand NCCL CUDA AKS Dynamic Resource Allocation(DRA)

Principal Software Engineer, CoreAI | Microsoft Careers

Microsoft

US 85 days ago $139,900$274,800
Python C++ Java JavaScript Azure CI/CD Kubernetes Docker Terraform Prometheus Grafana LLMs SLMs Multimodal_Models Code_Specific_Models Scalability Reliability Security Privacy Cloud_Infrastructure DevOps