Senior Software Engineer, CoreAI

Microsoft

Quick summary

Work type: On-site
Location: Redmond, WA
Salary: $119,800–$234,700 / yr
Posted: 37 days ago
Closes: Nov 17, 2026
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $183k

This role $177k

$106k most similar roles pay here $248k

This role pays more than 60% of similar roles. Most pay $157,512–$208,850 — the shaded band above. At the midpoint, this role pays about $177k versus about $183k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 694 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 636 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Senior Software Engineer, CoreAI

Role Posting Log in to save

As a Senior Software Engineer on the AI Core Infrastructure team within the CoreAI Organization at Microsoft, you will play a pivotal role in developing cutting-edge GPU management infrastructure and training platforms that support large-scale model pre-training and fine-tuning for state-of-the-art language, multimodal, and code-specific models. Your responsibilities include architecting and designing core AI services using Go, Rust, Python, C++, and C#, which are deployed on Kubernetes clusters to ensure high stability, low latency, and strong security in complex training environments across Azure and partner clouds. You will collaborate with engineers, researchers, and external partners to enhance system reliability and efficiency while providing operational support and technical leadership for the continuous improvement of engineering practices. This role requires extensive experience with distributed systems, cloud infrastructure, DevOps practices, and production ML systems, including hands-on knowledge of containerization tools like Docker and Kubernetes, as well as CUDA libraries and NCCL.

Skills

Kubernetes Python Go Rust C++ Docker CI/CD Azure NCCL CUDA Terraform

What you'll do

Design and develop core AI Infrastructure services in Go, Rust, Python, C++, and C# for large-scale Kubernetes clusters.
Debug and diagnose issues to improve the stability of large-scale model training runs on GPUs.
Enhance systems to ensure high stability, low latency, strong security, and maintainability in complex training environments.
Provide operational support and technical leadership for deployment and monitoring of engineering systems and practices.
Collaborate with researchers and partners to continuously improve large-scale AI training infrastructure.

What we're looking for

Bachelor's Degree in Computer Science or related field with 4+ years of technical engineering experience.
Experience coding in C#, C++, Python, or similar languages for software development.
At least 3 years of designing, developing, and shipping high-quality software.
2+ years of experience with distributed systems and cloud-based infrastructure.
Knowledge and hands-on experience with production ML systems and large-scale training infrastructure.

Save