Software Engineering, CoreAI | Microsoft Careers

Microsoft

Quick summary

Work type
On-site
Location
Salary
$102,100–$202,200 / yr
Posted
45 days ago
Closes
Oct 26, 2026

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $180k
This role $152k
$86k most similar roles pay here $251k

This role pays less than 71% of similar roles. Most pay $152,150–$208,800 — the shaded band above. At the midpoint, this role pays about $152k versus about $180k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 1559 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 1390 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Software Engineering, CoreAI | Microsoft Careers

As a Software Engineer at the senior level in the AI Core Infrastructure team within the CoreAI organization, you will play a pivotal role in developing and maintaining cutting-edge GPU management infrastructure and training platforms that support Microsoft’s extensive AI workloads. Your daily tasks will involve architecting and implementing core AI services using Go, Rust, Python, C++, and C#, which are deployed on Kubernetes clusters to handle large-scale model pre-training and fine-tuning across Azure and partner clouds. You will collaborate closely with researchers and external partners to ensure the stability of these systems while also enhancing their security and maintainability in complex training environments. Additionally, you will provide technical leadership by contributing to the deployment, monitoring, and continuous improvement of engineering practices within a high-stakes production environment that leverages distributed systems and cloud-based infrastructure.

What you'll do

  • Architect and develop core AI Infrastructure services in Go, Rust, Python, C++, and C# for large-scale Kubernetes clusters.
  • Enhance stability, low latency, strong security, and maintainability of systems in complex training environments on Azure and partner clouds.
  • Collaborate with teams to debug, diagnose, and improve the stability of large-scale model training runs.
  • Provide operational support and technical leadership for deployment, monitoring, and continuous improvement of engineering practices.
  • Design and implement high-quality software solutions for distributed systems and cloud-based infrastructure.

What we're looking for

  • Bachelor's Degree in Computer Science or related field with 2+ years of technical engineering experience.
  • Experience designing, developing, and shipping high-quality software.
  • Proficiency in C#, C++, Python, Go, Rust, Java, JavaScript for large-scale Kubernetes deployments.
  • Expertise in distributed systems and cloud-based infrastructure.
  • Hands-on experience with DevOps practices including CI/CD, automated testing, and deployment.
  • Knowledge of containerization tools like Docker and Kubernetes.
  • Experience with production ML systems, large-scale training infrastructure, NCCL, CUDA libraries.

More like this

Similar roles

| Microsoft Careers

Microsoft

US 88 days ago $142,800$274,800
Kubernetes Python C C++ Java JavaScript Terraform AWS Azure PostgreSQL CI/CD Prometheus Grafana Docker RDMA InfiniBand NCCL CUDA AKS Dynamic Resource Allocation(DRA)

Principal Software Engineer, CoreAI | Microsoft Careers

Microsoft

US 92 days ago $142,800$274,800
Python C++ Java JavaScript Azure CI/CD Kubernetes Docker Terraform Prometheus Grafana LLMs SLMs Multimodal_Models Code_Specific_Models Scalability Reliability Security Privacy Cloud_Infrastructure DevOps