below marketmost similar roles pay hereabove market
This role pays less than
51%
of similar roles. Most pay
$167,887–$226,350
— the blue band above.
At the midpoint, this role pays about
$177k
versus about
$197k
for comparable roles.
Based on 240 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
694 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 651 roles with salary data.
The Senior and/or Principal Software Engineer - AI Infrastructure joins the AI Infra team to build foundational platforms and services for Generative AI. This role involves designing and developing high-scale distributed services to support large-scale state-of-the-art model training and inference, specifically for AzureML. You will build backend services, training frameworks, and machine learning systems while ensuring high stability, low latency, and cloud security. The technical stack includes C#, Go, Rust, C++, C, Java, JavaScript, and Python, with deployment on Kubernetes clusters and Docker containers. You will solve complex AI problems by developing core compute services for LLM models like GPT5 and OSS models. Key responsibilities include providing technical leadership, collaborating with data scientists, and maintaining 24x7x365 service availability for distributed platforms.
What does a Software Engineer earn?
Median $197400 from 2576 postings across 150 companies.
Design and develop core compute services powering AzureML for state-of-the-art LLM models.
Build and maintain core AI infrastructure services to support large-scale model training and inference.
Develop and test backend services using C#, Go, Rust, and C++ on Kubernetes and Docker.
Develop and operate training and inference infrastructure frameworks and machine learning systems.
Optimize systems for high stability, efficiency, low latency, and tight cloud security.
Provide operational support and DRI responsibilities for the product.
Provide technical leadership and vision to other team members.
What we're looking for
Bachelor's Degree in Computer Science or related technical field and 4+ years of technical engineering experience with coding in languages like C, C++, C#, Java, JavaScript, or Python.
Equivalent experience to the degree and years of experience requirement.
Master's Degree in Computer Science or related technical field and 8+ years of technical engineering experience with coding in languages like C, C++, C#, Java, JavaScript, or Python (preferred).
Bachelor's Degree in Computer Science or related technical field and 12+ years of technical engineering experience with coding in languages like C, C++, C#, Java, JavaScript, or Python (preferred).
Knowledge and first-hand experience with large model training systems (preferred).
3+ years of experience operating and designing systems that support large model training (preferred).
Experience in distributed systems and architecture (preferred).
AI infrastructure and workload knowledge (preferred).
Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
Distributed Systems
C
C++
C#
Java
JavaScript
Python
Container Orchestration
Data Infrastructure
Storage Systems
Streaming Platforms
Network Infrastructure
Model Inference
GPU Computing
Distributed Training
Observability
open-source
Telemetry