below marketmost similar roles pay hereabove market
This role pays more than
60%
of similar roles. Most pay
$174,600–$231,000
— the blue band above.
At the midpoint, this role pays about
$209k
versus about
$203k
for comparable roles.
Based on 240 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
694 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 651 roles with salary data.
The Principal Software Engineering, AI Infrastructure role sits within the FIT Infrastructure team, where you will build foundational accelerated compute platforms for large-scale AI training and inference. You will design and develop GPU accelerated infrastructure across bare metal, virtual machines, and containerized environments, focusing on workload management, scheduling, preemption, and failover. Your daily work involves building and operating orchestration and resource governance scenarios using AKS and the Kubernetes ecosystem to ensure fair sharing and isolation. You will design, develop, test, and maintain services using C# and Golang. The role requires expertise in distributed systems, multi-tenant AI platforms, and GPU accelerated computing, including CUDA and NCCL style collectives. You will solve complex problems regarding performance, reliability, and utilization across large GPU fleets for frontier AI model serving.
What does a Software Engineering earn?
Median $178325 from 38 postings across 15 companies.
Develop systems for AI workload management, scheduling, preemption, and failover.
Build GPU accelerated infrastructure for training and inference across bare metal, VMs, and containers.
Operate orchestration and resource governance using AKS and Kubernetes for fair sharing and isolation.
Design, develop, test, and maintain services written in C# and Golang on Kubernetes clusters.
Optimize performance, reliability, and utilization across large-scale GPU fleets.
Drive end-to-end platform features including observability, diagnostics, and operational excellence.
Influence platform architecture and technical direction through design reviews and leadership.
What we're looking for
Bachelor's Degree in Computer Science or related technical field and 6+ years of technical engineering experience with coding in languages like C, C++, C#, Java, JavaScript, Linux, Go, or Python.
Ability to pass the Microsoft Cloud Background Check.
Master's Degree in Computer Science or related technical field and 8+ years of technical engineering experience (preferred).
Bachelor's Degree in Computer Science or related technical field and 12+ years of technical engineering experience (preferred).
Proven ability to design and operate large scale, production infrastructure with high reliability and performance requirements (preferred).
Demonstrated technical leadership, including mentoring engineers and driving cross team architectural alignment (preferred).
Hands-on experience with resource scheduling, preemption, priority handling on large clusters (preferred).
Experience with large-scale online Inferencing services or building multitenant AI platforms in cloud environments (preferred).
Kubernetes
Go
Python
Linux
AWS
EKS
Terraform
Argo CD
Helm
Prometheus
Grafana
PyTorch
Ray
vLLM
SGLang
TensorRT-LLM
CUDA
NVLink
NVSwitch
NCCL
EFA
DCGM
Containers
HPC