This role pays more than
68%
of similar roles. Most pay
$122,661–$169,050
— the shaded band above.
At the midpoint, this role pays about
$152k
versus about
$146k
for comparable roles.
Based on 240 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
598 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 586 roles with salary data.
As a Software Engineer II, you will join the team to design, develop, and maintain critical AI infrastructure services supporting inference, pre-training, and post-training workloads for state-of-the-art models. You will build and enhance distributed systems across Azure and partner cloud environments to ensure high reliability, low latency, and operational efficiency. Your daily work involves developing automation and tooling to improve GPU capacity utilization and streamline fleet operations while troubleshooting issues with researchers and partners. The role requires proficiency in Go, Rust, Python, C++, and C#, alongside experience with Kubernetes, Docker, NCCL, and CUDA libraries. You will solve complex technical problems related to large-scale training infrastructure and production ML systems. This position demands expertise in CI/CD, automated testing, and managing high-performance distributed systems within a cloud-based environment to optimize the performance of massive AI workloads.
What does a Software Engineer earn in California?
Median $214000 from 775 postings across 63 companies.
Kubernetes
Go
Rust
C++
C#
Python
Terraform
Infrastructure as Code
Distributed Systems
Linux
Azure
InfiniBand
RoCE
RDMA
NVLink
NCCL
Bare-metal Provisioning
Container Runtimes