Software Engineer II

Microsoft

Confirmed live today High trust

Quick summary

Work type: On-site
Location: Redmond, WA
Salary: $102,100–$202,200 / yr
Posted: 3 days ago
Freshness: Confirmed live today
Closes: Apr 21, 2027
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $145k

This role $152k

$90k $214k

below market most similar roles pay here above market

This role pays more than 65% of similar roles. Most pay $121,750–$169,050 — the blue band above. At the midpoint, this role pays about $152k versus about $145k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 694 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 651 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Software Engineer II

Role Posting Log in to save

As a Software Engineer II, you will join the AIINFRA Software Engineering team to design, develop, and maintain critical AI infrastructure services. Your daily responsibilities involve building and enhancing distributed systems that support inference, pre-training, and post-training workloads for state-of-the-art AI models. You will collaborate with researchers and engineers to troubleshoot issues, optimize performance, and improve reliability across Azure and partner cloud environments. The role requires developing automation and tooling to improve GPU capacity utilization and streamline fleet operations. You will utilize a technical stack including Go, Rust, Python, C++, C#, and C# alongside containerization tools like Docker and Kubernetes. Key domain expertise includes production ML systems, large-scale training infrastructure, NCCL, and CUDA libraries to solve complex problems in high-reliability, low-latency distributed systems.

What does a Software Engineer earn in Washington?

Median $202800 from 409 postings across 38 companies.

See salary data

Skills

Go Rust Python C++ C# Kubernetes Azure Distributed Systems CI/CD Docker CUDA NCCL Java JavaScript ML Systems

What you'll do

Design, develop, and maintain AI infrastructure services using Go, Rust, Python, C++, and C#.
Deploy and manage services on large-scale Kubernetes clusters for AI inference and training workloads.
Build distributed systems that ensure high reliability, low latency, and operational efficiency across cloud environments.
Develop automation and tooling to improve GPU capacity utilization and streamline fleet operations.
Troubleshoot and optimize the performance of large-scale AI training and inference systems.
Contribute to the deployment, monitoring, and continuous improvement of engineering systems and practices.
Provide technical leadership and vision for the development of production ML systems.

What we're looking for

Bachelor's Degree in Computer Science or related technical field OR equivalent experience.
2+ years of technical engineering experience coding in languages including C, C++, C#, Java, JavaScript, or Python.
2+ years of experience designing, developing, and shipping high quality software.
2+ years of experience with distributed systems and cloud-based infrastructure.
1+ year of experience with DevOps practices including CI/CD, automated testing, and deployment.
2+ years of software development experience in C#, C++, Python, or similar languages.
2+ years of experience with containerization tools such as Docker and Kubernetes.
Knowledge and hands-on experience with production ML systems, large-scale training infrastructure, NCCL, and CUDA libraries.

Save