Software Engineer II, AI Infrastructure

Microsoft

Confirmed live yesterday High trust
Hybrid

Quick summary

Work type
Hybrid
Location
—
Salary
$102,100–$202,200 / yr
Posted
7 days ago
Freshness
Confirmed live yesterday
Closes
Mar 23, 2027

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $183k
This role $152k
$88k most similar roles pay here $237k

This role pays less than 62% of similar roles. Most pay $144,350–$222,250 — the shaded band above. At the midpoint, this role pays about $152k versus about $183k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 518 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 505 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Software Engineer II, AI Infrastructure

As a Software Engineer II - AI Infrastructure, you will join the AI Infra team to build and operate large-scale distributed systems that power mission-critical cloud services, including OpenAI and OSS model hosting, large-scale inferencing, and Microsoft Copilot backends. You will design, develop, test, and deploy platform services focused on resource management, workload orchestration, and capacity management to ensure reliability and performance across distributed environments. Your daily work involves developing control plane services using C# hosted on Kubernetes (AKS) clusters while managing concurrency and stateful resources. The role requires proficiency in Object Oriented Programming and experience with public cloud services at the IaaS level. You will solve complex problems regarding system efficiency, policy-driven decision making, and workload placement to support high-performance infrastructure for demanding AI workloads and large capacity fleets.

What does a Software Engineer earn?

Median $195000 from 1914 postings across 140 companies.

See salary data

What you'll do

  • Design, develop, test, and operate large-scale distributed systems and platform services for high-performance cloud workloads.
  • Build infrastructure capabilities and resource management services to optimize system efficiency and availability.
  • Develop features for capacity management, workload placement, and policy-driven decision making across distributed environments.
  • Develop and maintain control plane services written in C# hosted on Kubernetes clusters.
  • Analyze complex production issues to identify root causes and implement sustainable solutions for service health.
  • Provide operational support and participate in on-call rotations as a designated point of contact.
  • Participate in technical design reviews and lead code quality initiatives to improve engineering best practices.

What we're looking for

  • Bachelor's Degree in Computer Science or related technical field and 2+ years of experience coding in languages like C, C++, C#, Java, JavaScript, or Python.
  • Master's Degree in Computer Science or related field and 3+ years of engineering experience (preferred).
  • Bachelor's Degree in Computer Science or related field and 5+ years of engineering experience (preferred).
  • Proficiency in Object Oriented Programming and familiarity with common code design patterns (preferred).
  • 2+ years of experience with service development in a distributed environment, in a dev-ops role, including concurrency and stateful resource management.
  • Hands-on experience with public cloud services at the IaaS level.

More like this

Similar roles

Software Engineer II

Microsoft

Redmond, WA 27 days ago $102,100–$202,200
Python C++ C# Java JavaScript C Artificial Intelligence Distributed Systems Information Retrieval Data Mining Data Analysis
2+ yrs exp Hybrid

Software Engineer II

Microsoft

Redmond, WA 69 days ago $102,100–$202,200
Azure AKS Cosmos DB Azure SQL Python C# Java JavaScript C++ C Kubernetes CI/CD Semantic Kernel LangChain Azure OpenAI REST APIs Microservices Distributed Systems RAG Infrastructure-as-Code
2+ yrs exp

Software Engineer II

Microsoft

20 days ago $102,100–$202,200
Azure Python C# C++ Java JavaScript Docker Kubernetes CI/CD Cloud Infrastructure Distributed Systems GitHub Copilot Telemetry Monitoring Automation
2+ yrs exp Hybrid

Software Engineer, AI Infrastructure

Apple Inc

Cupertino, CA 76 days ago $184,700–$324,800
Python Go LLMs Distributed Systems Cloud Services Security Architecture AI Infrastructure Observability Load Shaping Cost Controls Backend Programming
5+ yrs exp

AI Infrastructure Software Engineer

Qualcomm

San Diego, CA 15 days ago $99,500–$149,300
C C++ Python Java Embedded Systems RTOS Linux Android Windows DSP IPC Memory Management Concurrency Machine Learning Computer Vision System Optimization

Software Engineer II, AI Insights

The Walt Disney Company

New York, NY 14 days ago $123,000–$165,000
AI Machine Learning FastAPI Flask AWS EKS Docker LangChain LangGraph PyTorch TensorFlow Databricks Snowflake PySpark Pandas Grafana Datadog Microservices
3+ yrs exp