This role pays more than
69%
of similar roles. Most pay
$149,500–$188,277
— the shaded band above.
At the midpoint, this role pays about
$177k
versus about
$169k
for comparable roles.
Based on 240 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
598 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 586 roles with salary data.
As a Senior Software Engineer on the Azure AI Platform team, you will join an agile group building the Next Generation Traffic Shaping, Scheduling, and Optimization Platform. This critical control-plane service manages intelligent routing, capacity allocation, quota enforcement, and workload optimization for OpenAI models and large-scale AI workloads. You will design and develop distributed systems to balance demand across thousands of endpoints while optimizing premium AI accelerator utilization. Your daily work involves developing algorithms for real-time traffic shaping, building high-fidelity telemetry tools, and ensuring reliability for mission-critical services like Microsoft Copilot. The role requires proficiency in C#, Python, or Go, along with experience in distributed systems, cloud infrastructure, Kubernetes, and GPU fleet management. You will provide technical leadership to solve complex problems regarding how global AI traffic is served efficiently across the Azure infrastructure.
What does a Software Engineer earn?
Median $197500 from 2196 postings across 133 companies.
Design and implement scalable distributed systems for Azure AI traffic management and scheduling.
Develop algorithms for intelligent workload distribution across global infrastructure to meet latency and cost goals.
Manage capacity allocation, quota enforcement, and real-time traffic shaping for large-scale AI models.
Optimize GPU utilization and fleet efficiency to improve service performance for premium AI hardware.
Build high-fidelity telemetry and automated tools to monitor service health and traffic patterns.
Lead investigations into complex production issues to improve system reliability and incident mitigation.
Drive technical architecture decisions and influence the long-term roadmap for AI infrastructure.
Mentor engineers and conduct code reviews to maintain high engineering standards across the team.
What we're looking for
Bachelor's Degree in Computer Science or related technical field and 4+ years of experience coding in languages like C, C++, C#, Java, JavaScript, or Python.
Master's Degree in Computer Science and 6+ years of engineering experience, or a Bachelor's Degree and 8+ years of engineering experience.
At least 3 years of experience in software engineering, preferably in distributed systems or cloud infrastructure.
Strong coding skills in C#, Python, or Go.
Experience with telemetry, metrics pipelines, or resource scheduling systems.
Familiarity with cloud platforms (Azure, AWS, GCP) and container orchestration (Kubernetes, Service Fabric).
Experience operating large-scale services with high reliability requirements and experience with AI/ML infrastructure or GPU fleets.
Ability to pass the Microsoft Cloud background check.
Distributed Systems
Microsoft Azure
AWS
Python
C#
Java
C++
JavaScript
Cloud Computing
Service-Oriented Architecture
AI
Observability
Reliability Engineering
Telemetry