below marketmost similar roles pay hereabove market
This role pays more than
60%
of similar roles. Most pay
$149,500–$213,875
— the blue band above.
At the midpoint, this role pays about
$177k
versus about
$182k
for comparable roles.
Based on 240 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
694 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 651 roles with salary data.
Senior Software Engineer, AI Infrastructure joins the team responsible for the platform that routes and prioritizes AI traffic across global infrastructure. In this role, you will design, build, and run services that match AI requests to available computing capacity, ensuring services like Azure OpenAI remain fast and reliable. Day-to-day responsibilities include writing secure code, creating design proposals, managing production reliability through on-call rotations, and collaborating with partner teams to translate user requirements into technical milestones. You will utilize C#, Java, or Go, along with Python, Docker, and Kubernetes. The work focuses on the technical challenge of managing GPU fleets and serving large-scale AI models in production. You must demonstrate experience building distributed systems and managing traffic routing or computing resource allocation.
What does a Software Engineer earn?
Median $197400 from 2576 postings across 150 companies.
Design and own key platform components for routing AI traffic and managing computing capacity.
Write clear, secure, and well-tested code while providing timely code reviews for the team.
Break down work into dependable milestones and use feature flags for safe, gradual rollouts.
Participate in the on-call rotation as a designated responsible individual to maintain service health.
Develop monitoring dashboards and troubleshooting guides to reduce the frequency of production incidents.
Translate customer needs from product managers into clear technical requirements.
Integrate security, privacy, and compliance into every stage of the software development lifecycle.
Utilize AI tools to write code, generate tests, and investigate live production issues.
What we're looking for
Bachelor's Degree in Computer Science or related technical field and 4+ years of technical engineering experience building distributed systems with C#, Java, or Go.
Equivalent experience to the required degree and years of experience.
Ability to pass the Microsoft Cloud Background Check.
Master's Degree in Computer Science or related technical field and 6+ years of technical engineering experience building distributed systems with C#, Java, or Go (preferred).
Bachelor's Degree in Computer Science or related technical field and 8+ years of technical engineering experience building distributed systems with C#, Java, or Go (preferred).
3+ years of experience running distributed services on public cloud platforms such as Microsoft Azure, AWS, or GCP (preferred).
2+ years of experience with systems that route or schedule traffic, or that allocate computing resources (preferred).
Experience with Python, Docker, Kubernetes, AI/ML infrastructure, and delivering projects with partner teams (preferred).
Python
C/C++
Large Language Models
AI Agents
Retrieval-Augmented Generation
CUDA
MLOps
GPU Computing
Data Pipelines
APIs
system-design
Production Software
Model Evaluation
AI Observability
Workflow Orchestration
Silicon Bring-up