This role pays more than
59%
of similar roles. Most pay
$155,800–$209,625
— the shaded band above.
At the midpoint, this role pays about
$177k
versus about
$183k
for comparable roles.
Based on 240 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
686 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 666 roles with salary data.
Senior & Principal Software Engineer - Systems & Infrastructure joins the AI Infrastructure Engineering Systems team to build cloud platforms, engineering infrastructure, and developer systems for large-scale AI services. You will own technical strategy and solution architecture for complex requirements, designing and optimizing distributed systems across data, storage, streaming, traffic, and network infrastructure. Day-to-day responsibilities include improving system observability, creating test strategies, diagnosing production issues, and influencing open-source projects to enhance engineering effectiveness. The role requires proficiency in languages such as C, C++, C#, Java, JavaScript, or Python. You will solve critical challenges regarding the performance, reliability, and scalability of AI workloads, including model inference. By navigating ambiguous problem spaces, you will translate loosely defined requirements into robust architectures that support the development and operation of high-scale AI services within a collaborative environment.
What does a Software Engineer earn?
Median $196750 from 2011 postings across 148 companies.
Own technical strategy and architecture for complex infrastructure requirements including data, storage, and networking.
Design and optimize large-scale distributed systems for performance, scalability, security, and cost efficiency.
Improve system observability through metrics, logging, and telemetry to enhance developer productivity.
Develop test strategies and implement automated solutions for production deployment and routine operations.
Diagnose production issues and conduct incident retrospectives to implement preventive actions.
Influence open-source projects and build reusable tools to improve engineering effectiveness.
Manage complex infrastructure initiatives from initial problem discovery through implementation and production.
Optimize the performance and reliability of large-scale AI workloads and model inference.
What we're looking for
Bachelor's degree in Computer Science or related field and 4+ years of technical engineering experience in languages like C, C++, C#, Java, JavaScript, or Python.
Master's degree in Computer Science or related field and 6+ years of technical engineering experience (preferred).
Bachelor's degree in Computer Science or related field and 8+ years of technical engineering experience (preferred).
Ability to pass Microsoft background and Microsoft Cloud background checks.
Experience architecting, building, and operating large-scale distributed systems (preferred).
Experience with backend services, databases, data infrastructure, storage systems, streaming platforms, or network infrastructure (preferred).
Experience with cloud platforms, container orchestration, or distributed data-processing technologies (preferred).
Familiarity with AI/ML infrastructure concepts such as model inference, GPU computing, model serving, or distributed training (preferred).
Python
C++
C#
Java
JavaScript
Rust
Distributed Systems
AI/ML Infrastructure
Model Inference
GPU Computing
Data Pipelines
Query Execution
Indexing
Concurrency
Data Structures
open-source
Telemetry
Python
C++
C#
Java
JavaScript
C
Distributed Systems
Cloud Services
CI/CD
Large Language Models
Data Pipelines
Static Analysis
Semantic Search
Retrieval Systems
Telemetry
Automated Testing
source-control
Code Indexing
LLM
Python
C++
C#
Java
JavaScript
Distributed Systems
Cloud-Native Architecture
Microservices
Retrieval
Prompt Orchestration
Data Modeling
System Design
Observability
Responsible AI