This role pays more than
79%
of similar roles. Most pay
$179,075–$223,700
— the shaded band above.
At the midpoint, this role pays about
$231k
versus about
$201k
for comparable roles.
Based on 239 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
622 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 571 roles with salary data.
As an AI Infrastructure Software Engineering IC5, you will lead the technical strategy for AI performance tooling and validation across various layers of the software stack, including models, compilers, runtimes, libraries, and APIs. Your day-to-day responsibilities include conducting deep performance investigations to optimize production-scale training and inference, establishing quality standards, and mentoring engineers to raise the technical bar. You will work with C++, Python, PyTorch, TensorFlow, CUDA, ROCm, and Triton, among other technologies, to build high-performance distributed systems for AI workloads. This role requires a deep understanding of DNN/LLM inference or training performance, software engineering, distributed systems, GPU architecture, and hardware/software co-design. You will influence technical strategy across organizations, lead multi-team initiatives, and drive alignment with senior stakeholders to ensure measurable impact on performance, reliability, cost efficiency, and developer productivity in the AI domain.
C++
C#
Windows Subsystem for Linux
AI/ML
CI/CD
Python
Docker
Kubernetes
AWS
GitHub
Visual Studio
PostgreSQL
Redis
Git
Jenkins
Terraform
Ansible
Prometheus
Grafana