This role pays more than
64%
of similar roles. Most pay
$149,500–$202,636
— the shaded band above.
At the midpoint, this role pays about
$177k
versus about
$176k
for comparable roles.
Based on 240 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
657 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 642 roles with salary data.
As a Senior Software Engineer- AI Frameworks on the Microsoft AI Frameworks team, you will develop software, performance systems, and engineering tools to enable state-of-the-art AI models to run reliably at cloud scale. You will own components across AI frameworks, runtimes, benchmarking systems, and performance tooling while building automation and observability to detect regressions and accelerate model onboarding. The role involves profiling and optimizing large language model training and inference workloads on NVIDIA, AMD, and Microsoft hardware. Key technical requirements include proficiency in C++ or Python, with preferred expertise in CUDA, Triton, and kernel optimization. You will also utilize tools like vLLM and SGLang to manage execution, scheduling, and batching. This role solves complex performance and reliability issues across the stack to improve model deployment efficiency and hardware utilization.
What does a Software Engineer earn in Remote?
Median $204475 from 374 postings across 53 companies.
Design, implement, and operate production-quality components for AI frameworks, runtimes, and benchmarking systems.
Benchmark, profile, debug, and optimize large language model training and inference workloads on GPUs and Microsoft hardware.
Build automation and observability tools to detect regressions and accelerate model and hardware onboarding.
Lead projects from initial problem definition through final deployment while ensuring maintainability and reliability.
Diagnose cross-stack issues by collaborating with researchers, infrastructure owners, and hardware vendors.
Contribute to technical design reviews, engineering standards, and the mentoring of other engineers.
What we're looking for
Bachelor's Degree in Computer Science or a related technical field.
4+ years of technical engineering experience coding in languages such as C++ or Python (or equivalent experience).
Ability to pass Microsoft Cloud background checks and other required security screenings.
Expertise in GPU or equivalent accelerator programming and kernel optimization using CUDA, Triton, or comparable technologies (preferred).
Experience using profiling and benchmarking to deliver measurable performance improvements with an understanding of memory hierarchy and hardware utilization (preferred).
Familiarity with vLLM, SGLang, or equivalent inference frameworks including model execution and scheduling (preferred).
Demonstrated technical ownership and cross-team collaboration to deliver complex engineering changes into production (preferred).
Ability to use AI-assisted development tools while maintaining sound engineering judgment for correctness and performance (preferred).