This role pays more than
74%
of similar roles. Most pay
$174,500–$210,817
— the shaded band above.
At the midpoint, this role pays about
$209k
versus about
$193k
for comparable roles.
Based on 240 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
657 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 642 roles with salary data.
Senior and/or Principal Software Engineer- LLM Serving Performance joins the Microsoft AI Frameworks team to develop software and systems for running state-of-the-art AI models at scale. The role involves optimizing GPU kernels, compilers, runtimes, and distributed inference systems to improve latency, throughput, reliability, and hardware efficiency across various model architectures and platforms including NVIDIA and AMD GPUs. Candidates will perform low-level optimizations, resolve critical performance bottlenecks, and turn innovations into reusable production capabilities. Required skills include proficiency in C++ or Python, with preferred expertise in GPU accelerator programming, kernel optimization, and inference libraries like vLLM or SGLang. The work focuses on the technical challenge of building a high-performance LLM serving stack by collaborating across model, compiler, infrastructure, and hardware teams to ensure efficient execution across different hardware generations and software layers.
What does a Software Engineer earn in Remote?
Median $204475 from 374 postings across 53 companies.
LLMs
RAG
PyTorch
TensorFlow
Hugging Face
Python
C++
Rust
Go
TypeScript
React
Angular
AWS
Azure
Google Cloud
CI/CD
ONNX Runtime
OpenVINO
TensorRT
WebRTC
gRPC
Windows Development
Computer Vision
Speech Synthesis
Embedded Systems