below marketmost similar roles pay hereabove market
This role pays more than
68%
of similar roles. Most pay
$169,550–$220,800
— the blue band above.
At the midpoint, this role pays about
$209k
versus about
$195k
for comparable roles.
Based on 240 similar postings.
Employer
About Microsoft
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has
694 open roles
on FindRole.
Listed pay typically runs
$119,800–$234,700
across 651 roles with salary data.
The Principal Software Engineer joins the team responsible for delivering efficient Graphics Processing Unit techniques for online advertising platforms. This role focuses on leveraging large language models and deep learning to improve advertising efficiency and monetization. You will design and build robust, reusable frameworks for complex inferencing capabilities while optimizing for cost and performance under tight latency and throughput constraints. Daily tasks include developing internal tools for experiment tracking, model versioning, and performance monitoring. You will utilize C, C++, C#, Java, JavaScript, or Python alongside deep learning frameworks like PyTorch, OnnxRuntime, Tensorflow, vLLM, and TensorRT-LLM. The work involves low-level GPU architecture, kernel programming, model quantization, and high-performance application development using Docker and Kubernetes to solve technical problems in the AI infrastructure space.
What does a Software Engineer earn?
Median $197400 from 2576 postings across 150 companies.
Design and implement complex inferencing capabilities for state-of-the-art deep learning models.
Build robust, extensible, and reusable frameworks for both experimentation and production use-cases.
Optimize inference performance for cost and speed using cutting-edge hardware and software stacks.
Develop internal tools for the AI lifecycle, including experiment tracking and model versioning.
Implement performance monitoring and model versioning systems.
Translate technical ideas into production-ready solutions for GPU-based LLM use cases.
Adapt algorithms for retrieval, selection, ranking, and classification for execution on GPUs.
What we're looking for
Bachelor's Degree in Computer Science or related technical field and 6+ years of technical engineering experience with coding in languages like C, C++, C#, Java, JavaScript, or Python.
Ability to pass the Microsoft Cloud background check upon hire and every two years thereafter.
Master's Degree in Computer Science or related technical field and 8+ years of technical engineering experience with coding in languages like C, C++, C#, Java, JavaScript, or Python (preferred).
Bachelor's Degree in Computer Science or related technical field and 12+ years of technical engineering experience with coding in languages like C, C++, C#, Java, JavaScript, or Python (preferred).
2+ years of experience working with deep learning frameworks such as PyTorch, OnnxRuntime, Tensorflow, vLLM, or TensorRT-LLM (preferred).
Experience in end-to-end system design and development with some familiarity with MLOps (preferred).
Experience with low-level GPU architecture, optimizations, kernel programming, and model quantization (preferred).
Knowledge and experience with Docker, Kubernetes, high-performance application development, and technical leadership skills (preferred).
Distributed Systems
Vector Index
C++
Python
Java
C#
JavaScript
Search Engine
Approximate-nearest-neighbor search
LLM
Big Data
System Architecture
Performance Optimization
Data Access Patterns
Software Development Lifecycle