| Microsoft Careers

Microsoft

Quick summary

Work type
On-site
Location
Redmond, WA
Salary
$165,600–$296,400 / yr
Posted
30 days ago
Nearby
99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $181k
This role $231k
$99k most similar roles pay here $318k

This role pays more than 99% of similar roles. Most pay $155,000–$207,350 — the shaded band above. At the midpoint, this role pays about $231k versus about $181k for comparable roles.

Based on 238 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 1103 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 985 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · | Microsoft Careers

Apply Now Log in to save

As a Principal Researcher on Microsoft’s applied research team focused on efficiency in AI systems, you will work across the full stack from large-scale serving systems to hardware-level optimizations. Your day-to-day responsibilities include formulating and evaluating new algorithmic approaches for end-to-end AI serving, designing endpoint configurations with batching and routing strategies, and conducting hardware-aware optimization through close collaboration with model and kernel teams. You will build experimental prototypes, validate research ideas, and drive them toward production readiness while publishing results in academic conferences and filing patents. The role requires expertise in machine learning frameworks like PyTorch and TensorFlow, GPU programming using CUDA or ROCm, and proficiency in C++ and Python for high-performance systems. Ideal candidates have a doctorate and at least 8 years of relevant research experience, with demonstrated success in designing efficient inference systems under strict SLO constraints.

Skills

Python PyTorch TensorFlow vLLM NVIDIA_Triton_Inference_Server ONNX_Runtime DeepSpeed MII CUDA C++ GPU_Programming Research_Publications Patents Algorithmic_Optimization Parallel_Computing SLO_Constraints Attention_Mechanisms KV_Cache_Optimizations Batching_and_Scheduling_Strategies Cost_Aware_Deployment

What you'll do

  • Develop and evaluate new algorithmic approaches for AI serving systems.
  • Design and experimentally validate endpoint configuration and execution policies.
  • Conduct hardware-aware optimization by collaborating with model and kernel teams.
  • Build experimental prototypes to validate research ideas and drive production readiness.
  • Publish research results, file patents, and contribute to open-source frameworks.
  • Identify high-impact problems and drive research through prototyping and validation.

What we're looking for

  • Doctorate in relevant field with 8+ years of related research experience or equivalent.
  • Expertise in designing and optimizing efficient inference systems under strict SLO constraints.
  • Proficient in machine learning frameworks (e.g., PyTorch, TensorFlow) and inference serving frameworks.
  • Extensive GPU programming and optimization skills using CUDA, ROCm, Triton, PTX, CUTLASS, etc.
  • Strong research impact through publications and patents with hands-on experience in production delivery.

Related searches

More | Microsoft Careers jobs | Microsoft Careers jobs in Redmond All jobs at Microsoft

More like this

Similar roles

| Microsoft Careers

Microsoft

US 97 days ago $88,000–$150,100
Azure AI Sales methodologies CI/CD Power Platform Market intelligence tools Cloud Native Data Platform Analytics Kubernetes Python PostgreSQL AWS Grafana
Hybrid
Save

| Microsoft Careers

Microsoft

Redmond, WA +2 58 days ago $142,800–$274,800
Azure Kubernetes Docker CI/CD Python PostgreSQL Terraform Prometheus Grafana Git Jira Swagger RESTful APIs JSON YAML DevOps Scrum Agile
Hybrid
Save

| Microsoft Careers

Microsoft

US 57 days ago $102,100–$202,200
Intune Microsoft Azure Windows 11 iOS Android SCIM Terraform Docker CI/CD Kubernetes PostgreSQL Python Prometheus Grafana AI Agentic AI
Save

| Microsoft Careers

Microsoft

WA 76 days ago $119,800–$234,700
Python TypeScript Golang Java C# Scala Rust React Next.js AI/ML systems C#/Java Model pretraining Post training Evaluation Inference CI/CD
Save

| Microsoft Careers

Microsoft

Redmond, WA 51 days ago
Python TensorFlow PyTorch DeepLearning ComputerVision SelfSupervisedLearning MixtureOfExperts DenseVisionProblems CVPR NeurIPS ICML ICCV ECCV AAAI IJCAI 3DV IEEETransactions ACMTransactions IJCV
Save

| Microsoft Careers

Microsoft

US 28 days ago $130,900–$251,900
AI Cloud Security CI/CD Data Protection Model Protection Runtime Monitoring Agent Security Market Trends Competitive Intelligence Vendor Analysis Technical Communication Cybersecurity AI Governance Risk Management Product Marketing Strategic Market Analysis
Save