| Microsoft Careers

Microsoft

Quick summary

Work type
On-site
Location
Salary
$142,800–$274,800 / yr
Posted
80 days ago
Closes
Sep 13, 2026

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $200k
This role $209k
$127k most similar roles pay here $291k

This role pays more than 56% of similar roles. Most pay $177,250–$222,000 — the shaded band above. At the midpoint, this role pays about $209k versus about $200k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 310 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 285 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · | Microsoft Careers

As a Principal Engineer on the CoreAI GPU Infrastructure team, you will design and build foundational accelerated compute platforms for large-scale AI training and inference across Azure. Your daily tasks include developing systems for GPU device management, scheduling, isolation, and sharing, as well as building advanced orchestration capabilities using Kubernetes and related ecosystems to ensure efficient resource utilization. You will also optimize performance and reliability across extensive GPU fleets and collaborate with networking teams to enable high-performance interconnects. This role requires expertise in C++, Java, Python, and other languages, along with experience in virtualization and container platforms like Kubernetes. Ideal candidates have a background in large-scale infrastructure design and operation, strong problem-solving skills, and the ability to mentor engineers while driving technical direction across teams. The position offers significant impact on cloud GPU platform development and collaboration with experts from various domains.

What you'll do

  • Design and build GPU-accelerated infrastructure for diverse environments.
  • Develop systems for efficient GPU device management and multitenant usage.
  • Build advanced orchestration scenarios using Kubernetes ecosystem capabilities.
  • Optimize performance and utilization across large-scale GPU fleets.
  • Partner with networking teams to enable high-performance interconnects.
  • Drive end-to-end platform features from design through production deployment.
  • Influence platform architecture and technical direction through leadership.

What we're looking for

  • Bachelor's Degree in Computer Science or related field with 6+ years of technical engineering experience.
  • Proven ability to design and operate large-scale production infrastructure with high reliability and performance.
  • Strong problem-solving skills for debugging complex cross-layer systems issues.
  • Hands-on experience with virtualization and container platforms like VMs, Kubernetes, and container runtimes.
  • Demonstrated technical leadership in mentoring engineers and driving architectural alignment across teams.
  • Experience in building or operating multitenant AI platforms in cloud environments.

More like this

Similar roles

Principal Software Engineer, CoreAI | Microsoft Careers

Microsoft

US 84 days ago $139,900$274,800
Python C++ Java JavaScript Azure CI/CD Kubernetes Docker Terraform Prometheus Grafana LLMs SLMs Multimodal_Models Code_Specific_Models Scalability Reliability Security Privacy Cloud_Infrastructure DevOps

Principal Software Engineer - CoreAI | Microsoft Careers

Microsoft

Redmond, WA 3 days ago $142,800$274,800
Azure Python SQL Kubernetes Docker CI/CD Terraform PostgreSQL Snowflake Apache Spark Data Governance Machine Learning AI Tools Self-service Analytics Cross-functional Collaboration Cloud Services Data Lineage Security Best Practices