| Microsoft Careers

Microsoft

Quick summary

Work type
On-site
Location
Redmond, WA
Salary
$139,900–$274,800 / yr
Posted
55 days ago
Nearby
99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $181k
This role $207k
$101k most similar roles pay here $293k

This role pays more than 79% of similar roles. Most pay $155,000–$207,350 — the shaded band above. At the midpoint, this role pays about $207k versus about $181k for comparable roles.

Based on 238 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 1103 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 985 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · | Microsoft Careers

Apply Now Log in to save

As a Principal Software Engineering Manager within the HPC/AI organization, you will lead a team responsible for designing and developing Azure’s AI networking infrastructure, powering some of the world's largest distributed training systems. Your day-to-day involves hiring and managing software engineers to build high-performance, scalable, and observable networking systems that connect AI accelerators at massive scale. You’ll collaborate across Microsoft teams to define architecture, deliver solutions to complex infrastructure challenges, and ensure systems meet evolving needs in AI workloads. The role requires expertise in large-scale distributed systems, networking technologies such as InfiniBand and ROCE, and familiarity with AI-specific hardware like GPUs and TPUs. Additionally, you must have experience with telemetry tools for network monitoring at scale and a background in building fault-tolerant systems in distributed environments.

Skills

InfiniBand ROCE MRC NVLink Ethernet TCP/IP RDMA gRPC SDN GPUs TPUs Terraform Azure Kubernetes Docker CI/CD Prometheus Grafana Python C++

What you'll do

  • Lead the design and development of large-scale distributed AI networking systems.
  • Hire, manage, and grow a high-performing team of software engineers.
  • Ensure services are modular, secure, reliable, diagnosable, observable, and reusable.
  • Improve test coverage and automation to enhance system reliability.
  • Collaborate across teams to deliver cohesive end-to-end infrastructure solutions.

What we're looking for

  • 10+ years of professional experience designing and developing large-scale distributed systems.
  • Extensive hands-on experience with AI-specific networking technologies like InfiniBand, ROCE, NVLink.
  • Deep understanding of networking protocols including Ethernet, TCP/IP, RDMA, gRPC.
  • Experience building and operating networking infrastructure for hyperscale datacenters or AI clusters.
  • Familiarity with network virtualization, software-defined networking (SDN), and network performance tuning.

Related searches

More | Microsoft Careers jobs | Microsoft Careers jobs in Redmond All jobs at Microsoft

More like this

Similar roles

| Microsoft Careers

Microsoft

US 97 days ago $88,000–$150,100
Azure AI Sales methodologies CI/CD Power Platform Market intelligence tools Cloud Native Data Platform Analytics Kubernetes Python PostgreSQL AWS Grafana
Hybrid
Save

| Microsoft Careers

Microsoft

US 97 days ago $86,100–$169,800
Dynamics365 PowerPlatform CopilotStudio Azure CI/CD Python SQL JavaScript HTML CSS Git Terraform Kubernetes Docker MVC .NET-Core Swagger REST-APIs JSON XML
Save

| Microsoft Careers

Microsoft

US 101 days ago $85,100–$169,800
Microsoft M365 Defender Defender for Cloud Sentinel Kubernetes Azure AWS CI/CD PostgreSQL Python JavaScript React Docker Terraform Git Zero Trust MFA SOC 2 PCI DSS NIST
Hybrid
Save

| Microsoft Careers

Microsoft

US 57 days ago $102,100–$202,200
Intune Microsoft Azure Windows 11 iOS Android SCIM Terraform Docker CI/CD Kubernetes PostgreSQL Python Prometheus Grafana AI Agentic AI
Save

| Microsoft Careers

Microsoft

US 100 days ago
Microsoft Azure Microsoft Fabric Azure Databricks Cosmos DB Purview CI/CD Kubernetes Terraform Python SQL Power BI AI methodologies DevOps practices Cloud security best practices Change management proven practices
Save

| Microsoft Careers

Microsoft

US 55 days ago $119,800–$234,700
Kusto SQL OAuth OIDC SAML PKI MFA Python Azure CI/CD Linux Git Docker Prometheus Grafana PostgreSQL Jupyter Terraform Ansible
Save