Principal Software Engineering Manager

Microsoft

Quick summary

Work type: On-site
Location: —
Salary: $139,900–$274,800 / yr
Posted: 71 days ago

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $199k

This role $207k

$124k most similar roles pay here $291k

This role pays more than 51% of similar roles. Most pay $174,200–$223,700 — the shaded band above. At the midpoint, this role pays about $207k versus about $199k for comparable roles.

Based on 239 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 622 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 559 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Principal Software Engineering Manager

Role Posting Log in to save

As a Principal Software Engineering Manager within the HPC/AI organization at Microsoft, you will lead a team responsible for developing foundational components of Azure’s AI networking infrastructure. Your day-to-day responsibilities include hiring and managing software engineers to design and deploy high-performance, scalable systems that connect AI accelerators at massive scale. You will collaborate with cross-functional teams to define architecture and deliver solutions to complex infrastructure challenges, ensuring the reliability and performance of Microsoft’s AI platforms. The role requires expertise in networking technologies such as InfiniBand, ROCE, NVLink, and familiarity with AI-specific hardware like GPUs and TPUs. Additionally, you must have experience with telemetry and observability tools for network monitoring at scale, and a background in building fault-tolerant systems in large distributed environments. This role offers the unique opportunity to work on cutting-edge AI infrastructure that drives innovation across cloud computing and high-performance networking.

Skills

Azure Kubernetes Docker CI/CD Python C++ Go Rust InfiniBand ROCE MRC NVLink Ethernet TCP/IP RDMA gRPC SDN GPU TPU Prometheus Grafana Ansible Terraform

What you'll do

Lead the design and development of large-scale distributed AI networking systems.
Hire, manage, and grow a high-performing team of software engineers.
Ensure services are modular, secure, reliable, diagnosable, observable, and reusable.
Improve test coverage and automation to resolve reliability gaps proactively.
Collaborate across Microsoft teams to deliver cohesive infrastructure solutions.

What we're looking for

10+ years of professional experience designing and developing large-scale distributed systems.
Deep expertise in networking technologies for AI-specific hardware like InfiniBand, ROCE, NVLink.
Strong understanding of networking protocols including Ethernet, TCP/IP, RDMA, gRPC.
Experience with network virtualization, software-defined networking (SDN), and performance tuning.
Familiarity with AI accelerators such as GPUs and TPUs and their interaction with networking infrastructure.
Hands-on experience building and operating networking infrastructure for hyperscale datacenters or AI clusters.

Save