Principal Software Engineer, AI Infra Management and Ops

Microsoft

Confirmed live yesterday High trust
Remote

Quick summary

Work type
Remote
Location
Remote
Salary
$142,800–$274,800 / yr
Posted
3 days ago
Freshness
Confirmed live yesterday
Closes
Mar 15, 2027

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $204k
This role $209k
$127k most similar roles pay here $291k

This role pays more than 60% of similar roles. Most pay $177,587–$231,000 — the shaded band above. At the midpoint, this role pays about $209k versus about $204k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 633 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 621 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Principal Software Engineer, AI Infra Management and Ops

As a Principal Software Engineer, AI Infra Management and Ops, you will join a team building foundational platform capabilities for large-scale distributed systems and accelerated computing environments. You will lead the design and evolution of cloud-native platforms, infrastructure services, and resource orchestration while advancing practices like CI/CD, Infrastructure as Code, and automated service lifecycle management. Your daily work involves collaborating across engineering teams to shape technical strategy for compute, networking, storage, and observability. The role focuses on solving complex problems in Artificial Intelligence infrastructure, High Performance Computing, and GPU platforms. You will work with technologies including C, C++, C#, Java, Python, Go, and Rust, while engaging with hardware components like InfiniBand fabrics, RDMA, SmartNICs, DPUs, and bare-metal systems to ensure reliable, scalable performance for business-critical workloads across large-scale datacenter environments.

What does a Software Engineer earn in Remote?

Median $203391 from 376 postings across 52 companies.

See salary data

What you'll do

  • Design and evolve cloud-native services and distributed systems for large-scale production environments.
  • Define technical direction and architecture for infrastructure components including networking, storage, and compute.
  • Develop platform capabilities to improve deployment automation, observability, reliability, and developer productivity.
  • Advance software engineering practices such as CI/CD, Infrastructure as Code, and security monitoring.
  • Design and operate AI infrastructure, GPU environments, and high-performance computing platforms.
  • Architect datacenter networking solutions including Ethernet fabrics, InfiniBand, RDMA, and SmartNICs.
  • Lead technical mentorship and design reviews to foster engineering excellence across the organization.

What we're looking for

  • Bachelor's Degree in Computer Science or related technical field.
  • 6+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python.
  • Ability to pass Microsoft Cloud background checks and meet government security screening requirements.
  • Experience delivering solutions across multiple teams and influencing technical direction through leadership and mentoring (preferred).
  • Knowledge of large-scale distributed systems, cloud-native platforms, or infrastructure services (preferred).
  • Familiarity with AI infrastructure, HPC environments, accelerated computing, or GPU deployments (preferred).
  • Knowledge of datacenter architecture, rack-scale infrastructure, and modern networking technologies like RDMA, SmartNICs, or DPUs (preferred).
  • Proficiency in Go, Rust, C#, Java, or Python (preferred).

More like this

Similar roles

Principal Software Engineer, AI Frameworks

Microsoft

15 days ago $165,600$296,400
C++ Python AI Frameworks Compiler Runtime Azure AMD GPUs Performance Engineering Benchmarking Observability Architecture Automation
8+ yrs exp

Principal Software Engineer, AI Engineer

JPMorgan Chase

Jersey City, NJ 86 days ago
Python PyTorch TensorFlow LLM MLOps CI/CD AWS Azure Microservices Prompt Engineering Agentic AI Machine Learning Software Engineering Data Pipelines Model Governance
7+ yrs exp

Principal AI Software Engineer

Amd

San Jose, CA 149 days ago $240,000$360,000
ROCm CUDA OpenCL GPU Architecture CPU Architecture Diffusion MoE Compiler Operating Systems Performance Engineering Hardware/Software Co-design AI/ML Frameworks Open Source

Principal Software Engineer, Core AI Platform

JPMorgan Chase

Seattle, WA 18 days ago
Python AI Infrastructure Machine Learning Cloud Platforms Distributed Systems SRE Observability System Design SDKs Automated Testing Infrastructure Engineering Generative AI
10+ yrs exp