Senior Software Engineer, AI Infra Management and Ops

Microsoft

Confirmed live yesterday High trust
Remote

Quick summary

Work type
Remote
Location
Remote
Salary
$119,800–$234,700 / yr
Posted
6 days ago
Freshness
Confirmed live yesterday
Closes
Apr 19, 2027

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $176k
This role $177k
$106k $248k
below market most similar roles pay here above market

This role pays more than 62% of similar roles. Most pay $149,500–$202,561 — the blue band above. At the midpoint, this role pays about $177k versus about $176k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 694 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 651 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Senior Software Engineer, AI Infra Management and Ops

The Senior Software Engineer, AI Infra Management and Ops joins the team building foundational platform capabilities for large-scale distributed systems and accelerated computing environments. You will design and maintain cloud-native services and distributed systems to support service lifecycle management, resource orchestration, observability, and reliability. Your daily work involves guiding technical strategy for compute, networking, and storage while improving deployment automation and developer productivity. You will contribute to the operation of Artificial Intelligence infrastructure, High Performance Computing platforms, and GPU environments. Required skills include proficiency in C, C++, C#, Java, JavaScript, or Python. You will work with technologies such as Ethernet and InfiniBand fabrics, RDMA, SmartNICs, DPUs, and Infrastructure as Code to solve complex problems in large-scale datacenter architecture and high-performance networking.

What does a Software Engineer earn in Remote?

Median $208800 from 354 postings across 50 companies.

See salary data

What you'll do

  • Design, develop, and maintain cloud-native services and distributed systems for large-scale platform capabilities.
  • Define technical direction and architecture for infrastructure involving compute, networking, storage, and cloud services.
  • Develop platform engineering capabilities to improve deployment automation, observability, reliability, and developer productivity.
  • Implement software engineering practices including CI/CD, Infrastructure as Code, testing, security, and monitoring.
  • Design and operate AI infrastructure, HPC platforms, bare-metal systems, and GPU environments.
  • Collaborate on datacenter architecture, network topology design, and high-performance fabrics like InfiniBand and RDMA.
  • Lead architecture reviews and provide technical mentorship to foster engineering excellence across the organization.

What we're looking for

  • Bachelor's Degree in Computer Science or a related technical field.
  • 4+ years of technical engineering experience with coding in languages such as C, C++, C#, Java, JavaScript, or Python.
  • Ability to pass the Microsoft Cloud background check.
  • Proficiency in one or more modern programming languages such as Go, Rust, C#, Java, or Python (preferred).
  • Knowledge of large-scale distributed systems, cloud-native platforms, or infrastructure services (preferred).
  • Familiarity with AI infrastructure, HPC environments, accelerated computing platforms, or large-scale GPU deployments (preferred).
  • Knowledge of datacenter architecture, rack-scale infrastructure, and modern networking technologies (preferred).
  • Familiarity with InfiniBand, NVLink, NVSwitch, RDMA, SmartNICs, or DPUs (preferred).

More like this

Similar roles

Senior Software Engineer, AI Infrastructure Solutions

Nvidia

Santa Clara, CA 5 days ago $152,000–$241,500
Python C/C++ Large Language Models AI Agents Retrieval-Augmented Generation CUDA MLOps GPU Computing Data Pipelines APIs system-design Production Software Model Evaluation AI Observability Workflow Orchestration Silicon Bring-up
5+ yrs exp

Senior Software Engineer AI

Blackline

Pleasanton, CA +2 99 days ago
Python PySpark TensorFlow PyTorch scikit-learn Kubernetes Docker MLflow Kubeflow Airflow Vertex AI LangChain LangGraph AWS GCP Azure CI/CD Prometheus Grafana Newrelic Java Scala Bash Fivetran Plaid CDC IaC
Hybrid

Senior Software Engineer, Agentic AI Tools

F5 Inc

San Jose, CA +1 56 days ago
Python TypeScript Go LangChain LangGraph CrewAI LlamaIndex RAG MLflow Kubeflow BentoML OpenAI Anthropic Gemini NVIDIA BeautifulSoup Scrapy NGINX BIG-IP APIs Web Scraping MLOps Vector Databases Prompt Engineering
8+ yrs exp Hybrid

Senior AI Software Engineer

T. Rowe Price

Owings Mills, MD 28 days ago $121,000–$206,000
AI Engineering Agentic AI AWS Salesforce Python Java JavaScript Azure Containerized Microservices Prompt Engineering APIs Cloud-Native Architectures Automated Testing
5+ yrs exp Hybrid