Principal AI Systems Architect

Microsoft

Confirmed live today High trust
Hybrid

Quick summary

Work type
Hybrid
Location
—
Salary
$165,600–$296,400 / yr
Posted
today
Freshness
Confirmed live today
Closes
Mar 29, 2027

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $222k
This role $231k
$150k most similar roles pay here $312k

This role pays more than 55% of similar roles. Most pay $184,900–$259,000 — the shaded band above. At the midpoint, this role pays about $231k versus about $222k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 518 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 505 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Principal AI Systems Architect

The Principal AI Systems Architect joins the Systems Pathfinding and Architecture team within the Azure Hardware Systems and Infrastructure organization. In this role, you will own and define system architecture requirements for Microsoft AI accelerator systems. Your daily responsibilities include defining rack- and cluster-scale architecture across accelerator, host, network, memory, storage, power, cooling, and datacenter constraints while making quantitative trade-offs between performance and total cost of ownership. You will develop functional proof-of-concepts to de-risk new capabilities, write high-level product specifications, and use performance simulations and hardware models for what-if studies. Key technical domains include networking—specifically RoCE, Infiniband transports, congestion control, and network topology design—alongside reliability, serviceability, and power management. You will also participate in industry consortiums to shape standards and influence vendor roadmaps while managing complex requirements for large-scale AI datacenter systems.

What you'll do

  • Define AI rack- and cluster-scale architecture across accelerator, host, network, memory, storage, power, cooling, and datacenter constraints.
  • Make quantitative trade-offs between performance and total cost of ownership (TCO).
  • Develop functional proof-of-concepts to evaluate and de-risk new capabilities.
  • Write and own high-level product requirements and specifications for AI systems.
  • Use performance simulations and hardware models to conduct what-if studies and select architecture options.
  • Participate in industry consortiums to shape standards and influence vendor roadmaps.

What we're looking for

  • Master's degree in Engineering and 9+ years of experience, or Bachelor's degree and 11+ years of experience.
  • Ability to pass Microsoft Cloud Background Check and other required security screenings.
  • Experience in large scale AI datacenter systems and their network (preferred).
  • Expertise in networking, reliability, serviceability, or datacenter architecture for large scale AI systems (preferred).
  • Experience owning hardware system architecture at scale and authoring specifications (preferred).
  • Ability to make decision trade-offs across multiple domains (preferred).
  • Deep expertise in AI systems or specific domains like power management or networking (preferred).
  • Skilled in partnering with and influencing architects, engineers, and software leads (preferred).

More like this

Similar roles

Principal AI Network Architect

Microsoft

8 days ago $142,800–$274,800
AI Infrastructure Ethernet RDMA RoCE SONiC Switch ASICs Optical Networking SerDes Firmware Distributed Systems GPU System Architecture Control Plane Hardware Engineering
8+ yrs exp Hybrid

Principal AI Architect

LPL Financial

Fort Mill, NC +3 48 days ago $155,942–$259,869
Generative AI Agentic AI RAG LLMOps MLOps Python AWS Kubernetes EKS Bedrock DynamoDB Vector Databases Infrastructure-as-Code Microservices API Gateway DevSecOps
10+ yrs exp

Principal AI Architect

CVS Health

Remote (CO) 28 days ago $144,200–$288,400
AI AWS GCP Azure Multi-model Orchestration Agentic Systems API MCP infrastructure-as-code FinOps Responsible AI Model Evaluation PHI
10+ yrs exp Remote

Principal Solutions Architect, AI

Motorola Solutions

Allen, TX 94 days ago $148,800–$175,600
AI MLOps Python Java C++ TensorFlow PyTorch AWS Azure GCP Natural Language Processing Agentic AI Prompt Engineering Cloud-native Architecture Android iOS Windows
10+ yrs exp

Principal Computer Systems Architect

Northrop Grumman

San Diego, CA 50 days ago $114,000–$171,000
Linux Red Hat Splunk STIGs DNS BIND Bash Shell Ansible Python Docker OpenShift Kubernetes VMware KVM Hyper-V RH-V iSCSI DevSecOps Agile Model-based Engineering
5+ yrs exp

Principal AI Security Architect

Micron Technology

Boise, ID 8 days ago
AI Security LLMs RAG Frameworks Threat Modeling Incident Response Prompt Injection Testing Security Architecture Risk Management Model Risk Management Adversarial Attack Simulation
5+ yrs exp