Principal AI System Architect

Microsoft

Confirmed live today High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Salary
$142,800–$274,800 / yr
Posted
1 day ago
Freshness
Confirmed live today
Closes
Mar 13, 2027

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $211k
This role $209k
$127k most similar roles pay here $291k

This role pays more than 51% of similar roles. Most pay $172,350–$248,700 — the shaded band above. At the midpoint, this role pays about $209k versus about $211k for comparable roles.

Based on 239 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 599 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 590 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Principal AI System Architect

The Principal AI System Architect joins the Systems Pathfinding and Architecture team within the Azure Hardware Systems and Infrastructure organization. In this role, you will own and define system architecture requirements for Microsoft AI accelerator systems. Your daily responsibilities include defining rack- and cluster-scale architecture while navigating constraints in networking, memory, storage, power, cooling, and datacenter infrastructure. You will perform quantitative trade-offs regarding performance and total cost of ownership, develop functional proof-of-concepts to de-risk new capabilities, and use performance simulations and hardware models for what-if studies. Key technical domains include RoCE, Infiniband transports, congestion control, network topology design, and reliability. You will also author high-level product specifications, drive alignment across cross-functional engineering teams, and participate in industry consortiums to shape standards and influence vendor roadmaps for large-scale AI datacenter systems.

What you'll do

  • Define AI rack and cluster-scale architecture across accelerator, host, network, memory, storage, power, and cooling constraints.
  • Perform quantitative trade-offs between system performance and total cost of ownership (TCO).
  • Develop functional proof-of-concepts to evaluate and de-risk new hardware capabilities.
  • Write and own high-level product requirements and technical specifications for AI systems.
  • Use performance simulations and hardware models to conduct what-if studies for architectural decision-making.
  • Participate in industry consortiums to shape standards and influence vendor roadmaps.
  • Drive alignment across cross-functional engineering and leadership teams to ensure project outcomes.

What we're looking for

  • Master's degree in Engineering and 7+ years of experience, or Bachelor's degree and 8+ years of experience.
  • Ability to pass Microsoft Cloud Background Check and other required security screenings.
  • Experience in large scale AI datacenter systems and their network (preferred).
  • Expertise in networking, reliability, serviceability, or datacenter architecture for large scale AI systems (preferred).
  • Experience owning hardware system architecture at scale and authoring specifications (preferred).
  • Ability to make decision trade-offs across multiple domains (preferred).
  • Deep expertise in AI systems or a key domain like power management or networking (preferred).
  • Skilled in partnering with and influencing architects, hardware engineers, and software leads (preferred).

More like this

Similar roles

Principal Software Architect

Microsoft

14 days ago $165,600$296,400
C C++ C# Java JavaScript Python Distributed Systems CI/CD LangChain LlamaIndex AutoGen DSPy Transformers Haystack Retrieval-Augmented Generation Prompt Engineering Threat Modeling
8+ yrs exp Hybrid

Principal AI Architect

LPL Financial

Fort Mill, NC +3 33 days ago $155,942$259,869
Generative AI Agentic AI RAG LLMOps MLOps Python AWS Kubernetes EKS Bedrock DynamoDB Vector Databases Infrastructure-as-Code Microservices API Gateway DevSecOps
10+ yrs exp

Principal AI Architect

CVS Health

Remote (CO) 13 days ago $144,200$288,400
AI AWS GCP Azure Multi-model Orchestration Agentic Systems API MCP infrastructure-as-code FinOps Responsible AI Model Evaluation PHI
10+ yrs exp Remote

Principal Solutions Architect, AI

Motorola Solutions

Allen, TX 79 days ago $148,800$175,600
AI MLOps Python Java C++ TensorFlow PyTorch AWS Azure GCP Natural Language Processing Agentic AI Prompt Engineering Cloud-native Architecture Android iOS Windows
10+ yrs exp

Principal AI Strategy Architect

Micron Technology

Boise, ID 40 days ago
Generative AI LLMs RAG MLOps Python PyTorch TensorFlow LangChain Vector Databases Azure AWS GCP Data Engineering Microsoft 365 NIST AI RMF
8+ yrs exp

Principal Architect, Distributed Systems & Secure AI

Adobe

San Jose, CA 20 days ago $248,900$360,500
Agentic AI Distributed Systems Identity and Access Management OAuth OIDC SAML OPA Rego Cedar Kafka Spark Cloud-Native Services Data Governance Security Architecture
10+ yrs exp Hybrid