Principal AI Network Architect

Microsoft

Confirmed live today High trust
Hybrid

Quick summary

Work type
Hybrid
Location
—
Salary
$142,800–$274,800 / yr
Posted
8 days ago
Freshness
Confirmed live today
Closes
Mar 21, 2027

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $216k
This role $209k
$127k most similar roles pay here $291k

This role pays less than 56% of similar roles. Most pay $172,963–$259,625 — the shaded band above. At the midpoint, this role pays about $209k versus about $216k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 518 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 505 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Principal AI Network Architect

The Principal AI Network Architect joins the Silicon, Cloud Hardware, and Infrastructure Engineering team to define long-term architecture and technology roadmaps for AI scale-up networking systems. This role involves architecting next-generation scale-up switches, including switch topology, ASIC selection, radix planning, and electrical and optical interconnect strategies. The architect will design network architectures for AI clusters, racks, pods, and multi-rack domains while performing tradeoff analyses regarding performance, scalability, reliability, power, cost, and serviceability. Key technical areas include Ethernet, RDMA/RoCE, SONiC, switch ASICs, SerDes technologies, and optical networking technologies like OCI, XPO, CPO, and OBO. The role addresses the challenge of building high-performance infrastructure for AI training and inference workloads by providing technical direction to development teams and partners while evaluating emerging networking technologies across the broader ecosystem.

What you'll do

  • Define the long-term architecture and technology roadmap for AI scale-up networking systems.
  • Architect next-generation switch hardware including topology, ASIC selection, and electrical/optical interconnect strategies.
  • Design network architectures for AI clusters, racks, pods, and multi-rack scale-up domains.
  • Conduct trade-off analyses regarding performance, scalability, reliability, power, cost, and operational efficiency.
  • Lead technical studies for switch silicon, optics, control planes, and AI fabrics.
  • Develop performance, capacity, reliability, and TCO models to guide investment decisions.
  • Provide architectural guidance to development teams, manufacturing partners, and platform engineering organizations.

What we're looking for

  • A Master's degree in Engineering and 7+ years of experience, or a Bachelor's degree and 8+ years of experience is required.
  • Ability to pass Microsoft Cloud Background Check and meet government security screening requirements.
  • Must provide proof of citizenship or U.S. permanent residency for export control compliance.
  • 10+ years of relevant experience in system level design and implementation across the hardware development lifecycle (preferred).
  • 10+ years of hands-on experience in server hardware architecture, design, and development with knowledge of firmware and OS (preferred).
  • 10+ years of experience in networking, distributed systems, AI infrastructure, or large-scale system architecture (preferred).
  • Experience architecting high-performance network switches and large-scale switching systems (preferred).
  • Knowledge of Ethernet, RDMA/RoCE, SONiC, switch ASICs, SerDes, and optical networking technologies (preferred).

More like this

Similar roles

Principal AI Network Hardware Systems Engineer

Microsoft

5 days ago $142,800–$274,800
RDMA RoCE TCP/IP UDP SONiC Linux Networking Ethernet SmartNICs DPUs High-Speed SerDes Packet Analysis Telemetry Azure Distributed Training Collective Communication Congestion Control QoS
8+ yrs exp

Principal Architect, AI Networking

Nvidia

Remote (Santa Clara, CA) +1 161 days ago $272,000–$431,250
RDMA NVLink GPUDirect InfiniBand RoCE NCCL UCX MPI NVSHMEM CUDA C C++ Rust Python vLLM SGLang TensorRT-LLM Distributed Training Computer Architecture
10+ yrs exp Remote

Principal Network Architect

Northern Trust

Naperville, IL 29 days ago $137,400–$233,600
BGP OSPF EIGRP SD-WAN Layer 2 Protocols MPLS Ethernet DWDM IPsec IKEv1 IKEv2 RADIUS TACACS+ SNMP Cisco Catalyst Juniper MX Aruba Arista NGFW Tufin F5 NetScaler Infoblox Active Directory CyberArk AWS Azure Illumio
10+ yrs exp

Principal AI Architect

LPL Financial

Fort Mill, NC +3 48 days ago $155,942–$259,869
Generative AI Agentic AI RAG LLMOps MLOps Python AWS Kubernetes EKS Bedrock DynamoDB Vector Databases Infrastructure-as-Code Microservices API Gateway DevSecOps
10+ yrs exp

Principal AI Architect

CVS Health

Remote (CO) 28 days ago $144,200–$288,400
AI AWS GCP Azure Multi-model Orchestration Agentic Systems API MCP infrastructure-as-code FinOps Responsible AI Model Evaluation PHI
10+ yrs exp Remote

Principal Developer, AI Networking

Nvidia

Remote (Santa Clara, CA) +3 111 days ago $272,000–$431,250
NCCL RDMA CUDA PyTorch TensorFlow C++ Python Bash RoCE MPI SHARP Distributed Systems LLM Training High-Performance Networking Profiling Benchmarking
10+ yrs exp Remote