Principal AI Software Architect
Microsoft
Quick summary
Market check
How this pay compares to similar roles
This role pays less than 67% of similar roles. Most pay $167,249–$237,350 — the shaded band above. At the midpoint, this role pays about $177k versus about $202k for comparable roles.
Based on 240 similar postings.
Employer
Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing
Microsoft currently has 622 open roles on FindRole.
Listed pay typically runs $119,800–$234,700 across 559 roles with salary data.
Most-posted roles
At a glance
As a Senior AI Software Architect in Microsoft’s AHSI team, you will play a pivotal role in enabling and optimizing large-scale AI models for Maia accelerators. Your day-to-day responsibilities include porting and integrating models using frameworks like PyTorch, ONNX, vLLM, and SGLang, while applying advanced techniques such as KV cache quantization and parallelism strategies to enhance performance. You will collaborate closely with hardware architects and kernel developers to co-design solutions that address complex business challenges at scale, ensuring efficient model deployment and inference across diverse interconnects like NVLink and PCIe. This role requires expertise in PyTorch, model optimization, and distributed training concepts, along with a strong background in AI inference stacks and Triton kernels.
Skills
What you'll do
What we're looking for
Related searches
More like this
Microsoft
Microsoft
IBM
IBM
IBM
IBM