Principal AI Software Architect

Microsoft

Quick summary

Work type: On-site
Location: —
Salary: $142,800–$274,800 / yr
Posted: 72 days ago
Closes: Oct 13, 2026

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $202k

This role $209k

$127k most similar roles pay here $291k

This role pays more than 50% of similar roles. Most pay $167,850–$236,812 — the shaded band above. At the midpoint, this role pays about $209k versus about $202k for comparable roles.

Based on 240 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 622 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 559 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Principal AI Software Architect

Role Posting Log in to save

As a Principal AI Software Architect for Microsoft MAIA accelerators within the SPARC team, you will lead by example in enabling and optimizing machine learning model training workflows on cutting-edge hardware. Your daily tasks include validating training processes, collaborating with engineering teams to understand accelerator architecture, and ensuring efficient deployment of large models using PyTorch and either Triton or CUDA. You will mentor others to produce high-quality code adhering to design specifications while continuously improving performance and maintainability. Ideal for those passionate about advancing AI infrastructure on next-generation hardware platforms, this role requires a Bachelor's Degree in Computer Science and 6+ years of experience with languages like C, C++, PyTorch, CUDA/Triton, along with expertise in accelerator architecture and model mapping.

Skills

PyTorch CUDA Triton C C++ AWS Azure Kubernetes Docker CI/CD Prometheus Grafana Git Python PostgreSQL

What you'll do

Leads efforts to optimize code performance and maintainability for machine learning workflows.
Validates training processes on MAIA accelerators and ensures efficient deployment of large models.
Collaborates with engineering teams to understand accelerator architecture and integrate new technologies.
Applies metrics to drive code quality, stability, and adherence to best practices in AI development.
Identifies and escalates potential blockers during the development process to ensure timely resolution.

What we're looking for

Bachelor's Degree in Computer Science or related technical field and 6+ years of relevant engineering experience.
Hands-on experience with PyTorch, CUDA, and Triton for efficient deployment of large machine learning models.
Expertise in leading code performance optimization, testability, maintainability, and cost-effectiveness.
Deep understanding of best practices and coding patterns in AI infrastructure development.
Ability to collaborate across teams and mentor others in producing high-quality, scalable code.
Experience with accelerator architecture and mapping models to accelerators for optimal performance.

Similar roles

Senior AI Software Architect

Microsoft

165 days ago $119,800–$234,700

PyTorch ONNX vLLM SGLang KV cache quantization Parallelism strategies TP PP NVLink PCIe Inference pipelines sglang/vllm Triton kernels CUDA programming AI inference stacks Performance profiling Model checkpointing Resharding scripts

Save

Principal Engineer, AI Serving Framework Architect (Software)

Samsung Semiconductor

San Jose, CA 24 days ago $219,000–$351,000

Python PyTorch C++ vLLM AI Inference System Profiling Kubernetes Docker CI/CD PostgreSQL Prometheus Grafana AWS Azure Google Cloud Platform Samsung SDS Cloud Services Git Jenkins GitHub Bitbucket Slack Zoom Confluence Jira Terraform Ansible Kafka Redis MongoDB RAG Vector DB KVCache Hierarchical Memory Systems

Save