Principal AI Software Architect | Microsoft Careers

Microsoft

Actively hiring
US Posted 42 days ago $139,900–$274,800 / year
View original post Log in to save

At a glance

AI generated

TL;DR

As a Principal AI Software Architect for Microsoft MAIA accelerators within the SPARC team at Azure Hardware Systems and Infrastructure (AHSI), you will lead the optimization of machine learning model training workflows on cutting-edge hardware, collaborating closely with engineering and research teams to understand and validate accelerator architecture. Your daily tasks include leveraging PyTorch and either Triton or CUDA to ensure efficient deployment of large models, while also mentoring team members to produce high-quality, scalable code that adheres to design specifications. You will apply best practices in coding patterns and metrics to drive code quality and stability, and conduct thorough code reviews to enhance reliability and maintainability. This role requires extensive experience with languages such as C++, PyTorch, CUDA/Triton, and a deep understanding of AI model architecture and accelerator mapping.

Skills

PyTorch CUDA Triton C C++ Python Java JavaScript Code Reviews Automated Source Code Analysis Tools CI/CD

What you'll do

  • Leads efforts to optimize code performance and maintainability for Microsoft’s cloud products.
  • Identifies and implements best coding practices and patterns in AI infrastructure projects.
  • Escalates development blockers and leads strategies to address them, impacting project timelines.
  • Reviews product and test codes to ensure adherence to team standards and quality metrics.
  • Conducts timely code reviews focusing on diagnosability, reliability, and maintainability aspects.
  • Applies automated source code analysis tools to enhance build/development processes efficiency.

What we're looking for

  • 6+ years of technical engineering experience with coding in languages like C, C++, PyTorch, CUDA/Triton.
  • Bachelor's Degree in Computer Science or related field and extensive hands-on experience with machine learning frameworks.
  • Experience in bringing up and validating training processes on cutting-edge hardware accelerators.
  • Deep expertise in AI model architecture and mapping models to accelerators.
  • Strong background in accelerator architecture and understanding of number formats.
  • Ability to lead by example, mentor others, and drive code quality and stability improvements.

Market check

Salary context

This $139,900–$274,800 range sits above 56% of similar postings on FindRole.

Peer median band

$152,000–$262,400

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$168,700–$235,750

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 451 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 417 roles with salary data.

Most-posted roles

View all roles at Microsoft

More like this

Similar roles

Senior AI Software Architect | Microsoft Careers

Microsoft

US 135 days ago $119,800–$234,700
PyTorch ONNX vLLM SGLang NVLink PCIe TridentOmniscienTriton CUDA BF16 FP8 KV cache quantization Checkpointing Resharding TP PP Parallelism strategies Distributed training concepts Sharding Allreduce Performance profiling

Principal AI Network Architect | Microsoft Careers

Microsoft

US 55 days ago $139,900–$274,800
Ethernet RDMA RoCE Infiniband Congestion_control Layer_2/3_switching AI_GPU_clusters NVLinks UALink High_radix_ethernet_switches CI/CD Azure Bash Python C++ Linux Networking_lab Hyperscale_network_deployments

Solution Architect - Data & AI | Microsoft Careers

Microsoft

US 13 days ago $101,800–$193,800
Azure Azure OpenAI Azure AI Search Azure AI Document Intelligence Cosmos DB Bicep Terraform GitHub Actions Azure DevOps Durable Functions Semantic Kernel Application Insights CI/CD RAG FedRAMP IL4/IL5 Cloud Adoption Framework Well-Architected Framework

Senior Solution Architect - AI Business Solutions | Microsoft Careers

Microsoft

US 16 days ago $122,500–$214,600
Dynamics_365 Power_Platform Azure AI Copilot Copilot_Studio CI/CD Microsoft_Cloud Low_code Cloud_Adoption_Framework Well_Architected_Framework Omnichannel_Customer_Service Data_Integration Governance_Models Enterprise_Architecture_Frameworks Security_and_Identity_Architectures Application_Lifecycle_Governance Kubernetes Terraform