Principal Technical Program Management, AI Accelerator Software Planning

Microsoft

Quick summary

Work type
On-site
Location
Salary
$142,800–$274,800 / yr
Posted
19 days ago
Closes
Dec 5, 2026

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $205k
This role $209k
$127k most similar roles pay here $291k

This role pays more than 52% of similar roles. Most pay $167,781–$242,975 — the shaded band above. At the midpoint, this role pays about $209k versus about $205k for comparable roles.

Based on 238 similar postings.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 694 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 636 roles with salary data.

Most-posted roles

View all roles at Microsoft

At a glance

TL;DR · Principal Technical Program Management, AI Accelerator Software Planning

As a Principal Program Manager at Microsoft, you will lead software planning and execution for a high-performance accelerator platform, driving end-to-end development from early stages through production deployment. You will manage cross-functional teams, including hardware, firmware, and software engineers, to align on requirements and milestones, ensuring readiness for critical validation gates and system integration. Your responsibilities include building integrated program plans, coordinating schedules, and mitigating risks across the entire software stack, from device drivers and firmware to distributed infrastructure and AI frameworks. Ideal candidates have over a decade of experience in technical program management with deep expertise in GPU or accelerator ecosystems, proficiency in managing complex engineering programs, and strong communication skills for diverse stakeholders. This role requires familiarity with AI training and inference workloads, performance optimization, and system-level scalability challenges within the context of cutting-edge AI infrastructure development.

What you'll do

  • Own and drive software program execution from early development through production readiness.
  • Lead cross-functional planning for the full software stack including firmware, compilers, runtime systems, and SDKs.
  • Build integrated program plans with schedules, dependency maps, and readiness criteria across teams.
  • Partner with hardware, firmware, and software teams to align on requirements and milestones.
  • Drive new platform bring-up readiness by sequencing software deliverables aligned with hardware milestones.
  • Establish and run execution rhythms including program reviews, status reporting, and issue escalation.

What we're looking for

  • 10+ years of experience in Technical Program Management or related roles leading large-scale engineering programs.
  • Deep expertise in GPU, accelerator, AI infrastructure, HPC software stacks including device drivers, firmware, and runtime systems.
  • Proven ability to drive new platform bring-up and system integration across complex engineering environments.
  • Strong program execution skills with managing schedules, dependencies, risks, and coordination across hardware/software teams.
  • Familiarity with AI training and inference workloads, performance optimization, and system-level scalability challenges.
  • Excellent communication and stakeholder management skills for diverse audiences.

More like this

Similar roles

Principal Technical Program Manager

Oracle

Austin, TX 25 days ago $90,100$209,500
Oracle AWS Kubernetes Terraform Python PostgreSQL CI/CD Docker Prometheus Grafana AI HPC Data Center GPU Architecture Cross-Functional Team Management Cloud Architecture

Principal Technical Program Manager

Oracle

Nashville, TN +1 22 days ago $102,300$209,500
AWS Azure GCP Kubernetes Terraform CI/CD Python PostgreSQL Docker Git Jira Confluence Data Center GPU architecture AI workloads HPC

Principal Technical Program Manager

Oracle

Nashville, TN 66 days ago $90,100$199,500
Oracle AWS Kubernetes Terraform Python PostgreSQL CI/CD Docker Prometheus Grafana AI HPC Data Center GPU Architecture Cloud Architecture Agile Methodology

Principal Technical Program Manager

Oracle

Nashville, TN +1 39 days ago $90,100$199,500
Oracle AWS Kubernetes Terraform Python PostgreSQL CI/CD Docker Prometheus Grafana AI HPC Data Center GPU architecture Cloud Architecture Agile Methodologies

Principal Technical Product Manager, Accelerator Optimization

Microsoft

29 days ago $165,600$296,400
AMD NVIDIA GPU AI ML Distributed Systems Model Serving Compilers Runtime Systems Performance Engineering Cloud Platform Architecture CI/CD Benchmarking Regression Detection Service Reliability Python C++ CUDA OpenCL Kubernetes Terraform

Senior AI Hardware Architect

Microsoft

15 days ago $119,800$234,700
Python C/C++ GPU AI_accelerators PyTorch vLLM SGLang Distributed_training Quantization Sparsity Sharding_strategies KV-cache_management Flash_Attention Communication_computation_overlap Performance_profiling Benchmarking Silicon_correlation Architectural_simulation Workload_characterization Data_analysis Visualization Terraform AWS Kubernetes