Senior Technical Program Manager, AI Inference

Nvidia

Confirmed live today High trust
Remote

Quick summary

Work type
Remote
Location
Santa Clara, CA
Salary
$168,000–$258,750 / yr
Employment
Full-time
Posted
4 days ago
Freshness
Confirmed live today

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $207k
This role $213k
$156k $270k
below market most similar roles pay here above market

This role pays more than 60% of similar roles. Most pay $177,250–$236,625 — the blue band above. At the midpoint, this role pays about $213k versus about $207k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Technical Program Manager, AI Inference

The Senior Technical Program Manager, AI Inference joins the AI Platform Inference team to lead critical programs across software, hardware, and tooling. This role involves owning the full program lifecycle, including planning, scheduling, dependency tracking, and executive reporting for multiple concurrent inference programs. You will partner with hardware and software engineering leads to align library development with hardware timelines, coach teams on agile practices, and build metrics to surface risks. Key requirements include a BS in Computer Science or AI, ten years of experience leading global technical programs, and knowledge of software engineering methodologies, hardware bring-up processes, and enterprise quality standards. You must be proficient with Scaled Agile frameworks and program tracking tools. The work focuses on solving complex technical problems within AI infrastructure, specifically regarding GPU technology and production AI software.

What does a Technical Program Manager earn in California?

Median $200000 from 105 postings across 25 companies.

See salary data

What you'll do

  • Drive planning, scheduling, dependency tracking, and executive reporting across multiple concurrent inference programs.
  • Partner with hardware and software leads to align library development with hardware timelines.
  • Coach teams on agile practices and run rituals to keep programs on track.
  • Build and maintain metrics to surface risks early and support data-driven decisions.
  • Communicate program status and technical context to engineering teams and senior leadership.
  • Identify process gaps and implement improvements to increase delivery quality and team efficiency.
  • Moderate complex technical discussions and drive them to clear, documented conclusions.

What we're looking for

  • BS degree in Computer Science, Artificial Intelligence, or equivalent experience.
  • 10 years of experience leading global technical programs.
  • Solid knowledge of software engineering standard methodologies, hardware bring-up processes, and enterprise quality standards.
  • Proficiency with Scaled Agile frameworks and program tracking tools.
  • Demonstrated ability to resolve resource conflicts, unblock teams, and drive alignment across the organization.
  • Clear, compelling communication skills for both technical and business audiences.
  • Proven experience in machine learning, deep learning, GPU technology, or AI infrastructure (preferred).
  • Experience shipping production AI software or co-managing software-hardware programs end to end (preferred).

More like this

Similar roles

Senior Technical Program Manager, AI Acceleration

Nvidia

Santa Clara, CA 118 days ago
AI ASIC RTL Design Simulation Formal Verification LLM System Architecture Scalable Infrastructure Data Pipelines Orchestration Systems Pre-silicon Workflows AI Agents
10+ yrs exp

Technical Program Manager, AI Factory Infrastructure

Nvidia

Remote (Santa Clara, CA) +5 36 days ago
AI Infrastructure Data Center Deployment Liquid Cooling Power Delivery Networking Hardware Software Commissioning Basis Of Design Colocation Storage Network Topology
10+ yrs exp Remote