Principal Product Manager, AI Frameworks

Nvidia

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$240,000–$379,500 / yr
Employment
Full-time
Posted
6 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $207k
This role $310k
$139k $405k
below market most similar roles pay here above market

This role pays more than 98% of similar roles. Most pay $177,943–$236,500 — the blue band above. At the midpoint, this role pays about $310k versus about $207k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1792 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1179 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Principal Product Manager, AI Frameworks

As a Principal Product Manager, AI Frameworks, you will join the Product Management organization to build tools, SDKs, and libraries that enable model builders to achieve large-scale performance, resilience, and experience on NVIDIA GPUs. You will develop product strategies, roadmaps, and go-to-market plans while collaborating with internal and external customers to identify key improvements for training and post-training software. The role requires technical depth in GenAI, machine learning concepts, and large-scale distributed systems. You will work with technologies such as PyTorch distributed, torchtitan, VeRL, and the Nemo Framework. Your work focuses on the technical challenge of optimizing software for frontier model builders, specifically addressing performance profiling, hardware-software co-design, and the transition of research-to-production for emerging modeling paradigms on GPU architectures.

What does a Product Manager earn in California?

Median $223300 from 310 postings across 48 companies.

See salary data

What you'll do

  • Build tools, SDKs, and libraries to enable large-scale model training performance and resilience on NVIDIA GPUs.
  • Develop comprehensive product strategies, roadmaps, and go-to-market plans for AI platform training software.
  • Identify key improvements by working directly with internal and external customers to build product-based roadmaps.
  • Create products specifically designed to assist researchers and production model builders in scaling frontier models.
  • Align with and drive company strategy in coordination with NVIDIA leadership.
  • Monitor the training and post-training software landscape to stay ahead of emerging modeling paradigms.
  • Support the development of best-in-class open-source frameworks and a robust software ecosystem.

What we're looking for

  • 15+ years of technical product management or similar experience at a technology company.
  • BS or MS degree in Computer Science, Computer Engineering, or similar experience.
  • Experience with training/post training and optimization software such as PyTorch distributed, torchtitan, VeRL, or Nemo Framework.
  • Demonstrable knowledge of GenAI or machine learning concepts, particularly model training, performance optimization, and software development.
  • Experience with large scale distributed systems.
  • Strong communication and interpersonal skills.
  • Experience leading GenAI/RecSys research to production at scale (preferred).
  • Experience with Open Source and Github-first developer products with deep customer interactions (preferred).

More like this

Similar roles

Principal Product Manager, AI Frameworks

Nvidia

Santa Clara, CA 6 days ago $240,000–$379,500
GenAI Machine Learning PyTorch Distributed Torchtitan Nemo Framework VeRL Tunix RL GPU Architecture Distributed Systems Performance Profiling HW/SW Co-design Software Development SDKs Libraries Open Source GitHub
10+ yrs exp

Senior Product Manager, AI Platform Inference

Nvidia

Santa Clara, CA 6 days ago $168,000–$258,750
Generative AI Inference vLLM SGLang FlashInfer TensorRT-LLM Triton Dynamo TorchAO GPU Architecture Performance Profiling HW/SW Co-design Machine Learning Software Development SDKs Libraries GitHub
6+ yrs exp

Principal Product Manager, AI

Zip

San Francisco, CA 126 days ago $200,000–$280,000
LLM SaaS Product Strategy Evals Guardrails Feedback Loops User Research Debugging
8+ yrs exp Hybrid

Principal Product Manager, Enterprise AI

Okta Inc

Bellevue, WA +2 6 days ago $210,000–$289,000
AI ML LLMs RAG Agentic System Design AI Evaluation Frameworks Workflow Automation Responsible AI Enterprise AI MVP
10+ yrs exp

Principal Product Manager, Business Applications AI

Palo Alto Networks

Santa Clara, CA 69 days ago $164,000–$266,000
Generative AI LLM RAG Agentic Workflows Snowflake Databricks Salesforce SAP Workday Tableau PowerBI Cursor Low-code Platforms SDLC Agile Scrum APIs
10+ yrs exp