Principal Product Manager, AI Frameworks

Nvidia

Actively hiring
Santa Clara, CA Posted 145 days ago $240,000–$379,500 / year
View original post Log in to save

At a glance

AI generated

TL;DR

As a Senior Product Manager for AI Platform Training at NVIDIA, you will join a small yet impactful team dedicated to enabling researchers and operators to achieve success on the NVIDIA platform. Your primary responsibilities include developing product strategies, roadmaps, and go-to-market plans while collaborating closely with internal and external customers to build robust training and post-training software solutions. You will work directly with leadership to align product initiatives with company strategy and drive innovation in large-scale distributed systems. Ideal candidates possess extensive experience with AI frameworks like PyTorch and torchtitan, a deep understanding of GPU architecture, and hands-on knowledge of GenAI and machine learning concepts. This role demands expertise in technical product management, open-source development, and customer engagement to push the boundaries of what is possible on NVIDIA GPUs.

Skills

PyTorch Distributed Systems GPU Architecture Performance Profiling CI/CD GitHub OpenSource Python PostgreSQL Kubernetes AWS NVIDIA GPUs VeRL Nemo Framework Terraform Prometheus Grafana

What you'll do

  • Develop product strategy and roadmaps for AI training software.
  • Create go-to-market plans in collaboration with marketing teams.
  • Identify key improvements by working directly with internal and external customers.
  • Enable researchers and operators to achieve success on the NVIDIA platform.
  • Stay informed about advancements in the training/post-training landscape.

What we're looking for

  • Extensive experience in technical product management or related roles.
  • Deep knowledge of AI training/post-training software and optimization techniques.
  • Proven ability to work on large-scale distributed systems.
  • BS or MS degree in Computer Science, Engineering, or equivalent experience.
  • Experience leading generative AI/Recommendation Systems research to production.
  • Strong background in GPU architecture and performance profiling.
  • Demonstrated success with open-source projects and GitHub-first developer products.

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $221k
This role $310k
$161k most similar roles pay here $403k

This role pays more than 95% of similar roles. Most pay $196,750–$246,150 — the shaded band above. At the midpoint, this role pays about $310k versus about $221k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 855 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 843 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Principal Product Manager, AI Frameworks

Nvidia

Santa Clara, CA 128 days ago $240,000–$379,500
Python PyTorch VeRL Tunix Nemo Framework Docker Kubernetes CI/CD GitHub PostgreSQL Prometheus Grafana AWS Azure Google Cloud Platform GitLab Jenkins Terraform OpenStack Linux CUDA C++
Save

Senior Product Manager, AI Frameworks

Nvidia

Santa Clara, CA 52 days ago $168,000–$258,750
Python C++ CUDA TensorFlow PyTorch FSDP GitHub Docker Kubernetes CI/CD Prometheus Grafana PostgreSQL AWS Azure GitLab OpenStack NVIDIA_GPU_Architecture HW/SW_Co_Design Performance_Profiling
Save

Principal Product Manager, AI

Okta Inc

San Francisco, CA 29 days ago $210,000–$263,000
AI ML LLMs RAG Agentic system design CI/CD Python PostgreSQL Kubernetes AWS Terraform Docker Prometheus Grafana GitLab GitHub MLOps
Save

Principal Applied AI Product Manager

Adobe

San Jose 17 days ago $194,800–$282,100
SQL LLM Agentic architectures API design Figma FigJam Miro Jira Confluence Git CI/CD Python PostgreSQL AWS Kubernetes
Save

Product Manager, AI Infrastructure

Arm Holdings

San Jose, California 39 days ago $211,600–$286,200
AI ML Datacenter Cloud Product Management Systems Thinking Competitive Analysis GenAI ML Accelerators Hardware Software Infrastructure Performance Analysis System Layers End-to-End System Behavior Problem Solving Technical Analysis Customer Workloads Product Roadmap Engineering Priorities
Hybrid
Save