Senior Product Manager, AI Frameworks

Nvidia

Actively hiring
Santa Clara, CA Posted 52 days ago $168,000–$258,750 / year
View original post Log in to save

At a glance

AI generated

TL;DR

As a Product Manager for AI Platform Recommender Systems at NVIDIA, you will join a small yet impactful team to build products that enable frontier RecSys and Generative Recommendation Models on Nvidia systems. Your day-to-day responsibilities include creating and optimizing pre-training/inference frameworks, developing product strategies and roadmaps, collaborating with customers to define end-to-end ML lifecycle plans, and aligning with company strategy. You will need experience in designing and scaling training and inference software like Torchtitan and FSDP, knowledge of GenAI concepts, and expertise in large-scale distributed systems. Additionally, familiarity with GPU architecture, HW/SW co-design, and performance profiling is essential. This role requires a rare blend of technical depth and product management skills to push the boundaries of what is possible on NVIDIA’s platform for researchers and operators.

Skills

Python C++ CUDA TensorFlow PyTorch FSDP GitHub Docker Kubernetes CI/CD Prometheus Grafana PostgreSQL AWS Azure GitLab OpenStack NVIDIA_GPU_Architecture HW/SW_Co_Design Performance_Profiling

What you'll do

  • Create and optimize pre-training and inference frameworks for RecSys and Generative Recommender models.
  • Develop product strategy and roadmaps in collaboration with NVIDIA leadership.
  • Build go-to-market plans to support the end-to-end ML lifecycle.
  • Collaborate with customers to identify key improvements for AI platforms.
  • Work on large-scale distributed systems and performance optimization software.

What we're looking for

  • Extensive experience in designing and scaling training/inference frameworks for RecSys and Generative Recommender models.
  • Proven track record of developing product strategies, roadmaps, and go-to-market plans for AI products.
  • Deep understanding of generative AI and machine learning concepts, including model training and performance optimization.
  • Significant experience with large-scale distributed systems and GPU architecture.
  • BS or MS in Computer Science, Engineering, or equivalent technical background.
  • 10+ years of technical product management experience at a technology company.

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $221k
This role $213k
$157k most similar roles pay here $274k

This role pays less than 58% of similar roles. Most pay $196,000–$246,150 — the shaded band above. At the midpoint, this role pays about $213k versus about $221k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 824 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 812 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Principal Product Manager, AI Frameworks

Nvidia

Santa Clara, CA 145 days ago $240,000–$379,500
PyTorch Distributed Systems GPU Architecture Performance Profiling CI/CD GitHub OpenSource Python PostgreSQL Kubernetes AWS NVIDIA GPUs VeRL Nemo Framework Terraform Prometheus Grafana
Save

Principal Product Manager, AI Frameworks

Nvidia

Santa Clara, CA 128 days ago $240,000–$379,500
Python PyTorch VeRL Tunix Nemo Framework Docker Kubernetes CI/CD GitHub PostgreSQL Prometheus Grafana AWS Azure Google Cloud Platform GitLab Jenkins Terraform OpenStack Linux CUDA C++
Save

Senior Product Manager, AI Platform and Developer Productivity

Nvidia

Remote (Santa Clara, CA) 5 days ago $208,000–$327,750
AI/ML Distributed Training Inference Optimization GPU-Accelerated Computing Large-Scale Systems Performance Observability Telemetry Profiling CI/CD SDLC Developer Workflows APIs Kubernetes AWS Azure GCP PostgreSQL MongoDB Python Go JavaScript React Node.js Git Jenkins Prometheus Grafana
Remote
Save

Product Manager, AI Infrastructure

Arm Holdings

San Jose, California 39 days ago $211,600–$286,200
AI ML Datacenter Cloud Product Management Systems Thinking Competitive Analysis GenAI ML Accelerators Hardware Software Infrastructure Performance Analysis System Layers End-to-End System Behavior Problem Solving Technical Analysis Customer Workloads Product Roadmap Engineering Priorities
Hybrid
Save

Senior Manager, AI Product Development, Digital Solutions

Abbott

Santa Clara, CA 97 days ago $148,700–$297,300
Python Java Golang C# AWS Azure Google Cloud Docker Kubernetes Airflow CI/CD SQL NoSQL Scrum Kanban MLOps GenAI RAG MCP Prompt Engineering Security by Design FDA-regulated business 510(k) submissions Clinical-grade ML
Save

Senior Manager, Product Manager, AI Acceleration

Capital One Financial

New York 8 days ago $200,700–$229,100
Python Java JavaScript React Node.js AWS Azure Google Cloud Platform Kubernetes Docker CI/CD PostgreSQL MongoDB Git Jira Terraform Prometheus Grafana Swagger RESTful APIs
Save