Senior Product Manager, Local AI and Agents for Enterprise

Nvidia

Actively hiring
Santa Clara, US Posted 25 days ago $168,000–$258,750 / year
View original post Log in to save

At a glance

AI generated

TL;DR

As a senior Product Manager at NVIDIA, you will lead the product efforts for local AI on Linux platforms, focusing on enabling developers and enterprises to build, run, and deploy advanced AI models locally. Your primary responsibilities include defining the enterprise agent use case, collaborating with cloud inference backend teams, and owning the product strategy and roadmap for Linux developer experiences across various client platforms. You will conduct extensive research into the AI ecosystem, work closely with cross-functional teams including engineering and DevRel to ship features, and influence NVIDIA’s GPU and software roadmaps based on real-world needs. The ideal candidate has over 8 years of experience in AI/ML product management, hands-on development skills, deep knowledge of modern AI workflows, and fluency in Linux environments. Familiarity with technologies like vLLM, SGLang, TensorRT-LLM, and PyTorch is essential for this role that aims to make NVIDIA’s client platforms the premier choice for local AI deployment.

Skills

Linux CUDA PyTorch Docker vLLM SGLang TensorRT-LLM NVIDIA DGX NVIDIA RTX AI/ML frameworks Inference backends Model optimization Enterprise AI On-prem deployments CI/CD Git Prometheus Grafana

What you'll do

  • Define and lead the enterprise agent use case for NVIDIA's client platforms.
  • Own the product strategy and roadmap for Linux developer experience on NVIDIA hardware.
  • Research and map workflows across training, fine-tuning, inference, and agent deployment.
  • Work hands-on with modern AI models, frameworks, and tooling to inform decisions.
  • Influence GPU, system, and software roadmaps based on actual needs of developers and enterprises.

What we're looking for

  • 8+ years of product management experience in AI/ML, developer tools, or infrastructure products.
  • First-hand development experience with production code and technical debugging skills.
  • Deep understanding of modern AI workflows including training, fine-tuning, inference, and agent deployment.
  • Proficiency in Linux for both development and deployment environments.
  • Strong communication skills to translate technical concepts for diverse audiences.
  • Experience as an AI/ML engineer or application developer working with LLM APIs and agent frameworks.

Market check

Salary context

This $168,000–$258,750 range sits above 45% of similar postings on FindRole.

Peer median band

$184,000–$262,400

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$186,050–$246,150

Middle half of comparable postings.

Based on 239 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 801 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 797 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Senior Product Manager, AI Frameworks

Nvidia

Us, Ca, Santa Clara, US 47 days ago $168,000–$258,750
Python C++ CUDA TensorFlow PyTorch FSDP GitHub Docker Kubernetes CI/CD Prometheus Grafana PostgreSQL AWS Azure GitLab OpenStack NVIDIA_GPU_Architecture HW/SW_Co_Design Performance_Profiling

Principal Product Manager, AI Frameworks

Nvidia

Us, Ca, Santa Clara, US 123 days ago $240,000–$379,500
Python PyTorch VeRL Tunix Nemo Framework Docker Kubernetes CI/CD GitHub PostgreSQL Prometheus Grafana AWS Azure Google Cloud Platform GitLab Jenkins Terraform OpenStack Linux CUDA C++

Principal Product Manager, AI Frameworks

Nvidia

Us, Ca, Santa Clara, US 140 days ago $240,000–$379,500
PyTorch Distributed Systems GPU Architecture Performance Profiling CI/CD GitHub OpenSource Python PostgreSQL Kubernetes AWS NVIDIA GPUs VeRL Nemo Framework Terraform Prometheus Grafana

Product Manager, AI Infrastructure

Arm Holdings

San Jose, California, US 34 days ago $211,600–$286,200
AI ML Datacenter Cloud Product Management Systems Thinking Competitive Analysis GenAI ML Accelerators Hardware Software Infrastructure Performance Analysis System Layers End-to-End System Behavior Problem Solving Technical Analysis Customer Workloads Product Roadmap Engineering Priorities

Manager, Product Manager, AI Acceleration

Capital One Financial

New York, Ny, US 10 days ago $164,800–$188,100
Python JavaScript AI Generative_AI Language_Models Product_Management CI/CD Cloud_Services Docker Kubernetes Terraform PostgreSQL MongoDB AWS Azure Grafana Prometheus Git Jira

Senior Manager, AI Product Development, Digital Solutions

Abbott

US 92 days ago $148,700–$297,300
Python Java Golang C# AWS Azure Google Cloud Docker Kubernetes Airflow CI/CD SQL NoSQL Scrum Kanban MLOps GenAI RAG MCP Prompt Engineering Security by Design FDA-regulated business 510(k) submissions Clinical-grade ML