Product Manager, AI Platform SW - Agentic AI Kernel Generation

Nvidia

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$168,000–$258,750 / yr
Posted
135 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $214k
This role $213k
$157k most similar roles pay here $270k

This role pays more than 51% of similar roles. Most pay $182,487–$246,150 — the shaded band above. At the midpoint, this role pays about $213k versus about $214k for comparable roles.

Based on 239 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Product Manager, AI Platform SW - Agentic AI Kernel Generation

As a Product Manager, AI Platform SW - Agentic AI Kernel Generation on the AI Software Platforms team, you will architect products that enable coding agents to synthesize, optimize, and deploy GPU kernels across diverse architectures. You will manage the end-to-end data lifecycle for agent training and evaluation, including dataset curation, synthetic data creation, and benchmark suites for correctness and latency. The role involves partnering with engineering teams to integrate agents with compilers, profilers, execution sandboxes, and runtimes while driving multi-agent orchestration. Key technical domains include CUDA kernels, graph-level execution plans, and LLM-based coding workflows. You will utilize your expertise in high-performance computing, parallel computing architectures, and GPU kernel optimization to build tools that automate the generation of optimized inference and training solutions for developers within the agentic AI infrastructure space.

What does a Product Manager earn in California?

Median $223300 from 163 postings across 44 companies.

See salary data

What you'll do

  • Architect products that enable coding agents to generate and optimize CUDA kernels across various GPU architectures.
  • Define the end-to-end data lifecycle for agent training, including dataset curation and synthetic data generation.
  • Develop benchmark suites to evaluate agents on objective metrics like correctness, latency, and performance.
  • Integrate AI agents with compilers, profilers, execution sandboxes, and runtimes in a safe environment.
  • Drive multi-agent orchestration and self-healing code loops to improve agent performance over time.
  • Define product roadmaps and prioritize features for the agentic AI kernel generation ecosystem.
  • Coordinate with engineering and research teams to integrate agents into existing GPU-accelerated software stacks.

What we're looking for

  • 7+ years of technical product management experience in AI, ML infrastructure, or high-performance computing.
  • Proven experience in the AI agent or LLM space, specifically developing or productizing coding agents.
  • Experience with multi-agent orchestration and self-healing code loops that improve over time.
  • Experience connecting agents to compilers or execution environments.
  • Proven record of crafting and releasing automated testing or evaluation suites for correctness, performance, and latency.
  • BS or MS in Computer Engineering, Computer Science, or a related technical field.
  • Equivalent experience in parallel computing architectures and systems is acceptable.

More like this

Similar roles

Senior Product Manager, AI Platform Inference

Nvidia

Santa Clara, CA 37 days ago $168,000$258,750
vLLM SGLang FlashInfer TensorRT-LLM Triton Dynamo TorchAO NVIDIA GPUs Generative AI Machine Learning GPU Architecture Performance Profiling Software Development Open Source GitHub
6+ yrs exp

Product Manager, Agentic Platform

Microsoft

Redmond, WA 64 days ago $119,800$234,700
AI GitHub Copilot Copilot Workspace Claude Code OpenAI Codex ChatGPT Cursor RAG Agentic AI CI/CD Developer Tools Product Management Telemetry Enterprise Governance
5+ yrs exp

Product Manager, CPU AI

Amd

Santa Clara, CA 9 days ago $160,000$240,000
Agentic AI AI Inference RAG Speculative Decode Vector Databases Model Serving CPU Datacenter Platforms Cloud Infrastructure Benchmarking Performance Optimization
Hybrid

Senior Agentic AI Product Manager

Apple Inc

Austin, TX 101 days ago
LLM Prompt Engineering RAG Agent Orchestration Multi-agent Systems Model Context Protocol Data Pipelines Evaluation Frameworks
10+ yrs exp