Product Manager, AI Platform SW - Agentic AI Kernel Generation

Nvidia

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$168,000–$258,750 / yr
Posted
46 days ago

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $210k
This role $213k
$157k most similar roles pay here $270k

This role pays more than 58% of similar roles. Most pay $172,875–$246,150 — the shaded band above. At the midpoint, this role pays about $213k versus about $210k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 967 open roles on FindRole.

Listed pay typically runs $168,000–$270,250 across 950 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Product Manager, AI Platform SW - Agentic AI Kernel Generation

NVIDIA's AI Software Platforms team is seeking a senior Product Manager to lead the development of agentic AI infrastructure for automatic GPU kernel synthesis and optimization. In this role, you will define strategies and roadmaps for products that enable coding agents to generate optimized CUDA kernels across diverse GPU architectures, ensuring safe integration with compilers and execution environments. Key responsibilities include architecting end-to-end data lifecycles for agent training and evaluation, collaborating with engineering teams on multi-agent orchestration, and working closely with developers and ecosystem partners to deliver innovative AI solutions. Ideal candidates have extensive experience in technical product management within AI or ML infrastructure, a deep understanding of AI agents and LLM-based coding workflows, and proven expertise in developing automated testing suites and evaluating agent performance metrics. Strong background in GPU kernel optimization, multi-agent systems, and cost-per-inference models is essential for this role.

What you'll do

  • Define the data lifecycle for agent training and evaluation, including dataset curation and benchmark suite creation.
  • Integrate AI agents with CUDA compilers, profilers, execution sandboxes, and runtimes in a safe manner.
  • Develop roadmaps and build products that span the entire lifecycle of coding agents from data collection to continuous improvement.
  • Craft automated testing suites for AI agents, measuring them on metrics like correctness, performance, and latency.
  • Partner with engineering teams to ensure agents generate optimized CUDA kernels across diverse GPU architectures.

What we're looking for

  • 7+ years of technical product management experience in AI, ML infrastructure, or high-performance computing.
  • Proven experience developing or productizing coding agents with multi-agent orchestration capabilities.
  • Record of crafting and releasing automated testing suites for agent evaluation on metrics like correctness and performance.
  • BS/MS in Computer Engineering, CS, or related field; PhD preferred with research focus in GPU kernel optimization or ML model serving.
  • Track record building coding-agent platforms used by development teams at scale and contributing to open-source projects.

More like this

Similar roles

Senior Product Manager, Local AI and Agents for Enterprise

Nvidia

Santa Clara, CA 41 days ago $168,000$258,750
Linux CUDA PyTorch Docker vLLM SGLang TensorRT-LLM NVIDIA DGX NVIDIA RTX AI/ML frameworks Inference backends Model optimization Enterprise AI On-prem deployments CI/CD Git Prometheus Grafana

Agentic AI Product Manager

Apple Inc

Cupertino, CA 11 days ago $172,100$258,600
LLM-powered applications prompt engineering RAG agent orchestration full-stack development MCP evaluation frameworks multilingual deployments CI/CD Python JavaScript React Node.js PostgreSQL AWS Kubernetes

Agentic AI Product Manager

Apple Inc

Austin, TX 11 days ago
LLM-powered applications prompt engineering RAG agent orchestration full-stack development multilingual deployments MCP evaluation frameworks accuracy hallucination detection quality scoring CI/CD

Senior Agentic AI Product Manager

Apple Inc

Cupertino, CA 11 days ago $203,300$305,600
LLM-powered applications prompt engineering RAG agent orchestration full-stack development multilingual deployments MCP evaluation frameworks accuracy hallucination detection quality scoring CI/CD

Senior Agentic AI Product Manager

Apple Inc

Austin, TX 11 days ago
LLM-powered applications prompt engineering RAG agent orchestration full-stack development multilingual deployments MCP evaluation frameworks accuracy hallucination detection quality scoring CI/CD

Product Manager, AI Infrastructure

Arm Holdings

San Jose, California 50 days ago $211,600$286,200
AI ML Datacenter Cloud Product Management Systems Thinking Competitive Analysis GenAI ML Accelerators Hardware Software Infrastructure Performance Analysis System Layers End-to-End System Behavior Problem Solving Technical Analysis Customer Workloads Product Roadmap Engineering Priorities
Hybrid