Senior Product Manager, AI Platform Inference

Nvidia

Confirmed live today High trust

Quick summary

Work type: On-site
Location: Santa Clara, CA
Salary: $168,000–$258,750 / yr
Employment: Full-time
Posted: 83 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $202k

This role $213k

$155k $270k

below market most similar roles pay here above market

This role pays more than 62% of similar roles. Most pay $177,250–$226,850 — the blue band above. At the midpoint, this role pays about $213k versus about $202k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Product Manager, AI Platform Inference

Role Posting Log in to save

As a Senior Product Manager - AI Platform Inference, you will join the Product Management organization to build tools, SDKs, and libraries that enable developers to successfully deploy inference on NVIDIA GPUs. Your daily responsibilities include creating products for better inference deployments, developing product strategies, and establishing roadmaps and go-to-market plans. You will collaborate with internal and external developers to build product-based roadmaps for model optimization software while aligning with leadership on company strategy. The role requires experience with inference deployment and optimization software such as vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, and TorchAO. You must possess knowledge of GenAI, machine learning performance optimization, software development, GPU architecture, HW/SW co-design, and performance profiling to solve complex technical challenges in the evolving generative AI landscape.

What does a Product Manager earn in California?

Median $222500 from 327 postings across 57 companies.

See salary data

Skills

Generative AI Inference vLLM SGLang FlashInfer TensorRT-LLM Triton Dynamo TorchAO GPU Architecture Performance Profiling HW/SW Co-design Machine Learning Software Development SDKs Libraries GitHub

What you'll do

Build tools, SDKs, and libraries to enable developer inference deployments on NVIDIA GPUs.
Create products that help developers build and optimize high-performance inference deployments.
Develop comprehensive product strategies, roadmaps, and go-to-market plans for AI platform inference.
Collaborate with internal and external developers to build roadmaps for model optimization software.
Align with and drive company-wide product strategy in coordination with leadership.
Identify key improvements in the inference landscape through direct interaction with developers.
Drive the development of software for model optimization and performance profiling.

What we're looking for

Experience with Inference deployment and optimization software such as vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, or TorchAO.
Demonstrable knowledge of GenAI or machine learning concepts, particularly regarding performance optimization and software development.
BS or MS degree in Computer Science, Computer Engineering, or similar experience.
6+ years of technical product management or similar experience at a technology company.
Strong communication and interpersonal skills.
Experience leading optimization products for Inference (preferred).
Experience working on Open Source and Github-first developer products with deep customer interactions (preferred).
Knowledge of GPU architecture, HW/SW co-design, and performance profiling (preferred).

Save