Product Manager, BioNeMo Inference

Nvidia

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$148,000–$224,250 / yr
Employment
Full-time
Posted
53 days ago
Freshness
Confirmed live today

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $210k
This role $186k
$137k $254k
below market most similar roles pay here above market

This role pays less than 65% of similar roles. Most pay $177,250–$242,400 — the blue band above. At the midpoint, this role pays about $186k versus about $210k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Product Manager, BioNeMo Inference

Product Manager - BioNeMo Inference will lead the BioNeMo Inference team to define how developers and researchers deploy, operate, and scale biomolecular AI inference workloads. The role involves defining the product vision, strategy, and roadmap for inference products built on NVIDIA NIM and accelerated computing. Key responsibilities include defining requirements for performance optimization such as batching, throughput, latency, GPU utilization, and multi-node scaling. The position requires developing the developer experience across APIs, SDKs, containers, Helm charts, and reference architectures. Candidates must possess technical expertise in AI/ML inference systems, model serving, and cloud-native infrastructure including Docker, Kubernetes, and CI/CD. This role solves the technical challenge of translating biomolecular model capabilities into production-ready inference experiences across cloud and enterprise environments.

What does a Product Manager earn in California?

Median $222500 from 327 postings across 57 companies.

See salary data

What you'll do

  • Define the product vision, strategy, and roadmap for BioNeMo inference products and NIM-based deployments.
  • Translate model capabilities into production-ready inference experiences by working with engineering and research teams.
  • Define technical requirements for batching, throughput, latency, GPU utilization, and multi-node scaling.
  • Ensure BioNeMo inference products deploy cleanly across cloud and enterprise Kubernetes-based environments.
  • Develop the developer experience across APIs, SDKs, containers, Helm charts, and technical documentation.
  • Engage with early customers to validate product direction and turn feedback into prioritized requirements.
  • Establish and monitor product metrics for adoption, usability, performance, and operational quality.
  • Drive cross-functional product launches in coordination with marketing, sales, and developer relations.

What we're looking for

  • 5+ years of industry experience, including 3+ years in software engineering or a deeply technical role and 2+ years in product management.
  • Master’s degree or equivalent experience in Electrical, Mechanical, Materials, or other related fields.
  • Demonstrated experience defining and shipping technical products, platforms, APIs, SDKs, developer tools, or cloud services.
  • Strong understanding of AI/ML inference systems and deployment tradeoffs, including model serving, GPU infrastructure, batching, throughput, latency, scaling, and cost-performance optimization.
  • Familiarity with containers and cloud-native infrastructure, including Docker, Kubernetes, Helm, CI/CD, and public-cloud deployment concepts.
  • Strong customer discovery, product requirement definition, prioritization, and roadmap-management skills.
  • Excellent written and verbal communication skills for both technical and non-technical audiences.
  • Experience launching and scaling AI inference, model-serving, MLOps, or GPU-accelerated infrastructure products (preferred).

More like this

Similar roles

Senior Product Manager, Inference Platform

Nvidia

Santa Clara, CA 29 days ago $208,000–$327,750
TensorRT-LLM vLLM Triton Inference Server MLOps AI/ML Systems Inference Serving Cloud Infrastructure KV Cache Management Speculative Decoding Continuous Batching Capacity Planning Resource Scheduling Model Serving Architecture
10+ yrs exp Hybrid

Senior Product Manager, AI Platform Inference

Nvidia

Santa Clara, CA 83 days ago $168,000–$258,750
Generative AI Inference vLLM SGLang FlashInfer TensorRT-LLM Triton Dynamo TorchAO GPU Architecture Performance Profiling HW/SW Co-design Machine Learning Software Development SDKs Libraries GitHub
6+ yrs exp

Senior Product Manager, AI Inference Performance

Nvidia

Santa Clara, CA 5 days ago $208,000–$327,750
AI Inference TensorRT-LLM vLLM SGLang NVIDIA Dynamo Triton Inference Server Quantization KV Caching Speculative Decoding LLM Capacity Planning Autoscaling SLA Management Benchmarking
10+ yrs exp

Senior Product Manager, AI Inference Software

Amd

Remote (San Francisco, CA) +1 118 days ago $205,680–$308,520
AI Inference ROCm vLLM SGLang AMD ATOM llm-d GPU Computing Distributed Systems High-Performance Computing Cloud Infrastructure Memory Management open-source Technical Writing Kernel Runtime Orchestration
Remote

Staff Product Manager

Robinhood

Menlo Park, CA +1 39 days ago $221,000–$260,000
Product Strategy Live Sports Data User Research Compliance Merchandising
Hybrid