Senior Product Manager, Switchyard

Nvidia

Confirmed live 2 days ago High trust
Remote

Quick summary

Work type
Remote
Location
Santa Clara, CA
Salary
$168,000–$258,750 / yr
Employment
Full-time
Posted
7 days ago
Freshness
Confirmed live 2 days ago

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $201k
This role $213k
$154k most similar roles pay here $270k

This role pays more than 63% of similar roles. Most pay $177,250–$224,500 — the shaded band above. At the midpoint, this role pays about $213k versus about $201k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1403 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1051 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Product Manager, Switchyard

As a Senior Product Manager, Switchyard, you will lead the development of an adaptive inference runtime designed for systems of models. You will drive the product strategy and roadmap by setting priorities, quality bars, and clear outcomes in collaboration with Engineering teams. Your daily work involves translating research advancements in cost and quality prediction into usable features while defining developer experiences and product interfaces. You will manage partner integrations, build adoption motions with marketing and solution teams, and create deployment playbooks for model routing. The role requires technical proficiency in LLM inference, model routing, agent runtimes, and developer APIs to solve challenges regarding task-level quality, cost, latency, and policy compliance. You must be able to navigate complex trade-offs while managing open-source tools and infrastructure products intended for developers and AI practitioners.

What does a Product Manager earn in California?

Median $222000 from 280 postings across 53 companies.

See salary data

What you'll do

  • Drive the product strategy and roadmap for the Switchyard adaptive inference runtime.
  • Translate research advancements in cost prediction and optimization into usable products and features.
  • Define developer experiences and product interfaces for adaptive inference systems.
  • Manage partner integrations with agent harness builders, inference gateways, and model serving systems.
  • Improve reliability, usability, documentation, and SDK coverage in collaboration with Engineering.
  • Develop the adoption motion by identifying qualified workloads and building repeatable deployment playbooks.
  • Establish messaging and narratives for model routing and adaptive inference with marketing teams.
  • Define and inspect evidence for success using benchmarks, evals, and explicit criteria.

What we're looking for

  • Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or a related field, or equivalent experience.
  • 8+ years of product management or closely related experience building technical products for developers, infrastructure teams, or AI practitioners.
  • Proven track record of scaling developer or infrastructure products through partnership motions and integrations.
  • Technical proficiency in LLM inference, model routing, agent runtimes, and developer APIs.
  • Ability to engage mature customers and partners independently to uncover production constraints and guide GTM teams.
  • Evidence-driven product approach grounded in benchmarks, evals, and explicit success criteria.
  • Experience with LLM routers, AI gateways, model serving, distributed inference, or systems that dynamically allocate test-time compute (preferred).
  • Experience taking research from prototype to a reliable developer product or working with open-source communities and SDKs (preferred).

More like this

Similar roles

Senior Product Manager

Microsoft

104 days ago $119,800–$234,700
Azure Key Vault PKI Cryptography SecretsManagement Managed Identity Identity Cloud Security HSM Vault Technologies SPIFFE FedRAMP SOC 2 Common Criteria EU CRA SFI Telemetry zero-trust architecture
5+ yrs exp

Senior Product Manager

Warner Bros. Discovery

Atlanta, GA 88 days ago
Connected TV Roku Fire TV Android TV Streaming Video JIRA Confluence Excel PowerPoint Analytics Platforms User Stories QA AI
5+ yrs exp Hybrid

Senior Product Manager

Microsoft

56 days ago $119,800–$234,700
Azure Cloud Infrastructure Server Architecture Microprocessors Memory Storage Networking Accelerators AI (training Product Management Strategic Planning Phase Gate Process Hardware Engineering
5+ yrs exp

Senior Product Manager

Adobe

San Jose, CA 56 days ago
LLM RAG Agentic Orchestration Prompting Fine-tuning LLMOps Responsible AI Adobe Experience Platform AEM Target
5+ yrs exp

Senior Product Manager

Veeva Systems

Remote (Boston, MA) 175 days ago $100,000–$200,000
LLMs Generative AI Python LangChain LlamaIndex RAG Prompt Engineering APIs Machine Learning Data Engineering Veeva Vault Product Management Process Automation
5+ yrs exp Remote

Senior Product Manager

Microsoft

Redmond, WA 49 days ago $119,800–$234,700
LLM AI Application Security Threat Modeling Telemetry Infrastructure
5+ yrs exp