Product Manager, AI Infrastructure

Arm Holdings

Hybrid

Quick summary

Work type: Hybrid
Location: San Jose, California
Salary: $211,600–$286,200 / yr
Posted: 46 days ago
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $210k

This role $249k

$154k most similar roles pay here $300k

This role pays more than 81% of similar roles. Most pay $174,456–$245,325 — the shaded band above. At the midpoint, this role pays about $249k versus about $210k for comparable roles.

Based on 240 similar postings.

Employer

About Arm Holdings

Arm Holdings plc is a leading British semiconductor and software design firm, established in 1990 and recognized for developing energy-efficient processor architectures that power nearly all smartphones and a vast range of IoT and computing devices.

Arm Holdings currently has 32 open roles on FindRole.

Listed pay typically runs $194,600–$263,250 across 32 roles with salary data.

Most-posted roles

View all roles at Arm Holdings

At a glance

TL;DR · Product Manager, AI Infrastructure

Apply Now Log in to save

Join Arm’s Cloud AI team as a Senior Product Manager responsible for driving the product direction of next-generation AI compute platforms. You will lead competitive and performance analysis to inform engineering priorities, ensuring that customer workloads are optimized across hardware, software, and services. Your role involves translating technical insights into actionable strategies, fostering alignment among cross-functional teams to enhance system performance and competitiveness. Ideal candidates possess a strong background in datacenter AI workloads and experience with ML accelerators, along with hands-on expertise in building or running large-scale GenAI workloads. Proficiency in systems thinking and the ability to navigate ambiguous challenges are crucial, as is a deep understanding of complex compute systems. This role offers the opportunity to shape cutting-edge products that will define the future of AI infrastructure.

Skills

AI ML Datacenter Cloud Product Management Systems Thinking Competitive Analysis GenAI ML Accelerators Hardware Software Infrastructure Performance Analysis System Layers End-to-End System Behavior Problem Solving Technical Analysis Customer Workloads Product Roadmap Engineering Priorities

What you'll do

Own competitive and performance analysis for AI compute platforms.
Identify workload-driven performance gaps and set product priorities.
Inform roadmap decisions with data-driven insights across system layers.
Drive alignment on system improvements and competitiveness among teams.
Translate technical analysis into actionable directions for engineering partners.

What we're looking for

6+ years of product management or related technical leadership experience
Strong understanding of datacenter AI workloads and infrastructure
Experience analyzing performance of complex compute systems (hardware & software)
Ability to drive multi-functional problems and make product tradeoffs
Hands-on experience with ML accelerators and large-scale GenAI workloads
Expertise in competitive analysis across AI compute platforms and customer workloads

Similar roles

Principal Product Manager, AI

Okta Inc

San Francisco, CA 36 days ago $210,000–$263,000

AI ML LLMs RAG Agentic system design CI/CD Python PostgreSQL Kubernetes AWS Terraform Docker Prometheus Grafana GitLab GitHub MLOps

Save

Senior Product Manager, AI Platform and Developer Productivity

Nvidia

Remote (Santa Clara, CA) +1 12 days ago $208,000–$327,750

AI/ML Distributed Training Inference Optimization GPU-Accelerated Computing Large-Scale Systems Performance Observability Telemetry Profiling CI/CD SDLC Developer Workflows APIs Kubernetes AWS Azure GCP PostgreSQL MongoDB Python Go JavaScript React Node.js Git Jenkins Prometheus Grafana

Remote

Save

Principal Product Manager, AI Frameworks

Nvidia

Santa Clara, CA 135 days ago $240,000–$379,500

Python PyTorch VeRL Tunix Nemo Framework Docker Kubernetes CI/CD GitHub PostgreSQL Prometheus Grafana AWS Azure Google Cloud Platform GitLab Jenkins Terraform OpenStack Linux CUDA C++

Save

Principal Product Manager, AI Frameworks

Nvidia

Santa Clara, CA 152 days ago $240,000–$379,500

PyTorch Distributed Systems GPU Architecture Performance Profiling CI/CD GitHub OpenSource Python PostgreSQL Kubernetes AWS NVIDIA GPUs VeRL Nemo Framework Terraform Prometheus Grafana

Save

Senior Applied AI Product Manager

Adobe

San Jose +1 9 days ago $165,600–$239,725

SQL LLM Agentic architectures API design Figma FigJam Miro Jira Confluence Git CI/CD Python PostgreSQL AWS Kubernetes

Save

Senior Product Manager, AI Frameworks

Nvidia

Santa Clara, CA 59 days ago $168,000–$258,750

Python C++ CUDA TensorFlow PyTorch FSDP GitHub Docker Kubernetes CI/CD Prometheus Grafana PostgreSQL AWS Azure GitLab OpenStack NVIDIA_GPU_Architecture HW/SW_Co_Design Performance_Profiling

Save