Product Director, AI Infrastructure Platforms

JPMorgan Chase

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Palo Alto, CA
Posted
9 days ago
Freshness
Confirmed live today

Market check

Salary context

How this pay compares to similar roles

Similar $238k
$176k most similar roles pay here $298k

This listing doesn't post a salary. Most similar roles pay $206,625–$268,406.

Based on 240 similar postings.

Employer

About JPMorgan Chase

JPMorgan Chase & Co. is a global financial services firm and one of the largest banks in the world, offering investment banking, commercial banking, asset management, and consumer financial services.

JPMorgan Chase currently has 1151 open roles on FindRole.

Most-posted roles

View all roles at JPMorgan Chase

At a glance

TL;DR · Product Director, AI Infrastructure Platforms

As a Product Director - AI Infrastructure Platforms, you will lead the vision, strategy, and roadmap for the inferencing product area within an integrated suite of specialized AI infrastructure. You will manage the full product lifecycle to develop features for model training, inference, and experimentation across public cloud, on-premises, Neo Cloud, and edge environments. Your daily work involves overseeing product development, mentoring teams, conducting competitive analysis, and managing capital investments in compute, storage, networking, and orchestration layers. You will navigate complex multi-vendor ecosystems and regulatory demands to build an enterprise-scale AI Factory. Required expertise includes high-performance compute, GPU-accelerated infrastructure, and technologies such as Nvidia GPUs, InfiniBand, Spectrum-X, Arista, DDN, VAST Data, and Kubernetes. You must translate evolving hardware and workload patterns into actionable strategies while ensuring performance, cost efficiency, and scalability for high-value use cases.

What you'll do

  • Define and execute the vision, strategy, and roadmap for the AI inference product area.
  • Manage the full product lifecycle from initial planning and research to execution and risk management.
  • Drive platform adoption across various business lines to build an enterprise-scale AI Factory.
  • Maximize ROI on hardware investments across compute, storage, networking, and orchestration layers.
  • Analyze market trends and competitive signals to inform capital allocation and vendor strategies.
  • Prioritize product features and investment trade-offs while aligning with senior stakeholders.
  • Identify target market segments and align product capabilities to meet specific customer needs.
  • Lead, mentor, and develop a team of Product Managers and Senior Product Associates.

What we're looking for

  • 8+ years of experience or equivalent expertise delivering products, projects, or technology applications.
  • Extensive knowledge of the product development life cycle, technical design, and data analytics.
  • Extensive experience in high-performance compute, GPU-accelerated, data center, or AI infrastructure.
  • Deep knowledge of the AI infrastructure stack including compute, accelerators, networking, storage, and orchestration layers.
  • Financial acumen to build investment strategies, including TCO analysis, depreciation planning, ROI modeling, and multi-year capital planning.
  • Technical depth in AI hardware evaluation, distributed training, real-time inference, and regulatory considerations across hybrid environments.
  • Advanced degree in Computer Science or Engineering (MBA preferred) (preferred).
  • Background in technical product management within the AI infrastructure ecosystem or highly regulated industries (preferred).

More like this

Similar roles

Product Director, AI Infrastructure Platforms

JPMorgan Chase

Palo Alto, CA 9 days ago
AI Infrastructure GPU Kubernetes Nvidia GPUs InfiniBand Spectrum-X Arista DataDirect Networks VAST Data AWS Azure GCP CoreWeave Lambda Labs Fluidstack Runpod Baseten Together AI Fireworks Nebius Serverless GPU TCO Analysis
8+ yrs exp

AI/ML Platform Product Executive Director

JPMorgan Chase

New York, NY 76 days ago
Machine Learning MLOps Graph Intelligence Feature Stores CI/CD Sequence Modeling Data Analytics Risk Management Cybersecurity Representation Learning Model Governance
8+ yrs exp

Director, AI Product Management

Lam Research

Fremont, CA 45 days ago $168,000$350,000
AI MLOps Data Governance Responsible AI Product Management Roadmapping Digital Transformation KPIs OKRs Software Engineering
10+ yrs exp Hybrid