Principal Product Manager, Foundational AI Research | Microsoft Careers

Microsoft

Actively hiring
San Francisco Bay area · New York City metropolitan area Posted 24 days ago $139,900$274,800 / year

At a glance

AI generated

TL;DR

As a Principal Product Manager, Foundational Research at Microsoft AI, you will join a team of leading experts in deep learning and large language models (LLMs) to advance cutting-edge research. Your day-to-day responsibilities include identifying and prioritizing issues related to pre-training and post-training data evaluations, creating novel data collection tasks for model evaluation, and collaborating closely with infrastructure, data engineering, and product feedback teams. You will work backward from customer needs to deliver robust solutions that empower developers and enterprise customers, requiring experience in building data pipelines and evaluating large-scale ML models alongside researchers and engineers. Ideal candidates possess a background in managing high-stakes projects, fostering innovation, and driving progress in complex environments, with a preference for those with advanced technical degrees and hands-on experience in AI research and infrastructure development.

Skills

Python Kubernetes Terraform AWS CI/CD Docker PostgreSQL Git Jenkins Prometheus Grafana Linux Scalability APIs Machine Learning Deep Learning Data Pipelines Evaluation Systems Infrastructure Development

What you'll do

  • Identify and prioritize issues in language, coding, and multimodal areas, working with researchers to resolve them.
  • Design innovative data collection tasks to evaluate models and gather training data for fine-tuning.
  • Develop model prototypes to validate new feature directions and scope projects accordingly.
  • Build and maintain robust data pipelines or evaluation systems for AI model development.
  • Work closely with infrastructure teams to ensure efficient training runs and post-training evaluations.

What we're looking for

  • At least 8 years of experience in product management or software development.
  • Direct collaboration with model researchers and ML engineers on training runs, data evaluation, infrastructure, coding, or safety.
  • Experience building and shipping data pipelines or evaluation systems personally.
  • Bachelor's Degree required; technical postgraduate degree preferred.
  • Ability to work backward from customer needs to deliver scalable solutions.
  • Proactive attitude and enthusiasm for exploring new methods in AI research.

Market check

Salary context

This $139,900–$274,800 range sits above 45% of similar postings on FindRole.

Peer median band

$168,000$262,400

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$188,712$246,150

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Microsoft

Microsoft Corporation is a global technology leader producing software, hardware, and cloud services including Windows, Office 365, Azure cloud platform, Xbox gaming, and Surface devices. Industry: Software & Cloud Computing

Microsoft currently has 451 open roles on FindRole.

Listed pay typically runs $119,800–$234,700 across 417 roles with salary data.

Most-posted roles

View all roles at Microsoft

More like this

Similar roles

Principal Product Manager - AI Security (CoreAI) | Microsoft Careers

Microsoft

US 63 days ago $139,900$274,800
Azure Microsoft Defender Entra Purview LLM Python Go Rust JavaScript Threat Modeling Secure System Architecture Attack Surface Analysis Prompt Injection Jailbreaks Sensitive Data Leakage Indirect Prompt Injection Adversarial Manipulation CI/CD Kubernetes Docker Prometheus Grafana

Principal Product Manager – AI Products

Nvidia

Us, Ca, Santa Clara, US 16 days ago $240,000$379,500
LLMs Generative models Distributed inference CI/CD Kubernetes AWS Python Go Terraform Docker Prometheus Grafana GitLab GitHub Slack JIRA Confluence MLOps PostgreSQL Snowflake Redis MongoDB

Principal Product Manager, AI Frameworks

Nvidia

Us, Ca, Santa Clara, US 123 days ago $240,000$379,500
Python PyTorch VeRL Tunix Nemo Framework Docker Kubernetes CI/CD GitHub PostgreSQL Prometheus Grafana AWS Azure Google Cloud Platform GitLab Jenkins Terraform OpenStack Linux CUDA C++

Principal Product Manager, AI Frameworks

Nvidia

Us, Ca, Santa Clara, US 140 days ago $240,000$379,500
PyTorch Distributed Systems GPU Architecture Performance Profiling CI/CD GitHub OpenSource Python PostgreSQL Kubernetes AWS NVIDIA GPUs VeRL Nemo Framework Terraform Prometheus Grafana