Senior Manager, Engineering - Enterprise AI and Automation

Nvidia

Actively hiring
Us, Ca, Santa Clara, US Posted 94 days ago $272,000$431,250 / year

At a glance

AI generated

TL;DR

As a Senior Engineering Manager for Agentic Systems & Platform Architecture at NVIDIA, you will lead the strategic development of a scalable platform that accelerates the creation and deployment of autonomous agents. Your role involves tracking evolving agent architectures across the company and external ecosystems, identifying gaps, and translating insights into actionable strategies to enhance developer productivity and agent quality. You will architect high-performance data pipelines, integrate GPU-optimized workflows, and establish robust governance policies for compliance and Responsible AI. Additionally, you will lead a multi-functional team in building a centralized safety toolkit and scaling platform adoption. This role requires extensive experience with LLM/agent architectures, hands-on expertise in evaluating and integrating open-source tools, and a proven track record of turning POCs into production-ready solutions with measurable business impact.

Skills

LLM Agent Architectures Open Source Libraries APIs SDKs Evaluation Systems Metric Regression Feedback Loops OSS Integration Enterprise Governance Agent Safety Toolkit Vector Databases RAG Systems GPU-Optimized Workflows CI/CD Python PostgreSQL Kubernetes Docker

What you'll do

  • Track evolving agent development patterns across NVIDIA and external ecosystems.
  • Identify gaps in current agent architectures and develop a platform strategy to enhance developer productivity.
  • Assess open-source tools for integration, making informed build-vs-use decisions.
  • Architect high-performance data pipelines and GPU-optimized workflows for autonomous agents.
  • Lead the integration of AI Data Platform into NVIDIA’s on-prem AI Factory for optimized performance.
  • Establish robust governance policies for agent development, ensuring compliance with Responsible AI frameworks.

What we're looking for

  • 10+ years of software engineering experience, including 4+ years in team management.
  • Deep expertise in agent architectures and LLMs, leading POCs and integrating into business use cases.
  • Proven ability to develop clear platform strategies from ambiguous problem spaces.
  • Experience building multi-team developer platforms with APIs/SDKs and reusable components.
  • Strong track record of implementing enterprise-grade governance for agent systems.
  • Demonstrated success in scaling agent platforms used by multiple teams, from POC to production.
  • Expertise in evaluating and benchmarking agent workflows at scale.

Market check

Salary context

This $272,000–$431,250 range sits above 98% of similar postings on FindRole.

Peer median band

$178,637$262,400

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$185,500$247,875

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 802 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 798 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Senior Engineering Manager, AI

Cisco

Remote (Usa-Seattle, US) 9 days ago $228,400$289,200
Python Java Kubernetes Docker CI/CD Terraform AWS Azure Git GitHub Jenkins PostgreSQL MongoDB TensorFlow PyTorch MLflow Prometheus Grafana
Remote

Senior Manager- Software Development Engineering-AI

CVS Health

Remote (Work At Home-Texas, US) 15 days ago $106,605$284,280
AWS GCP Azure MLOps LLM platforms Agile SAFe CI/CD DORA metrics OAuth SSO SAML Prometheus PostgreSQL Kubernetes Terraform
Remote

Senior Manager, AI, and Data Engineering

Pfizer

Usa - Ny - Headquarters, US 13 days ago $139,100$231,900
Python Java Scala R SQL Spark TensorFlow Kubernetes Docker AWS Azure Google Cloud Platform CI/CD Git Jupyter Notebook PostgreSQL MongoDB Snowflake Hadoop Airflow