Senior Staff Software Engineer, Enterprise AI Platform

Nvidia

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Employment
Full-time
Posted
27 days ago
Freshness
Confirmed live today

Market check

Salary context

How this pay compares to similar roles

Similar $193k
$141k $245k
below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $151,000–$235,112.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1763 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1151 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Staff Software Engineer, Enterprise AI Platform

The Senior Staff Software Engineer - Enterprise AI Platform joins the team building a platform for long-running autonomous agents to operate safely within an enterprise environment. You will design and build the core constructs for these agents, including blueprints, tools, skills, plugins, and a runtime safety harness. Daily responsibilities involve developing policy engines with circuit breakers, brokering credentials for multi-agent systems, providing checkpoint recovery, and instrumenting observability across different harnesses. You will work with Python, Go, and Rust to build distributed systems, messaging, caching, and durable storage. The role solves the technical challenges of running continuous, self-improving agent fleets at scale, ensuring security, identity, and policy follow every hop while smoothing over differences between various execution models like Claude and Codex.

What does a Software Engineer earn in California?

Median $214500 from 1167 postings across 73 companies.

See salary data

What you'll do

  • Design agent blueprints with clean interfaces for authorization, sandboxing, memory, and observability.
  • Build a runtime safety harness featuring policy engines, rate limits, circuit breakers, and kill switches.
  • Develop multi-agent orchestration systems to support delegation, handoffs, and long-running autonomous tasks.
  • Broker credentials to enable secure authentication and least-privilege scoping for multi-agent systems.
  • Implement checkpoint and recovery mechanisms to ensure agents resume cleanly after crashes or restarts.
  • Instrument decision-level traces and cost anomaly alerts to monitor agent behavior and performance.
  • Create self-improving loops that turn production telemetry and evaluation signals into actionable insights.
  • Maintain the health and reliability of the production platform through an on-call rotation.

What we're looking for

  • BS or MS in Computer Science, Engineering, or a related field (or equivalent experience).
  • 12+ years of experience building distributed systems, infrastructure, or developer platforms at scale.
  • Hands-on experience building agents on a harness, exposing them as APIs, and shipping them with CI/CD.
  • Experience deploying and operating long-running services on container orchestration platforms.
  • Experience with scalable system building blocks including messaging, caching, and durable storage.
  • Proficiency in Python, Go, Rust, or similar languages.
  • Built a safety or policy engine that enforces rules on agent actions at runtime (preferred).
  • Designed evaluation and feedback loops for agent behavior tied to versioned skills or blueprints (preferred).

More like this

Similar roles

Senior Staff Software Engineer, AI Agent Platform

Nvidia

Santa Clara, CA 4 days ago $200,000–$322,000
Kubernetes Python Kafka Redis GitLab CI ArgoCD FastAPI Flask MongoDB PostgreSQL Vault OAuth 2.0 JWT LangChain LangGraph Milvus Pinecone Weaviate React Vue CI/CD Distributed Systems RAG OTEL
10+ yrs exp

Lead Principal Engineer, Enterprise Agentic AI Platform

Nvidia

Santa Clara, CA 4 days ago $272,000–$431,250
Python Go Kubernetes LangChain LangGraph Agentic AI RAG GPU Inference CI/CD APIs SDKs Vector Databases Telemetry Observability Distributed Systems Benchmarking Sandbox Isolation
10+ yrs exp

Senior Staff Software Engineer, AI Platform

Pinterest

Remote (Palo Alto, CA) 4 days ago $208,592–$429,454
Python GenAI Distributed Systems RecSys AutoEvals OpenEvals Ragas Model Versioning Orchestration Observability Release Management Production Monitoring Benchmark Design Failure Analysis
5+ yrs exp Remote

Senior Software Engineer, Enterprise AI

Instacart

Remote 3 days ago $199,000–$210,000
Python Java Go C++ Large Language Models Retrieval-Augmented Generation Distributed Systems Cloud Infrastructure APIs Model Serving Production Observability Machine Learning Automated Testing Software Development Lifecycle Data Platforms
5+ yrs exp Remote

Senior Software Engineer, Enterprise AI

Instacart

Remote (Ontario, Canada) +3 3 days ago $168,000–$177,500
Python Java Go C++ Large Language Models Retrieval-Augmented Generation Distributed Systems Cloud Infrastructure APIs Model Serving Production Observability Machine Learning Software Development Lifecycle Automated Testing
5+ yrs exp Remote