Senior Staff Software Engineer, AI Agent Platform

Nvidia

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$200,000–$322,000 / yr
Employment
Full-time
Posted
11 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $191k
This role $261k
$117k $344k
below market most similar roles pay here above market

This role pays more than 88% of similar roles. Most pay $151,000–$231,925 — the blue band above. At the midpoint, this role pays about $261k versus about $191k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1623 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1110 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Staff Software Engineer, AI Agent Platform

As a Senior Staff Software Engineer - AI Agent Platform, you will join the team responsible for designing and scaling the infrastructure powering the AI agent ecosystem. You will build foundational services to manage the full agent lifecycle, including registration, deployment, and execution. Key responsibilities include architecting multi-tenant Kubernetes environments with pod lifecycle management, developing automated CI/CD pipelines using GitLab CI and ArgoCD, and building framework-agnostic infrastructure for agent SDKs. You will utilize Python, FastAPI, Kafka, Redis, and MongoDB or PostgreSQL to develop data ingestion pipelines and session management. The role requires expertise in OAuth 2.0, JWT, and Vault for security. You will solve complex problems regarding distributed systems, multi-cluster management, and RAG architectures to enable production-scale autonomous AI agent operations.

What does a Software Engineer earn in California?

Median $214500 from 1193 postings across 76 companies.

See salary data

What you'll do

  • Build platform services to manage the full agent lifecycle from registration through deployment and execution.
  • Architect multi-tenant Kubernetes environments with pod lifecycle management, namespace isolation, and persistent storage.
  • Develop and maintain automated CI/CD pipelines using GitLab CI and ArgoCD with reusable templates.
  • Build framework-agnostic infrastructure supporting multiple agent SDKs, memory services, and OTEL instrumentation.
  • Operate Kafka-based message pipelines and real-time event streaming using Redis PubSub and SSE.
  • Develop data ingestion pipelines and storage layers to power AI agent knowledge and context.
  • Implement session management for state persistence, conversation history, and agent recovery.
  • Develop multi-layer authentication using OAuth 2.0, JWT, and Vault for secrets management.

What we're looking for

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field, or equivalent experience.
  • 12+ years of experience in software engineering, ideally in platform engineering, infrastructure, or developer tools.
  • Experience building and scaling AI agents in production using frameworks like Claude Code, Codex, or LangGraph.
  • Deep Kubernetes expertise including pod orchestration, persistent storage, RBAC, and multi-cluster management.
  • Strong Python skills with production API experience using FastAPI, Flask, or similar async frameworks.
  • Proven track record designing distributed systems with Kafka, Redis, and MongoDB or PostgreSQL.
  • Expertise building and managing robust CI/CD pipelines using GitLab CI and ArgoCD for continuous delivery to Kubernetes.
  • Experience building or operating AI agent platforms, agentic workflow systems, or RAG architectures (preferred).

More like this

Similar roles

Senior Staff Software Engineer, Enterprise AI Platform

Nvidia

Santa Clara, CA 20 days ago $224,000–$356,500
Python Go Rust Distributed Systems CI/CD Container Orchestration Messaging Caching Durable Storage Vector Stores Secrets Management Authentication Authorization Observability Telemetry
10+ yrs exp

Senior Software Engineer, AI Agent Compute

Nvidia

Remote (CA) +1 13 days ago
Go TypeScript Temporal PostgreSQL MongoDB Distributed Systems VM Lifecycle Management Identity and Access Management Network Security Container Security Zero-Trust Observability Data Modeling
8+ yrs exp Remote

Senior Software Engineer, AI Agent Compute

Nvidia

Remote (CA) +1 46 days ago
Go TypeScript Temporal PostgreSQL MongoDB Distributed Systems VM Identity and Access Management Network Security Container Security Zero-Trust Observability Data Modeling
8+ yrs exp Remote

Senior Software Engineer, AI Agent Platform

GEICO

Palo Alto, CA +3 27 days ago $105,000–$230,000
Python Java Go Distributed Systems GenAI RAG Kubernetes CI/CD Kafka AWS Azure OpenSearch Prometheus Grafana OpenTelemetry LangGraph Langfuse LangSmith Braintrust Arize Phoenix MCP SRE
5+ yrs exp

Senior Software Engineer, AI Agent Platform

GEICO

Palo Alto, CA +3 27 days ago $105,000–$230,000
Python Java Go Kubernetes AWS Azure CI/CD RAG GenAI Kafka OpenSearch Prometheus Grafana OpenTelemetry LangGraph Temporal Restate Datadog Langfuse LangSmith Braintrust Arize Phoenix Distributed Systems API Design SRE
5+ yrs exp