Senior Staff Software Engineer - AI Agent Platform

Nvidia

Actively hiring
Santa Clara, US Posted 24 days ago $200,000–$322,000 / year
View original post Log in to save

At a glance

AI generated

TL;DR

As a Sr. Engineer on NVIDIA’s AI agent ecosystem team, you will design and build the infrastructure that enables teams to develop, deploy, and operate autonomous AI agents at scale. Your daily tasks include architecting Kubernetes-based execution environments with pod lifecycle management and developing automated CI/CD pipelines using GitLab CI and ArgoCD. You will also create framework-agnostic infrastructure supporting multiple agent SDKs and build Kafka-based message pipelines for real-time event streaming. Additionally, you will develop data ingestion pipelines, manage multi-layer authentication systems, and partner with security teams on compliance issues. Ideal candidates have extensive experience in platform engineering, deep Kubernetes expertise, strong Python skills, and a proven track record of designing distributed systems using technologies like Kafka and Redis. Experience with AI agent platforms, RAG architectures, and full-stack development is also beneficial.

Skills

Kubernetes Python GitLab CI ArgoCD OAuth 2.0 JWT Vault CI/CD MongoDB PostgreSQL FastAPI Flask Kafka Redis Docker React Vue OpenTelemetry OTEL

What you'll do

  • Design and develop platform services overseeing the full lifecycle of AI agents.
  • Architect Kubernetes-based execution environments with advanced features like namespace isolation and identity propagation.
  • Create and maintain automated CI/CD pipelines using GitLab CI and ArgoCD for standardized agent deployment.
  • Build framework-agnostic infrastructure supporting multiple AI SDKs, ensuring observability and configurability.
  • Develop Kafka-based message pipelines and real-time event streaming systems using Redis PubSub and SSE.
  • Implement session management to ensure state persistence and conversation history across AI agent sessions.

What we're looking for

  • Bachelor's or Master's degree in Computer Science/Engineering with 12+ years of software engineering experience.
  • Deep expertise in Kubernetes for production-scale AI agent infrastructure.
  • Strong Python skills and API development experience using FastAPI or similar frameworks.
  • Proven track record designing distributed systems with Kafka, Redis, and MongoDB/PostgreSQL.
  • Expertise in building and managing CI/CD pipelines using GitLab CI and ArgoCD.
  • Solid grasp of OAuth 2.0, JWT validation, token exchange, and secrets management with Vault.
  • Experience leading complex technical projects and writing clear design documents.

Market check

Salary context

This $200,000–$322,000 range sits above 92% of similar postings on FindRole.

Peer median band

$170,000–$246,300

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$165,852–$246,150

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 801 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 797 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Senior Staff AI Platform Engineer

Nvidia

Us, Ca, Santa Clara, US 67 days ago $168,000–$270,250
Python Kubernetes C++ Go Rust MLOps Hugging Face Weights & Biases NVIDIA NIM Prometheus Grafana Docker CI/CD AWS Azure Google Cloud Platform PostgreSQL MySQL Redis Git GitHub Jenkins Terraform Ansible Knative OpenTelemetry FedRAMP SOC 2

Senior Software Engineer, AI Agents

Arm Holdings

San Jose, California, US 29 days ago $170,900–$231,200
Python C++ Linux APIs RAG GitHub Copilot Vector databases Benchmarking methodologies CI/CD MCP SDKs Arm architecture Developer tools Terraform Git Docker Kubernetes

Staff Software Engineer - AI Team

JLL (Jones Lang LaSalle)

Remote (Home Office - Illinois - Chicago Metro, US) 9 days ago $180,000–$220,000
Python Node .NET Terraform PostgreSQL MongoDB Rag Platform MCP Gateway Claude Agent SDK CI/CD AWS Azure GCP Kubernetes Docker Prometheus Grafana
Remote

Senior Staff Machine Learning Engineer, AI Agent Platform

GEICO

Remote (Ny Manhattan Office, US) 50 days ago $130,000–$300,000
Python Java Go C++ Kubernetes CI/CD MCP A2A LLM GPU Elasticsearch Qdrant Kafka PostgreSQL MongoDB Spark Ray Temporal Redis Neo4j Azure AWS LangGraph AutoGen CrewAI LangSmith Arize_Phoenix Langfuse RAG RBAC ABAC
Remote

Senior Software Engineer, Agentic AI

PayPal

Usa - California - San Jose - Corp - N First St, US 80 days ago $218,000–$323,950
Python TensorFlow Keras Scikit-learn Pandas NumPy AWS Azure Google Cloud Platform Docker Kubernetes CI/CD PostgreSQL MongoDB RESTful APIs Microservices MLOps

Senior Software Engineer, Agentic AI

Nvidia

Us, Wa, Redmond, US 31 days ago $152,000–$241,500
Python C++ Rust CUDA Nsight Compute Nsight Systems TRT-LLM SGLang vLLM Transformer Engine Docker Kubernetes CI/CD PostgreSQL Git GitHub NVIDIA GPUs Agentic AI Distributed Systems