Senior Staff Software Engineer, Agentic IT Operations

Nvidia

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$200,000–$322,000 / yr
Employment
Full-time
Posted
5 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $176k
This role $261k
$96k $346k
below market most similar roles pay here above market

This role pays more than 95% of similar roles. Most pay $149,500–$203,225 — the blue band above. At the midpoint, this role pays about $261k versus about $176k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1763 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1151 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Staff Software Engineer, Agentic IT Operations

The Senior Staff Software Engineer - Agentic IT Operations joins the team to define the technical strategy for autonomous AI-driven enterprise operations. In this senior individual contributor role, you will architect and build production agentic systems using LLM-based agents, tool calling, RAG, and orchestration frameworks to automate complex workflows like endpoint services and IT support. You will own the reference architecture for agent runtimes, memory management, and safety guardrails while managing integrations across ServiceNow, ERP, and procurement systems. Key technical requirements include proficiency in Python or Go, infrastructure-as-code, Kubernetes, and cloud platforms like AWS, GCP, or Azure. You will solve the business problem of transforming manual, reactive IT workflows into scalable, autonomous platforms by establishing engineering standards for prompt versioning, evaluation harnesses, and data-governance patterns.

What does a Software Engineer earn in California?

Median $214500 from 1167 postings across 73 companies.

See salary data

What you'll do

  • Define the technical strategy and reference architecture for agentic AI across enterprise IT systems.
  • Architect and build production agentic systems using LLM-based agents, RAG, and orchestration frameworks.
  • Design autonomous agents to execute multi-step enterprise workflows with human-in-the-loop controls and safety guardrails.
  • Own the architecture of the integration and automation platform spanning ServiceNow, ERP, and procurement systems.
  • Establish engineering standards for building, testing, evaluating, and operating agentic systems.
  • Drive technical alignment and resolve contested architectural decisions across organizational boundaries without formal authority.
  • Mentor and grow senior and staff engineers through design partnership, code review, and technical coaching.

What we're looking for

  • Bachelor’s or Master’s degree in a related field, or equivalent experience.
  • 12+ years of hands-on software engineering experience building and operating production systems at scale.
  • Deep expertise in at least one of: Infrastructure, SRE, DevOps, Platform, or Production Engineering.
  • Proven experience taking agentic AI or LLM-based systems to production, including RAG, tool calling, and human-in-the-loop safeguards.
  • Production-grade proficiency with infrastructure-as-code, CI/CD, Kubernetes, and cloud platforms (AWS, GCP, or Azure).
  • Fluent in Python, Go, or equivalent languages to architect, write, and review production-quality code.
  • Experience with monitoring and observability tools such as Prometheus, Grafana, Datadog, or PagerDuty.
  • Experience defining an agentic AI or automation platform strategy for a large enterprise (preferred).

More like this

Similar roles

Senior Staff Software Engineer, Agentic Workflows

Nvidia

Santa Clara, CA 21 days ago
Python Go LLM Agentic Workflows APIs CI/CD Distributed Systems Model Context Protocol Artifactory Hugging Face Jira ServiceNow Event-driven Systems Production Debugging Testing Observability Model Registries CDN
10+ yrs exp

Senior Software Engineer, Agentic AI Tools

F5 Inc

San Jose, CA +1 64 days ago
Python TypeScript Go LangChain LangGraph CrewAI LlamaIndex RAG MLflow Kubeflow BentoML OpenAI Anthropic Gemini NVIDIA BeautifulSoup Scrapy NGINX BIG-IP APIs Web Scraping MLOps Vector Databases Prompt Engineering
8+ yrs exp Hybrid

Senior Software Engineer, Agentic AI

Nvidia

Remote (Santa Clara, CA) +2 33 days ago
Python Rust Go Node.js LLM RAG Vector Databases PyO3 Tokio serde OpenTelemetry Asynchronous Programming API Design Serialization Middleware
Remote