Senior Software Engineer, Agentic AI

Nvidia

Confirmed live today High trust
Remote

Quick summary

Work type
Remote
Location
Santa Clara, CAAustin, TXDurham, NC
Salary
$184,000–$287,500 / yr
Employment
Full-time
Posted
2 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $196k
This role $236k
$132k most similar roles pay here $304k

This role pays more than 79% of similar roles. Most pay $157,200–$235,750 — the shaded band above. At the midpoint, this role pays about $236k versus about $196k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 1391 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 1116 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Software Engineer, Agentic AI

As a Senior Software Engineer, Agentic AI, you will join the team to develop core libraries for agentic applications and build foundational technology that powers next-generation autonomous systems. Your daily responsibilities include developing open-source libraries and tools to optimize agent harnesses and frameworks, benchmarking agents to identify performance bottlenecks, and collaborating with teams building high-performance data pipelines, RAG systems, vector databases, and GPU-optimized training workflows. You will utilize Rust, Python, Go, or Node.js while applying expertise in asynchronous programming, LLM applications, tool calls, and model-provider APIs. The role focuses on the technical challenge of creating scalable agentic capabilities, reusable building blocks, and high-quality libraries to improve developer productivity and ensure stable deployment of autonomous systems. You will also manage cross-language APIs and address friction in current architectures through evaluation, benchmarking, and feedback loops.

What does a Software Engineer earn in California?

Median $214000 from 925 postings across 71 companies.

See salary data

What you'll do

  • Develop open-source libraries and tools to optimize agent harnesses and frameworks for performance and stability.
  • Track and analyze evolving agent development patterns across research and commercial products.
  • Benchmark latest agents to identify bottlenecks and develop solutions to reduce cost and latency.
  • Collaborate with teams building RAG systems, vector databases, and GPU-optimized training workflows.
  • Identify architectural gaps and translate insights into tools that improve developer velocity and agent quality.
  • Design and extend cross-language APIs while ensuring consistency, usability, and backward compatibility.
  • Perform systems-level debugging to trace execution from high-level API calls through runtime internals.

What we're looking for

  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Applied Math, or a related field, or equivalent experience.
  • 8+ years of experience in at least one of Rust, Python, Go, or Node.js, with working familiarity in at least one more.
  • Solid understanding of asynchronous programming, callbacks, request lifecycles, and event-driven systems.
  • Hands-on experience with evolving agent architectures, multiple agents frameworks, and agent harnesses.
  • Proficiency in LLM applications, agent workflows, tool calls, and model-provider APIs.
  • Ability to design or extend cross-language APIs with attention to consistency, usability, stability, and backwards compatibility.
  • Systems-level debugging and performance intuition to trace execution from high-level API calls through runtime internals and optimize hot paths.
  • Strong interpersonal skills for effective collaboration with the open source community.
  • Experience building evaluation/benchmarking systems for agent workflows (preferred).
  • Rust systems work, especially async Rust, Tokio, serde, API design, or Python native extension experience (preferred).
  • Knowledge of OpenTelemetry, tracing, structured events, exporters, or observability pipelines (preferred).
  • Experience with middleware, plugin systems, guardrails, policy engines, or maintaining open-source libraries and SDKs (preferred).

More like this

Similar roles

Senior Software Engineer, Agentic Engineering

Nvidia

Remote (CA) 21 days ago
Python LangChain LangGraph LLM Multi-agent orchestration Compiler infrastructure GPUs Kernel programming Domain-specific languages Code generation High-dimensional optimization Program transformation Deep learning workloads
6+ yrs exp Remote

Senior Systems Engineer, Agentic AI

Nvidia

Austin, TX +1 23 days ago
LLMs Agentic AI Python C++ Go Rust Kubernetes Distributed Systems HPC ETL Model Serving Inference Optimization Workflow Orchestration Software Architecture
10+ yrs exp

Senior Software Engineer, Agentic Systems

Adobe

San Jose, CA 16 days ago
Python PyTorch TensorFlow Kubernetes AWS Docker RAG LLM Transformers Diffusion Models NVIDIA Triton TorchServe ONNX CUDA ml-ops dev-ops Distributed Systems Semantic Retrieval
5+ yrs exp

Senior Software Engineer, Agentic AI Tools

F5 Inc

Remote (San Jose, CA) 33 days ago
Python TypeScript Go LangChain LangGraph CrewAI LlamaIndex RAG Prompt Engineering MLflow Kubeflow BentoML BeautifulSoup Scrapy NGINX API Vector Databases Cybersecurity
8+ yrs exp Remote Hybrid

Senior Agentic AI Full Stack Software Engineer

General Dynamics

Arlington, VA 95 days ago $157,250–$212,750
Python Streamlit React FastAPI Docker Kubernetes PostgreSQL MySQL Git CI/CD RAG LLM RESTful APIs MLOps AI Ops Web Applications
10+ yrs exp