Senior Software Engineer, Agentic AI

Nvidia

Remote Actively hiring
Remote, USA · Santa Clara, CA · Austin, TX · Remote, NC Posted 23 days ago $184,000$287,500 / year

At a glance

AI generated

TL;DR

Join NVIDIA as a Software Engineer to develop core libraries for agentic applications, working on foundational technology that powers autonomous systems. You will track evolving agent development patterns and maintain knowledge of research and commercial products, developing open-source libraries and tools to optimize performance and stability. Your day-to-day involves benchmarking agents to identify bottlenecks, collaborating with teams building high-performance data pipelines and GPU-optimized workflows, and identifying gaps in current architectures to enhance developer productivity and agent quality. Required skills include experience in Rust, Python, Go, or Node.js, asynchronous programming, LLM applications, and systems-level debugging. Additional expertise in evaluation/benchmarking systems, Rust async work, and observability pipelines is beneficial.

Skills

Python Rust Go Node.js LLM applications agent workflows OpenTelemetry tracing structured events exporters observability pipelines async Rust Tokio serde PyO3 maturin API design runtime state management profiling optimizing runtime/library overhead middleware pipelines

What you'll do

  • Track evolving agent development patterns to maintain up-to-date knowledge of research and commercial products.
  • Develop high-performance open-source libraries and tools for agentic applications to ensure top-tier quality and stability.
  • Benchmark agents to identify performance bottlenecks and devise solutions to enhance efficiency and reduce costs.
  • Collaborate with teams on data pipelines, RAG systems, vector databases, and GPU-optimized workflows to deliver superior agentic apps.
  • Identify gaps in agent architectures and create tools that boost developer productivity and improve agent quality through evaluations.

What we're looking for

  • 8+ years experience in Rust, Python, Go, or Node.js with familiarity in at least one more
  • Solid understanding of asynchronous programming and event-driven systems
  • Hands-on experience with agent architectures, frameworks, and harnesses
  • Proficiency in LLM applications, workflows, tool calls, and model-provider APIs
  • Ability to design cross-language APIs focusing on consistency and usability
  • Expertise in systems-level debugging and performance optimization
  • Experience building evaluation/benchmarking systems for agent workflows

Market check

Salary context

This $184,000–$287,500 range sits above 69% of similar postings on FindRole.

Peer median band

$172,100$245,300

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$162,000$246,150

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 801 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 797 roles with salary data.

Most-posted roles

View all roles at Nvidia

More like this

Similar roles

Senior Software Engineer, Agentic AI

Nvidia

Us, Wa, Redmond, US 31 days ago $152,000$241,500
Python C++ Rust CUDA Nsight Compute Nsight Systems TRT-LLM SGLang vLLM Transformer Engine Docker Kubernetes CI/CD PostgreSQL Git GitHub NVIDIA GPUs Agentic AI Distributed Systems

Senior Staff Software Engineer - AI Agent Platform

Nvidia

Us, Ca, Santa Clara, US 24 days ago $200,000$322,000
Kubernetes Python GitLab CI ArgoCD OAuth 2.0 JWT Vault CI/CD MongoDB PostgreSQL FastAPI Flask Kafka Redis Docker React Vue OpenTelemetry OTEL

Senior Software Engineer, Agentic AI

PayPal

Usa - California - San Jose - Corp - N First St, US 80 days ago $218,000$323,950
Python TensorFlow Keras Scikit-learn Pandas NumPy AWS Azure Google Cloud Platform Docker Kubernetes CI/CD PostgreSQL MongoDB RESTful APIs Microservices MLOps

Senior Software Engineer, AI Agents

Arm Holdings

San Jose, California, US 29 days ago $170,900$231,200
Python C++ Linux APIs RAG GitHub Copilot Vector databases Benchmarking methodologies CI/CD MCP SDKs Arm architecture Developer tools Terraform Git Docker Kubernetes

Sr Software Engineer, Agentic AI

T-Mobile

US 22 days ago $113,600$205,000
Python Java C++ Kubernetes Docker LLMs RAG AI orchestration frameworks Microservices APIs Scalability Reliability Observability Security CI/CD Prometheus Grafana PostgreSQL Big Data platforms

Staff Software Engineer, Agentic AI

PayPal

Usa - California - San Jose - Corp - N First St, US 80 days ago $218,000$323,950
Python Java MachineLearning Docker Kubernetes AWS CI/CD SQL PostgreSQL Scikit-learn TensorFlow PyTorch RESTful_APIs NLP ComputerVision