Senior Software Engineer, Agentic Systems

Nvidia

Remote Actively hiring Posted this week
Santa Clara, CA Posted 4 days ago $184,000$287,500 / year

At a glance

AI generated

TL;DR

As a Senior Software Engineer on NVIDIA’s NeMo Platform team, you will focus on developing NeMo Evaluator, which aids in assessing improvements in AI agents. Your daily tasks include designing Python APIs and SDK workflows for agent evaluation across various runtimes, building systems for data ingestion and analysis, and integrating agentic capabilities with other NVIDIA products. You will also enhance reliability and performance of NeMoStack services through robust testing and code reviews while collaborating closely with cross-functional teams to drive technical innovation. Ideal candidates have extensive experience in Python engineering, SDK design, distributed systems, and cloud-native technologies, along with a strong background in production infrastructure and evaluation workflows for AI systems.

Skills

Python Kubernetes Docker CI/CD Pydantic Prometheus Grafana PostgreSQL AWS Azure Google Cloud Platform Terraform Git GitHub Jenkins Slack Confluence Swagger OpenAPI RESTful APIs GraphQL

What you'll do

  • Design and implement Python-first APIs and SDK workflows for NeMo Evaluator.
  • Build systems for ingesting, normalizing, validating, and analyzing agent execution data.
  • Partner with cross-functional teams to integrate agentic capabilities across NVIDIA platforms.
  • Improve reliability, observability, debuggability, and performance of NeMoStack services.
  • Drive fast iteration and high ownership in engineering through design reviews and mentoring.
  • Build strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows.

What we're looking for

  • 5+ years of professional software engineering experience in building production systems
  • Strong Python skills including API design, testing, debugging, and maintainable software design
  • Experience designing SDKs, libraries, plugins, or developer-facing interfaces
  • Knowledge of distributed systems, cloud-native services, Kubernetes, and job orchestration
  • Expertise in reliability, scalability, security, and performance tradeoffs in production infrastructure
  • Ability to work independently, define technical scope, and drive work across team boundaries
  • Experience building and deploying agentic AI systems with evaluation for real product outcomes

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 825 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 813 roles with salary data.

Most-posted roles

View all roles at Nvidia