Senior Software Engineer, AI Frameworks

Nvidia

Remote

Quick summary

Work type
Remote
Location
Santa Clara, CA
Salary
$152,000–$241,500 / yr
Posted
68 days ago

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $200k
This role $197k
$141k most similar roles pay here $252k

This role pays less than 54% of similar roles. Most pay $163,416–$235,750 — the shaded band above. At the midpoint, this role pays about $197k versus about $200k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 563 open roles on FindRole.

Listed pay typically runs $168,000–$264,500 across 556 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Software Engineer, AI Frameworks

Apply Now Log in to save

As a Senior Software Engineer on our team, you will drive the integration of NVIDIA Grove within Dynamo and other leading open-source AI frameworks like PyTorch, Ray, and llm-d. Your day-to-day responsibilities include designing and implementing end-to-end integrations, building adapters and plugins to ensure smooth operation across training and inference stacks, and collaborating with framework owners to upstream changes for long-term maintainability. You will also develop reference workflows, optimize performance in multi-node environments, enhance observability through metrics and logging tools, and participate in technical design reviews. The ideal candidate has hands-on experience integrating AI frameworks, a strong background in distributed systems, practical Kubernetes skills, and expertise in Go, C++, or Python. Familiarity with GPU optimization and open-source contributions to projects like Dynamo and PyTorch is highly valued.

Skills

Kubernetes Docker CI/CD Python Go C++ PyTorch Ray llm-d Dynamo Helm Kustomize Terraform AWS Grafana Prometheus GitOps OpenAPI Swagger

What you'll do

  • Design and implement end-to-end integrations of Grove with major AI frameworks like Dynamo and PyTorch.
  • Build adapters and plugins to enable seamless adoption and operation of Grove features across training and inference stacks.
  • Develop reference workflows and sample applications that accelerate user adoption of Grove capabilities.
  • Optimize performance, scalability, and reliability for distributed training and inference in multi-node environments.
  • Improve observability by developing metrics, logging, tracing, and debugging tools for Kubernetes-based deployments.

What we're looking for

  • 5+ years experience in software engineering with a focus on AI frameworks
  • Hands-on integration experience with major AI frameworks like PyTorch or Ray
  • Solid understanding of AI workloads and performance optimization techniques
  • Expertise in distributed systems concepts including scheduling and fault tolerance
  • Practical Kubernetes deployment and operational experience
  • Strong programming skills in Go, C++, and/or Python for reliable system development
  • Proven ability to collaborate effectively with open-source communities

Related searches

More Senior Software Engineer jobs Senior Software Engineer jobs in Santa Clara Remote Senior Software Engineer jobs All jobs at Nvidia

More like this

Similar roles

Senior Software Engineer - AI Research Clusters

Nvidia

Remote (Santa Clara, CA) 37 days ago $152,000–$241,500
Python Kubernetes Docker GitLab CI C++ Rust RSQL REST API JavaScript CSS Slurm Linux GPU Computing AIOps Agentic AI CI/CD Prometheus Grafana
Remote
Save

Software Engineer, AI Foundation (Mid-Senior level)

Zip

Remote (San Francisco, CA) 82 days ago $160,000–$260,000
Python LLM Airflow Vector_Databases Observability_Tooling Tracing Logging Metric_Alerting LangChain LangGraph Document_Parsing OCR_Pipelines ML_Platforms Developer_Tooling Internal_Platform_Engineering Evaluation_Frameworks
Remote
Save