Senior Software Engineer, NIM Model Customization

Nvidia

Confirmed live 2 days ago High trust

Quick summary

Work type: On-site
Location: Santa Clara, CA
Salary: $184,000–$287,500 / yr
Posted: 16 days ago
Freshness: Confirmed live 2 days ago
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $202k

This role $236k

$139k most similar roles pay here $303k

This role pays more than 84% of similar roles. Most pay $175,137–$228,950 — the shaded band above. At the midpoint, this role pays about $236k versus about $202k for comparable roles.

Based on 240 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 896 open roles on FindRole.

Listed pay typically runs $184,000–$287,500 across 876 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Senior Software Engineer, NIM Model Customization

Role Posting Log in to save

As a Senior Software Engineer, NIM Model Customization, you will join the NIM team to build a groundbreaking model customization and deployment lifecycle platform from inception. You will be responsible for developing the fine-tuning handoff pipeline, including LoRA adapter repackaging, re-quantization, and re-validation into NIM. Your daily work involves building an evaluation harness, implementing observability and attestation layers for auditable compliance artifacts, and defining durable platform APIs to support international ISVs and CSPs. The role requires expertise in model customization tools such as LoRA, QLoRA, supervised fine-tuning, reinforcement learning, preference optimization, and retrieval-augmented generation. You must possess experience with LLM serving infrastructure like vLLM or TRT-LLM, a deep understanding of model quantization workflows, and the ability to solve complex problems within cross-functional teams to manage the transition from model selection through deployment.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

Skills

LLM LoRA QLoRA SFT RL DPO RAG vLLM TRT-LLM Model Quantization Fine-tuning Cloud Services Observability open-source

What you'll do

Build the fine-tuning handoff pipeline including LoRA adapter repackaging, re-quantization, and re-validation into NIM.
Develop an evaluation harness to ensure models meet high performance standards.
Implement observability and attestation layers to produce auditable compliance artifacts.
Partner with ISVs and CSPs to roll out NVIDIA NIMs on a large scale.
Define and improve durable platform APIs for international customers.
Build a groundbreaking model customization and deployment lifecycle platform from inception.

What we're looking for

Bachelor’s degree in Computer Science, Engineering, or equivalent experience.
Experience utilizing model customization tools including LoRA, QLoRA, SFT, RL, DPO, and RAG.
7+ years of experience with LLM serving infrastructure such as vLLM, TRT-LLM, or equivalent.
Deep understanding of model quantization and fine-tuning workflows.
Demonstrated history of developing robust platform APIs.
Strong collaborative skills and experience working in cross-functional teams.
Experience with large-scale deployment of AI models (preferred).
Familiarity with compliance and audit processes for AI models (preferred).