below marketmost similar roles pay hereabove market
This role pays more than
61%
of similar roles. Most pay
$191,875–$254,750
— the blue band above.
At the midpoint, this role pays about
$236k
versus about
$223k
for comparable roles.
Based on 240 similar postings.
Employer
About Nvidia
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has
1623 open roles
on FindRole.
Listed pay typically runs
$184,000–$287,500
across 1110 roles with salary data.
The Senior Deep Learning Software Engineer, Inference and Model Optimization joins the Algorithmic Model Optimization Team to develop and scale automated inference and deployment solutions. This role involves training, developing, and deploying generative AI models like large language models and diffusion models. You will analyze and extract standardized model graph representations from arbitrary models to build a modular software platform. Key responsibilities include developing high-performance optimization techniques such as automated model sharding, tensor parallelism, and efficient attention kernels with kv-caching. You will utilize the PyTorch 2.0 ecosystem, HuggingFace, CUDA, TRT-LLM, and Triton to improve inference efficiency. The work focuses on solving hardware and software optimization opportunities by profiling GPU kernel-level performance to maintain leadership in inference software solutions like TensorRT and TRT Model Optimizer.
CUDA
Python
C++
Rust
TensorRT-LLM
vLLM
SGLang
Triton
PyTorch
NVIDIA Nsight Systems
CUTLASS
NCCL
Quantization
Distributed Systems
GPU Architecture
Model Parallelism
Speculative Decoding