As a Deep Learning Systems Engineer at NVIDIA’s datacenter team, you will play a pivotal role in analyzing the performance and power consumption of deep learning applications on cutting-edge hardware. Your day-to-day responsibilities include developing software infrastructure to characterize DL applications, evolving cost-efficient datacenter architectures for Large Language Models (LLMs), and working with experts to create analysis tools using Python, bash, and C++. You will also analyze system characteristics and develop methodologies to measure performance metrics and identify efficiency improvements. The ideal candidate has a Bachelor’s degree in Electrical Engineering or Computer Science, preferably with an advanced degree, and at least 8 years of relevant experience in system software, silicon architecture, or performance modeling. Proficiency in C/C++ and Python is essential, along with exposure to containerization platforms like Docker and workload managers such as Slurm.
Skills
Python
C/C++
CUDA
PyTorch
TensorFlow
Linux
Docker
Slurm
perf
gprof
nvidia-smi
dcgm
What you'll do
Develop software infrastructure to analyze deep learning applications.
Evolve cost-efficient data center architectures for Large Language Models.
Create analysis tools in Python, bash, and C++ to measure DL performance metrics.
Analyze system characteristics of deep learning applications on Nvidia hardware.
Estimate efficiency improvements through performance metric measurements.
What we're looking for
Bachelor’s degree in Electrical Engineering or Computer Science, or equivalent experience.
8+ years of relevant industry experience.
Deep understanding of computer system architecture and performance analysis.
Experience programming in C/C++ and Python; familiarity with containerization platforms (Docker) and workload managers (Slurm).
Expertise in at least one area: system software, silicon architecture, or deep learning frameworks.
Demonstrated ability to work independently and manage tasks from start to finish.
Market check
Salary context
This
$184,000–$287,500
range sits above
76%
of similar postings on FindRole.
Peer median band
$167,000–$257,550
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$171,200–$235,750
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Nvidia
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has
801 open roles
on FindRole.
Listed pay typically runs
$184,000–$287,500
across 797 roles with salary data.