Senior Performance Engineer, Deep Learning

What you'll do

• Build and support the Transformer Engine library for accelerating Large Language Model training.
• Implement and optimize new Deep Learning models to scale efficiently on NVIDIA GPUs and systems.
• Collaborate on systems research to improve performance through low precision training and parallelism methods.
• Build and contribute to NVIDIA submissions for community benchmarks like MLPerf.
• Influence the design of new hardware generations and core platform software components.
• Support enterprise customers and partners by delivering benefits from NVIDIA’s hardware and software innovations.
• Contribute to optimizations within mainstream open-source frameworks like PyTorch and JAX.

What we're looking for

• BS or equivalent experience in Computer Science, Electrical Engineering, or a related field.
• 3+ years of experience in C++ and Python programming.
• Strong background, experience, or coursework in parallel systems programming, preferably on GPUs (preferred).
• Knowledge of Computer Architecture, Code Optimization, and/or Operating Systems.
• Proven experience in developing large software projects.
• Excellent verbal and written communication skills.
• Experience in PyTorch, JAX, or any other DL framework (preferred).
• Experience with performance analysis, profiling, and code optimization techniques, especially with multi-GPU or multi-node systems (preferred).