Principal Machine Learning Engineer, Accelerated Apache Spark
At a glance
AI generatedTL;DR
NVIDIA seeks a senior Machine Learning Engineer to join its GPU-accelerated Apache Spark team, focusing on enhancing the performance of large-scale data processing workloads. This role involves designing machine learning solutions for optimizing GPU-accelerated enterprise Apache Spark applications and developing advanced algorithms to improve system efficiency. The engineer will also create AI-based tools to address system issues and optimize application performance, while collaborating with partners and customers to deploy complex ML solutions in diverse environments. Essential skills include extensive experience in ML/DL solution development, proficiency in Python data science libraries such as numpy, pandas, scikit-learn, scipy, PyTorch, and TensorFlow, deep knowledge of sophisticated ML methodologies like LLM/GenAI and reinforcement learning, and familiarity with NVIDIA GPUs and CUDA. The ideal candidate will maintain expertise in the latest ML systems and algorithms and provide technical leadership to a team of engineers.
Skills
What you'll do
- Design and implement ML solutions for performance prediction of GPU-accelerated Apache Spark workloads.
- Develop advanced algorithms to continuously enhance the performance of Apache Spark on GPUs.
- Create AI-based tools to assist in fixing system issues and optimizing applications.
- Lead technical mentorship and provide guidance in data science and machine learning.
- Stay updated with the latest ML systems and algorithm advancements.
What we're looking for
- 12+ years of professional experience in designing, implementing, and productionizing high-quality ML/DL solutions.
- Proven hands-on experience (2+ years) with large-scale data processing platforms like Apache Spark.
- Deep expertise in sophisticated ML methodologies including LLM/GenAI, reinforcement learning, and adaptive systems.
- Strong programming skills in Python and relevant libraries such as numpy, pandas, scikit-learn, pytorch, tensorflow.
- Experience as a technical lead in ML model development with proven ability to mentor engineers.
- Understanding of Apache Spark's internal workings and architecture, familiarity with NVIDIA GPUs/CUDA.
- Excellent feature engineering skills and experience developing boosted tree models (e.g., XGBoost).
Employer
About Nvidia
Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing
Nvidia currently has 825 open roles on FindRole.
Listed pay typically runs $184,000–$287,500 across 813 roles with salary data.
Most-posted roles
- Senior Solutions Architect, AI Infrastructure 4
- Senior System Software Engineer - AV Platform 4
- Senior Circuit Design Engineer 3
- Senior Circuit Methodology Engineer 3
- Senior Deep Learning Performance Architect 3