Distinguished Engineer, Apache Spark

Nvidia

Quick summary

Work type
On-site
Location
Santa Clara, CA · Champaign, IL
Salary
$320,000–$488,750 / yr
Posted
148 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $197k
This role $404k
$119k most similar roles pay here $528k

This role pays more than 99% of similar roles. Most pay $158,600–$236,325 — the shaded band above. At the midpoint, this role pays about $404k versus about $197k for comparable roles.

Based on 239 similar postings.

Employer

About Nvidia

Nvidia is a leading designer of graphics processing units (GPUs) and system-on-chip units, powering gaming, professional visualization, data centers, and artificial intelligence workloads. Industry: Semiconductors & AI Computing

Nvidia currently has 563 open roles on FindRole.

Listed pay typically runs $168,000–$264,500 across 556 roles with salary data.

Most-posted roles

View all roles at Nvidia

At a glance

TL;DR · Distinguished Engineer, Apache Spark

As a Distinguished Engineer in NVIDIA’s Apache Spark Acceleration group, you will lead the architecture and design of GPU-accelerated Apache Spark solutions, working closely with distributed system engineers who are PMC members or committers to projects like Apache Spark and Hadoop. Your daily tasks include engaging open-source communities for technical discussions, collaborating with partners on public cloud deployments, presenting at industry events, and mentoring team members. You will also build and optimize CUDA/C++ libraries and develop automation tools for distributed systems. Ideal candidates have over 17 years of experience in software development, strong programming skills in C++, Java, or Scala, and extensive contributions to open-source big-data projects such as Apache Spark and Hadoop. Knowledge of distributed system schedulers like Kubernetes and YARN is essential, along with the ability to quickly adapt to new technologies and work effectively across global teams.

What you'll do

  • Lead the architecture and design of accelerated Apache Spark and related frameworks.
  • Engage in open source communities for technical discussions and contributions.
  • Work with partners to deploy GPU-enabled data analytics solutions on public clouds or clusters.
  • Present technical solutions at industry conferences and meetups.
  • Mentor engineering team members and provide feedback on technical decisions.

What we're looking for

  • 17+ years of software development or research experience in complex projects
  • BS/MS/PhD in Computer Science or related field and outstanding technical skills in distributed systems
  • Excellent programming skills in C++, Java, and/or Scala
  • 5+ years contributing to Apache Spark, Hadoop, Hive, Arrow, Delta Lake as a committer/contributor
  • Deep knowledge of distributed system schedulers like Kubernetes, YARN, and Apache Spark
  • Ability to quickly learn new areas and work effectively across teams globally
  • Experience in designing columnar query engines and working with acceleration libraries (CUDA, RAPIDS)

More like this

Similar roles

Spark Data Engineer, Senior

Booz Allen Hamilton

Chantilly, VA 17 days ago $77,600$176,000
Spark PySpark Java Spark ETL AWS Kafka Docker Kubernetes Cassandra PostgreSQL

Databrick Engineer

Booz Allen Hamilton

Fort Meade, MD 5 days ago $77,600$176,000
Databricks Python Pyspark SQL Terraform Databricks_CLI REST_APIs RBAC Spark_SQL Delta_Lake Infrastructure_as_Code Medallion_architecture ETL CI/CD

Sr. Databricks Data Engineer, Onsite, AVP

State Street

Quincy, MA 16 days ago $90,000$157,500
Databricks Scala PySpark Azure AWS Microservices APIs Event-Driven Architecture CI/CD Agile_methodology SQL Data_Lakehouse
Hybrid

Senior Software Engineer (Databricks)

CoStar Group

San Diego, CA 2 days ago $124,000$187,000
C# .NET .NET Core AWS EC2 ECS/EKS Lambda S3 RDS DynamoDB CloudWatch Claude APIs Git CI/CD Terraform Databricks Microservices DevOps
Hybrid