Software Engineer, Spark Platform

DoorDash, Inc

Confirmed live yesterday High trust
Hybrid

Quick summary

Work type
Hybrid
Location
San Francisco, CASunnyvale, CASeattle, WANew York, NY
Salary
$130,600–$192,000 / yr
Posted
71 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $181k
This role $161k
$119k most similar roles pay here $236k

This role pays less than 71% of similar roles. Most pay $151,000–$211,200 — the shaded band above. At the midpoint, this role pays about $161k versus about $181k for comparable roles.

Based on 240 similar postings.

Employer

About DoorDash, Inc

DoorDash, Inc. is an American company operating online food ordering and food delivery. It trades under the symbol DASH. With a 56% market share, DoorDash is the largest food delivery platform in the United States.

DoorDash, Inc currently has 187 open roles on FindRole.

Listed pay typically runs $144,800–$212,950 across 166 roles with salary data.

Most-posted roles

View all roles at DoorDash, Inc

At a glance

TL;DR · Software Engineer, Spark Platform

Software Engineer, Spark Platform joins the Spark Platform team to manage and operate the company's Apache Spark ecosystem, including execution runtimes, remote shuffle services, cluster schedulers, and reliability tooling. This role involves building and maintaining an in-house platform that supports data, analytics, and machine learning workloads. Key responsibilities include managing multi-tenant scheduling, executor bin-packing on Kubernetes, cluster lifecycle automation, and developing observability and incident automation to ensure system sustainability. The ideal candidate will utilize Python, Go, Scala, or Java, along with SQL fluency, to solve complex distributed systems problems. Technical requirements include experience with Apache Spark at scale, Kubernetes controllers, and big-data schedulers like YuniKorn or Volcano. Additionally, the role requires familiarity with observability stacks such as Prometheus and OpenTelemetry, alongside expertise in cloud environments involving VPC networking and autoscaling primitives.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

What you'll do

  • Manage and optimize the Spark runtime, shuffle service, and cluster scheduler at scale.
  • Implement multi-tenant scheduling and executor bin-packing on Kubernetes for diverse workloads.
  • Automate cluster lifecycle processes including provisioning, upgrades, capacity changes, and node failure handling.
  • Build observability tools and incident automation to ensure platform debuggability and sustainable on-call rotations.
  • Develop user-facing tooling to support internal teams using the Spark ecosystem.
  • Perform performance tuning and architectural improvements for high-scale distributed systems.

What we're looking for

  • Hold a B.S., M.S., or PhD in Computer Science or an equivalent degree.
  • Possess 2+ years of industry experience operating production distributed systems.
  • Have experience operating Apache Spark at scale on Amazon EMR, Databricks, or in-house deployments.
  • Have hands-on experience operating production systems on Kubernetes, including controllers and operators.
  • Be familiar with big-data schedulers such as YuniKorn, Volcano, Kueue, or the Spark-on-Kubernetes operator.
  • Possess familiarity with observability stacks like Prometheus and OpenTelemetry to define SLIs and SLOs.
  • Demonstrate comfort working in cloud environments, specifically AWS, including VPC networking and autoscaling.
  • Have professional experience with Python, Go, Scala, or Java, along with SQL fluency.

More like this

Similar roles

Senior Software Engineer, Spark Platform

DoorDash, Inc

San Francisco, CA +3 71 days ago $130,600$192,000
Apache Spark Kubernetes Amazon EMR Databricks Scala Java Python Go SQL Apache Iceberg Delta Lake Celeborn YuniKorn Volcano Kueue SRE Distributed Systems
6+ yrs exp Hybrid

Data Engineer, Apple Ads

Apple Inc

New York City, NY 6 days ago $150,400$277,600
Apache Spark Kafka Java Scala Python SQL S3 Hadoop Apache Iceberg Flink Kubernetes AWS Parquet Trino Druid Data Lake Distributed Systems Data Modeling
3+ yrs exp

Lead Software Engineer, Back End

Capital One Financial

Richmond, VA +1 3 days ago $197,300$225,100
Apache Spark Java Scala Spring Boot AWS Python Go SQL NoSQL EMR Glue Lambda Step Functions S3 RDS DynamoDB Kinesis LLM GitHub Copilot
4+ yrs exp

Lead Software Engineer, Back End

Capital One Financial

Richmond, VA +1 3 days ago $197,300$225,100
Java Apache Spark Scala Spring Boot Python Go AWS SQL NoSQL S3 DynamoDB Kinesis Lambda EMR Glue Step Functions RDS Microservices LLM Integration
4+ yrs exp

Lead Software Engineer - Data Engineer

JPMorgan Chase

Houston, TX 35 days ago
Python Java LLM RAG AI ML Kafka Redis Memcached Airflow Temporal Spark PySpark Databricks Snowflake Apache Iceberg AWS Azure GCP Dynatrace Splunk Grafana Microservices API Design
5+ yrs exp

Lead Software Engineer

JPMorgan Chase

OH 70 days ago
Databricks Apache Spark Python Java SQL AWS Delta Lake Terraform CI/CD S3 Glue Kinesis Kafka MSK Unity Catalog Lambda DynamoDB Git pytest JUnit
10+ yrs exp