Software Engineer, Spark Platform

DoorDash, Inc

Confirmed live yesterday High trust

Hybrid

Quick summary

Work type: Hybrid
Location: San Francisco, CASunnyvale, CASeattle, WANew York, NY
Salary: $130,600–$192,000 / yr
Posted: 14 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $182k

This role $161k

$111k $243k

below market most similar roles pay here above market

This role pays less than 66% of similar roles. Most pay $151,000–$212,875 — the blue band above. At the midpoint, this role pays about $161k versus about $182k for comparable roles.

Based on 240 similar postings.

Employer

About DoorDash, Inc

DoorDash, Inc. is an American company operating online food ordering and food delivery. It trades under the symbol DASH. With a 56% market share, DoorDash is the largest food delivery platform in the United States.

DoorDash, Inc currently has 97 open roles on FindRole.

Listed pay typically runs $163,800–$240,900 across 96 roles with salary data.

Most-posted roles

View all roles at DoorDash, Inc

At a glance

TL;DR · Software Engineer, Spark Platform

Role Posting Log in to save

The Software Engineer, Spark Platform joins the Spark Platform team to own and operate the company's Apache Spark ecosystem. This role involves managing the execution runtime, remote shuffle service, cluster scheduler, and reliability tooling for data, analytics, and ML workloads. You will build and operate an in-house Spark platform, focusing on runtime upgrades, multi-tenant scheduling, executor bin-packing on Kubernetes, and cluster lifecycle automation. Key responsibilities include developing observability and incident automation to ensure platform sustainability. You will utilize technologies including Python, Go, Scala, Java, and SQL, while working with Kubernetes, Prometheus, OpenTelemetry, and AWS. The work addresses complex distributed system problems, specifically optimizing runtime performance, systems architecture, and multi-tenant scheduling to serve dozens of consumer teams across the company.

What does a Software Engineer earn in California?

Median $214500 from 1223 postings across 76 companies.

See salary data

Skills

Apache Spark Kubernetes AWS Python Go Scala Java SQL Prometheus OpenTelemetry Distributed Tracing Amazon EMR Databricks YuniKorn Volcano Kueue VPC Networking

What you'll do

Build and operate an in-house Spark platform at company-wide scale.
Drive multi-tenant scheduling, executor bin-packing, and cost-aware placement on Kubernetes.
Automate cluster lifecycle events including provisioning, upgrades, and node-failure handling.
Build observability and incident automation to ensure platform debuggability and sustainable on-call rotations.
Perform Spark runtime upgrades and performance optimizations.
Partner on shuffle, runtime, and architecture work to improve the Spark ecosystem.

What we're looking for

B.S., M.S., or PhD in Computer Science or equivalent.
2+ years of industry experience operating production distributed systems.
Experience operating Apache Spark at scale on Amazon EMR, Databricks, or an in-house deployment.
Hands-on experience operating production systems on Kubernetes, including controllers, operators, and custom resources.
Familiarity with batch or big-data schedulers (YuniKorn, Volcano, Kueue, or equivalent) and/or the Spark-on-Kubernetes operator.
Familiarity with observability stacks (Prometheus, OpenTelemetry, distributed tracing, structured logging) and defining SLOs/SLIs.
Comfort working in a cloud environment (AWS preferred) including VPC networking, instance lifecycle, and autoscaling.
Professional experience with Python, Go, Scala, or Java; SQL fluency.

Similar roles

Senior Software Engineer, Spark Platform

DoorDash, Inc

San Francisco, CA +3 14 days ago $159,800–$235,000

Apache Spark Kubernetes Scala Java Python Go SQL Amazon EMR Databricks Apache Iceberg Delta Lake Celeborn YuniKorn Volcano Kueue Distributed Systems SRE

6+ yrs exp Hybrid

Save

Software Engineer, Data Platform

DoorDash, Inc

San Francisco, CA +3 14 days ago $130,600–$192,000

Spark Flink Kafka Airflow Cassandra Clickhouse Iceberg DataHub OLAP Data Lake Streaming AI Coding Tools Claude Code Codex Cursor

2+ yrs exp

Save

Full-stack Engineer 4, Enterprise Platforms Technology

Capital One Financial

McLean, VA +1 32 days ago $197,300–$225,100

Java Scala Python Go Node.js TypeScript Apache Spark AWS EMR Glue Lambda Step Functions S3 RDS DynamoDB Kinesis SQL NoSQL Docker Kubernetes CI/CD Infrastructure as Code Git GitHub Bitbucket Claude Code GitHub Copilot Cursor OpenAI Canvas

4+ yrs exp

Save

Full-stack Engineer 4, Enterprise Platforms Technology

Capital One Financial

McLean, VA +1 32 days ago $197,300–$225,100

4+ yrs exp

Save

Lead Software Engineer, Back End

Capital One Financial

Richmond, VA +1 49 days ago

Java Apache Spark Scala Spring Boot Python Go AWS EMR Glue Lambda Step Functions S3 RDS DynamoDB Kinesis SQL NoSQL Claude Code GitHub Copilot Microservices

4+ yrs exp

Save

Lead Software Engineer, Back End

Capital One Financial

Richmond, VA +1 49 days ago

Java Apache Spark Scala Spring Boot Python Go AWS EMR Glue Lambda Step Functions S3 RDS DynamoDB Kinesis SQL NoSQL Claude Code GitHub Copilot Microservices

4+ yrs exp

Save