Senior Software Engineer, Spark Platform

DoorDash, Inc

Confirmed live 2 days ago High trust
Hybrid

Quick summary

Work type
Hybrid
Location
San Francisco, CASunnyvale, CASeattle, WANew York, NY
Salary
$130,600–$192,000 / yr
Posted
71 days ago
Freshness
Confirmed live 2 days ago

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $176k
This role $161k
$108k most similar roles pay here $231k

This role pays less than 59% of similar roles. Most pay $151,000–$200,620 — the shaded band above. At the midpoint, this role pays about $161k versus about $176k for comparable roles.

Based on 240 similar postings.

Employer

About DoorDash, Inc

DoorDash, Inc. is an American company operating online food ordering and food delivery. It trades under the symbol DASH. With a 56% market share, DoorDash is the largest food delivery platform in the United States.

DoorDash, Inc currently has 187 open roles on FindRole.

Listed pay typically runs $144,800–$212,950 across 166 roles with salary data.

Most-posted roles

View all roles at DoorDash, Inc

At a glance

TL;DR · Senior Software Engineer, Spark Platform

Senior Software Engineer, Spark Platform joins the Spark Platform team to own and operate the company's Apache Spark ecosystem, including the execution runtime, remote shuffle service, cluster scheduler, and reliability tooling. This role involves setting the multi-year technical direction for an in-house Spark-on-Kubernetes platform while solving complex distributed systems problems like multi-tenant scheduling, runtime performance, and failure modes at scale. The successful candidate will partner with management on roadmaps and hiring while mentoring others through design reviews. Required expertise includes deep experience with Apache Spark internals, query execution, and shuffle architecture. Candidates should have production experience with remote shuffle systems, batch schedulers, and Kubernetes operator patterns. Technical requirements include proficiency in Scala, Java, Python, or Go, along with strong SQL skills and familiarity with data lake table formats like Apache Iceberg or Delta Lake to support data, analytics, and ML workloads.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

What you'll do

  • Set the multi-year technical direction and architecture for the in-house Spark-on-Kubernetes platform.
  • Solve complex distributed systems problems involving shuffle architecture, multi-tenant scheduling, and runtime performance.
  • Manage the reliability of the Spark ecosystem including execution runtimes, remote shuffle services, and cluster schedulers.
  • Partner with management to define the technical roadmap, hire new engineers, and design interview processes.
  • Mentor team members through design reviews and by raising the bar for engineering standards.
  • Represent the Spark Platform in cross-team architecture forums to support data, analytics, and ML workloads.

What we're looking for

  • Bachelor’s, Master’s, or PhD in Computer Science or equivalent.
  • 6+ years of industry experience designing and operating distributed systems at scale.
  • Deep hands-on experience with Apache Spark internals, query execution, shuffle, and the executor/driver model at platform scale.
  • Production experience with remote shuffle systems, batch/big-data schedulers, or SRE patterns for distributed compute platforms.
  • Strong fluency operating workloads on Kubernetes in production including operator patterns and multi-tenant failure modes.
  • Familiarity with data lake table formats like Apache Iceberg or Delta Lake and associated query engines.
  • Proven track record of technical leadership, mentoring, and partnering with management on roadmaps and hiring.
  • Professional experience with Scala, Java, Python, or Go, along with strong SQL skills.

More like this

Similar roles

Software Engineer, Spark Platform

DoorDash, Inc

San Francisco, CA +3 71 days ago $130,600$192,000
Apache Spark Kubernetes AWS Python Go Scala Java SQL Prometheus OpenTelemetry Distributed Systems Databricks YuniKorn Volcano Kueue VPC Networking
10+ yrs exp Hybrid

Senior Platform Software Engineer

Oracle

Nashville, TN +1 74 days ago $92,500$209,500
Oracle Cloud Infrastructure (OCI) Agentic AI Java GoLang C# System Architecture Agile Software Design Automation
4+ yrs exp

Senior Platform Software Engineer

Oracle

Austin, TX 74 days ago $92,500$209,500
Java Python Go TypeScript .NET RESTful API OCI CLI CI/CD OpenAPI Software Architecture Code Generation Cloud Infrastructure Quality Assurance Pipelines
3+ yrs exp

Senior Platform Software Engineer

Oracle

Nashville, TN 43 days ago $92,500$209,500
Java REST gRPC Distributed Systems RDBMS NoSQL CI/CD Source Control Automated Testing Observability Cloud Infrastructure
5+ yrs exp

Senior Platform Software Engineer

Oracle

Nashville, TN 43 days ago $92,500$209,500
Java Python Go TypeScript .NET RESTful API OCI Cloud Infrastructure SDKs CI/CD OpenAPI Distributed Systems Cloud Architecture Software Development Lifecycle Monitoring Observability
3+ yrs exp

Senior Platform Software Engineer

Oracle

Nashville, TN 43 days ago $92,500$209,500
Java Go C++ Python REST APIs Microservices Distributed Systems Git CI/CD IAM OCI AWS Azure GCP SQL Unix Linux System Design Test Automation
3+ yrs exp