As a Senior Software Engineer on the Core Data & Services team within Disney’s DEET organization, you will play a pivotal role in establishing and scaling foundational data pipelines and datasets that enable engineering and analytical teams to make informed business decisions. Your day-to-day responsibilities include maintaining and expanding existing Scala and Python/Spark-based data pipelines while ensuring strict uptime SLAs, implementing new batch and streaming data pipelines using Databricks and Airflow, and developing shared libraries in Scala and Python to ensure consistent functionality across all data pipelines. You will work closely with product managers, architects, and other engineers to drive the success of the Core Data platform, contributing to the development of standards and best practices for pipeline configurations and documentation. The tech stack includes Airflow, Spark, Databricks, Delta Lake, Snowflake, Scala, and Python, requiring strong skills in these areas along with experience in distributed processing systems like Spark and data pipeline orchestration tools such as Airflow.
Maintain and expand existing data pipelines in Scala and Python/Spark.
Implement new batch and streaming data pipelines using Scala, Databricks, and Airflow.
Develop shared libraries in Scala and Python to abstract complex business logic.
Shift towards a Lakehouse-centric data platform architecture.
Ensure high operational efficiency and quality of datasets for all stakeholders.
Contribute to documenting internal and external standards for pipeline configurations.
What we're looking for
5+ years of data engineering experience developing large data pipelines
Proficient in Scala and Python for complex business logic abstraction
Hands-on experience with distributed processing systems like Spark and orchestration tools like Airflow
Strong SQL skills and ability to create queries for analyzing complex datasets
Experience maintaining strict uptime SLAs for data pipeline operations
Familiarity with cloud provider resources such as AWS S3 and Delta Lake
Active participation in agile/scrum ceremonies and documentation of work changes
Market check
Salary context
This
$141,900–$190,300
range sits above
45%
of similar postings on FindRole.
Peer median band
$135,650–$209,000
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$142,400–$195,250
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About The Walt Disney Company
The Walt Disney Company is a diversified global entertainment and media enterprise operating in segments including Disney Parks, Experiences and Products; Entertainment (ABC, Hulu, Disney+); and ESPN. Industry: Entertainment & Media
The Walt Disney Company currently has
118 open roles
on FindRole.
Listed pay typically runs
$141,900–$190,300
across 110 roles with salary data.