Sr Data Engineer

The Walt Disney Company

Remote Actively hiring Verified listing
Remote, USA · New York, NY Posted 11 days ago $148,700–$199,400 / year
View original post Log in to save

At a glance

AI generated

TL;DR

The Commerce Data Pipelines team within the DEET organization at Disney is seeking a Senior Data Engineer to join their world-class team. This role involves establishing and scaling foundational data pipelines using Scala, Python, and Spark to ensure strict uptime SLAs for dozens of engineering and analytical teams. Responsibilities include extending platform functionality through metadata parsing, building new integrations with APIs, implementing batch and streaming data pipelines, and developing shared libraries that abstract complex business logic. The tech stack includes Airflow, Databricks, Delta Lake, Snowflake, and more. Candidates will collaborate closely with product managers, architects, and other engineers to drive the success of the Commerce Data platform while ensuring high operational efficiency and quality. Ideal candidates have 5+ years of data engineering experience, strong Scala and Python skills, hands-on production experience with distributed processing systems like Spark, and familiarity with cloud providers such as AWS.

Skills

Scala Python Spark Airflow Databricks Delta Lake Snowflake AWS S3 SQL CI/CD Agile Scrum

What you'll do

  • Maintain and expand existing data pipelines in Scala and Python/Spark.
  • Implement new batch and streaming data pipelines using Databricks and Airflow.
  • Develop shared libraries to abstract complex business logic across all data pipelines.
  • Shift towards a Lakehouse-centric data platform with customers and stakeholders.
  • Ensure high operational efficiency and quality of datasets for reliability and accuracy.
  • Contribute to documenting internal and external standards for pipeline configurations.

What we're looking for

  • 5+ years of data engineering experience developing large data pipelines
  • Proficient in Scala and Python for complex business logic abstraction
  • Hands-on experience with distributed processing systems like Spark and orchestration tools like Airflow
  • Strong SQL skills and ability to create queries for analyzing complex datasets
  • Experience implementing Lakehouse architecture and working with Delta Lake, Snowflake
  • Collaborative mindset with strong communication and documentation skills
  • Willingness to learn new technologies and adapt in a fast-paced environment

Market check

Salary context

This $148,700–$199,400 range sits above 67% of similar postings on FindRole.

Peer median band

$117,600–$189,800

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$126,800–$192,287

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About The Walt Disney Company

The Walt Disney Company is a diversified global entertainment and media enterprise operating in segments including Disney Parks, Experiences and Products; Entertainment (ABC, Hulu, Disney+); and ESPN. Industry: Entertainment & Media

The Walt Disney Company currently has 118 open roles on FindRole.

Listed pay typically runs $141,900–$190,300 across 110 roles with salary data.

Most-posted roles

View all roles at The Walt Disney Company

More like this

Similar roles

Sr Data Engineer

The Walt Disney Company

Remote (Usa - Ny - 7 Hudson Square, US) 46 days ago $148,700–$199,400
Scala Python Spark Databricks Airflow Snowflake GitHub Actions Jenkins AWS S3 Kafka CI/CD SQL Bash PowerShell GraphQL Redshift BigQuery Scrum Agile
Remote

Sr Data Engineer

The Walt Disney Company

Remote (Usa - Ca - 1200 Grand Central Ave, US) 92 days ago $138,900–$186,200
Python Java SQL Kafka Flink Spark Kinesis Pinecone Weaviate FAISS pgvector Airflow Dagster AWS S3 Glue MWAA Prometheus Datadog Databricks LangChain
Remote

Sr Data Engineer

The Walt Disney Company

Remote (Usa - Ca - Market St, US) 15 days ago $138,900–$186,200
Python Java SQL Kafka Flink Spark Kinesis Pinecone Weaviate FAISS pgvector Airflow Dagster AWS S3 Glue MWAA Datadog Prometheus Databricks LangChain
Remote

Data Engineer Sr

PNC

Denver - 12345 W Colfax (Co147), US 53 days ago $65,000–$171,925
Big_Data_Management_and_Analytics Business_Intelligence Data_Architecture Database_Structures CI/CD Python SQL Hadoop Spark PostgreSQL Docker Kubernetes AWS Azure Google_Cloud_Platform Terraform Git Jenkins Prometheus Grafana

Sr. Data Engineer

Adobe

San Jose, US 44 days ago $177,900–$257,550
AWS Python PySpark Apache Airflow MongoDB MySQL Docker Kubernetes CI/CD Prometheus Grafana Terraform PostgreSQL Adobe Experience Cloud

Sr Lead Data Engineer

Northern Trust

Chicago, Illinois, US 85 days ago $114,500–$194,700
Snowflake SQL NoSQL ETL Data Warehouse Relational Databases Dimensional Modeling Machine Learning Artificial Intelligence GenAI CI/CD Agile AWS Kubernetes