Senior Software Development Engineer, Big Data

Zillow

Actively hiring
Remote (Remote-Nc, US) Posted 105 days ago $160,900–$257,100 / year
View original post Log in to save

At a glance

AI generated

TL;DR

As a Senior Data Engineer on Zillow Group’s Housing Trends Data Engineering team, you will play a pivotal role in processing vast datasets to generate macroeconomic housing market indicators and forecasts. Your daily tasks include collaborating closely with data science teams to design and build scalable data products, as well as maintaining robust data pipelines that ensure accuracy and consistency. You’ll leverage Python, AWS cloud services, Databricks, SparkSQL, and Kubernetes to develop cutting-edge solutions, while also contributing to the continuous improvement of internal processes through automation and optimization. With a strong background in big data ecosystems and machine learning engineering, you will help shape Zillow’s housing market intelligence by building infrastructure for deploying ML models into production environments and supporting cross-functional teams with feature stores and ETL pipelines.

Skills

Python AWS Databricks SparkSQL Spark Streaming PostgreSQL EKS Kubernetes GitLab CI/CD Agile DevOps LLM Agentic AI Prometheus Grafana

What you'll do

  • Design and build batch and real-time data pipelines using big data ecosystems.
  • Develop scalable data products and maintain consistent delivery pipelines.
  • Collaborate with data scientists to create efficient model training systems.
  • Implement feature stores and ETL pipelines for streamlined feature engineering.
  • Build infrastructure for deploying machine learning models into production environments.
  • Identify and implement process improvements for greater scalability and performance.

What we're looking for

  • Strong proficiency in Python programming.
  • Experience with big data ecosystems, AWS cloud services, and Lakehouse platforms.
  • Hands-on experience with Databricks, SparkSQL, Spark Streaming, PostgreSQL, EKS, Kubernetes.
  • Proven ability to design and orchestrate batch and real-time data pipelines.
  • Familiarity with Agile/DevOps processes, GitLab, CI/CD tools.
  • Understanding of data science concepts, machine learning algorithms/libraries.
  • Strong problem-solving skills and communication abilities in a fast-paced environment.

Market check

Salary context

This $160,900–$257,100 range sits above 75% of similar postings on FindRole.

Peer median band

$119,900–$210,665

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$139,100–$209,187

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Zillow

Zillow Group is a leading real estate and rental marketplace providing consumers with data, tools, and services to find, buy, sell, rent, and finance homes, and connecting buyers with agents and lenders. Industry: Real Estate Technology & Marketplace

Zillow currently has 33 open roles on FindRole.

Listed pay typically runs $160,900–$257,100 across 33 roles with salary data.

Most-posted roles

View all roles at Zillow

More like this

Similar roles

Senior Software Engineer, Big Data

Zillow

Remote (Remote-Wa, US) 71 days ago $160,900–$257,100
Kafka Flink Python Java Scala AWS Kubernetes Terraform CI/CD SLOs Prometheus Grafana Databricks Confluent MSK Redpanda
Remote

Senior Data Engineer, Big Data

T-Mobile

US 16 days ago $105,100–$189,600
AWS Azure Google Cloud Python SQL NoSQL Docker CI/CD Prometheus Grafana Kubernetes Terraform PostgreSQL Snowflake MSSQL

Senior Data Engineer, Big Data

T-Mobile

US 16 days ago $105,100–$189,600
AWS Azure Google Cloud Python SQL NoSQL Docker CI/CD Kubernetes Terraform PostgreSQL MongoDB Mentorship Data Warehousing Business Analytics

Senior Software Engineer - Data Infrastructure

Plaid

San Francisco Hq, US 69 days ago $190,800–$262,800
Data Warehouses Data Lakehouses Apache Spark Workflow Orchestration Streaming Infrastructure Databricks Airflow AWS EMR Python CI/CD Kubernetes Terraform

Senior Software Engineer - Data Infrastructure

Plaid

Seattle Office, US 69 days ago $190,800–$262,800
Data Warehouses Data Lakehouses Apache Spark Workflow Orchestration Streaming Infrastructure Databricks Airflow AWS EMR Python CI/CD

Senior Software Engineer (Data Engineering)

Kohl's

Remote (Kohl'S Corporate Offices (0900), US) 15 days ago
Python Apache Airflow Spark SQL NoSQL Google BigQuery Amazon Redshift Snowflake GCP AWS Azure PCI DSS GDPR CCPA OpenAI GenAI XP CI/CD
Remote