Senior Software Engineer, Big Data

Zillow

Actively hiring
Remote (Remote-Wa, US) Posted 71 days ago $160,900$257,100 / year

At a glance

AI generated

TL;DR

As a Senior Software Engineer, Big Data on Zillow’s Streaming team within the Data Platform organization, you will lead the design and evolution of large-scale Kafka and Flink infrastructure supporting tier-0 and tier-1 workloads. Your responsibilities include driving critical initiatives in platform modernization, developing streaming control planes, APIs, CLIs, and provisioning systems, and enhancing reliability through SLO definition and monitoring. You will also mentor engineers and contribute to long-term platform strategy by evaluating modern streaming ecosystem capabilities such as managed Kafka offerings and serverless stream processing. The role requires 5+ years of experience with large-scale distributed systems, proficiency in languages like Python or Java, and expertise in cloud environments and Kubernetes. Preferred qualifications include working with streaming vendors, leading system design efforts, and integrating streaming systems with analytics platforms for AI capabilities.

Skills

Kafka Flink Python Java Scala AWS Kubernetes Terraform CI/CD SLOs Prometheus Grafana Databricks Confluent MSK Redpanda

What you'll do

  • Design and build large-scale Kafka and Flink infrastructure supporting critical workloads.
  • Lead modernization initiatives for the streaming platform, including architecture evolution.
  • Develop and enhance control planes and APIs for standardized streaming resource management.
  • Improve platform reliability through SLO definition, monitoring, and incident response automation.
  • Enable simplified stream processing patterns to reduce bespoke infrastructure needs.
  • Evaluate and integrate modern streaming ecosystem capabilities and managed Kafka offerings.

What we're looking for

  • 5+ years of experience building and operating large-scale distributed systems.
  • Significant production experience with Kafka and Flink, including performance tuning and incident resolution.
  • Proficiency in at least one programming language: Python, Java, or Scala.
  • Experience operating services in cloud environments like AWS and Kubernetes.
  • Strong skills in designing scalable, multi-tenant systems with reliability and observability.
  • Experience defining and operating against SLOs, participating in on-call rotations.
  • Familiarity with infrastructure-as-code tools such as Terraform and CI/CD systems.

Market check

Salary context

This $160,900–$257,100 range sits above 85% of similar postings on FindRole.

Peer median band

$117,000$199,400

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$135,000$175,825

Middle half of comparable postings.

Based on 240 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About Zillow

Zillow Group is a leading real estate and rental marketplace providing consumers with data, tools, and services to find, buy, sell, rent, and finance homes, and connecting buyers with agents and lenders. Industry: Real Estate Technology & Marketplace

Zillow currently has 33 open roles on FindRole.

Listed pay typically runs $160,900–$257,100 across 33 roles with salary data.

Most-posted roles

View all roles at Zillow

More like this

Similar roles

Senior Software Development Engineer, Big Data

Zillow

Remote (Remote-Nc, US) 105 days ago $160,900$257,100
Python AWS Databricks SparkSQL Spark Streaming PostgreSQL EKS Kubernetes GitLab CI/CD Agile DevOps LLM Agentic AI Prometheus Grafana
Remote

Senior Data Engineer, Big Data

T-Mobile

US 16 days ago $105,100$189,600
AWS Azure Google Cloud Python SQL NoSQL Docker CI/CD Prometheus Grafana Kubernetes Terraform PostgreSQL Snowflake MSSQL

Senior Data Engineer, Big Data

T-Mobile

US 16 days ago $105,100$189,600
AWS Azure Google Cloud Python SQL NoSQL Docker CI/CD Kubernetes Terraform PostgreSQL MongoDB Mentorship Data Warehousing Business Analytics

Senior Software Engineer - Data Infrastructure

Plaid

San Francisco Hq, US 69 days ago $190,800$262,800
Data Warehouses Data Lakehouses Apache Spark Workflow Orchestration Streaming Infrastructure Databricks Airflow AWS EMR Python CI/CD Kubernetes Terraform

Senior Software Engineer - Data Infrastructure

Plaid

Seattle Office, US 69 days ago $190,800$262,800
Data Warehouses Data Lakehouses Apache Spark Workflow Orchestration Streaming Infrastructure Databricks Airflow AWS EMR Python CI/CD

Senior Software Engineer (Data Engineering)

Kohl's

Remote (Kohl'S Corporate Offices (0900), US) 15 days ago
Python Apache Airflow Spark SQL NoSQL Google BigQuery Amazon Redshift Snowflake GCP AWS Azure PCI DSS GDPR CCPA OpenAI GenAI XP CI/CD
Remote