Databricks Platform & Database Engineer

CoStar Group

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Arlington, VA
Salary
$136,000–$177,000 / yr
Posted
42 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $177k
This role $156k
$124k most similar roles pay here $230k

This role pays less than 62% of similar roles. Most pay $134,312–$220,068 — the shaded band above. At the midpoint, this role pays about $156k versus about $177k for comparable roles.

Based on 240 similar postings.

Employer

About CoStar Group

CoStar Group is the leading provider of commercial real estate information, analytics, and online marketplaces, including CoStar, Apartments.com, and LoopNet platforms. Industry: Commercial Real Estate Data & Analytics

CoStar Group currently has 65 open roles on FindRole.

Listed pay typically runs $133,000–$190,000 across 63 roles with salary data.

Most-posted roles

View all roles at CoStar Group

At a glance

TL;DR · Databricks Platform & Database Engineer

As a Databricks Platform & Database Engineer, you will serve as the primary owner of the enterprise Databricks environment on AWS. You will manage the full lifecycle of the platform, including administration, automation, governance, and reliability for workspaces and Unity Catalog objects. Your daily responsibilities involve managing a diverse portfolio of relational databases like SQL Server, Aurora, PostgreSQL, and MySQL, alongside non-relational stores such as DynamoDB across cloud and on-premises environments. You will build IaC solutions using Terraform, develop CI/CD workflows, and optimize cluster performance for cost and speed. The role requires advanced SQL, PySpark, and Python skills to support data ingestion and distribution. You will solve complex engineering challenges by integrating AI technologies into the platform while ensuring robust security, compliance, and high availability for large-scale real estate information systems.

What you'll do

  • Deploy, administer, and manage Databricks workspaces on AWS including configuration, security, and lifecycle management.
  • Manage Unity Catalog objects and enforce workspace security policies for users, groups, and service principals.
  • Optimize and right-size Databricks clusters and SQL warehouses to improve performance and reduce costs.
  • Design and maintain relational and non-relational databases across AWS cloud and on-premises data centers.
  • Develop Infrastructure as Code (IaC) solutions using Terraform for Databricks and RDS resources.
  • Automate operational tasks including database provisioning, job scheduling, and backup management.
  • Build and maintain CI/CD workflows for platform configuration and pipeline code.
  • Implement proactive monitoring, alerting, and root cause analysis for 24/7 production environments.

What we're looking for

  • Bachelor's Degree from an accredited, not-for-profit, in-person university or college.
  • 5+ years of experience in database engineering or data platform roles involving relational/non-relational databases and Databricks ownership.
  • Proven hands-on experience administering enterprise Databricks environments on AWS including Unity Catalog and workspace security.
  • Strong relational database engineering skills for SQL Server, Aurora, PostgreSQL, and MySQL.
  • Advanced SQL skills and proficiency in PySpark and Python.
  • Infrastructure-as-Code experience using Terraform and managing CI/CD pipelines.
  • Familiarity with large language models (LLMs), prompt engineering, or agent-based architectures.
  • Experience supporting 24/7 production environments and implementing data governance and cost optimization.

More like this

Similar roles

Senior Databricks Platform Engineer

General Dynamics

Remote 6 days ago $169,604$229,464
Databricks Unity Catalog Apache Spark Delta Lake Python SQL Terraform CI/CD Docker Kubernetes AWS Bash Grafana Prometheus Datadog CloudWatch Elastic ETL ELT
10+ yrs exp Remote

Product Data Engineer

Comcast

West Chester, PA 7 days ago
AWS PySpark Databricks Kafka Kubernetes Airflow MWAA Python Snowflake Amazon EKS ETL ELT Data Warehousing Distributed Systems Streaming Data Architecture
5+ yrs exp

Software Engineer III

JPMorgan Chase

Wilmington, DE 29 days ago
Databricks Python Java SQL PySpark AWS SageMaker EMR Lambda EC2 Kubernetes Terraform Kafka Oracle Cassandra MLOps CI/CD Delta Lake Unity Catalog TensorFlow Pandas NumPy
3+ yrs exp

Senior Data Engineer

CoStar Group

Arlington, VA 22 days ago $128,000$190,000
Python PySpark SQL Databricks Snowflake BigQuery AWS Terraform CI/CD Kafka Power BI NoSQL DynamoDB Amazon S3 ETL Medallion Architecture LLMs Prompt Engineering Object-Oriented Programming
6+ yrs exp

Consultant Data Engineer

Nationwide

Columbus, OH 21 days ago $118,000$222,000
Databricks Delta Lake Python SQL Spark AWS Azure Redshift S3 EC2 CI/CD Git JIRA Jenkins Confluence R UNIX Shell Perl Ruby Robotic Process Automation
5+ yrs exp Hybrid