Databricks Platform & Database Engineer

CoStar Group

Confirmed live today High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Arlington, VA
Salary
$136,000–$177,000 / yr
Employment
Full-time
Posted
88 days ago
Freshness
Confirmed live today

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $169k
This role $156k
$117k $221k
below market most similar roles pay here above market

This role pays less than 59% of similar roles. Most pay $126,800–$211,200 — the blue band above. At the midpoint, this role pays about $156k versus about $169k for comparable roles.

Based on 240 similar postings.

Employer

About CoStar Group

CoStar Group is the leading provider of commercial real estate information, analytics, and online marketplaces, including CoStar, Apartments.com, and LoopNet platforms. Industry: Commercial Real Estate Data & Analytics

CoStar Group currently has 59 open roles on FindRole.

Listed pay typically runs $133,000–$190,000 across 59 roles with salary data.

Most-posted roles

View all roles at CoStar Group

At a glance

TL;DR · Databricks Platform & Database Engineer

The Databricks Platform & Database Engineer serves as the primary owner of the enterprise Databricks environment on AWS, managing administration, automation, governance, and platform reliability. You will deploy and maintain Databricks workspaces, manage Unity Catalog objects, and oversee a portfolio of relational databases including SQL Server, Aurora, PostgreSQL, and MySQL, alongside non-relational stores like DynamoDB. Daily responsibilities involve optimizing clusters, designing end-to-end data workflows, and implementing Infrastructure-as-Code solutions using Terraform. You will build CI/CD workflows, manage security protocols, and support 24/7 production environments. The role requires proficiency in SQL, PySpark, and Python to solve complex engineering challenges within a real estate information and marketplace context, specifically focusing on data ingestion, cost optimization, and integrating AI technologies into enterprise systems.

What you'll do

  • Deploy, administer, and maintain Databricks workspaces on AWS including configuration, networking, and cluster management.
  • Manage Unity Catalog objects and administer workspace security for users, groups, and service principals.
  • Design, implement, and administer relational and non-relational databases across AWS and on-premises data centers.
  • Develop Infrastructure-as-Code (IaC) solutions using Terraform for Databricks and AWS RDS resources.
  • Automate operational tasks such as database provisioning, job scheduling, and backup management.
  • Build and maintain CI/CD workflows for platform configuration and pipeline code.
  • Implement proactive monitoring, alerting, and root cause analysis for production environments.
  • Support data ingestion from various sources into Databricks using AWS DMS or Lakeflow.

What we're looking for

  • Bachelor’s Degree from an accredited, not-for-profit, in-person university or college.
  • 5+ years of experience in database engineering or data platform roles involving relational/non-relational databases and Databricks platform ownership.
  • Proven, hands-on experience administering enterprise Databricks environments on AWS.
  • Deep expertise in Databricks administration including Unity Catalog, workspace security, cluster management, and Auto Loader.
  • Strong relational database engineering skills in SQL Server, Aurora, PostgreSQL, and/or MySQL.
  • Advanced SQL skills and proficiency in PySpark and Python.
  • Infrastructure-as-Code experience with Terraform and CI/CD pipeline management.
  • Familiarity with large language models, prompt engineering, or agent-based architectures.

More like this

Similar roles

Databricks Platform Engineer

Booz Allen Hamilton

McLean, VA 34 days ago $62,000–$141,000
Databricks Terraform Terragrunt Python SQL CI/CD DataOps GitHub Actions Delta Lake Unity Catalog Splunk Dynatrace Scala Java REST APIs MLOps Agile

Databricks Platform Engineer

Booz Allen Hamilton

McLean, VA 45 days ago
Databricks Terraform Terragrunt Python SQL DataOps CI/CD GitHub Actions Delta Lake Unity Catalog MLOps Scala Java REST APIs Splunk Dynatrace Agile

Databricks Platform Engineer

Booz Allen Hamilton

McLean, VA 45 days ago $77,600–$176,000
Databricks Terraform Terragrunt Python SQL DataOps CI/CD GitHub Actions Delta Lake Unity Catalog MLOps Scala Java Splunk Dynatrace REST APIs CLI Agile

Databricks Platform Engineer

McKesson Corporation

Columbus, OH 39 days ago $106,500–$177,500
Databricks Azure Terraform SQL Python Unity Catalog Infrastructure as Code CI/CD Snowflake Azure Data Lake Data Engineering Data Governance Data Modeling Cloud Infrastructure Data Ingestion Platform Administration
4+ yrs exp Hybrid

Platform and Databricks DevOps Engineer

Booz Allen Hamilton

McLean, VA 20 days ago
Databricks Terraform Python Bash AWS Azure GCP Kubernetes Docker CI/CD Unity Catalog Delta Lake Delta Live Tables REST APIs SCIM Photon Jenkins
3+ yrs exp

Databricks Data Engineer, Lead

Booz Allen Hamilton

Bethesda, MD +1 12 days ago $77,600–$176,000
Databricks Python PySpark AWS Delta Lake Unity Catalog ETL Data Modeling Amazon S3 AWS Glue Amazon RDS AWS Lambda CloudWatch Collibra Medallion Architecture Data Governance
8+ yrs exp