Databricks Platform Engineer

What you'll do

• Design, build, and optimize Databricks infrastructure and DataOps workflows for scalability and cost-efficiency.
• Use Terraform and Terragrunt to manage and govern data environments via Infrastructure as Code.
• Develop and manage CI/CD pipelines and DataOps workflows using GitHub and GitHub Actions.
• Implement platform observability, logging, and operational monitoring using tools like Splunk or Dynatrace.
• Administer Databricks platform components, including Unity Catalog, workflows, and Delta Lake architecture.
• Integrate new AI capabilities and scale AI workloads within the data platform.
• Manage cloud budgets and optimize compute costs across Databricks and other cloud resources.
• Navigate enterprise governance by managing change requests and supporting audit-compliant applications.

What we're looking for

• U.S. citizenship is required.
• 4+ years of experience with Python and SQL, interacting with REST APIs and CLI tools to manage infrastructure.
• 3+ years of experience with Databricks platform architecture, administration, and distributed processing environments.
• 3+ years of experience implementing Infrastructure as Code (IaC) utilizing Terraform and Terragrunt.
• Experience designing CI/CD pipelines and DataOps workflows utilizing GitHub and GitHub Actions.
• Experience implementing platform observability, logging, and operational monitoring utilizing Splunk or Dynatrace.
• Experience navigating enterprise governance, managing change requests, and supporting audit compliant applications.
• Bachelor’s degree.