QA Automation Tester

What you'll do

• Administer and maintain Databricks workspaces across development, test, and production environments.
• Configure and manage clusters, pools, jobs, and workflows to support ETL, streaming, and machine learning workloads.
• Implement identity and access management (IAM) roles and enforce security best practices like encryption and network controls.
• Optimize cluster configurations, autoscaling, and job scheduling to balance performance with cost control.
• Automate workspace provisioning and policy enforcement using Infrastructure as Code tools like Terraform.
• Integrate Databricks with CI/CD pipelines for automated code deployment and environment management.
• Provide Tier 2/3 technical support for Databricks incidents and service requests.
• Develop platform documentation, runbooks, and standard operating procedures for internal users.

What we're looking for

• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field (or an additional four years of experience).
• 8+ years of experience administering cloud-based data platforms or big data environments.
• Hands-on administration experience with Databricks on Azure, AWS, or GCP.
• Proficiency in scripting and automation using Python, PowerShell, or Bash.
• Familiarity with Spark concepts including clusters, executors, jobs, partitions, and performance considerations.
• Experience with cloud storage (Azure Data Lake Storage, S3, GCS) and identity and access management (IAM).
• Ability to obtain and maintain a Public Trust (MBI T2) clearance.
• Must meet specific U.S. residency requirements for the past five years.