Data Platform SRE, AI & Data Platforms

What you'll do

• Develop and operate large-scale big data platforms using open source and other technologies.
• Support critical analytics, reporting, and AI/ML applications.
• Optimize platform performance and cost efficiency for high-scale operations.
• Automate routine operational tasks for big data systems.
• Identify and resolve production errors to ensure platform reliability and user experience.
• Manage and debug distributed data processing systems with a focus on Apache Spark.
• Maintain and optimize data lake technologies such as Apache Iceberg.
• Orchestrate workflows and data pipelines using tools like Airflow or DBT.

What we're looking for

• 3+ years of professional software engineering experience with large-scale big data platforms.
• Strong programming skills in Java, Scala, Python, or Go.
• Proven expertise in operating large-scale distributed data processing systems with a focus on Apache Spark.
• Hands-on experience with table formats and data lake technologies such as Apache Iceberg.
• Strong background in incident management, troubleshooting, root cause analysis, and performance optimization.
• Proficiency with cloud technologies including AWS and GCP.
• Experience with Unix/Linux systems and command-line tools for debugging and operational support.
• Experience with multi-tenant Kubernetes clusters, workflow orchestration (Airflow, DBT), and the AI/ML stack.