We are seeking a Senior Product Manager to lead critical initiatives within our Apache Spark engine team in Austin, TX. This role involves driving the roadmap for key components such as Catalyst optimizer and Structured Streaming, while also focusing on lakehouse integrations with Delta Lake, Iceberg, and Hudi. The ideal candidate will work closely with platform engineers, data engineering teams, and ML infrastructure to optimize cost efficiency through shuffle optimization and dynamic resource allocation. Proficiency in JVM performance tuning, Spark internals including DAG scheduler and Catalyst optimizer, and experience with open-source contributions are essential. Candidates should have a strong background in SQL-based platforms, lakehouse architecture, and observability for distributed systems, as well as familiarity with ML feature engineering pipelines.