We are seeking a Senior Product Manager to lead critical initiatives within our Apache Spark engine team in San Jose. This role involves driving the roadmap for key components such as the Catalyst optimizer and lakehouse integrations with Delta Lake, Iceberg, and Hudi. You will work closely with platform engineers, data engineering teams, and ML infrastructure groups to optimize query performance, reduce costs, and enhance scalability through innovations like dynamic partition pruning and shuffle optimization. The ideal candidate has deep expertise in Spark internals, JVM performance tuning, and open-source community dynamics, along with experience in structured streaming and observability features. This position requires a strong quantitative background and the ability to translate complex technical insights into actionable product improvements.