Senior Systems Software Engineer, Accelerated Spark Applications

What you'll do

• Design, build, and operate a hosted Spark service control plane on Kubernetes using Java, Helm, and Flux.
• Perform end-to-end code reviews for services to ensure they remain releasable on the production release train.
• Extend the cuDF Spark runtime and CPU/GPU workload router using Scala and Java.
• Ensure interoperability with Delta Lake, Apache Iceberg, and Unity Catalog.
• Investigate and resolve production failures on clusters running thousands of concurrent jobs.
• Instrument metrics, dashboards, and alerts while participating in the on-call rotation.
• Provide technical recommendations on infrastructure, continuous integration, and testing strategies.

What we're looking for

• BS, MS, or PhD in Computer Science, Computer Engineering, or a related field (or equivalent experience).
• 9+ years of experience in software development.
• Strong distributed-systems fundamentals and proficiency in Java or Scala, plus C++ or Python.
• Hands-on experience operating services on Kubernetes, on-premise, or cloud.
• Experience owning or reviewing long-lived servers, including REST front ends, proxies, request routers, JDBC, or Thrift services.
• Experience supporting enterprise or internal production customers, including on-call.
• Experience using AI tools in software development.
• Knowledge of Apache Spark internals, Spark Connect, Kyuubi, Delta Lake, Apache Iceberg, Unity Catalog, cuDF, or CUDA (preferred).