Staff ML Infrastructure Engineer, ML Platform & Technology - Pre-training Infrastructure

What you'll do

• Drive performance optimization for large-scale foundation model training on TPUs to improve efficiency and throughput.
• Profile and optimize JAX/XLA workloads across compute, memory, communication, and compilation.
• Develop and optimize high-performance TPU kernels for critical operations like attention and Mixture-of-Experts.
• Optimize distributed training techniques, sharding strategies, and collective communication over TPU interconnects.
• Research and implement new techniques across the JAX, XLA, and TPU stack to improve training performance.
• Develop performance profiling, benchmarking, and automated tuning capabilities for large-scale training workloads.
• Lead complex technical projects and mentor engineers in specialized areas of expertise.

What we're looking for

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 6+ years of experience building or optimizing high-performance ML or distributed systems.
• Proficiency in Python or other relevant programming languages.
• Strong understanding of distributed systems, parallel computing, and performance optimization.
• Experience profiling and optimizing compute-, memory-, or communication-intensive workloads.
• Ability to clearly communicate complex technical problems and collaborate with partners to develop solutions.
• Advanced degree in Computer Science, Engineering, or a related field (preferred).
• Experience with JAX, XLA, PyTorch, TPU/GPU architectures, and developing kernels using Pallas, Triton, or CUDA (preferred).