Machine Learning Systems Engineer, Siri Agent Modeling

What you'll do

• Design and optimize machine learning models for training and inference on Apple Silicon devices.
• Collaborate with cross-functional teams to enhance model performance and efficiency across the ML stack.
• Implement production-level code for deploying models that impact millions of Apple customers daily.
• Troubleshoot complex issues like CUDA OOM errors during model training and deployment.
• Utilize advanced optimization techniques such as quantization, KV Cache, and speculative decoding in LLMs.
• Familiarity with parallelism methodologies like FSDP and DDP for efficient ML training.

What we're looking for

• Experience in the full model lifecycle including training, evaluation, and deployment.
• Strong understanding of ML model architectures like Transformers and CNNs.
• Expertise in Python and ML frameworks such as PyTorch.
• Bachelor's degree in Computer Science or related field.
• Collaborative experience working on large inter-team projects.
• Knowledge of LLM optimization techniques including quantization and KV Cache.