Machine Learning Systems Engineer, Siri Agent Modeling

What you'll do

• Design and optimize ML model training and inference processes for Apple devices.
• Develop production-level code to train and deploy machine learning models across various Apple products.
• Collaborate with cross-functional teams to enhance the performance of AI models on Apple Silicon.
• Implement advanced techniques like quantization, KV Cache, and Speculative Decoding to improve model efficiency.
• Work on large-scale ML projects involving multiple inter-team collaborations.
• Utilize frameworks such as PyTorch and libraries like HuggingFace transformers for LLM training.

What we're looking for

• Extensive experience in the full model lifecycle including training, evaluation, and deployment.
• Deep understanding of ML model architectures like Transformers and CNNs and proficiency with PyTorch.
• Strong background in Python programming for machine learning applications.
• Bachelor's degree in Computer Science or related field, or equivalent industry experience.
• Expertise in optimizing large language models through techniques such as quantization and KV Cache.
• Familiarity with distributed training methodologies like FSDP and DDP.
• Experience working on inter-team projects and collaborating across various engineering teams.