Staff ML Engineer, Ads ML Infrastructure

What you'll do

• Design and develop secure, scalable back-end systems for large-scale ML serving.
• Support real-time and batch inference using distributed systems like Ray and high-throughput RPCs.
• Optimize model performance through quantization, tensor parallelism, and low-level GPU kernel tuning.
• Build foundational AI/ML infrastructure including Feature Stores and Vector Databases.
• Develop abstractions and automation tools to streamline ML workflows and improve developer experience.
• Implement privacy-preserving ML techniques and federated learning to meet Apple's privacy commitments.
• Lead technical design reviews and mentor engineers to support team growth and knowledge sharing.

What we're looking for

• Proven track record of designing and operating large-scale, low-latency ML Serving platforms for real-time and batch inference.
• Experience with model quantization, tensor parallelism, and inference optimizations like ONNX Runtime, TensorRT, or vLLM.
• Experience working on distributed systems such as Ray or high-throughput RPC systems for scalable inference workloads.
• Hands-on experience designing and optimizing low-level GPU kernels to maximize hardware utilization and accelerate deep learning primitives.
• Prior experience in the advertising industry, federated learning, and privacy-preserving ML techniques.
• Experience leading development of foundational AI/ML platforms and tooling including Feature Stores and Vector DBs.
• Ability to communicate effectively with technical and non-technical multi-functional teams in a collaborative environment.
• PhD, MS, or BS in computer science or a related field with 8+ years of experience in machine learning (preferred).