ML Researcher, Foundation Models

What you'll do

• Pre-train and develop mid-training approaches for foundation models tailored for Apple silicon.
• Implement reinforcement learning techniques like RLHF, GRPO, and PPO to improve model reasoning.
• Develop autonomous coding agents capable of operating in real repositories and performing multi-step workflows.
• Solve reward modeling problems to prevent reward hacking and handle sparse or delayed rewards.
• Research scaling laws for RL compute allocation and progressive alignment across capability stages.
• Train models to manage their own context during long-horizon tasks using techniques like sparse attention.
• Perform distillation to combine independently optimized capabilities into a single, cohesive model.

What we're looking for

• PhD or equivalent practical experience in Computer Science or a related technical field.
• Demonstrated expertise in deep learning with publications at top ML/NLP conferences or a track record of applying techniques to products.
• Proficiency in Python and at least one deep learning toolkit such as JAX, PyTorch, or TensorFlow.
• Experience in reinforcement learning for LLMs including RLHF, GRPO, PPO, reward modeling, and scaling laws.
• Expertise in code generation, repository-level code understanding, and agentic coding systems.
• Experience with agentic systems involving multi-turn RL, tool-use planning, and long-horizon task execution.
• Knowledge of distillation and alignment techniques such as on-policy or reward-tilted distillation.
• Familiarity with long context and efficiency techniques like sparse attention and context compression.