AIML Researcher/Engineer, Foundation Model Post-Training

What you'll do

• Design and iterate on end-to-end post-training strategies to unlock model capacities.
• Pioneer novel algorithms for preference optimization, model steering, and safety.
• Drive data strategy by researching methods for high-quality human and synthetic data generation.
• Develop robust evaluation methodologies to measure model helpfulness and factuality.
• Collaborate with pre-training teams to inform architecture choices and align user requirements.

What we're looking for

• Demonstrated expertise in deep learning with a focus on LLMs, post-training, or reinforcement learning.
• Proficiency in Python and a major deep learning framework such as JAX or PyTorch.
• Master's or PhD degree in Computer Science, Machine Learning, or a related technical field (or equivalent practical experience).
• Experience training state-of-the-art large models at scale with familiarity in distributed training challenges (preferred).
• Experience improving model performance on complex reasoning tasks such as math, coding, and logic (preferred).
• Experience with various transformer architectures and their transformations (preferred).
• Strong communication skills and a passion for working cross-functionally across Research and Product teams (preferred).