Staff Research Engineer, Post-training & Evaluation

What you'll do

• Define the "Reddit Benchmark" evaluation standard for model quality.
• Ensure evaluation reliability and statistical rigor in benchmarking models.
• Design methodologies for automated model-as-a-judge evaluations.
• Set post-training recipes to convert base models into high-performing endpoints.
• Evaluate base and CPT checkpoints to select optimal starting points.
• Drive the strategy for generating synthetic data to improve model generalization.

What we're looking for

• 6+ years of professional ML experience or PhD + 4 years in related field.
• Deep expertise in evaluation reliability and statistical rigor for automated evaluations.
• Strong experience building custom, domain-specific evaluation harnesses.
• Experience evaluating both generation and representation/classification models.
• Fluency in Python with strong data-pipeline and eval-harness engineering skills.