Evaluation & Insights Machine Learning Engineer

What you'll do

• Lead rigorous evaluations of large language models and multimodal systems.
• Develop advanced scoring frameworks for quantifying model quality metrics.
• Extract actionable signals from qualitative data for model training adjustments.
• Improve model performance by refining behavior with evaluation telemetry insights.
• Recognize latent patterns in model outputs using advanced ML techniques.

What we're looking for

• Bachelor’s or Master’s degree in a relevant technical field with 5+ years of ML Engineering experience.
• Advanced proficiency in Python and deep learning ecosystems like PyTorch, JAX, Hugging Face.
• Proven experience building scalable ML inference pipelines and evaluation workflows for large AI systems.
• Strong ability to interpret unstructured model outputs and synthesize qualitative findings into actionable guidance.
• Hands-on experience developing, fine-tuning, or evaluating LLMs, multimodal models, and NLP systems.
• Deep familiarity with AI quality metrics, hallucination detection techniques, and alignment frameworks.