Senior Staff Machine Learning Engineer, Data & Eval

Airbnb

Confirmed live yesterday High trust
Remote

Quick summary

Work type
Remote
Location
Remote
Salary
$244,000–$305,000 / yr
Posted
101 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $234k
This role $274k
$170k most similar roles pay here $319k

This role pays more than 82% of similar roles. Most pay $208,343–$260,050 — the shaded band above. At the midpoint, this role pays about $274k versus about $234k for comparable roles.

Based on 240 similar postings.

Employer

About Airbnb

Founded in 2008 and formerly known as AirBed & Breakfast, Inc., Airbnb is a global marketplace connecting travelers with hosts who offer unique accommodations, ranging from private rooms to entire homes. It operates a massive digital platform for booking stays, experiences, and travel services worldwide.

Airbnb currently has 65 open roles on FindRole.

Listed pay typically runs $200,000–$240,000 across 51 roles with salary data.

Most-posted roles

View all roles at Airbnb

At a glance

TL;DR · Senior Staff Machine Learning Engineer, Data & Eval

As a Senior Staff Machine Learning Engineer, Data & Eval on the Core ML team, you will drive technical direction and execution for machine learning evaluation and the end-to-end data flywheel powering CSxAI products. You will be responsible for defining evaluation strategies, building scalable frameworks including golden sets and synthetic data, and designing data flywheels involving instrumentation, feedback collection, and labeling strategies. Your daily work involves productionizing pipelines for dataset creation, model monitoring, and continuous testing while ensuring safety and reliability. You will utilize Generative AI technologies, LLM fine-tuning, RAG/Search, and advanced evaluation methodologies like human-in-the-loop systems and A/B testing. This role addresses the challenge of creating intelligent, scalable customer service experiences by transforming complex feedback into learning signals to improve model performance across various applications within a high-complexity marketplace.

What does a Machine Learning Engineer earn in Remote?

Median $229700 from 72 postings across 27 companies.

See salary data

What you'll do

  • Define evaluation strategies and success metrics for Generative AI systems to align offline results with online business outcomes.
  • Build and scale evaluation frameworks including golden sets, synthetic data, and automated regression testing.
  • Design the end-to-end data flywheel for instrumentation, feedback collection, labeling strategy, and dataset versioning.
  • Lead cross-functional quality initiatives to define product standards and act on evaluation results across teams.
  • Develop and productionize pipelines for dataset creation, model monitoring, and continuous testing at scale.
  • Drive technical architecture decisions for evaluation infrastructure while balancing speed, cost, and safety.

What we're looking for

  • PhD in Computer Science, Mathematics, Statistics, or a related technical field (or equivalent practical experience).
  • 10+ years of experience building, testing, and shipping ML/AI systems end-to-end.
  • 2+ years of experience with GenAI/LLM systems in production.
  • 5+ years of experience leading large, ambiguous technical initiatives as a senior individual contributor.
  • Deep expertise in evaluation methodology including offline/online alignment, metric design, and A/B testing.
  • Hands-on experience with GenAI systems including orchestration, retrieval, tool calling, and memory.
  • Experience building data pipelines and quality systems for labeling workflows, dataset curation, and monitoring.
  • Solid knowledge of ML fundamentals such as model selection, training, serving, and lifecycle management.

More like this

Similar roles

Senior Staff Machine Learning Engineer, Post Training

Airbnb

Remote 101 days ago $248,000$310,000
Generative AI LLM PyTorch Python Machine Learning RAG Reinforcement Learning Model Quantization GPU Inference Data Processing multimodal modeling Kernel Development
10+ yrs exp Remote

Senior Staff Machine Learning Engineer, Trust

Airbnb

Remote 101 days ago $244,000$305,000
Machine Learning LLMs GenAI Agentic AI Python Scala Java C++ TensorFlow PyTorch Kubernetes Data Engineering Natural Language Processing Computer Vision Anomaly Detection A/B Testing Test Driven Development
10+ yrs exp Remote

Senior Machine Learning Engineer, Trust

Airbnb

Remote 27 days ago $200,000$235,000
Machine Learning LLMs Python TensorFlow PyTorch Scala Java Neural Networks Transformers Deep Learning Feature Engineering Data Engineering A/B Testing Real-time Systems
5+ yrs exp Remote