Staff Applied Scientist, Agentic Interfaces

Datadog

Confirmed live today High trust

Quick summary

Work type: On-site
Location: New York, NY
Salary: $276,000–$345,000 / yr
Posted: 151 days ago
Freshness: Confirmed live today
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $221k

This role $310k

$144k $367k

below market most similar roles pay here above market

This role pays more than 95% of similar roles. Most pay $186,331–$254,750 — the blue band above. At the midpoint, this role pays about $310k versus about $221k for comparable roles.

Based on 240 similar postings.

Employer

About Datadog

Datadog, Inc. is an American company that provides an observability service for cloud-scale applications, providing monitoring of servers, databases, tools, and services, through a SaaS-based data analytics platform.

Datadog currently has 73 open roles on FindRole.

Listed pay typically runs $192,000–$240,000 across 71 roles with salary data.

Most-posted roles

View all roles at Datadog

At a glance

TL;DR · Staff Applied Scientist, Agentic Interfaces

Role Posting Log in to save

The Staff Applied Scientist - Agentic Interfaces joins the Agentic Interfaces team to define and build measurement systems for AI agents consuming observability, security, and software delivery data. You will own the evaluation strategy for agent integrations, defining metrics for answer quality, tool-selection accuracy, retrieval relevance, latency, and token cost. Day-to-day responsibilities include building eval datasets, golden traces, and regression harnesses while conducting applied research on non-deterministic trajectories, large tool catalogs, and hallucination control. You will partner with AI engineers to improve context efficiency and provide technical leadership through design reviews and mentorship. The role requires a BS/MS/PhD in a scientific field and over 10 years of experience in engineering or applied science, specifically leading ML or GenAI initiatives in production environments.

What does a Applied Scientist earn?

Median $208800 from 61 postings across 10 companies.

See salary data

Skills

GenAI ML MCP Retrieval Evaluation Experimentation Telemetry Observability Security SRE

What you'll do

Own the evaluation strategy for Datadog's AI agent integrations.
Define offline and online metrics for quality, cost, and agent success.
Build evaluation datasets, golden traces, and regression harnesses for the platform.
Drive measurable improvements to retrieval relevance, tool-selection accuracy, and context efficiency.
Conduct applied research on non-deterministic agent trajectories and hallucination control.
Partner with internal teams to ensure first-party agents use a unified measurement substrate.
Provide technical leadership through design reviews, mentorship, and external thought leadership.

What we're looking for

You have a BS/MS/PhD in a scientific field or equivalent experience.
You have 10+ years of relevant engineering or applied science experience.
You have experience as a technical lead.
You have a proven track record of leading ML or GenAI initiatives in a product-driven environment from research through production.
You have significant experience with evaluation, experimentation, or measurement of ML systems at scale.
You have a strong product mindset and can drive initiatives across cross-functional teams.
You can make sound technical calls and thrive in ambiguous environments.

Save