Staff Applied Scientist - Dashboards | Datadog Careers

Datadog

Hybrid

Quick summary

Work type
Hybrid
Location
New York, NY
Salary
$276,000–$345,000 / yr
Posted
10 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $192k
This role $310k
$119k most similar roles pay here $369k

This role pays more than 98% of similar roles. Most pay $162,000–$222,425 — the shaded band above. At the midpoint, this role pays about $310k versus about $192k for comparable roles.

Based on 240 similar postings.

Employer

About Datadog

Datadog, Inc. is an American company that provides an observability service for cloud-scale applications, providing monitoring of servers, databases, tools, and services, through a SaaS-based data analytics platform.

Datadog currently has 114 open roles on FindRole.

Listed pay typically runs $187,000–$240,000 across 56 roles with salary data.

Most-posted roles

View all roles at Datadog

At a glance

TL;DR · Staff Applied Scientist - Dashboards | Datadog Careers

As a Staff Applied Scientist on the Dashboards team at Datadog, you will lead the evaluation and quality assurance of an AI-native observability platform that transforms how teams interact with metrics, logs, and traces. Your daily responsibilities include defining comprehensive offline and online metrics to measure system performance across various dimensions such as answer quality, tool selection accuracy, and latency, while also building robust datasets and regression harnesses to ensure consistent product improvements. You will collaborate closely with engineers to enhance retrieval relevance and context efficiency, driving measurable advancements in the AI-driven control surface. This role requires expertise in machine learning evaluation at scale, a strong background in scientific fields or equivalent experience, and proven leadership in technical and cross-functional initiatives. The ideal candidate thrives in ambiguity and can navigate complex product challenges within Datadog’s expansive ecosystem of observability tools.

What you'll do

  • Define and implement evaluation metrics for Dashboards to ensure quality and cost optimization.
  • Build reusable eval datasets and regression harnesses to catch quality changes before impacting customers.
  • Drive improvements in retrieval relevance, tool-selection accuracy, and context efficiency through technical leadership.
  • Provide mentorship and lead design reviews across the Dashboards team and broader organization.
  • Develop a measurement system that catches regressions across all widget types and data sources.

What we're looking for

  • At least 10 years of relevant engineering or applied science experience, including leadership roles.
  • Proven track record leading ML or GenAI initiatives from research to production in a product-driven environment.
  • Significant experience evaluating and measuring large-scale ML systems.
  • Strong technical expertise in defining evaluation metrics for AI systems.
  • Ability to drive cross-functional initiatives and provide technical mentorship.

More like this

Similar roles

Staff Data Scientist

Apple Inc

Sunnyvale, CA 47 days ago $203,300$305,600
Python R SQL Spark LLMs RAG CausalML EconML GRF Kubernetes MLOps CI/CD Feature Stores PostgreSQL Docker Terraform AWS Azure GoogleCloud

Staff Data Scientist

Stripe

South San Francisco +2 102 days ago $205,400$308,000
Python R SQL Kubernetes Terraform AWS CI/CD Docker Prometheus Grafana PostgreSQL BigQuery Snowflake GitLab Jupyter Airflow
Hybrid

Staff Data Scientist

Nerd Wallet

Remote (US) 14 days ago $152,000$282,000
Python pandas numpy scikit-learn LightGBM XGBoost PySpark SQL Snowflake Databricks Spark AWS Git MLflow A/B testing Power analysis Bias detection Kafka Kinesis Airflow DBT Feast
Remote

Staff Data Scientist

Twilio

Remote (US) 61 days ago $155,520$155,520
Python R SQL Scikit-learn XGBoost PyTorch TensorFlow Airflow dbt Spark AWS Kubernetes CI/CD Tableau Slack Generative AI Machine Learning Data Engineering A/B Testing Salesforce PostgreSQL
Remote

Staff Data Scientist

Apple Inc

Sunnyvale, CA 42 days ago $203,300$305,600
Python R SQL Spark LLMs CI/CD MLOps Kubernetes Feature Stores Causal Inference EconML GRF Causal Forests Recommendation Systems Streaming Data Batch Processing Data Lakes Synthetic Data Generation Prompt Engineering RAG Architectures