Distinguished Architect, AI | Datadog Careers

Datadog

Hybrid

Quick summary

Work type
Hybrid
Location
New York, NY
Salary
$300,000–$484,000 / yr
Posted
15 days ago
Nearby
99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $209k
This role $392k
$135k most similar roles pay here $521k

This role pays more than 99% of similar roles. Most pay $172,225–$246,150 — the shaded band above. At the midpoint, this role pays about $392k versus about $209k for comparable roles.

Based on 240 similar postings.

Employer

About Datadog

Datadog, Inc. is an American company that provides an observability service for cloud-scale applications, providing monitoring of servers, databases, tools, and services, through a SaaS-based data analytics platform.

Datadog currently has 109 open roles on FindRole.

Listed pay typically runs $187,000–$240,000 across 58 roles with salary data.

Most-posted roles

View all roles at Datadog

At a glance

TL;DR · Distinguished Architect, AI | Datadog Careers

Apply Now Log in to save

Datadog is hiring a Distinguished Architect to join its Product Solutions Architecture team, targeting senior-level professionals with extensive experience in AI/LLM ecosystems and high-performance computing. This role involves demonstrating thought leadership by influencing key decision-makers and guiding technical founders on best practices and emerging trends. Day-to-day responsibilities include leading deep-dive architecture reviews, collaborating with cross-functional teams to develop custom observability solutions, and identifying technology shifts that inform product development. The ideal candidate should possess a strong background in distributed systems, accelerator hardware, and modern orchestration frameworks, along with excellent presentation and communication skills for both technical and non-technical audiences.

Skills

AI/LLM GPUs TPUs Docker Kubernetes Terraform AWS Azure Grafana Prometheus Python CI/CD Git PostgreSQL MongoDB Redis OpenTelemetry GraphQL REST_APIs

What you'll do

  • Lead technical conversations and influence decision-makers in the AI/LLM space.
  • Guide highly technical clients on best practices and emerging trends in AI infrastructure.
  • Present deep-dive architecture reviews to customer teams and leaders, showcasing Datadog’s capabilities.
  • Identify technology shifts in AI-native sectors and inform Datadog Product Management accordingly.
  • Collaborate with PSA, Sales, and Marketing to create high-quality technical resources for practitioners.
  • Assist in recruiting top talent for the Product Solutions Architecture and Field CTO teams.

What we're looking for

  • 10+ years of experience in large-scale infrastructure and distributed systems architecture.
  • Deep expertise in AI/LLM ecosystem, accelerator hardware (GPUs/TPUs), and modern orchestration frameworks.
  • Proven ability to influence elite technical leaders and research scientists in fast-paced environments.
  • Strong hands-on technologist with deep understanding of AI/LLM Observability challenges.
  • Excellent customer-facing presentation skills for both technical and non-technical audiences.
  • Ability to travel up to 50% of the time via various modes of transportation.

Related searches

More Distinguished Architect jobs Distinguished Architect jobs in New York All jobs at Datadog

More like this

Similar roles

Senior Architect, AI Solutions Engineering

Nvidia

Santa Clara, CA 79 days ago $224,000–$356,500
Python Java Shell-script Kubernetes Docker SQL NoSQL MySQL Cassandra MongoDB Elasticsearch OpenStack Hadoop Git Puppet Chef JFrog Kafka CI/CD REST_APIs Large_Language_Models RAG Fine-Tuning_LLMs LangChain LangGraphs Cascading_models
Save

AI Solutions Architect

SpaceX

Remote (US) 13 days ago $234,000–$247,000
Snowflake Python ERP POS CRM APIs Docker CI/CD Kubernetes PostgreSQL AWS Git Swagger Terraform GraphQL
Remote
Save

Solutions Architect, Applied AI Builder

Nvidia

Santa Clara, CA 72 days ago $152,000–$241,500
Python TypeScript Go Rust C++ Synthetic data generation GPU-backed inference systems Multi-agent workflows Orchestration patterns Complex long-running task systems MCP A2A-style communication patterns Secure execution Sandboxing Secrets handling Auditability CI/CD
Save

Architect, Applied Scientist (Reasoning Platform, AI Lead)

Oracle

US 7 days ago $161,700–$338,500
Python Java Machine Learning Deep Learning Cloud Services Natural Language Processing Time Series Analysis Automatic Speech Recognition Computer Vision CI/CD Kubernetes AWS Docker Terraform Prometheus Grafana
Save