Distinguished Architect, AI

Datadog

Confirmed live yesterday High trust
Remote

Quick summary

Work type
Remote
Location
Remote
Salary
$330,000–$440,000 / yr
Posted
100 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $225k
This role $385k
$136k most similar roles pay here $473k

This role pays more than 98% of similar roles. Most pay $184,900–$264,453 — the shaded band above. At the midpoint, this role pays about $385k versus about $225k for comparable roles.

Based on 240 similar postings.

Employer

About Datadog

Datadog, Inc. is an American company that provides an observability service for cloud-scale applications, providing monitoring of servers, databases, tools, and services, through a SaaS-based data analytics platform.

Datadog currently has 266 open roles on FindRole.

Listed pay typically runs $161,000–$205,000 across 138 roles with salary data.

Most-posted roles

View all roles at Datadog

At a glance

TL;DR · Distinguished Architect, AI

As a Distinguished Architect, AI within the Product Solutions Architecture team, you will serve as a technical multiplier for leading AI labs and companies. You will bridge the gap between advanced infrastructure aspirations and the company roadmap to solve unique observability challenges for training and deploying foundational models at scale. Your daily responsibilities include providing strategic advisory to founders and research leads, conducting deep-dive architecture reviews, and identifying emerging technology shifts to inform product management. You will collaborate across teams to co-create custom integrations while assisting in recruiting top talent. The role requires expertise in distributed systems, high-performance computing, accelerator hardware like GPUs and TPUs, and modern orchestration frameworks. You must possess a deep understanding of the AI/LLM ecosystem, LLM Observability, and the technical requirements for managing high-throughput hyper-scale workloads.

What does a Architect earn?

Median $235750 from 31 postings across 17 companies.

See salary data

What you'll do

  • Act as a technical multiplier for AI labs to bridge infrastructure goals with the Datadog roadmap.
  • Advise high-level stakeholders on best practices and emerging trends in the AI/LLM space.
  • Lead deep-dive architecture reviews and design engagements to demonstrate how Datadog supports high-throughput workloads.
  • Identify emerging AI technology shifts and provide feedback to Product Management for feature development.
  • Co-create custom observability integrations and solutions alongside Product Solutions Architects.
  • Influence key decision-makers by connecting technical capabilities to organizational and business impact.
  • Assist leadership in recruiting and hiring top talent for the PSA and Field CTO teams.

What we're looking for

  • Bachelor's degree in engineering or a related field is required; a Master's degree is preferred.
  • 10+ years of experience with at-scale distributed systems architecture, high-performance computing, or large-scale infrastructure.
  • Deep familiarity with the AI/LLM ecosystem, accelerator hardware (GPUs/TPUs), and modern orchestration frameworks.
  • Proven ability to influence and interact with technical founders, research scientists, and senior engineers in rapid-growth environments.
  • Strong hands-on technical credibility as a "close-to-the-metal" technologist capable of white-boarding architectural solutions.
  • Excellent public speaking and presentation skills for both large audiences and executive-level stakeholders.
  • Ability to link product functionality to business objectives, value realization, and ROI through strong verbal and written communication.
  • Willingness to travel via auto, train, or air up to 50% of the time.

More like this

Similar roles

Senior Product Solutions Architect, AI Agent

Datadog

Remote 100 days ago $185,000$246,000
LLM Observability Python JavaScript TypeScript Distributed Systems Tracing Metrics Logging SRE DevOps Datadog AI Software Engineering Reference Architecture
Remote Hybrid

Distinguished AI Engineer

Capital One Financial

San Francisco, CA +4 10 days ago $269,100$307,200
Python Go Scala Java C++ C# AWS Huggingface PyTorch VectorDBs LLM Inference Machine Learning Nemo Guardrails Similarity Search SaaS AI Engineering
8+ yrs exp

Distinguished Architect, Engineering Excellence

Palo Alto Networks

Santa Clara, CA 69 days ago $243,000$335,000
AI Agentic Workflows Microservices Event-Driven Architecture API SDLC AIOps Prompt Engineering GitHub Copilot Cursor Diagram-as-Code Refactoring CRM ERP HRIS CLM
10+ yrs exp

Distinguished Technologist, Edge AI Architect

HP Inc.

Palo Alto, CA +1 25 days ago $174,050$278,450
Edge AI LLM vLM Multi-modal AI Inference Serving Agentic AI MLOps LLMOps Python C++ Rust CUDA Kubernetes Docker AWS Microsoft Azure CI/CD Distributed Systems Secure Boot Hardware/software co-design
10+ yrs exp

Principal AI Architect

LPL Financial

Fort Mill, NC +3 28 days ago $155,942$259,869
Generative AI Agentic AI RAG LLMOps MLOps Python AWS Kubernetes EKS Bedrock DynamoDB Vector Databases Infrastructure-as-Code Microservices API Gateway DevSecOps
10+ yrs exp