Manager, Engineering - AI Platform - Training & Serving

Datadog

Confirmed live 2 days ago High trust

Hybrid

Quick summary

Work type: Hybrid
Location: —
Posted: 101 days ago
Freshness: Confirmed live 2 days ago

Market check

Salary context

How this pay compares to similar roles

Similar $222k

$162k most similar roles pay here $278k

This listing doesn't post a salary. Most similar roles pay $176,850–$267,050.

Based on 240 similar postings.

Employer

About Datadog

Datadog, Inc. is an American company that provides an observability service for cloud-scale applications, providing monitoring of servers, databases, tools, and services, through a SaaS-based data analytics platform.

Datadog currently has 266 open roles on FindRole.

Listed pay typically runs $161,000–$205,000 across 138 roles with salary data.

Most-posted roles

View all roles at Datadog

At a glance

TL;DR · Manager, Engineering - AI Platform - Training & Serving

Role Posting Log in to save

Manager I, Engineering - AI Platform - Training & Serving will join the AI platform team to manage and grow a group of over ten engineers while defining technical roadmaps and shaping the product vision. This role involves building and scaling infrastructure for large-scale training and inference, specifically addressing challenges like distributed training of foundation models, serving at scale, and designing user experiences. The manager will collaborate with internal teams to tailor storage, infrastructure, and data pipelines while participating in hands-on activities such as code reviews and design reviews. The ideal candidate is a strong technician with experience in backend, data engineering, and infrastructure. They must be proficient in using AI coding tools to refine outputs and possess the interpersonal skills necessary to coordinate across cross-functional teams including product and science.

What does a Engineering Manager earn?

Median $267050 from 138 postings across 39 companies.

See salary data

Skills

Distributed Training AI Infrastructure Data Pipelines Infrastructure Code Review

What you'll do

Manage and grow a team of over 10 engineers within the Training & Serving department.
Define the technical roadmap for training and serving in alignment with AI platform goals.
Oversee the distributed training of foundation models and large-scale inference systems.
Coordinate with infrastructure teams to tailor storage, data pipelines, and hardware for AI needs.
Perform hands-on technical tasks including code reviews, design reviews, and active coding.
Build and maintain cross-functional partnerships with product, engineering, and science teams.
Drive the development of tools that enable large-scale training and inference for internal users.

What we're looking for

At least 1 year of experience leading software engineering teams as a tech lead or people manager.
Experience in backend engineering, data engineering, and infrastructure.
Ability to perform hands-on technical work including code reviews, design reviews, and coding.
Strong interpersonal skills to build and lead high-performing teams.
Proven ability to deliver high-quality software on schedule in ambiguous and fast-paced environments.
Experience building partnerships with cross-functional engineering, product, and science teams.
Demonstrated ability to use AI coding tools in daily workflows and refine AI-generated output.

Save