On-Device ML Engineering Manager, Tools & Services

Apple Inc

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Seattle, WA
Salary
$195,700–$338,400 / yr
Posted
50 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $227k
This role $267k
$156k most similar roles pay here $358k

This role pays more than 80% of similar roles. Most pay $197,631–$257,237 — the shaded band above. At the midpoint, this role pays about $267k versus about $227k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · On-Device ML Engineering Manager, Tools & Services

As the On-Device ML Engineering Manager (Tools & Services), you will lead a diverse team focused on building infrastructure that makes on-device machine learning performance measurable, understandable, and improvable. You will manage engineers developing frontend web services for model introspection, backend services, and an on-device toolchain designed to gather low-level performance data and associate it with high-level PyTorch framework operations. The role involves overseeing the infrastructure required to run ML inference across fleets of devices while improving the iterative workflow from model authoring to performance profiling. You will utilize skills in Python, Swift, Objective-C, or C/C++ to support tools involving Core ML, Win ML, ONNX, TF Lite, ExecuTorch, and MLIR or LLVM compiler technologies. This role solves critical problems in the research-to-production lifecycle for on-device machine learning models across various hardware platforms.

What you'll do

  • Lead the team developing frontend and backend web services for introspecting ML models and their execution.
  • Manage the development of on-device toolchains that gather, associate, and report low-level performance data.
  • Improve the end-to-end workflow for model authoring, profiling, and optimization for ML developers.
  • Own the infrastructure for running ML inference across large fleets of devices to ensure reliable performance data.
  • Hire, mentor, and manage the careers of software engineers specializing in ML and developer tools.
  • Partner with cross-functional teams to advance state-of-the-art on-device ML functionality and performance.

What we're looking for

  • BS/MS/PhD in Computer Science or Electrical Engineering.
  • Two or more years of strong and validated management experience.
  • Knowledge of ML development workflows and at least one authoring framework like PyTorch.
  • Experience delivering web services and developer-facing tools across frontend and backend.
  • Proficiency in at least one of Python, Swift, Objective-C, or C/C++.
  • Track record of creating clean software architectures and high-performance extensible software.
  • Experience with on-device ML frameworks such as Core ML, Win ML, ONNX, TF Lite, or ExecuTorch.
  • Experience with performance profiling, benchmarking, and infrastructure for running workloads across device fleets.

More like this

Similar roles

On-Device ML Compiler Engineer

Apple Inc

Cupertino, CA 8 days ago $184,700$324,800
MLIR C++ PyTorch Swift GPU Neural Engine Compiler Optimization Machine Learning Model Compression System Software Engineering Profiling Debugging Benchmarking

On-Device ML Compiler Engineer

Apple Inc

Cupertino, CA 58 days ago $150,400$277,600
MLIR C++ PyTorch Swift GPU Neural Engine Compiler Optimization Machine Learning Model Compression System Software Profiling Debugging Benchmarking