On-Device ML Engineering Manager, Tools & Services

Apple Inc

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Seattle, WA
Salary
$195,700–$338,400 / yr
Posted
95 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $229k
This role $267k
$166k $357k
below market most similar roles pay here above market

This role pays more than 82% of similar roles. Most pay $202,800–$254,750 — the blue band above. At the midpoint, this role pays about $267k versus about $229k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 3497 open roles on FindRole.

Listed pay typically runs $174,149–$277,600 across 2702 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · On-Device ML Engineering Manager, Tools & Services

The On-Device ML Engineering Manager (Tools & Services) leads the Performance Tools and Services team to develop infrastructure making on-device machine learning performance measurable and improvable. You will manage a diverse team of engineers building frontend web services for model introspection, backend services, and an on-device toolchain that gathers low-level performance data. The role involves owning the infrastructure for running ML inference across device fleets and improving the workflow from model authoring to performance profiling. Key requirements include proficiency in Python, Swift, Objective-C, or C/C++, along with experience in PyTorch, Core ML, Win ML, ONNX, TF Lite, or ExecuTorch. You will solve technical problems by connecting low-level signals to framework-level semantics using MLIR and LLVM compiler technologies to optimize model execution on hardware.

What you'll do

  • Lead the team building frontend and backend web services for introspecting ML models and on-device execution.
  • Manage the development of an on-device toolchain to gather and report low-level performance data.
  • Improve the end-to-end workflow for model authoring, performance profiling, and iterative model improvement.
  • Own the infrastructure for running ML inference across large fleets of devices to ensure reliable performance data.
  • Associate low-level performance signals with high-level framework-level operations like PyTorch.
  • Hire and guide the careers of ML, software, and tools engineers.
  • Partner with cross-functional teams to advance on-device ML functionality and performance.

What we're looking for

  • BS/MS/PhD in Computer Science or Electrical Engineering.
  • Two or more years of strong and validated management experience.
  • Knowledge of ML development workflows, including experience with at least one authoring framework like PyTorch.
  • Experience delivering web services and developer-facing tools spanning frontend and backend.
  • Solid programming skills in at least one of the following: Python, Swift, Objective-C, or C/C++.
  • Track record of creating clean software architectures, intuitive designs, and high-performance extensible software.
  • Excellent communication skills.
  • Experience with on-device ML frameworks, performance profiling, or MLIR/LLVM compiler technologies (preferred).

More like this

Similar roles

On-Device ML Infrastructure Engineer, CoreML Runtime

Apple Inc

Cupertino, CA 21 days ago $184,700–$324,800
C++ Swift Python MLIR LLVM TVM CoreML PyTorch TensorFlow JAX TFLite ONNX ExecuTorch GPU Programming Parallel Programming Operating Systems Transformers ML Compilers Model Compression

Senior Engineering Program Manager, On-Device ML

Apple Inc

Cupertino, CA 41 days ago $144,600–$263,800
Machine Learning ML Training Data Processing Pipelines Data Analytics Backend Services Research to Production Technical Roadmaps Apple Silicon Software Platforms Metrics Data Processing
6+ yrs exp