Machine Learning Engineer, Foundation Model Services

Apple Inc

Confirmed live 2 days ago Trusted

Quick summary

Work type
On-site
Location
Santa Clara, CA
Salary
$184,700–$324,800 / yr
Posted
113 days ago
Freshness
Confirmed live 2 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $226k
This role $255k
$166k most similar roles pay here $342k

This role pays more than 75% of similar roles. Most pay $197,925–$255,000 — the shaded band above. At the midpoint, this role pays about $255k versus about $226k for comparable roles.

Based on 240 similar postings.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 1984 open roles on FindRole.

Listed pay typically runs $175,000–$277,600 across 1590 roles with salary data.

Most-posted roles

View all roles at Apple Inc

At a glance

TL;DR · Machine Learning Engineer, Foundation Model Services

Machine Learning Engineer, Foundation Model Services joins the Foundation Model Services team within the Machine Learning Platform Technologies organization. This role focuses on building production-grade solutions and tools to serve large language, vision, and speech models at scale while optimizing billions of parameters for real-time use. The engineer will collaborate with product teams to launch services and work with the Foundation Model Research team to prototype inference for cutting-edge architectures. Key responsibilities include identifying hardware bottlenecks and developing high-throughput systems. Required skills include experience in LLMs, NLP, Information Retrieval, and Statistics, alongside proficiency in Python or Golang. Technical requirements include familiarity with PyTorch, TensorFlow, Transformers, and tools like TensorRT-LLM, vLLM, DeepSpeed, and Triton Server. The role involves managing infrastructure using Kubernetes and Docker on cloud platforms to power core services.

What does a Machine Learning Engineer earn in California?

Median $246394 from 172 postings across 28 companies.

See salary data

What you'll do

  • Build production-grade solutions to serve large foundation models to millions of customers in real time.
  • Prototype and develop inference for cutting-edge model architectures alongside the Foundation Model Research team.
  • Develop tools to identify and analyze performance bottlenecks in inference across different hardware types.
  • Optimize billions of parameters in language, vision, and speech models using state-of-the-art technologies.
  • Scale machine learning services to handle high throughput at supercomputing scales.
  • Build and maintain production systems using modern programming languages like Golang and Python.
  • Deploy and manage ML applications on cloud infrastructure using Kubernetes and Docker.

What we're looking for

  • Bachelor's degree or higher in Computer Science or a related technical field.
  • At least 5 years of industry experience in ML technologies including LLMs, Machine Learning, NLP, Information Retrieval, and Statistics.
  • Experience with high throughput services at supercomputing scale.
  • Proficiency in running applications on Cloud platforms using Kubernetes and Docker.
  • Proficiency in building and maintaining systems written in modern languages like Golang or Python.
  • Familiarity with popular ML frameworks such as PyTorch or TensorFlow.
  • Familiarity with fundamental Deep Learning architectures including Transformers and Encoder/Decoder models.
  • Familiarity with tools like Nvidia TensorRT-LLM, vLLM, DeepSpeed, and Nvidia Triton Server.

More like this

Similar roles

Machine Learning Engineer

Apple Inc

Sunnyvale, CA 8 days ago $216,200$324,800
LLM PyTorch TensorFlow JAX Transformers MoE Computer Vision Natural Language Processing Distributed Data Processing Machine Learning Deep Learning OCR Synthetic Data Generation Data Curation High Performance Computing

Machine Learning Engineer, Foundation Model Services

Apple Inc

Seattle, WA 113 days ago $175,000$308,500
LLMs Machine Learning NLP Python Golang Kubernetes Docker AWS Azure PyTorch TensorFlow Transformers Nvidia TensorRT-LLM DeepSpeed Nvidia Triton Server Information Retrieval Statistics
5+ yrs exp

Machine Learning Engineer

Q2

Austin, TX 28 days ago
Machine Learning Python R Java TensorFlow PyTorch scikit-learn Statistics Probability Theory Optimization Experimental Methodologies
5+ yrs exp Hybrid