Machine Learning Engineer, Foundation Model Services

Apple Inc

Actively hiring
Santa Clara, CA Posted 10 days ago $181,100$318,400 / year

At a glance

AI generated

TL;DR

As a Machine Learning Engineer at Apple’s Foundation Model Services team in Santa Clara, California, you will work on building and optimizing production-grade solutions for large-scale AI models that power various Apple services such as Search, Music, TV, and Siri. Your day-to-day responsibilities include collaborating with product teams to launch models serving millions of users in real-time, prototyping inference for cutting-edge model architectures alongside the research team, and developing tools to identify bottlenecks in inference across different hardware platforms. You will need experience with high-throughput services at supercomputing scale, proficiency in Kubernetes, Docker, Golang, and Python, as well as familiarity with ML frameworks like PyTorch or TensorFlow and deep learning architectures such as Transformers. This role offers the opportunity to contribute to groundbreaking technology that impacts billions of users worldwide.

Skills

AWS Azure Kubernetes Docker Python Golang PyTorch TensorFlow Transformers Encoder/Decoder models Nvidia TensorRT-LLM vLLVM DeepSpeed Nvidia Triton Server CI/CD

What you'll do

  • Develop production-grade solutions for real-time model serving to millions of users.
  • Collaborate with the Foundation Model Research team to prototype and develop inference for advanced model architectures.
  • Create tools to identify and resolve bottlenecks in inference across various hardware and use cases.
  • Optimize large-scale language, vision, and speech models using state-of-the-art technologies.
  • Ensure high throughput services run efficiently at supercomputing scale.
  • Maintain systems written in modern programming languages like Golang or Python.

What we're looking for

  • 5+ years of industry experience in ML technologies including LLMs and NLP.
  • Expertise in high-throughput services at supercomputing scale.
  • Proficiency in running applications on cloud platforms using Kubernetes and Docker.
  • Strong skills in building and maintaining systems with modern programming languages like Golang or Python.
  • Bachelor’s degree or higher in Computer Science or related technical field.
  • Familiarity with popular ML frameworks such as PyTorch or TensorFlow.

Employer

About Apple Inc

Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software

Apple Inc currently has 255 open roles on FindRole.

Listed pay typically runs $171,600–$272,100 across 182 roles with salary data.

Most-posted roles

View all roles at Apple Inc