below marketmost similar roles pay hereabove market
This role pays less than
54%
of similar roles. Most pay
$184,118–$254,750
— the blue band above.
At the midpoint, this role pays about
$214k
versus about
$219k
for comparable roles.
Based on 240 similar postings.
Employer
About Apple Inc
Apple Inc. is a multinational technology company known for designing and manufacturing consumer electronics, software, and online services, including the iPhone, Mac, iPad, and App Store. Industry: Consumer Electronics & Software
Apple Inc currently has
3497 open roles
on FindRole.
Listed pay typically runs
$174,149–$277,600
across 2702 roles with salary data.
The Multimodal AI Researcher joins the Video Computer Vision organization to develop breakthrough technologies for future products. This role involves conducting algorithm research and development to solve hard, open research problems in multimodal generative AI and agents. You will build foundation models that integrate real-time sensor data, such as video and audio, with other modalities like text. Key responsibilities include driving data requirements, validation strategies, and key performance indicators while translating research into real features. The position requires proficiency in Python and PyTorch, with experience in LLMs, VLMs, and training generative architectures like diffusion, reinforcement learning, flow matching, or normalizing flows. You will work on human-centric solutions involving interactive models and audio-to-audio systems to improve perception and multimodal understanding across the ecosystem.
Develop foundation models for generative AI and multimodal systems integrating video, audio, and text.
Conduct algorithm research and development to solve hard, open research problems in multimodal generative AI.
Build and train models for multimodal perception systems using LLMs and VLMs.
Train and troubleshoot generative architectures such as diffusion, reinforcement learning, and flow matching at scale.
Drive data requirements, validation strategies, and key performance indicators for AI models.
Implement software engineering solutions using Python and PyTorch to bring research to production features.
Develop real-time or streaming multimodal models for speech understanding and generation.
Apply reinforcement learning techniques to help post-train foundation models.
What we're looking for
BS degree and a minimum of 3 years of relevant industry experience.
Experience building models for multimodal perception systems.
Experience working with LLMs and VLMs.
Software engineering skills and proficiency in Python and PyTorch.
MS or PhD in computer vision, computer graphics, machine learning, computer science, computer engineering, or related fields (preferred).
Experience developing, training/tuning foundation models and multimodal LLMs (preferred).
Experience training and troubleshooting generative architectures such as diffusion, reinforcement learning, flow matching, or normalizing flow at scale (preferred).
Experience with real-time or streaming multimodal models (preferred).
Generative AI
Multimodal Foundation Models
Deep Learning
Python
PyTorch
JAX
Computer Vision
Data Pipelines
On-device Machine Learning
Data Curation
Vision-Language Models
Video-Language Models
Python
PyTorch
JAX
Deep Learning
Generative AI
Multimodal Foundation Models
Computer Vision
Data Pipelines
On-device Machine Learning
Data Curation
Vision-Language Models
Video-Language Models
Python
PyTorch
JAX
Deep Learning
Generative AI
Multimodal Foundation Models
Computer Vision
Data Pipelines
On-device Machine Learning
Data Curation
Vision-Language Models
Video-Language Models
Python
PyTorch
JAX
Deep Learning
Generative AI
Multimodal Foundation Models
Computer Vision
Data Pipelines
On-device Machine Learning
Data Curation
Vision-Language Models
Video-Language Models
Multimodal LLMs
Generative AI
Machine Learning
Deep Learning
Computer Vision
Natural Language Processing
Python
Go
Java
C++
Fine-tuning
Foundation Models