below marketmost similar roles pay hereabove market
This role pays more than
84%
of similar roles. Most pay
$149,500–$190,375
— the blue band above.
At the midpoint, this role pays about
$213k
versus about
$170k
for comparable roles.
Based on 240 similar postings.
Employer
About Robinhood
Robinhood is a financial technology company offering commission-free stock, ETF, options, and cryptocurrency trading through its mobile app, aimed at democratizing access to financial markets. Industry: Financial Technology & Investment App
Robinhood currently has
45 open roles
on FindRole.
Listed pay typically runs
$196,000–$230,000
across 45 roles with salary data.
The Senior Software Engineer, AI Infra joins the AI Infrastructure team to build the foundation powering machine learning and AI across the company. This role involves designing and scaling infrastructure for the entire ML lifecycle, including feature stores, training pipelines, model serving, inference, and observability. You will build and optimize distributed systems for large-scale workloads, focusing on performance, reliability, and latency. Key responsibilities include improving GPU utilization through scheduling solutions, evolving the LLM gateway with intelligent model routing, and supporting open-weight and fine-tuned models. You will utilize skills in distributed systems, backend platforms, and system design to solve complex infrastructure challenges. The work addresses the technical problem of providing scalable, reusable AI capabilities and efficient resource management for diverse engineering needs.
What does a Software Engineer earn in California?
Median $214500 from 1116 postings across 75 companies.
Design and scale infrastructure for feature stores, training pipelines, model serving, and observability.
Build and optimize distributed systems to support large-scale ML and AI workloads.
Develop scheduling solutions to improve GPU utilization and efficiency for training and inference.
Evolve the LLM gateway by implementing intelligent model routing and context optimization.
Support the infrastructure for serving open-weight and fine-tuned models across the company.
Own the operational health of critical infrastructure through monitoring, troubleshooting, and on-call rotations.
Build scalable and reusable infrastructure solutions based on needs from other engineering teams.
What we're looking for
Strong software engineering experience focusing on infrastructure, distributed systems, or large-scale backend platforms.
Hands-on experience designing, building, and operating distributed systems in production with a focus on scalability and reliability.
Experience solving complex infrastructure challenges including latency optimization and resource utilization.
Strong software development and system design skills to own complex technical problems from design through production.
Experience working with infrastructure technologies and tools in production environments at scale.
Ability to work independently and navigate ambiguity within a small, growing team.
Interest in machine learning and AI infrastructure with a willingness to work across traditional and emerging technologies.
Experience with ML infrastructure, model training or serving, GPU workload scheduling, LLM gateways, or open-source infrastructure technologies (preferred).
C
C++
C#
Java
JavaScript
Python
Azure
AWS
GCP
Kubernetes
Service Fabric
Distributed Systems
Telemetry
Real-time Data Processing
Inference Serving
Resource Scheduling