below marketmost similar roles pay hereabove market
This role pays more than
73%
of similar roles. Most pay
$149,500–$208,000
— the blue band above.
At the midpoint, this role pays about
$202k
versus about
$179k
for comparable roles.
Based on 240 similar postings.
Employer
About Qualcomm
Qualcomm is a leading American semiconductor and telecommunications company based in San Diego, CA.
Qualcomm currently has
587 open roles
on FindRole.
Listed pay typically runs
$147,900–$218,400
across 562 roles with salary data.
The Senior/Staff Software Engineer - LLM Inference Systems & Open-Source joins the Machine Learning Engineering team to advance the software ecosystem for large-scale LLM inference on Qualcomm platforms. You will contribute to open-source projects like llm-d by developing integrations for Qualcomm AI accelerators, focusing on distributed LLM serving, orchestration, and inference runtime integration. Daily responsibilities include developing device abstractions, memory management, and distributed execution while optimizing performance metrics like throughput and latency. You will utilize Python, C++, Go, or Rust to build cloud-native infrastructure using Kubernetes. Key technical tasks involve implementing model parallelism, KV-cache management, and request routing. This role solves the complex problem of building scalable, production-grade inference infrastructure by bridging the gap between hardware accelerators, distributed systems, and open-source LLM serving frameworks.
What does a Software Engineer earn in California?
Median $214500 from 1167 postings across 73 companies.