Senior Software Engineer, AI Tools - On-Device Generative AI Model Optimization

Qualcomm

Confirmed live 2 days ago High trust

Quick summary

Work type
On-site
Location
San Diego, CARaleigh, NC
Salary
$140,800–$211,200 / yr
Posted
78 days ago
Freshness
Confirmed live 2 days ago
Closes
Dec 22, 2026

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $203k
This role $176k
$129k most similar roles pay here $254k

This role pays less than 70% of similar roles. Most pay $164,300–$241,750 — the shaded band above. At the midpoint, this role pays about $176k versus about $203k for comparable roles.

Based on 240 similar postings.

Employer

About Qualcomm

Qualcomm is a leading American semiconductor and telecommunications company based in San Diego, CA.

Qualcomm currently has 623 open roles on FindRole.

Listed pay typically runs $148,300–$222,500 across 603 roles with salary data.

Most-posted roles

View all roles at Qualcomm

At a glance

TL;DR · Senior Software Engineer, AI Tools - On-Device Generative AI Model Optimization

As a Sr Software Engineer, AI Tools – On-Device Generative AI Model Optimization, you will join the Machine Learning Engineering team to develop tools and solutions for state-of-the-art AI across various technology verticals. You will reauthor generative AI architectures, including LLMs like Llama and Phi as well as multimodal models, to ensure efficient execution on Qualcomm hardware while maintaining accuracy. Your daily work involves translating hardware constraints into model transformations, integrating inference acceleration techniques, and building developer-facing diagnostics for the preparation pipeline. You will collaborate with compiler and quantization teams to optimize performance for edge devices. The role requires proficiency in Python, PyTorch internals, and the HuggingFace ecosystem. You will solve technical challenges regarding memory layout, compute precision, and latency budgets to enable production deployments of custom OEM models on resource-constrained hardware.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

What you'll do

  • Reauthor generative AI architectures for efficient execution on Qualcomm hardware including LLMs and multimodal models.
  • Translate hardware constraints such as memory layout and operator support into model-level transformations to preserve accuracy.
  • Integrate inference acceleration techniques like memory-efficient attention and decode acceleration into the model preparation pipeline.
  • Develop reauthoring strategies for custom OEM models and convert research prototypes into production deployments.
  • Collaborate with compiler teams to determine optimal graph-level optimizations or model-level reauthoring.
  • Coordinate with quantization engineers to ensure architectural decisions integrate seamlessly with the quantization stack.
  • Build developer-facing diagnostics to provide actionable feedback when models fail to run efficiently on target hardware.

What we're looking for

  • A Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field with 2+ years of relevant engineering experience.
  • A Master's degree in Computer Science, Engineering, Information Systems, or a related field with 1+ year of relevant engineering experience.
  • A PhD in Computer Science, Engineering, Information Systems, or a related field.
  • Experience in ML systems, model optimization, or inference engineering.
  • Proficiency in Python within large, typed codebases.
  • Strong written and verbal communication skills for collaborating across research, compiler, and partner-facing teams.
  • Deep knowledge of generative AI architectures (LLMs and multimodal models) and PyTorch internals.
  • Experience optimizing inference for edge hardware and familiarity with on-device runtimes or SoC constraints.

More like this

Similar roles

Senior Software Engineer, AI Tools - AI/ML Compiler

Qualcomm

San Diego, CA +1 78 days ago $140,800$211,200
ONNX ONNX Runtime Python PyTorch Machine Learning Model Optimization Quantization Compiler Engineering Dataflow Analysis GitHub Copilot Cursor Claude Code Codeium
2+ yrs exp

Staff/Sr. Staff Software Engineer, AI Software Tools

Qualcomm

San Diego, CA +1 100 days ago $158,400$237,600
Python C++ PyTorch ONNX ONNX Runtime ExecuTorch TFLite LiteRT Quantization LLM LVM LMM Hugging Face PEFT CMake Git Android RTOS QNX Qualcomm AI Stack Snapdragon
6+ yrs exp

Software Engineer, AI Tools

Qualcomm

Raleigh, NC 127 days ago $110,600$165,800
Python C++ C PyTorch TensorFlow ONNX LiteRT ExecuTorch MLIR TfLite JAX TorchAO LLM LSTM Graph Compilation Agentic AI Claude Code

Staff Software Engineer, AI Tools

Pinterest

Remote (San Francisco, CA) 7 days ago $177,185$364,795
Python Go TypeScript Java OAuth 2.0 OIDC SAML MCP Envoy Kubernetes EKS Terraform CI/CD REST RPC Webhooks SCIM mTLS Google Workspace Slack Atlassian
7+ yrs exp Remote

Lead Software Engineer, AI Tools

US Bank

Atlanta, GA +1 2 days ago $126,820$149,200
Python React.js TypeScript REST API LangChain LangGraph Semantic Kernel AutoGen Azure AI Foundry RAG Vector Databases FAISS GitHub Copilot Copilot Studio Prompt Engineering CI/CD Container Orchestration Java C#
6+ yrs exp Hybrid

Software Engineer, AI Platform

Anduril Industries

Boston, MA 30 days ago $166,000$220,000
CI/CD Python C++ Rust Terraform Ansible Docker Kubernetes GitLab CI Jenkins GitHub Actions Bash Crossplane Puppet Chef Prometheus Grafana ELK Stack Splunk GitOps