Senior Software Engineer, AI Inference Systems
Nvidia
Quick summary
Market check
How this pay compares to similar roles
This role pays less than 63% of similar roles. Most pay $142,487–$221,000 — the shaded band above. At the midpoint, this role pays about $155k versus about $182k for comparable roles.
Based on 240 similar postings.
Employer
SpaceX designs, manufactures, and launches advanced rockets and spacecraft with the mission of enabling humans to become a multi-planetary species. It operates the Falcon 9, Falcon Heavy, and Starship launch vehicles, as well as the Starlink satellite internet constellation.
SpaceX currently has 680 open roles on FindRole.
Listed pay typically runs $130,000–$165,000 across 442 roles with salary data.
Most-posted roles
At a glance
Software Engineer, Inference (AI Data Engineering) joins the application software team to maintain a high-performance AI inference platform serving internal models. This role involves designing and optimizing large-scale model serving systems end-to-end, including distributed infrastructure, load balancing, auto-scaling, and low-level GPU kernel work. The engineer will build reliable, high-throughput systems with features like quantization, speculative decoding, and custom tools for tracing and replaying issues across the full stack. Key responsibilities include benchmarking inference engines such as SGLang, vLLM, and TensorRT-LLM while developing CI/CD infrastructure for seamless deployment. Required technical skills include Rust or C++, Python, Go, gRPC, Docker, and Kubernetes. The role addresses the critical challenge of providing reliable, high-concurrency inference to power mission-critical applications, ensuring high availability and low tail latency for internal engineering goals.
What does a Software Engineer earn in California?
Median $214000 from 775 postings across 63 companies.
Skills
What you'll do
What we're looking for
More like this
Nvidia
F5 Inc
Nvidia
Apple Inc
Apple Inc
Nvidia