Browse tech roles

Basic role filtering by workplace, salary floor, and post age. For full AI matching and advanced filtering upload your resume using AI Match.

Active Keyword: LLM Inference Remove filter Clear all

8 of up to 20 (filtered)

Engineering Manager, LLM Inference & Deployment at Scale

Nvidia

Santa Clara, CA 14 days ago $224,000–$356,500
Actively hiring Confirmed live yesterday High trust Above market
LLMs VLMs TensorRT TensorRT-LLM vLLM SGLang Quantization Speculative Decoding Continuous Batching Prefix Caching KV-cache Optimization Distributed Computing GPU Cluster Orchestration Model Serving Inference Optimization Deep Learning
8+ yrs exp Hybrid
Save

Staff Applied Scientist

Adobe

San Jose, CA 32 days ago $216,400–$313,300
Actively hiring Confirmed live yesterday High trust Above market
LLM VLM Python PyTorch vLLM TensorRT-LLM SGLang Triton Inference Server TGI Kubernetes Ray Spark Dask Distributed Systems Quantization Vector Search
Save

Senior Lead AI Engineer, FM Hosting, LLM Inference

Capital One Financial

McLean, VA +2 39 days ago $229,900–$262,400
Actively hiring Confirmed live yesterday Trusted Above market
LLM Inference Python Go PyTorch Huggingface AWS VectorDBs Nemo Guardrails C++ Scala Java C# Machine Learning Similarity Search Model Evaluation Observability Optimization Techniques
6+ yrs exp
Save

Senior Lead AI Engineer, FM Hosting, LLM Inference

Capital One Financial

New York, NY +3 51 days ago $229,900–$262,400
Actively hiring Confirmed live yesterday Low trust Above market
LLM Inference Python Go PyTorch Huggingface AWS VectorDBs Nemo Guardrails C++ Java Scala C# Machine Learning Similarity Search Model Evaluation Observability
6+ yrs exp
Save

Senior Lead AI Engineer, FM Hosting, LLM Inference

Capital One Financial

New York, NY +3 71 days ago $229,900–$262,400
Actively hiring Confirmed live yesterday Low trust Above market
LLM Inference Python Go PyTorch Huggingface AWS VectorDBs Nemo Guardrails C++ Java Scala C# Machine Learning Similarity Search Model Evaluation Observability Optimization Techniques
6+ yrs exp
Save

Lead AI Engineer, FM Hosting, LLM Inference

Capital One Financial

New York, NY +3 102 days ago $197,300–$225,100
Actively hiring Confirmed live 2 days ago Low trust Competitive pay
LLM Inference Python PyTorch Huggingface VectorDBs AWS Nemo Guardrails Go Scala Java C++ C# Similarity Search Machine Learning Model Evaluation Observability
4+ yrs exp
Save

Lead AI Engineer, FM Hosting, LLM Inference

Capital One Financial

New York, NY +3 102 days ago $197,300–$225,100
Actively hiring Confirmed live 2 days ago Low trust Competitive pay
LLM Inference Python PyTorch Huggingface VectorDBs AWS Nemo Guardrails Go Scala Java C++ C# Similarity Search Machine Learning Model Evaluation Observability
4+ yrs exp
Save

Senior Lead AI Engineer, FM Hosting, LLM Inference

Capital One Financial

New York, NY +3 162 days ago $229,900–$262,400
Actively hiring Confirmed live yesterday Low trust Above market
LLM Python Go PyTorch Huggingface AWS VectorDBs Nemo Guardrails C++ Java Scala C# Machine Learning LLM Inference Similarity Search Model Evaluation Observability
6+ yrs exp
Save