Staff Software Engineer AI/ML

Samsung Semiconductor

Confirmed live 2 days ago High trust

Quick summary

Work type
On-site
Location
San Jose, CA
Salary
$163,000–$253,000 / yr
Posted
31 days ago
Freshness
Confirmed live 2 days ago

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $218k
This role $208k
$150k most similar roles pay here $280k

This role pays less than 61% of similar roles. Most pay $184,975–$251,875 — the shaded band above. At the midpoint, this role pays about $208k versus about $218k for comparable roles.

Based on 240 similar postings.

Employer

About Samsung Semiconductor

Samsung Semiconductor is the global semiconductor business unit of Samsung Electronics, designing and manufacturing memory chips, logic semiconductors, and foundry solutions for a broad range of applications.

Samsung Semiconductor currently has 49 open roles on FindRole.

Listed pay typically runs $163,000–$253,000 across 49 roles with salary data.

Most-posted roles

View all roles at Samsung Semiconductor

At a glance

TL;DR · Staff Software Engineer AI/ML

Staff Software Engineer AI/ML joins the Applied AI Engineering team within the AI and Process Innovation organization to develop next-generation AI frameworks and infrastructure. This role involves designing, building, and productizing agentic AI applications that combine vision and language models while architecting multi-agent systems using frameworks like LangGraph, LangChain, AutoGen, or CrewAI. The engineer will establish evaluation frameworks for multimodal systems, manage quality, cost, and latency trade-offs, and optimize inference performance on accelerated hardware through quantization and kernel-level tuning. Key technical requirements include proficiency in Python, C/C++, PyTorch, and TensorFlow, alongside experience with vLLM and TensorRT-LLM. The role addresses the challenge of enabling frontier AI models to autonomously plan and execute multi-step workflows while optimizing for memory bottlenecks and hardware architecture within a semiconductor design environment.

What does a Software Engineer earn in California?

Median $214000 from 775 postings across 63 companies.

See salary data

What you'll do

  • Design, build, and productize agentic AI applications using vision and language models from prototype to deployment.
  • Architect multi-agent systems using frameworks like LangGraph or CrewAI including orchestration, state management, and tool routing.
  • Establish evaluation frameworks and quality benchmarks for multimodal systems through reference metrics and regression harnesses.
  • Make data-driven decisions regarding model selection, routing strategies, and inference configurations to balance cost and latency.
  • Optimize inference performance on accelerated hardware through quantization, batching, caching, and kernel-level tuning.
  • Solve multi-discipline AI acceleration problems involving memory bottlenecks, network design, and hardware architecture.
  • Collaborate with researchers and developers to integrate and optimize the latest machine learning advancements.

What we're looking for

  • BS with 10+ years, MS with 8+ years, or PhD with 5+ years of experience in Computer Science, Electrical Engineering, or a related field.
  • Proven track record of deploying and operating LLM- or vision-powered systems in production with experience in evaluation and safe rollout practices.
  • Hands-on expertise with agentic AI frameworks including LangGraph, CrewAI, and ADK for multi-agent orchestration and tool routing.
  • Experience with LLM inference optimization and serving using tools like vLLM or TensorRT-LLM, including quantization and KV-cache management.
  • Strong Python and C/C++ skills with deep experience in PyTorch or TensorFlow and designing large-scale distributed systems.
  • PhD of software engineering experience (preferred).
  • MLOps exposure including prompt/version management, monitoring, and observability (preferred).
  • Experience with ML, graphics, computer vision accelerators, or performance modeling of heterogeneous systems (preferred).

More like this

Similar roles

Senior Staff Engineer, AI Software

Samsung Semiconductor

San Jose, CA 94 days ago $189,000$301,000
PyTorch vLLM LLM Agentic AI HBM Linux GitHub Jira AI/ML Memory Architecture software–hardware co-design
10+ yrs exp

Software Engineer AI/ML

GE Aerospace

Remote (Evendale, OH) 18 days ago $112,000$150,000
LLM Python AWS Databricks MLflow FastAPI Flask RAG Vector Databases CI/CD REST APIs Prompt Engineering TypeScript Java C# GitHub Visual Studio Lean Agile XP
3+ yrs exp Remote

AI/ML Software Engineer

Apple Inc

Sunnyvale, CA 30 days ago $150,400$277,600
Computer Vision Machine Learning C++ Swift iOS macOS MLX ARKit REKit 3D Graphics Diffusion Transformer Models On-device Inference Linear Algebra Numerical Analysis Agentic Workflow Frameworks Real-time Systems Software Architecture
5+ yrs exp

Applied AI/ML Software Engineer

Apple Inc

San Diego, CA 6 days ago $142,300$263,300
Machine Learning Generative AI LLMs RAG Python Ruby Java Kubernetes Data Analysis Infrastructure Evaluation Pipelines Agentic Pipelines

Staff Software Engineer, AI Applications

Plaid

San Francisco, CA 22 days ago $264,660$369,800
LLMs GenAI RAG Prompt Engineering Fine-tuning Agent Orchestration Microservices API JavaScript HTML CSS SSE Streaming Machine Learning Monitoring