Senior Staff Engineer, AI Software

Samsung Semiconductor

Quick summary

Work type
On-site
Location
San Jose, CA
Salary
$189,000–$301,000 / yr
Posted
2 days ago

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $208k
This role $245k
$154k most similar roles pay here $317k

This role pays more than 71% of similar roles. Most pay $170,000–$246,150 — the shaded band above. At the midpoint, this role pays about $245k versus about $208k for comparable roles.

Based on 240 similar postings.

Employer

About Samsung Semiconductor

Samsung Semiconductor is the global semiconductor business unit of Samsung Electronics, designing and manufacturing memory chips, logic semiconductors, and foundry solutions for a broad range of applications.

Samsung Semiconductor currently has 59 open roles on FindRole.

Listed pay typically runs $163,000–$253,000 across 51 roles with salary data.

Most-posted roles

View all roles at Samsung Semiconductor

At a glance

TL;DR · Senior Staff Engineer, AI Software

As a Senior Staff Engineer in the AI Software team, you will lead the co-design of software and hardware solutions to optimize AI model inference performance by addressing memory bottlenecks. Your day-to-day responsibilities include analyzing and optimizing large language models (LLMs) and agentic AI workloads across the entire software stack, profiling model execution to identify memory limitations, and collaborating with hardware teams to influence architectural decisions based on real-world workload behavior. You will develop, optimize, and benchmark inference solutions using frameworks like PyTorch and vLLM, while also defining best practices and mentoring others in co-design efforts. The role requires extensive experience with AI infrastructure, including a deep understanding of LLM model architectures, agentic AI workflows, and memory-centric compute approaches such as High Bandwidth Memory (HBM). Proficiency in Linux development environments, GitHub, Jira, and hands-on expertise with PyTorch are essential for this high-impact role.

What you'll do

  • Lead the co-design of software and hardware solutions to optimize AI model inference performance.
  • Analyze and optimize LLM and agentic AI workloads across the full software stack for acceleration.
  • Profile and characterize model execution to identify memory wall limitations and guide architectural decisions.
  • Collaborate with hardware teams to influence memory architecture based on real workload behavior.
  • Develop, optimize, and benchmark inference solutions using frameworks like PyTorch and vLLM.

What we're looking for

  • 15+ years of industry experience in AI software development.
  • Expertise in high-performance AI framework development for GPUs and accelerators.
  • Comprehensive understanding of AI infrastructure, from model definition to deployment.
  • Proficiency with PyTorch and vLLM for high-throughput inference and serving.
  • Solid knowledge of LLM model architectures and agentic AI workflows.
  • Strong command of memory architecture, including HBM and memory-centric compute.
  • Experience in profiling and optimizing AI workloads across the software stack.

More like this

Similar roles

Staff Software Engineer, AI

Blackline

New York, NY 6 days ago $193,000$193,000
Python LLM APIs (OpenAI, Anthropic, Google) RAG framework CI/CD ETL/ELT Kubernetes Docker PostgreSQL AWS GCP Prometheus Grafana
Hybrid

Senior Staff Engineer, AI Core

Nubank

Palo Alto, CA +1 11 days ago $345,000$345,000
Flutter Go Python Java AWS Microservices Event-driven design CI/CD Conversational AI Recommendation engines Distributed systems Kafka PostgreSQL Redis GraphQL FinTech Mobile app development
Hybrid

Senior Staff Engineer, AI Infrastructure

Samsung Electronics

Remote (3655 N 1St St, San Jose, Ca, Usa, US) 17 days ago $180,200$297,200
Kubernetes Docker Slurm LSF Python C++ PyTorch TensorFlow MLOps Data pipelines Large-scale data processing Storage architectures Pipeline orchestration PCIe NVLink InfiniBand GPU physical design Design verification CAD environments
Remote

Staff Software Engineer, AI

Okta Inc

Bellevue, WA +2 105 days ago $194,000$267,000
React Python AWS GCP Azure LLMs MCPs LangChain LangGraph LangSmith Distributed Systems Microservices REST GraphQL CI/CD Security Observability

Staff AI Software Engineer

Palo Alto Networks

Santa Clara, CA 2 days ago $124,000$201,500
Python Django FastAPI React GraphQL Google Cloud Platform Vertex AI Agent SDK LangChain A2A protocols Model Context Protocol (MCP) Vector embeddings Semantic search RAG architectures LLM guardrails Prompt engineering Docker Kubernetes GKE CI/CD

Senior Staff AI Platform Engineer

Nvidia

Santa Clara, CA 84 days ago $168,000$270,250
Python Kubernetes C++ Go Rust MLOps Hugging Face Weights & Biases NVIDIA NIM Prometheus Grafana Docker CI/CD AWS Azure Google Cloud Platform PostgreSQL MySQL Redis Git GitHub Jenkins Terraform Ansible Knative OpenTelemetry FedRAMP SOC 2