Senior Staff Engineer, AI Software

Samsung Semiconductor

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
San Jose, CA
Salary
$189,000–$301,000 / yr
Posted
94 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $212k
This role $245k
$156k most similar roles pay here $317k

This role pays more than 74% of similar roles. Most pay $177,656–$247,062 — the shaded band above. At the midpoint, this role pays about $245k versus about $212k for comparable roles.

Based on 240 similar postings.

Employer

About Samsung Semiconductor

Samsung Semiconductor is the global semiconductor business unit of Samsung Electronics, designing and manufacturing memory chips, logic semiconductors, and foundry solutions for a broad range of applications.

Samsung Semiconductor currently has 49 open roles on FindRole.

Listed pay typically runs $163,000–$253,000 across 49 roles with salary data.

Most-posted roles

View all roles at Samsung Semiconductor

At a glance

TL;DR · Senior Staff Engineer, AI Software

Senior Staff Engineer, AI Software joins the AGI Computing Lab to address complex system-level challenges posed by growing demands for future AI/ML workloads. This role involves leading the co-design of software and hardware solutions to optimize model inference performance while overcoming memory bottlenecks. You will analyze and optimize LLM and agentic AI workloads across the full software stack, profile execution to identify memory wall limitations, and collaborate with hardware teams to influence architecture and acceleration strategies. The position requires expertise in PyTorch, vLLM, and Linux development environments, alongside a deep understanding of transformer-based designs and High Bandwidth Memory. You will develop, optimize, and benchmark inference solutions while providing technical mentorship. The work focuses on creating scalable platforms that balance hardware and software components to ensure sustainable, high-performance execution for demanding AI applications.

What does a Engineer earn in California?

Median $208000 from 94 postings across 22 companies.

See salary data

What you'll do

  • Lead the co-design of software and hardware solutions to optimize AI model inference performance.
  • Analyze and optimize LLM and agentic AI workloads across the full software stack for hardware acceleration.
  • Profile and characterize model execution to identify memory wall limitations and guide architectural decisions.
  • Collaborate with hardware teams to influence memory architecture, acceleration strategies, and compute placement.
  • Develop, optimize, and benchmark inference and serving solutions using PyTorch and vLLM frameworks.
  • Define best practices and provide technical mentorship for software-hardware co-design initiatives.

What we're looking for

  • Candidates must have 15+ years of experience with a Bachelor's, 13+ years with a Master's, or 10+ years with a PhD.
  • Experience is required in writing high-performance AI framework software for GPUs or other accelerators.
  • Candidates must possess an end-to-end understanding of the AI infrastructure and software stack from model definition to deployment.
  • Knowledge of LLM model architectures and agentic AI architecture and workflows is required.
  • Hands-on expertise with the PyTorch framework is required.
  • Practical experience with vLLM for high-throughput model inference and serving is required.
  • Candidates must have a solid understanding of memory wall issues and HBM memory architecture.
  • Proficiency in Linux development environments and tools like GitHub and Jira is required.

More like this

Similar roles

Staff Software Engineer

PayPal

San Jose, CA +1 9 days ago $176,500$262,350
RDBMS NoSQL Redis ElastiCache Hazelcast SQS Kafka RabbitMQ Pulsar AWS GCP Azure Terraform Infrastructure as Code SDLC
5+ yrs exp Hybrid

Staff Software Engineer

Datadog

101 days ago $244,000$305,000
Data Visualization Virtual Runtime Profiling Streaming AI Coding Tools
10+ yrs exp Hybrid

Staff Software Engineer

GEICO

Palo Alto, CA 79 days ago $115,000$230,000
Go Python TypeScript React SQL NoSQL Graph Databases REST GraphQL Kubernetes Ansible Terraform AWS GCP Azure Data Modeling
10+ yrs exp

Staff Software Engineer

Anduril Industries

Costa Mesa, CA 74 days ago $220,000$292,000
AWS TypeScript React Remix Next.js JavaScript Distributed Systems Infrastructure as Code Observability AI LLM MES ERP
10+ yrs exp

Staff Software Engineer

Intuit

New York, NY 73 days ago $202,500$274,000
AWS CI/CD DevOps GenAI Technical Design Documentation Testing Prototypes POCs
10+ yrs exp

Staff Software Engineer

The Hartford

Hartford, CT +3 42 days ago $116,000$174,000
Generative AI Prompt Engineering AWS GCP Azure Python C# .NET Java Go Angular React Node.js RESTful APIs Microservices SQL Server Snowflake PostgreSQL MongoDB CI/CD
8+ yrs exp Hybrid