Staff Engineer, AI System Architect (Hardware)

Samsung Semiconductor

Quick summary

Work type
On-site
Location
San Jose, CA
Salary
$163,000–$253,000 / yr
Posted
today

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $209k
This role $208k
$152k most similar roles pay here $268k

This role pays less than 56% of similar roles. Most pay $172,000–$246,150 — the shaded band above. At the midpoint, this role pays about $208k versus about $209k for comparable roles.

Based on 240 similar postings.

Employer

About Samsung Semiconductor

Samsung Semiconductor is the global semiconductor business unit of Samsung Electronics, designing and manufacturing memory chips, logic semiconductors, and foundry solutions for a broad range of applications.

Samsung Semiconductor currently has 54 open roles on FindRole.

Listed pay typically runs $163,000–$253,000 across 54 roles with salary data.

Most-posted roles

View all roles at Samsung Semiconductor

At a glance

TL;DR · Staff Engineer, AI System Architect (Hardware)

As a Senior Staff AI System Architect at Samsung’s Architecture Research Lab, you will play a pivotal role in bridging AI workloads with system architecture and hardware design. Your day-to-day responsibilities include developing analytical and simulation-based frameworks to evaluate performance bottlenecks across compute, memory, and interconnect subsystems for next-generation AI systems. You will analyze emerging AI workloads like LLMs and DLRMs to derive architectural requirements and trade-offs, drive quantitative modeling, and perform comparative studies of system architectures. This role requires a Ph.D. in Computer Science or Electrical Engineering with 5+ years of experience in large-scale computing platforms, proficiency in Python, C++, and PyTorch, and strong knowledge of AI system hardware architectures. You will collaborate closely with cross-functional teams to align modeling insights with implementation realities and communicate architectural recommendations through technical presentations.

What you'll do

  • Conduct system-level architectural research for next-generation AI systems.
  • Develop and maintain analytical and simulation-based modeling frameworks to evaluate AI workloads.
  • Analyze emerging AI workloads to derive architecture requirements and trade-offs.
  • Drive architecture-level design decisions through quantitative modeling and performance projections.
  • Perform comparative studies of alternative system architectures, reporting key metrics.

What we're looking for

  • Ph.D. in Computer Science, Electrical Engineering, or related field with 5+ years of experience in system architecture for large-scale computing platforms.
  • Proven hands-on experience developing analytical and simulation models for AI workload performance evaluation.
  • Deep understanding of AI system hardware architectures including compute, memory hierarchies, and high-performance interconnects.
  • Strong knowledge of modern AI workloads such as LLMs, DLRMs, and large-scale training systems.
  • Ability to translate modeling results into actionable architectural design decisions.
  • Proficiency in Python, C++, and PyTorch for modeling, analysis, and experimentation.

More like this

Similar roles

Principal Engineer, AI System Architect (Hardware)

Samsung Semiconductor

San Jose, CA today $219,000$351,000
Python C++ PyTorch AI system hardware architectures LLMs DLRMs performance-per-watt metrics event-driven simulation models system-level architectural research architecture-level design decisions high-performance interconnects memory hierarchies

Principal Engineer, AI System Architect (Hardware)

Samsung Semiconductor

San Jose, CA today $219,000$351,000
Python C++ PyTorch LLMs DLRMs AI system hardware architectures system-level architectural research performance-per-watt metrics architecture requirements and trade-offs high-performance interconnects memory hierarchies cross-functional collaboration quantitative modeling

Senior Staff Engineer, AI Infrastructure

Samsung Electronics

Remote (3655 N 1St St, San Jose, Ca, Usa, US) 6 days ago $180,200$297,200
Kubernetes Docker Slurm LSF Python C++ PyTorch TensorFlow MLOps Data pipelines Large-scale data processing Storage architectures Pipeline orchestration PCIe NVLink InfiniBand GPU physical design Design verification CAD environments
Remote

Senior Engineer, AI Systems

Samsung Semiconductor

San Jose, CA today $138,000$206,000
Triton Python CUDA LLMs FlashAttention MoeKernels DomainSpecificLanguages PerformanceEngineering HardwareSoftwareCoDesign ProfilingTools GPUs HBM SRAM Caches

Senior Staff Engineer, AI Core

Nubank

Palo Alto, CA today $345,000$345,000
Flutter Go Python Java AWS Microservices Event-driven design CI/CD Conversational AI Recommendation engines Distributed systems Kafka PostgreSQL Redis GraphQL FinTech Mobile app development
Hybrid

Staff Software Engineer, AI

Okta Inc

Bellevue, WA 94 days ago $194,000$267,000
React Python AWS GCP Azure LLMs MCPs LangChain LangGraph LangSmith Distributed Systems Microservices REST GraphQL CI/CD Security Observability