Principal Engineer, AI System Architect (Hardware)

Samsung Semiconductor

Quick summary

Work type
On-site
Location
San Jose, CA
Salary
$219,000–$351,000 / yr
Posted
today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $211k
This role $285k
$155k most similar roles pay here $372k

This role pays more than 88% of similar roles. Most pay $176,000–$246,150 — the shaded band above. At the midpoint, this role pays about $285k versus about $211k for comparable roles.

Based on 240 similar postings.

Employer

About Samsung Semiconductor

Samsung Semiconductor is the global semiconductor business unit of Samsung Electronics, designing and manufacturing memory chips, logic semiconductors, and foundry solutions for a broad range of applications.

Samsung Semiconductor currently has 54 open roles on FindRole.

Listed pay typically runs $163,000–$253,000 across 54 roles with salary data.

Most-posted roles

View all roles at Samsung Semiconductor

At a glance

TL;DR · Principal Engineer, AI System Architect (Hardware)

The Principal Engineer, AI System Architect (Hardware) role at Samsung’s Architecture Research Lab involves leading the architecture team to develop next-generation AI system architectures that address critical bottlenecks in memory capacity and bandwidth. This technical lead will conduct system-level architectural research across compute, memory, and interconnect subsystems, developing analytical and simulation-based frameworks to evaluate AI workloads and identify performance bottlenecks. Key responsibilities include driving design decisions through quantitative modeling and collaborating with cross-functional teams to align theoretical insights with practical implementation. The ideal candidate has a Ph.D. in Computer Science or Electrical Engineering, 15+ years of experience in large-scale computing platforms, expertise in AI system hardware architectures, and proficiency in Python, C++, and PyTorch.

What you'll do

  • Lead the architecture team in shaping system-architecture strategy and advancing key innovations.
  • Conduct system-level architectural research for next-generation AI systems, focusing on compute, memory, and interconnects.
  • Develop analytical and simulation-based frameworks to evaluate AI workloads and identify performance bottlenecks.
  • Analyze emerging AI models to derive architecture requirements and trade-offs across hardware components.
  • Drive architecture-level design decisions through quantitative modeling and performance projections.
  • Perform comparative studies of alternative system architectures, reporting performance metrics for strategic choices.

What we're looking for

  • Ph.D. in Computer Science, Electrical Engineering, or related field with 15+ years of experience in system architecture for large-scale computing platforms.
  • Proven hands-on experience developing analytical and simulation models for evaluating AI workloads at the system level.
  • Deep understanding of AI system hardware architectures including compute, memory hierarchies, and high-performance interconnects.
  • Strong knowledge of modern AI workloads such as LLMs, DLRMs, and large-scale training systems.
  • Demonstrated ability to translate workload characteristics into actionable architectural design decisions.
  • Proficiency in Python, C++, and PyTorch for modeling, analysis, and experimentation.
  • Excellent communication skills with the ability to influence technical direction across teams.

More like this

Similar roles

Principal Engineer, AI System Architect (Hardware)

Samsung Semiconductor

San Jose, CA today $219,000$351,000
Python C++ PyTorch AI system hardware architectures LLMs DLRMs performance-per-watt metrics event-driven simulation models system-level architectural research architecture-level design decisions high-performance interconnects memory hierarchies

Staff Engineer, AI System Architect (Hardware)

Samsung Semiconductor

San Jose, CA today $163,000$253,000
Python C++ PyTorch AI LLMs DLRMs system-level architectural research event-driven simulation models high-performance interconnects memory hierarchies performance evaluation design-space exploration communication skills collaboration

Principal Engineer, AI Serving Framework Architect (Software)

Samsung Semiconductor

San Jose, CA today $219,000$351,000
Python PyTorch C++ vLLM AI Inference System Profiling Kubernetes Docker CI/CD PostgreSQL Prometheus Grafana AWS Azure Google Cloud Platform Samsung SDS Cloud Services Git Jenkins GitHub Bitbucket Slack Zoom Confluence Jira Terraform Ansible Kafka Redis MongoDB RAG Vector DB KVCache Hierarchical Memory Systems

AI/ML Platform Architect - Engineer, Principal

Qualcomm

San Diego, CA 100 days ago $200,800$301,200
Python C++ TensorFlow PyTorch GPU NPU Windows Agentic AI Computer Vision Audio Generative AI Version Control Systems Agile Project Management High Performance Computing Profiling Tools Software Development Methodologies Embedded Systems Computer Architecture

Senior Engineer, AI Systems

Samsung Semiconductor

San Jose, CA today $138,000$206,000
Triton Python CUDA LLMs FlashAttention MoeKernels DomainSpecificLanguages PerformanceEngineering HardwareSoftwareCoDesign ProfilingTools GPUs HBM SRAM Caches

Senior Staff Engineer, AI Infrastructure

Samsung Electronics

Remote (3655 N 1St St, San Jose, Ca, Usa, US) 6 days ago $180,200$297,200
Kubernetes Docker Slurm LSF Python C++ PyTorch TensorFlow MLOps Data pipelines Large-scale data processing Storage architectures Pipeline orchestration PCIe NVLink InfiniBand GPU physical design Design verification CAD environments
Remote