Principal Engineer, AI System Architect (Hardware)

Samsung Semiconductor

Quick summary

Work type
On-site
Location
San Jose, CA
Salary
$219,000–$351,000 / yr
Posted
today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $211k
This role $285k
$155k most similar roles pay here $372k

This role pays more than 88% of similar roles. Most pay $176,000–$246,150 — the shaded band above. At the midpoint, this role pays about $285k versus about $211k for comparable roles.

Based on 240 similar postings.

Employer

About Samsung Semiconductor

Samsung Semiconductor is the global semiconductor business unit of Samsung Electronics, designing and manufacturing memory chips, logic semiconductors, and foundry solutions for a broad range of applications.

Samsung Semiconductor currently has 54 open roles on FindRole.

Listed pay typically runs $163,000–$253,000 across 54 roles with salary data.

Most-posted roles

View all roles at Samsung Semiconductor

At a glance

TL;DR · Principal Engineer, AI System Architect (Hardware)

Apply Now Log in to save

As a Principal Engineer and AI System Architect at Samsung’s Architecture Research Lab, you will lead the technical direction of system architecture for next-generation AI systems, focusing on memory capacity/bandwidth and communication efficiency. Your daily tasks include developing performance models, driving design decisions, and proposing innovative architectures that enhance scalability and efficiency. You will work closely with hardware teams to ensure modeling insights align with practical implementation, using Python, C++, and PyTorch to analyze AI workloads such as LLMs and DLRMs. With a Ph.D. in Computer Science or Electrical Engineering and 15+ years of experience, you should have expertise in system-level performance evaluation and the ability to translate modeling results into actionable design decisions.

Skills

Python C++ PyTorch AI system hardware architectures LLMs DLRMs performance-per-watt metrics event-driven simulation models system-level architectural research architecture-level design decisions high-performance interconnects memory hierarchies

What you'll do

  • Lead the architecture team in shaping system-architecture strategy and advancing key innovations.
  • Conduct system-level architectural research for next-generation AI systems, focusing on compute, memory, and interconnects.
  • Develop analytical and simulation-based frameworks to evaluate AI workloads and identify performance bottlenecks.
  • Analyze emerging AI workloads to derive architecture requirements and trade-offs across hardware components.
  • Drive architecture-level design decisions through quantitative modeling and performance projections.
  • Perform comparative studies of system architectures, reporting performance metrics for strategic technology choices.

What we're looking for

  • Ph.D. in Computer Science, Electrical Engineering, or related field with 15+ years of experience in AI system architecture.
  • Expertise in developing analytical and simulation models for evaluating system-level performance.
  • Deep understanding of AI hardware architectures including compute, memory hierarchies, and interconnects.
  • Strong knowledge of modern AI workloads such as LLMs, DLRMs, and large-scale training systems.
  • Ability to translate workload characteristics into actionable architectural design decisions.
  • Proficiency in Python, C++, and PyTorch for modeling, analysis, and experimentation.
  • Excellent communication skills with the ability to influence technical direction across teams.

Related searches

More Principal Engineer jobs Principal Engineer jobs in San Jose All jobs at Samsung Semiconductor

More like this

Similar roles

Principal Engineer, AI System Architect (Hardware)

Samsung Semiconductor

San Jose, CA today $219,000–$351,000
Python C++ PyTorch LLMs DLRMs AI system hardware architectures system-level architectural research performance-per-watt metrics architecture requirements and trade-offs high-performance interconnects memory hierarchies cross-functional collaboration quantitative modeling
Save

Staff Engineer, AI System Architect (Hardware)

Samsung Semiconductor

San Jose, CA today $163,000–$253,000
Python C++ PyTorch AI LLMs DLRMs system-level architectural research event-driven simulation models high-performance interconnects memory hierarchies performance evaluation design-space exploration communication skills collaboration
Save

Principal Engineer, AI Serving Framework Architect (Software)

Samsung Semiconductor

San Jose, CA today $219,000–$351,000
Python PyTorch C++ vLLM AI Inference System Profiling Kubernetes Docker CI/CD PostgreSQL Prometheus Grafana AWS Azure Google Cloud Platform Samsung SDS Cloud Services Git Jenkins GitHub Bitbucket Slack Zoom Confluence Jira Terraform Ansible Kafka Redis MongoDB RAG Vector DB KVCache Hierarchical Memory Systems
Save

AI/ML Platform Architect - Engineer, Principal

Qualcomm

San Diego, CA 100 days ago $200,800–$301,200
Python C++ TensorFlow PyTorch GPU NPU Windows Agentic AI Computer Vision Audio Generative AI Version Control Systems Agile Project Management High Performance Computing Profiling Tools Software Development Methodologies Embedded Systems Computer Architecture
Save

Senior Staff Engineer, AI Infrastructure

Samsung Electronics

Remote (3655 N 1St St, San Jose, Ca, Usa, US) 6 days ago $180,200–$297,200
Kubernetes Docker Slurm LSF Python C++ PyTorch TensorFlow MLOps Data pipelines Large-scale data processing Storage architectures Pipeline orchestration PCIe NVLink InfiniBand GPU physical design Design verification CAD environments
Remote
Save

Senior Engineer, AI Systems

Samsung Semiconductor

San Jose, CA today $138,000–$206,000
Triton Python CUDA LLMs FlashAttention MoeKernels DomainSpecificLanguages PerformanceEngineering HardwareSoftwareCoDesign ProfilingTools GPUs HBM SRAM Caches
Save