AI Systems Engineer

Oracle

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Nashville, TN
Salary
$96,800–$306,400 / yr
Posted
4 days ago
Freshness
Confirmed live today

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $181k
This role $202k
$72k $332k
below market most similar roles pay here above market

This role pays more than 66% of similar roles. Most pay $147,743–$215,000 — the blue band above. At the midpoint, this role pays about $202k versus about $181k for comparable roles.

Based on 240 similar postings.

Employer

About Oracle

Oracle Corporation is a leading multinational technology company specializing in database software, cloud computing, and enterprise software.

Oracle currently has 955 open roles on FindRole.

Listed pay typically runs $102,300–$234,600 across 790 roles with salary data.

Most-posted roles

View all roles at Oracle

At a glance

TL;DR · AI Systems Engineer

The AI Systems Engineer joins the Oracle Hardware Platform Development Engineering team to evaluate and characterize next-generation GPU and AI accelerator platforms for Oracle Cloud Infrastructure. This hands-on role involves bringing up new hardware platforms, enabling AI training and inference software stacks, and running representative workloads to analyze system performance. You will identify whether workloads are HBM/memory-bandwidth, compute, scale-up, or scale-out bound while characterizing power, thermals, and memory behavior. Key responsibilities include debugging hardware-software integration issues, designing experiments, and performing comparative architecture analysis. You will utilize technologies including x86 and ARM architectures, CUDA, ROCm, NCCL, XLA, PyTorch, TensorFlow, JAX, and Ray. The role solves technical challenges in optimizing the ML stack for training and deploying next-generation large language models and generative AI models.

What you'll do

  • Evaluate and characterize next-generation GPU and AI accelerator platforms for Oracle Cloud Infrastructure.
  • Bring up new hardware platforms and enable AI training and inference software stacks.
  • Identify if workloads are bound by HBM/memory-bandwidth, compute, scale-up, or scale-out factors.
  • Characterize system power, thermals, memory behavior, utilization, and performance efficiency.
  • Debug hardware-software integration issues including compilation failures, memory leaks, and kernel inconsistencies.
  • Conduct detailed profiling of compilation graphs and training workloads to eliminate performance bottlenecks.
  • Perform comparative architecture analysis across different GPUs and emerging AI accelerators.
  • Translate performance findings into actionable recommendations for specific AI training and inference workloads.

What we're looking for

  • 10+ years of experience.
  • Solid knowledge of AI/GPU or AI/CPU platform architecture and capabilities.
  • Experience with the architecture, design, and implementation of modern x86 and ARM server platforms.
  • Experience with high-speed buses and interconnects used in modern Compute and AI platforms.
  • Ability to troubleshoot complex hardware–software issues including vLLM compilation failures, CUDA memory leaks, and kernel-level inconsistencies.
  • Ability to conduct detailed profiling of compilation graphs, training workloads, and runtime execution to optimize performance.
  • Minimum of 8+ years of experience in developing software infrastructure for large scale AI systems (preferred).
  • Bachelor's degree or higher in Computer Science or a related technical field (or equivalent experience) (preferred).

More like this

Similar roles

Senior Core Infrastructure Engineer, AI Infrastructure

Oracle

Nashville, TN 42 days ago $79,200–$209,500
OCI Python Java C C++ GoLang Shell Scripting Linux SQL MySQL Redis Memcache RoCE Infiniband Infrastructure as Code Distributed Systems System Design Fault Tolerance Telemetry Systems
4+ yrs exp

Senior AI/ML Platform Engineer

Amd

Santa Clara, CA 96 days ago $204,000–$306,000
Python C++ Go Rust Kubernetes Ray Slurm vLLM SGLang Triton PyTorch JAX MLflow Weights & Biases ROCm HIP CUDA CI/CD Distributed Systems GPU Infrastructure Experiment Tracking Workflow Orchestration EDA Tools Compilers Profilers

AI Infrastructure Technical Systems Engineer

Cisco

RTP, NC +1 4 days ago $140,300–$178,100
Kubernetes Red Hat OpenShift Python Go Ansible Terraform CI/CD GitOps Slurm Kueue Volcano Ray Prometheus OpenTelemetry Splunk RDMA RoCEv2 NVIDIA CUDA AMD ROCm HashiCorp Vault RHEL Ubuntu Redfish IPMI
5+ yrs exp Hybrid

AI Infrastructure Engineer

Fortinet

New York, NY 60 days ago $215,000–$350,000
Linux Python Bash Kubernetes Docker KVM CI/CD IaC GPU Virtualization Monitoring Logging Networking Performance Testing Benchmarking FortiGate FortiManager FortiAnalyzer
Hybrid

AI Infrastructure Engineer

Blackrock

New York, NY 69 days ago $162,000–$215,000
AWS Azure GCP Terraform Ansible CloudFormation Python Java Golang MLOps CI/CD Bicep Microservices Infrastructure as Code Azure ML AWS Bedrock
5+ yrs exp Hybrid

Software Engineer, AI Infrastructure

Apple Inc

Cupertino, CA 101 days ago $184,700–$324,800
Python Go Distributed Systems Cloud Services LLMs AI Infrastructure Security Architecture Observability Backend Programming Cost Controls Load Shaping
5+ yrs exp