Principal Core Infrastructure Engineer, GPU Validation

Oracle

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Nashville, TN
Salary
$114,600–$234,600 / yr
Posted
15 days ago
Freshness
Confirmed live today

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $196k
This role $175k
$100k $249k
below market most similar roles pay here above market

This role pays less than 54% of similar roles. Most pay $174,600–$216,687 — the blue band above. At the midpoint, this role pays about $175k versus about $196k for comparable roles.

Based on 240 similar postings.

Employer

About Oracle

Oracle Corporation is a leading multinational technology company specializing in database software, cloud computing, and enterprise software.

Oracle currently has 955 open roles on FindRole.

Listed pay typically runs $102,300–$234,600 across 790 roles with salary data.

Most-posted roles

View all roles at Oracle

At a glance

TL;DR · Principal Core Infrastructure Engineer, GPU Validation

The Principal Core Infrastructure Engineer - GPU Validation joins the HPC team to develop automated tools and validation frameworks ensuring GPU racks are production-ready. The role involves building NCCL performance benchmarks, GPU infrastructure and NVLink connectivity tests, and Slurm-based validation workflows. Key responsibilities include designing scalable components for distributed systems, implementing fault-tolerant paths like retries and circuit breakers, and developing automated diagnostics for Linux, hardware faults, and cable validation. The engineer will utilize Bash, Python, and Infrastructure as Code to manage deployments, while building dashboards and telemetry for infrastructure health. This position addresses the technical challenge of ensuring reliability and operability in high-performance computing environments by providing automated testing for high-speed networks, InfiniBand, and complex GPU hardware configurations.

What you'll do

  • Design and develop scalable validation frameworks for GPU racks and HPC infrastructure.
  • Build automated benchmarks for NCCL performance, GPU health, NVLink connectivity, and high-speed networks.
  • Develop Slurm-based workflows for distributed validation and performance testing.
  • Implement retries, timeouts, and recovery mechanisms to improve framework resilience.
  • Build dashboards, telemetry, and alerts to monitor infrastructure health and validation results.
  • Develop automated tools for Linux diagnostics, log analysis, and hardware fault isolation.
  • Create and maintain Bash, Python, and Infrastructure as Code tools for deployment and configuration.
  • Automate patching, updates, and rollback workflows in accordance with change management practices.

What we're looking for

  • Must live in or be willing to relocate to Nashville, TN to work in the office regularly.
  • Must be able to read, write, and speak English.
  • Design and develop scalable validation frameworks for GPU racks and HPC infrastructure.
  • Build automated benchmarks and diagnostics for NCCL performance, GPU health, NVLink connectivity, and high-speed networks.
  • Develop Slurm-based workflows for distributed validation and performance testing.
  • Develop and maintain Bash, Python, and Infrastructure as Code tools for deployment and configuration.
  • Build dashboards, telemetry, and alerts to monitor infrastructure health and validation results.
  • Implement retries, timeouts, and recovery mechanisms to improve framework resilience.

More like this

Similar roles

Senior Core Infrastructure Engineer

Oracle

Nashville, TN 43 days ago $79,200–$209,500
Oracle Cloud Infrastructure (OCI) Python Bash Slurm Linux NCCL InfiniBand GPU HPC Distributed Systems Telemetry Security Controls
3+ yrs exp

Senior GPU Validation Engineer

Nvidia

Santa Clara, CA 41 days ago $140,000–$224,250
Python C++ C C# AI Windows Linux SQL Elasticsearch CUDA RESTful APIs WinDBG gdb Object-Oriented Programming Load Testing