Agentic AI Systems Evaluation Engineer

HP Inc.

Confirmed live today High trust

Quick summary

Work type
On-site
Location
Spring, TXAustin, TX
Salary
$130,700–$205,200 / yr
Posted
4 days ago
Freshness
Confirmed live today
Closes
Mar 29, 2027

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $192k
This role $168k
$119k most similar roles pay here $237k

This role pays less than 65% of similar roles. Most pay $162,000–$222,500 — the shaded band above. At the midpoint, this role pays about $168k versus about $192k for comparable roles.

Based on 240 similar postings.

Employer

About HP Inc.

HP Inc. is a global technology company that develops and sells personal computers, printers, and related supplies and services. Its products include laptops, desktops, workstations, and printing solutions for consumers and businesses worldwide.

HP Inc. currently has 116 open roles on FindRole.

Listed pay typically runs $130,700–$205,200 across 97 roles with salary data.

Most-posted roles

View all roles at HP Inc.

At a glance

TL;DR · Agentic AI Systems Evaluation Engineer

[Agentic AI] Systems Evaluation Engineer works within a team focused on ensuring the technical design, development, and maintenance of state-of-the-art software applications. This role is responsible for defining measurement methodologies, creating benchmarking frameworks, and analyzing customer outcomes to quantify platform performance and AI workload effectiveness. The position involves building tools to help developers work faster, contributing to technology strategy, executing proof of concepts, and managing external engineering vendors. Key technical skills include experience with Linux and Windows validation, telemetry analytics, and performance benchmarking. Candidates should be proficient in technologies such as Python, Java, C++, JavaScript, SQL, React.js, Docker, Kubernetes, and Microservices. The role also requires expertise in AWS, Azure, API integration, automation, and DevOps within an Agile methodology to solve complex problems regarding software engineering roadmaps and scalability.

What you'll do

  • Define measurement methodologies and benchmarks to quantify customer outcomes and platform performance.
  • Create benchmarking frameworks to evaluate AI workload effectiveness.
  • Produce executive performance reports based on analyzed data.
  • Execute strategic software engineering proof of concepts to inform technology roadmaps.
  • Supervise external engineering vendors by analyzing their testing results and providing technical feedback.
  • Identify and implement changes to improve the effectiveness of engineering and service strategies.

What we're looking for

  • A four-year or graduate degree in Computer Science, Statistics, Software Engineering, or a related field.
  • 7 to 10 years of experience in software design, development, architecture, or programming languages.
  • Strong analytical skills and experience with benchmarking methodologies.
  • AI systems evaluation (preferred).
  • Telemetry analytics, performance benchmarking, and Linux/Windows validation experience (preferred).
  • Programming language certifications in Java, C++, Python, or JavaScript (preferred).
  • Proficiency in technologies including AWS, Azure, Docker, Kubernetes, Microservices, and SQL.
  • Knowledge of Agile methodology, DevOps, and full stack development.

More like this

Similar roles

Agentic AI AI Runtime / ML Model Systems Engineer

HP Inc.

Spring, TX +1 4 days ago $130,700–$205,200
ONNX TensorRT OpenVINO Python C++ Java JavaScript Kubernetes Docker Microsoft Azure SQL React.js Microservices API DevOps Agile Methodology Edge AI
7+ yrs exp

Software Engineer, Evaluation

Apple Inc

Cupertino, CA 81 days ago $150,400–$277,600
AI Machine Learning Distributed Systems React JavaScript RESTful API SQL NoSQL Benchmarking Software Engineering
3+ yrs exp

Software Engineer, Evaluation Engineering

Apple Inc

Cupertino, CA 115 days ago $150,400–$225,300
Swift C++ Objective-C Python iOS macOS visionOS watchOS LLM Machine Learning CLI Systems Engineering Telemetry Trace Collection Process Management Automation Scripts

Agentic AI Runtime & Performance Lead

HP Inc.

Spring, TX +2 4 days ago $147,050–$230,850
C++ Python Java JavaScript React.js SQL Microsoft Azure Kubernetes Docker Microservices API DevOps Agile Linux Windows Firmware Edge AI Automation
10+ yrs exp

Agentic AI Engineer

Booz Allen Hamilton

Annapolis Junction, MD 82 days ago $77,600–$176,000
LLMs Python LSTMs Regression Tree-based Models SVMs Agent Planning Context Window Management Go Software Design Patterns Model Evaluation Vector Databases RAG Machine Learning Data Science
1+ yrs exp