AI Automation Engineer

Fortinet

Confirmed live yesterday High trust

Quick summary

Work type
On-site
Location
Sunnyvale, CA
Salary
$110,000–$170,000 / yr
Employment
Full-time
Posted
4 days ago
Freshness
Confirmed live yesterday

Market check

Salary context

Below market

How this pay compares to similar roles

Similar $173k
This role $140k
$97k $228k
below market most similar roles pay here above market

This role pays less than 74% of similar roles. Most pay $139,518–$205,875 — the blue band above. At the midpoint, this role pays about $140k versus about $173k for comparable roles.

Based on 240 similar postings.

Employer

About Fortinet

Fortinet is a US-based cybersecurity company best known for its FortiGate next-generation firewalls. It sells a broad security platform spanning network security, SD-WAN, endpoint protection, cloud security, and SIEM/SOC operations.

Fortinet currently has 102 open roles on FindRole.

Listed pay typically runs $140,000–$183,000 across 77 roles with salary data.

Most-posted roles

View all roles at Fortinet

At a glance

TL;DR · AI Automation Engineer

The AI Automation Engineer joins the team to build and maintain the technical interview pipeline, managing everything from the question bank to AI-assisted scoring and full workflow automation. The role involves designing systems to add, calibrate, and validate interview questions while architecting scoring workflows that evaluate candidate answers against rubrics. Key responsibilities include managing assessment repositories, building validation checks, and mitigating AI evaluation bias. The engineer will use Python, JavaScript, or TypeScript to work with APIs from providers like OpenAI and Anthropic. Required skills include Git proficiency, database knowledge, and experience designing LLM-based pipelines. This position solves the technical problem of automating high-stakes assessment workflows while ensuring consistency, accuracy, and auditability across the entire end-to-end test delivery and reporting process.

What you'll do

  • Manage the technical interview question repository by adding, revising, and retiring content across various roles and skill areas.
  • Build automated validation checks to identify and correct incorrect or ambiguous interview questions before they enter the repository.
  • Architect scoring workflows that evaluate candidate answers against reference rubrics using structured AI methodologies.
  • Calibrate and benchmark scoring prompts against human-graded samples to identify systematic errors, hallucinations, or biases.
  • Automate the end-to-end workflow from question selection and test delivery to answer collection and reporting.
  • Track scoring consistency and pipeline health while documenting prompts and logic for auditability.
  • Identify and automate manual, repetitive internal processes as the role expands into a broader automation function.

What we're looking for

  • Bachelor's degree in Computer Science or related field, or equivalent practical experience.
  • Solid programming fundamentals in Python, JavaScript/TypeScript, or similar.
  • Comfort working with APIs, including LLM/AI APIs like OpenAI and Anthropic.
  • Demonstrated experience designing and evaluating prompts and pipelines for LLM-based tools.
  • Proficiency with Git and hosted platforms including branching, PRs/MRs, code review, and CI basics.
  • Basic understanding of databases such as SQL or similar.
  • Strong attention to detail and technical writing ability.
  • Familiarity with test/assessment platforms, ATS integrations, or scripting automation (preferred).

More like this

Similar roles

Automation Engineer

Apple Inc

San Francisco, CA 143 days ago $144,600–$263,800
Python Test Automation Frameworks Machine Learning Software QA Bluetooth WiFi Thread Algorithm Validation
5+ yrs exp

AI Engineer

eBay

Austin, TX 11 days ago $85,600–$151,100
Python SQL AI Machine Learning Data Science Hadoop Teradata Google Big Query Agile System Design Data Pipelines Web Apps Automation Intelligent Agents
4+ yrs exp

AI Engineer

eBay

Austin, TX 11 days ago $85,600–$151,100
Python SQL AI Machine Learning Intelligent Automation Data Pipelines Hadoop Teradata Google Big Query Agile System Design Web Apps Data Science
4+ yrs exp

Lead AI Automation Engineer

AbbVie

North Chicago, IL 7 days ago $109,500–$208,500
Python LangChain LangGraph RAG Model Context Protocol LLM Prompt Engineering Agentic Workflows SDLC GraphQL Graph Databases Cloud Platforms Data Integration AI/ML Frameworks GxP
7+ yrs exp Hybrid

AI Design Automation Engineer

Amd

San Jose, CA 46 days ago $200,000–$300,000
Python LLM Knowledge Graphs Vector Search Data Pipelines Backend Systems SystemVerilog Verilog TDD Graph Databases Hardware Design HDL

AI Engineer

Booz Allen Hamilton

Washington, DC 95 days ago $99,000–$225,000
Generative AI LLMs RAG LangGraph FastAPI Flask Node.js AWS Azure SageMaker Bedrock EKS ECS S3 Databricks Snowflake OpenTelemetry Datadog CI/CD Vector Stores Model Context Protocol (MCP)
3+ yrs exp