Principal Engineer, LLM

Upstart

Remote

Quick summary

Work type
Remote
Location
Canada
Salary
$238,400–$330,200 / yr
Posted
42 days ago
Closes
Sep 1, 2026

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $198k
This role $284k
$121k most similar roles pay here $353k

This role pays more than 90% of similar roles. Most pay $161,550–$235,000 — the shaded band above. At the midpoint, this role pays about $284k versus about $198k for comparable roles.

Based on 239 similar postings.

Employer

About Upstart

Upstart is an AI lending platform that partners with banks and credit unions to expand access to affordable credit using non-traditional variables.

Upstart currently has 40 open roles on FindRole.

Listed pay typically runs $177,200–$245,400 across 40 roles with salary data.

Most-posted roles

View all roles at Upstart

At a glance

TL;DR · Principal Engineer, LLM

As a Principal Engineer on Upstart’s GenAI Core Platform team, you will provide technical leadership by shaping the vision and architecture of the company's generative AI platform, ensuring its safe and efficient use across various business domains. Your responsibilities include defining a multi-year technical roadmap, collaborating with senior leadership to influence business strategy, and leading the design of large-scale systems for model inference and orchestration. You will also identify and mitigate systemic risks, establish operational standards for GenAI integrations, and mentor other engineers while fostering a culture of excellence. This role requires deep expertise in LLM infrastructure, scalable RAG architectures, automated evaluation pipelines, and hands-on experience with tools like LangChain and OpenAI APIs. Additionally, you should have full-stack engineering skills (Python, FastAPI, React/TypeScript) and knowledge of backend systems such as Kubernetes and Terraform.

What you'll do

  • Define and drive a multi-year technical roadmap for the Core GenAI Platform.
  • Lead architecture and design of large-scale systems for model inference and orchestration.
  • Identify and solve systemic technical risks impacting company-wide AI initiatives.
  • Establish operational standards for GenAI integrations to ensure security and reliability.
  • Mentor senior engineers and shape the growth of future technical leaders in the organization.

What we're looking for

  • Deep expertise in LLM-specific infrastructure and optimization techniques.
  • Proven experience designing scalable RAG architectures and managing model lifecycles.
  • Ability to build robust evaluation pipelines for ensuring model accuracy and safety.
  • Hands-on experience with LLM toolchains like LangChain, LlamaIndex, or OpenAI APIs.
  • Experience designing and operationalizing ML/LLM platforms at scale, focusing on cost, latency, and reliability.
  • Deep expertise in best practices and risks associated with GenAI technologies.
  • Proven ability to lead cross-functional technical initiatives and mentor senior engineers.

More like this

Similar roles

Principal Engineer

Intuit

Mountain View, CA 48 days ago $245,500$332,500
Python Java Kubernetes Docker AWS CI/CD PostgreSQL Redis MongoDB Git Jenkins SonarQube Selenium JUnit

Principal Engineer

Qualcomm

San Diego, CA 37 days ago $200,800$301,200
Python C++ TensorFlow PyTorch Linux Android Computer_Vision Deep_Learning Kubernetes Docker CI/CD Prometheus Grafana Qualcomm_Accelerators INT8 FP16 Heterogeneous_Compute AR/VR Robotics Autonomous_Vehicles IoT

Principal Engineer

Broadcom

San Jose Innovation Drive, CA 38 days ago $141,300$226,000
Verilog RTL Ethernet TCP/IP MPLS Python Perl ASIC deep submicron technologies timing closure low power design clock domain crossing

Principal Engineer

Qualcomm

San Diego, CA 58 days ago $192,600$289,000
C C++ Python Go Rust Linux Yocto/OE Debian Git CI/CD Docker Kubernetes AWS Gstreamer Linux kernel Networking Multimedia Embedded systems Assembly

Principal Engineer

Blackline

Pleasanton, CA 174 days ago $257,000$257,000
Java C# Python PostgreSQL Redis Mongodb Kubernetes AWS GCP Azure Drools Elasticsearch RESTful APIs Scrum CI/CD OAuth OpenID Connect SAML SSO Apigee Okta Ping Federate
Hybrid

Engineer, Principal

Qualcomm

San Diego, CA 30 days ago $192,600$289,000
ARM Linux kernel Device drivers Zephyr OS UEFI PCIe CXL I2C I3C SPI SoC architecture RISC-V SMMU CoreSight Virtualization CCA