Entry Level AI Software Engineer

IBM

Confirmed live yesterday High trust

Quick summary

Work type: On-site
Location: Durham, NC
Posted: 6 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

How this pay compares to similar roles

Similar $178k

$117k $224k

below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $142,400–$214,000.

Based on 240 similar postings.

Employer

About IBM

IBM is a US-based global technology company providing hybrid cloud, AI, consulting, enterprise software, and IT infrastructure products and services.

IBM currently has 268 open roles on FindRole.

Listed pay typically runs $187,136–$221,730 across 10 roles with salary data.

Most-posted roles

View all roles at IBM

At a glance

TL;DR · Entry Level AI Software Engineer

Role Posting Log in to save

JOB TITLE: Entry Level AI Software Engineer As an Entry Level AI Software Engineer within the IBM Z team, you will help integrate large language models into foundational systems that support global commerce, banking, and payments. You will work alongside experienced engineers to design, build, and test AI-powered features, such as agents for diagnosing system issues or tools for connecting AI to enterprise data. Your daily tasks include writing specifications, crafting prompts, and debugging across model interactions and application code. You must possess strong software engineering fundamentals in data structures and algorithms, proficiency in Python, and experience building prototypes with LLMs. The role requires technical skills in APIs, Git, and potentially RAG, vector databases, Docker, or Kubernetes to solve complex problems regarding reliability, security, and performance in high-stakes environments.

Skills

Python LLMs APIs Git RAG Vector Databases Docker Kubernetes OpenShift SQL Go JavaScript TypeScript Kafka OpenSearch Distributed Systems Microservices Model Context Protocol (MCP)

What you'll do

Design, build, and test AI-powered features that address specific developer and client needs.
Integrate large language models (LLMs), APIs, and enterprise data into functional applications.
Write clear technical specifications, effective prompts, and review AI-generated code.
Evaluate AI behavior using realistic test cases to measure quality, performance, and error handling.
Debug complex interactions across models, application code, APIs, and underlying systems.
Document work and iterate on features based on technical discussions and code reviews.

What we're looking for

High School Diploma/GED.
Bachelor's Degree (preferred).
Strong software engineering fundamentals including data structures, algorithms, software design, and testing.
Proficiency in Python and experience building applications or services that integrate APIs.
Hands-on experience building an application or working prototype with LLMs.
Systematic debugging mindset to investigate failures and reason about interactions between code, data, and models.
Ability to translate problems into clear requirements, prompts, and testable acceptance criteria.
Familiarity with Git, technical communication, and the ability to learn quickly and collaborate in a team.

Hybrid

Save

Entry level & Senior Software Engineer, Core AI Software

Qualcomm

San Diego, CA 40 days ago $140,800–$211,200

C/C++ Linux Generative AI LLMs Qualcomm AI Stack QNN Genie QAIRT Embedded Software CMake Git Agile Android Windows

2+ yrs exp

Save