Entry Level AI Software Engineer

IBM

Confirmed live yesterday High trust

Quick summary

Work type: On-site
Location: Durham, NC
Posted: 4 days ago
Freshness: Confirmed live yesterday
Nearby: 99+ roles within 25 mi

Market check

Salary context

How this pay compares to similar roles

Similar $179k

$119k $225k

below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $142,400–$215,000.

Based on 240 similar postings.

Employer

About IBM

IBM is a US-based global technology company providing hybrid cloud, AI, consulting, enterprise software, and IT infrastructure products and services.

IBM currently has 242 open roles on FindRole.

Listed pay typically runs $180,812–$215,000 across 9 roles with salary data.

Most-posted roles

View all roles at IBM

At a glance

TL;DR · Entry Level AI Software Engineer

Role Posting Log in to save

As an Entry Level AI Software Engineer within the IBM Z team, you will help integrate large language models into the foundational systems supporting global banking, payments, and commerce. You will work alongside experienced engineers to design, build, and test AI-powered features, such as diagnostic agents or tools for connecting AI to enterprise data. Your daily tasks include writing specifications, crafting prompts, and debugging complex interactions across models, APIs, and application code. You must possess strong software engineering fundamentals, including data structures and algorithms, alongside proficiency in Python. The role requires experience building prototypes with LLMs and familiarity with Git. Preferred skills include knowledge of RAG, vector databases, Docker, Kubernetes, and programming in JavaScript, TypeScript, or Go to solve reliability and performance challenges in high-stakes environments.

Skills

Python LLMs APIs Git RAG Vector Databases Docker Kubernetes OpenShift SQL Go TypeScript JavaScript Kafka OpenSearch Distributed Systems Microservices Model Context Protocol (MCP)

What you'll do

Design, build, and test AI-powered features to address specific developer and client needs.
Integrate large language models (LLMs), APIs, and enterprise data into functional applications.
Write clear technical specifications and effective prompts for AI-driven workflows.
Evaluate AI behavior using realistic test cases to measure quality and handle failures.
Debug complex interactions across models, application code, APIs, and underlying systems.
Document work and iterate on features based on code reviews and technical feedback.

What we're looking for

High School Diploma/GED.
Bachelor's Degree (preferred).
Strong software engineering fundamentals including data structures, algorithms, software design, and testing.
Proficiency in Python and experience building applications or services that integrate APIs.
Hands-on experience building an application or working prototype with LLMs.
Systematic debugging mindset to investigate failures and reason about interactions between code, data, and models.
Ability to translate problems into clear requirements, prompts, and testable acceptance criteria.
Familiarity with Git, technical communication, and the ability to learn quickly and collaborate in a team.

Hybrid

Save

Entry-Level Software Engineer

Boeing

Maryland Heights, MO +1 4 days ago $65,000–$72,680

C# JavaScript SQL Git Object Oriented Programming Agile Scrum Software Development Life Cycle

Hybrid

Save