Entry Level AI Software Engineer

IBM

Confirmed live today High trust

Quick summary

Work type: On-site
Location: Poughkeepsie, NY
Posted: 6 days ago
Freshness: Confirmed live today
Nearby: 57 roles within 25 mi

Market check

Salary context

How this pay compares to similar roles

Similar $178k

$121k $224k

below market most similar roles pay here above market

This listing doesn't post a salary. Most similar roles pay $142,500–$214,250.

Based on 240 similar postings.

Employer

About IBM

IBM is a US-based global technology company providing hybrid cloud, AI, consulting, enterprise software, and IT infrastructure products and services.

IBM currently has 265 open roles on FindRole.

Listed pay typically runs $180,812–$217,000 across 11 roles with salary data.

Most-posted roles

View all roles at IBM

At a glance

TL;DR · Entry Level AI Software Engineer

Role Posting Log in to save

JOB TITLE: Entry Level AI Software Engineer As an Entry Level AI Software Engineer within the IBM Z team, you will help integrate large language models into the foundational systems supporting global commerce, banking, and payments. You will work alongside experienced engineers to design, build, and test AI-powered features, such as diagnostic agents or tools that connect enterprise data to applications. Your daily tasks include writing specifications, crafting prompts, integrating APIs, and debugging complex interactions across models and underlying systems. You must possess strong software engineering fundamentals in data structures and algorithms, proficiency in Python, and experience building LLM prototypes. The role requires a systematic debugging mindset and familiarity with Git. Preferred skills include experience with RAG, vector databases, Docker, Kubernetes, and programming in JavaScript, TypeScript, or Go.

Skills

Python LLMs APIs Git RAG Vector Databases Docker Kubernetes OpenShift SQL Go JavaScript TypeScript Kafka OpenSearch Distributed Systems Microservices Model Context Protocol (MCP)

What you'll do

Design, build, and test AI-powered features that address specific developer and client needs.
Integrate large language models (LLMs), APIs, and enterprise data into functional applications.
Write clear technical specifications, effective prompts, and review AI-generated code for quality.
Evaluate AI behavior using realistic test cases to measure performance and handle incorrect outputs.
Debug complex interactions across model layers, application code, APIs, and underlying systems.
Document work and iterate on features based on technical discussions and code reviews.

What we're looking for

High School Diploma/GED.
Bachelor's Degree (preferred).
Strong software engineering fundamentals including data structures, algorithms, software design, and testing.
Proficiency in Python and experience building applications or services that integrate APIs.
Hands-on experience building an application or working prototype with LLMs.
Systematic debugging mindset to investigate failures and reason about interactions between code, data, and models.
Ability to translate problems into clear requirements, prompts, and testable acceptance criteria.
Familiarity with Git, technical communication, and the ability to learn quickly and collaborate in a team.

Similar roles

Entry Level AI Software Engineer

IBM

Durham 6 days ago

LLMs AI APIs Git Retrieval Agent Workflows Code Review Testing

Save

Entry Level Software Developer

IBM

San Jose, CA 6 days ago

Python Java JavaScript TypeScript C++ React FastAPI Flask Spring Boot Docker Kubernetes CI/CD DevOps NoSQL APIs AI LLM Machine Learning Version Control

Save

AI Software Engineer Co-op

IBM

11 days ago

Python LLMs APIs Git RAG Vector Databases Docker Kubernetes OpenShift Go JavaScript TypeScript SQL Kafka OpenSearch Distributed Systems Microservices Concurrency Multithreading Memory Management

Save