Lead Data Engineer - Generative AI

The Hartford

Hybrid Actively hiring
Charlotte, NC · Hartford, CT · Columbus, OH · Chicago, IL Posted 24 days ago $135,040–$202,560 / year
View original post Log in to save

At a glance

AI generated

TL;DR

As a Sr. Staff Data Engineer at our innovative company, you will lead the development of advanced AI solutions and data engineering strategies within a dynamic team focused on cutting-edge technology. Your daily responsibilities include designing and implementing efficient Retrieval-Augmented Generation (RAG) architectures, integrating these systems with enterprise data infrastructure, and collaborating closely with cross-functional teams to ensure seamless integration into operational processes. You will leverage technologies such as GCP, Vertex AI, S3, AWS Bedrock, Spark streaming, and more to build scalable real-time data pipelines while ensuring reliability and scalability through robust monitoring and incident management practices. Additionally, you will mentor junior team members and contribute to the broader community of practice by promoting best practices in AI and data engineering. This role requires extensive experience with Python, SQL, NoSQL databases like Snowflake, ETL/ELT tools, CI/CD pipelines, and cloud technologies such as AWS, Google Cloud, or Azure, along with a deep understanding of generative AI technologies and vector/graph databases.

Skills

Python AWS GCP Spark Snowflake CICD Vector databases Graph databases Unstructured data processing Langchain Langgraph Retrieval-Augmented Generation RAG Data governance Prompt engineering NLP Computer vision

What you'll do

  • Develop AI-driven systems to improve data capabilities while ensuring compliance with industry standards.
  • Implement efficient Retrieval-Augmented Generation (RAG) architectures and integrate them into enterprise infrastructure.
  • Design and maintain scalable real-time data streaming pipelines using technologies like GCP, Vertex AI, Spark Streaming.
  • Ensure reliability, availability, and scalability of data pipelines through effective monitoring and incident management.
  • Mentor junior team members and promote best practices in data engineering and AI solutions.
  • Apply AI solutions to insurance-specific data use cases and challenges.
  • Collaborate with architects and stakeholders to influence the vision of AI and data pipelines.

What we're looking for

  • 8+ years of hands-on experience with Python programming.
  • 7+ years of data engineering experience including SQL, NoSQL, Snowflake, and cloud technologies (AWS/Google/Azure).
  • 3+ years of experience implementing production-ready enterprise-grade Generative AI data solutions.
  • 3+ years of expertise in Retrieval-Augmented Generation (RAG) pipelines and integration with language models.
  • Proficiency in vector databases, graph databases, and processing unstructured data for GenAI applications.

Market check

Salary context

This $135,040–$202,560 range sits above 41% of similar postings on FindRole.

Peer median band

$143,000–$225,100

Median floor and ceiling across peers.

Typical midpoint (25–75%)

$142,350–$229,712

Middle half of comparable postings.

Based on 239 comparable postings.

* 240 is the maximum number of comparable postings sampled.

Employer

About The Hartford

The Hartford is a leading provider of property and casualty insurance, group benefits, and mutual funds, serving businesses and individuals across the United States. Industry: Insurance & Financial Services

The Hartford currently has 60 open roles on FindRole.

Listed pay typically runs $126,880–$190,320 across 60 roles with salary data.

Most-posted roles

View all roles at The Hartford

More like this

Similar roles

Senior Staff AI Data Engineer - Hybrid

The Hartford

Remote (Hartford Ct- Home Office, US) 24 days ago $135,040–$202,560
Python Snowflake AWS GCP Azure CICD Spark NoSQL ETL TensorFlow PyTorch Neo4j MongoDB DynamoDB OpenSearch VertexAI LangChain LangGraph S3 EC2 Lambda Prometheus Grafana CI/CD GenAI RAG Vector databases Graph databases
Remote

Generative AI Engineer

Equifax

US 30 days ago
Google Cloud Platform Vertex AI Python LangChain REST API Spring Flask Linux NLP Deep Learning Transformers BigQuery ML Cloud Run MLOps CI/CD Prompt Tuning LoRA PEFT RAG Data Governance GDPR SEC Compliance

Principal Data & AI Engineer

Adobe

San Jose, US 74 days ago $208,300–$301,600
AWS Python Apache Airflow DynamoDB MySQL SageMaker OpenSearch Pinecone LangChain LangGraph MLFlow CI/CD Docker Kubernetes PySpark

Data Engineer - AI and Analytics

CVS Health

Remote (Buffalo Grove-2100 E Lake Cook, US) 21 days ago $79,310–$158,620
Python SQL NoSQL ETL ELT Data warehouses Big data Cloud architecture GCP AWS Azure Reporting tools Query optimization Metadata management Workload management Git CI/CD Bash shell scripts UNIX utilities Agile methodologies API development Micorservices SOA
Remote

Sr AI Data Engineer

GE Aerospace

Remote (Remote, US) 10 days ago $95,000–$159,000
AWS CloudFormation Python SQL Glue Lambda Step Functions S3 Athena OpenSearch Neptune Bedrock CI/CD Kubernetes Terraform PostgreSQL Neo4j Cypher SPARQL GraphQL
Remote