As a Senior Data Engineer on our dynamic data and analytics team, you will be responsible for building complex batch and streaming pipelines to ingest data from upstream cloud systems, designing scalable frameworks for data pipeline development, and leveraging AI-powered coding assistants to optimize code and generate documentation. You will also develop prompts for Large Language Models (LLMs) to assist in tasks like data cleansing and transformation logic generation, while maintaining robust data pipelines that support AI/ML applications. Key technologies include BigQuery, DataFlow, Pub/Sub, Cloud Functions, Airflow, Vertex AI, and Python with SQL proficiency. Experience with GCP big data environments, Airflow or Cloud Composer, and DevOps/CICD practices is essential, along with a strong background in data engineering principles and communication skills to engage both technical and non-technical stakeholders effectively.
Skills
GCP
BigQuery
DataFlow
DataProc
Pub/Sub
Cloud Functions
Airflow
Vertex AI
Python
SQL
Google Cloud Composer
Terraform
Jenkins
GitHub
LangChain
LlamaIndex
What you'll do
Build complex batch and streaming pipelines to ingest data from cloud systems.
Design and implement frameworks for scaling development of data pipelines.
Use AI-powered coding assistants to accelerate and optimize code development.
Develop prompts for Large Language Models to assist in data-related tasks.
Design scalable data pipelines supporting AI/ML applications and automation.
Explore and implement AI agents to automate repetitive data management tasks.
What we're looking for
At least 5 years of experience in data engineering or related field.
Strong understanding of data engineering principles, including modeling and warehousing.
Experience building complex data pipelines using BigQuery, DataFlow, Pub/Sub, etc.
Proficiency in Python development and professional SQL skills.
Ability to communicate technical concepts effectively to various stakeholders.
At least 1 year working in a GCP big data environment.
Market check
Salary context
This listing doesn't show a salary. Similar roles on FindRole typically pay
$99,000–$189,650.
Peer median band
$99,000–$189,650
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$126,800–$188,714
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Equifax
Equifax is a global data, analytics, and technology company and one of the "Big Three" credit reporting agencies, specializing in consumer and commercial credit information.