As a Senior Software Engineer on the Profile Stores team, you will collaborate with talented engineers and product managers to build high-performance data ingestion pipelines and storage solutions for real-time customer profiles. Your responsibilities include designing and implementing key components of petabyte-scale data ingestion and maintenance, developing systems for both streaming and batch processing, and leveraging file and table formats like Apache Parquet and Databricks Delta to optimize storage models. You will also deploy production services using Agile methodologies with CI/CD pipelines, participate in architecture reviews, and continuously improve based on customer feedback. The role requires experience with distributed processing systems such as Apache Spark and Kafka, data lake cloud storages like AWS S3, and NoSQL databases including HBase and Cassandra. Strong programming skills in Java or Scala are essential, along with leadership abilities to drive cross-team initiatives and adapt to evolving priorities.
Skills
Apache Spark
Hadoop
Kafka
AWS S3
Azure Data Lake Storage
Apache Parquet
Databricks Delta
Apache Iceberg
Apache Hudi
Apache HBase
Cassandra
MongoDB
Azure Cosmos DB
Java
Scala
CI/CD
Agile
What you'll do
Own responsibility for designing and implementing key components to ingest and maintain petabytes of profile data.
Develop systems supporting high-volume data ingestion pipelines handling both streaming and batch processing.
Leverage file and table formats to design storage models for required ingestion volumes and access patterns.
Explore tradeoffs across different data formats and schema layouts based on workload characteristics.
Deploy production services and iteratively improve them based on customer feedback.
What we're looking for
5+ years of experience in software development or related field.
Experience with distributed processing systems like Apache Spark, Hadoop Stack, and Kafka.
Knowledge of cloud data lake storages such as Azure Data Lake Storage or AWS S3.
Understanding of file formats (Apache Parquet) and table formats (Databricks Delta, Iceberg).
Practical experience in building resilient data pipelines at scale.
Strong programming skills with Java or Scala.
Leadership to collaborate and drive cross-team efforts.
Market check
Salary context
This
$208,300–$301,600
range sits above
98%
of similar postings on FindRole.
Peer median band
$126,500–$203,750
Median floor and ceiling across peers.
Typical midpoint (25–75%)
$138,431–$184,900
Middle half of comparable postings.
Based on 240 comparable postings.*
* 240 is the maximum number of comparable postings sampled.
Employer
About Adobe
Adobe Inc. is a global software company known for creative and multimedia software products including Photoshop, Illustrator, Acrobat, and its cloud-based Creative Cloud and Document Cloud suites. Industry: Creative & Digital Experience Software
Adobe currently has
290 open roles
on FindRole.
Listed pay typically runs
$183,300–$265,350
across 290 roles with salary data.
Python
NodeJS
AWS
Azure
API design
DOM
web security
asynchrony
workers
performance optimization
cloud automation
AI agent development
CI/CD
Kubernetes
Terraform