As a senior engineer on the Profile Stores layer team, you will play a pivotal role in developing and maintaining high-performance data ingestion pipelines and storage solutions for real-time customer profiles. Your responsibilities include designing and implementing key components to manage petabyte-scale profile data, leveraging popular file and table formats like Apache Parquet and Databricks Delta, and deploying resilient production services using Agile methodologies. You will work with a talented team to tackle complex data challenges, ensuring scalability, efficiency, and resiliency in multi-cloud environments. The ideal candidate has 15+ years of experience with distributed processing systems such as Apache Spark and Kafka, expertise in cloud storage solutions like AWS S3 or Azure Data Lake Storage, and strong programming skills in Java or Scala.
Skills
Apache Spark
Hadoop
Apache Kafka
AWS S3
Azure Data Lake Storage
Apache Parquet
Databricks Delta
Apache Iceberg
Apache Hudi
Apache HBase
Cassandra
MongoDB
Azure Cosmos DB
Java
Scala
CI/CD
Agile
What you'll do
Design and implement key components for ingesting and maintaining petabyte-scale profile data.
Develop systems to support high-volume data ingestion pipelines, handling both streaming and batch processing.
Leverage file and table formats to design storage models for efficient data access patterns.
Explore tradeoffs in different data formats based on workload characteristics and application needs.
Deploy production services and continuously improve them based on customer feedback.
What we're looking for
15+ years of industry experience in software engineering or related field.
Strong background in distributed processing systems like Apache Spark, Hadoop, and Kafka.
Experience with cloud data lake storage solutions such as AWS S3 and Azure Data Lake Storage.
Proficiency in file formats (Apache Parquet) and table formats (Databricks Delta, Iceberg).
Practical experience building resilient, high-volume data ingestion pipelines at scale.
Extensive programming skills in Java or Scala for large-scale system development.
Leadership to drive cross-team initiatives and adapt to evolving priorities.
Market check
Salary context
Above market
How this pay compares to similar roles
Similar $161k
This role $280k
$91k
most similar roles pay here
$357k
This role pays more than
99%
of similar roles. Most pay
$139,000–$183,862
— the shaded band above.
At the midpoint, this role pays about
$280k
versus about
$161k
for comparable roles.
Based on 240 similar postings.
Employer
About Adobe
Adobe Inc. is a global software company known for creative and multimedia software products including Photoshop, Illustrator, Acrobat, and its cloud-based Creative Cloud and Document Cloud suites. Industry: Creative & Digital Experience Software
Adobe currently has
310 open roles
on FindRole.
Listed pay typically runs
$185,350–$268,375
across 310 roles with salary data.