Principal Data Architect and Manager, Service Special Projects

What you'll do

• Design the end-to-end architecture of a multi-layered, petabyte-scale lakehouse using cloud object storage and open table formats.
• Establish comprehensive data governance frameworks including schema registries, lineage, metadata management, and privacy-centric access controls.
• Architect batch and streaming ETL pipelines to process multimodal data and perform real-time metadata extraction.
• Build and operate a fault-tolerant Apache Kafka streaming backbone for high-volume data ingestion and distribution.
• Define the technical roadmap and oversee the execution of complex data transformations and infrastructure optimizations.
• Manage, mentor, and grow a team of data engineers while overseeing their performance and career development.
• Partner with recruiting to hire and onboard senior and staff-level data engineering talent.
• Communicate technical risks, trade-offs, and project progress to senior leadership and cross-functional partners.

What we're looking for

• MS Degree in Computer Science or a related field.
• 12+ years of experience in Data Architecture, Data Engineering, or Platform Engineering.
• At least 5 years of experience in a Principal, Staff, or Lead Manager capacity.
• Proven experience managing engineers, including hiring, performance management, and technical mentorship.
• Track record of shipping and operating petabyte-scale, low-latency data platforms in production.
• Expert-level proficiency with cloud object storage and architecture for large-scale data lakes and lakehouses.
• Deep expertise in Apache Kafka or similar brokers and complex stream processing frameworks like Spark or Flink.
• Proficiency in at least one modern data-pipeline language such as Scala, Java, or Python.