Principal Data Architect and Manager, Service Special Projects

What you'll do

• Define the end-to-end architecture for a petabyte-scale, multi-layered lakehouse on cloud object storage.
• Establish a data governance framework including schema registries, lineage, metadata management, and privacy-aligned access controls.
• Architect batch and streaming ETL pipelines to process multimodal data with real-time metadata extraction.
• Design and operate a fault-tolerant Apache Kafka streaming backbone for high-volume data delivery.
• Set the technical roadmap and drive the execution of data platform production delivery.
• Build and manage a team of data engineers, overseeing their performance, career development, and technical growth.
• Define SLAs, quality metrics, and observability standards to ensure platform reliability for downstream consumers.
• Communicate technical trade-offs and risks to senior leadership and partner organizations.

What we're looking for

• MS Degree in Computer Science or a related field.
• 12+ years of experience in Data Architecture, Data Engineering, or Platform Engineering.
• At least 5 years of experience operating in a Principal, Staff, or Lead Manager capacity.
• Proven experience leading, hiring, and mentoring engineers, including senior individual contributors and managers.
• Track record of shipping and operating petabyte-scale, low-latency data platforms in production.
• Expert-level proficiency with cloud object storage (e.g., AWS S3) and cloud services integration.
• Deep hands-on knowledge of Apache Kafka and complex stream processing frameworks like Spark Structured Streaming or Flink.
• Proficiency in at least one modern data-pipeline language such as Scala, Java, or Python.
• Experience architecting systems for entity resolution, knowledge-graph construction, and multimodal data pipelines.
• Experience with vector search technologies and storing/serving embeddings (preferred).
• Experience deploying and optimizing LLMs or ML models in production inference runtimes (preferred).
• Familiarity with Infrastructure as Code (Terraform, Pulumi) and modern CI/CD practices (preferred).
• Working knowledge of data privacy regulations and building privacy-preserving systems (preferred).