Engineering Manager - Real Time Analytics

What you'll do

• Lead the engineering team responsible for real-time merchant analytics systems.
• Oversee the development and maintenance of streaming data pipelines using Apache Beam and Google Cloud Dataflow.
• Ensure seamless transition from batch to streaming-first architecture without disrupting merchant operations.
• Optimize real-time stream processing across multiple regions while handling late-arriving data efficiently.
• Implement elegant data modeling solutions using dbt and custom frameworks for complex transformations.

What we're looking for

• Extensive experience in real-time data processing and streaming architectures.
• Proficiency in Apache Beam, Google Cloud Dataflow, and ClickHouse for pipeline development.
• Strong skills in multiple programming languages including Kotlin, Ruby, Python, and Rust.
• Experience with dbt for data modeling and configuration-driven pipeline development.
• Ability to replace batch systems with streaming-first architecture without disrupting operations.
• Expertise in handling late-arriving data and backfilling terabytes while maintaining real-time processing.
• Resilience and adaptability in a fast-paced, ambiguous work environment.