As a Senior Software Engineer in the distributed systems team, you will design and develop high-throughput, fault-tolerant infrastructure components such as metadata services, coordination layers, and state management systems for petabyte-scale data platforms. Your day-to-day responsibilities include implementing replication, automatic failover, and exactly-once processing to ensure system reliability and consistency. You will also contribute to the CI/CD pipeline by instrumenting components with structured logging and distributed tracing, and debug complex distributed failures using diagnostic tooling. This role requires expertise in Java, Go, or C++, as well as deep knowledge of consistency models, consensus protocols like Raft, and fault-tolerant system design. Experience with Kubernetes, OpenTelemetry, Jaeger, Prometheus, and Grafana is essential for monitoring and observability. Additionally, familiarity with petabyte-scale data movement, stateful streaming systems (Kafka, Flink), and open table formats (Iceberg, Delta) will be beneficial.
Design and implement metadata services and distributed schedulers for petabyte-scale systems.
Build fault-tolerant infrastructure with replication, automatic failover, and consensus protocols.
Develop diagnostic tooling to debug and resolve customer-reported production issues.
Contribute to CI/CD pipeline by instrumenting components with logging, tracing, and metrics.
Collaborate on reliability and scalability decisions for distributed data systems.
What we're looking for
6+ years of professional software engineering experience with at least 2 years in large-scale distributed systems.
Proficiency in Java, Go, C++, or a comparable systems language for production-level distributed-system code.
Deep understanding and hands-on experience with consistency models, replication, quorum systems, leader election, and consensus protocols (Raft/Paxos).
Experience designing fault-tolerant systems with automatic failover, idempotent operations, durable recovery, and distributed observability tools.
Ability to communicate clearly through design documents, post-mortems, and capacity analyses; Bachelor's degree in Computer Science or equivalent experience.