Senior Software Engineer

What you'll do

• Design and build scalable backend infrastructure for AI-powered search, ranking, and personalization.
• Integrate large language models and machine learning models into production search serving paths.
• Optimize GPU inference performance using techniques like batching, request routing, and caching.
• Develop retrieval systems spanning lexical, semantic, and embedding-based search methods.
• Build infrastructure for LLM-serving patterns like KV-cache reuse and streaming generation.
• Develop real-time feature retrieval and data-processing systems to provide fresh signals to models.
• Design systems for graceful degradation, observability, capacity management, and safe production rollouts.
• Troubleshoot complex production issues across distributed search and AI-serving systems.

What we're looking for

• 5+ years of professional software engineering experience building large-scale backend or distributed systems.
• Strong programming skills in Go, Java, C++, Python, or a similar language.
• Strong understanding of distributed systems, service-oriented architectures, concurrency, networking, caching, and data consistency.
• Experience building high-throughput, low-latency online serving systems.
• Experience with search, recommendation, ranking, machine learning serving, or other large-scale data-intensive systems.
• Experience diagnosing and optimizing system performance across latency, throughput, reliability, and infrastructure efficiency.
• Familiarity with distributed data processing and streaming technologies such as Kafka, Flink, Spark, or similar frameworks.
• Experience operating production systems, including observability, monitoring, capacity planning, incident response, and reliability engineering.