Principal Data Platform Engineer

What you'll do

• Build and maintain backend services using Python or Go to support AI platforms and data products.
• Develop RAG pipelines and tool-calling AI agents featuring retrieval, orchestration, and evaluation.
• Integrate model providers with an LLM Gateway while managing response streaming and prompt caching.
• Automate data platform workflows using dbt, Airflow (MWAA), and custom internal CLI tools.
• Manage infrastructure as code using Terraform to maintain AWS resources like ECS, Lambda, and S3.
• Implement security protocols including OAuth/OIDC flows, multi-tenant isolation, and least-privilege IAM policies.
• Ensure system reliability through CI/CD pipelines, structured logging, metrics, and distributed tracing.

What we're looking for

• 15+ years of experience designing, building, and maintaining production backend services at scale.
• Expert-level proficiency in Python, Go, or Java for server-side development using relevant frameworks.
• Expertise in service and API design including REST, gRPC, streaming patterns, and versioning.
• Proficiency in SQL, data modeling, and managing Snowflake and DynamoDB databases.
• Experience with AWS infrastructure including ECS Fargate, Lambda, IAM, and S3.
• Proficiency in Infrastructure as Code (Terraform) and CI/CD pipelines using GitHub Actions.
• Expertise in building production LLM applications involving RAG, agent orchestration, and prompt engineering.
• Knowledge of security protocols including OAuth/OIDC, multi-tenant isolation, and secrets management.