Principal Streaming Data Architect

What you'll do

• Lead the real-time data streaming and processing architecture for a nationwide sensor detection platform.
• Develop a stateful, low-latency stream processing engine capable of handling thousands of messages per second.
• Assess existing data ingestion solutions and advise on optimal frameworks for high-velocity data processing.
• Design and develop stateful stream processing applications to achieve sub-second deduplication of sensor messages.
• Implement a robust schema registry and event-driven data modeling strategy to ensure high data quality.
• Build a technical data governance foundation ensuring strict data lineage, metadata management, and auditability.
• Operationalize and deploy real-time machine learning models directly into the stream processing pipelines.
• Partner with DevSecOps to ensure data compliance with CJIS, FIPS 140-3, and FedRAMP High standards.

What we're looking for

• Must be a US Citizen.
• Bachelor's Degree or 10+ years of experience.
• Experience designing and developing stateful, low-latency stream processing engines for high-velocity data.
• Experience with Azure Event Hubs and Azure Databricks.
• Ability to design and implement schema registries and event-driven data modeling strategies.
• Experience building data governance foundations including data lineage, metadata management, and auditability.
• Ability to operationalize and deploy real-time machine learning models into stream processing pipelines.
• Experience ensuring compliance with CJIS, FIPS 140-3, and FedRAMP High standards.