Principal Streaming Data Architect

What you'll do

• Lead the real-time data streaming and processing architecture for a nationwide sensor detection platform.
• Develop a stateful, low-latency stream processing engine capable of handling thousands of messages per second from distributed sensors.
• Evaluate existing ingestion solutions like Azure Event Hubs and Databricks to select optimal high-velocity data processing frameworks.
• Design and develop stateful applications to achieve sub-second deduplication of sensor broadcast messages across thousands of devices.
• Implement a robust schema registry and event-driven data modeling strategy to ensure consistency in telemetry pipelines.
• Establish the technical data governance foundation, including lineage, metadata management, and auditability for all data flows.
• Operationalize and deploy real-time machine learning models directly into stream processing pipelines.
• Ensure all data-in-transit and in-memory states comply with CJIS, FIPS 140-3, and FedRAMP High security standards.

What we're looking for

• Must be a U.S. citizen.
• Bachelor's degree or 10+ years of experience.
• Experience designing and developing stateful, low-latency stream processing engines for high-velocity data.
• Expertise in Azure Event Hubs and Azure Databricks.
• Ability to design robust schema registries and event-driven data modeling strategies.
• Experience building technical data governance foundations including lineage, metadata management, and auditability.
• Ability to operationalize real-time machine learning models within stream processing pipelines.
• Knowledge of CJIS, FIPS 140-3, and FedRAMP High security standards.