Lead IT Architecture Data Engineer

What you'll do

• Design, build, and maintain robust data pipelines to ensure reliable data flow across the enterprise.
• Orchestrate workflows and monitor the health of data pipelines to ensure continuous availability.
• Create and optimize data connections, datasets, and transformations to align with business needs.
• Troubleshoot and resolve data synchronization issues from various source systems.
• Utilize Palantir Foundry to establish data connections and design complex logical data models.
• Develop data cleansing, consolidation, and integration mechanisms to support big data analytics at scale.
• Build visualizations in Palantir Foundry and create documentation for business users.

What we're looking for

• Bachelor's degree and 9 years of Palantir experience, Graduate degree and 7 years of Palantir experience, or 13 years of Palantir experience without a degree.
• Minimum of 4 years of experience with Data Pipeline development or ETL tools such as Palantir Foundry, Azure Data Factory, SSIS, or Python.
• Minimum of 4 years of experience in Data Integration.
• Experience designing and developing data pipelines in PySpark, Spark SQL, SQL, or Code Build (preferred).
• Experience building and deploying data synchronization schedules and maintaining data pipelines using Palantir Foundry (preferred).
• Strong understanding of Business Intelligence and Data Warehouse development methodologies (preferred).
• Hands-on experience with Snowflake Cloud Data Platform, including architecture, query optimization, and performance tuning (preferred).
• Security clearance.