Senior Data Engineer

What you'll do

• Design, develop, and optimize scalable data pipelines and cloud-based solutions using Azure services like Synapse and Databricks.
• Build complex data architectures to process and store high-volume datasets from various sources.
• Implement data security, privacy measures, and governance standards across all data engineering projects.
• Perform complex data quality checks and processing tasks using open-source and cloud tools.
• Provide technical expertise during critical incidents and resolve complex infrastructure problems.
• Establish best practices for data integration, metadata management, and real-time processing.
• Oversee quality assurance and testing for all deployed data solutions.
• Mentor less experienced engineers and contribute to engineering standards and reusable patterns.

What we're looking for

• Bachelor's Degree in Information Technology or related field required.
• 5+ years of relevant data engineering experience required.
• Proficiency in Python, SQL, Spark, and orchestration tools like Azure Data Factory or Databricks Workflows.
• Experience designing and optimizing scalable data pipelines and cloud-based solutions using Azure services.
• Knowledge of big data technologies, distributed computing, and NoSQL databases.
• Ability to implement data governance, security, privacy measures, and quality management standards.
• Proficiency in data modeling, integration, and lifecycle management for structured and unstructured data.
• Experience with DevOps practices and monitoring tools for data pipeline performance and system health.