Senior Consultant, Data Engineering & Architecture

What you'll do

• Translate functional requirements into system designs and communicate component interactions to stakeholders.
• Design and develop product components while refining code plans for architecture.
• Lead code reviews to ensure team adherence to coding standards and best practices.
• Create complex test plans and interpret results to inform project planning.
• Mentor other engineers in creating extensible, maintainable, and reusable code.
• Build and manage reliable data pipelines using tools like Apache Airflow.
• Proactively identify and contain software defects to minimize impact on customers.
• Implement CI/CD pipelines for automated testing, deployment, and release management.

What we're looking for

• Experience with a Bachelor's degree, or with an Advanced Degree, or with a PhD.
• Expert-level experience with the Spark framework, Hive-based technologies, and broader Big Data development tools (preferred).
• 5+ years of hands-on programming experience in Java, Scala, or Python to develop production-quality components (preferred).
• Practical experience applying Generative AI and Large Language Models in data engineering (preferred).
• Strong working knowledge of SQL, NoSQL, graph databases, and RESTful APIs (preferred).
• Experience designing, building, and managing reliable data pipelines using tools like Apache Airflow (preferred).
• Proficiency with Git version control and implementing CI/CD pipelines for automated testing and deployment (preferred).
• Experience in mentoring junior engineers and providing technical leadership (preferred).