Data Engineer III

What you'll do

• Develop workflows and ELT pipelines using Python and Databricks.
• Design and maintain reliable data collection, storage, and analytics solutions.
• Implement data security measures using entitlement frameworks to protect enterprise data.
• Update logical and physical data models based on new business use cases.
• Utilize SQL and NoSQL databases to manage and query large datasets.
• Use enterprise-authorized AI tools to accelerate data pipeline design, analysis, and documentation.
• Apply AI-assisted practices to improve SDLC quality, including test generation and control validation.
• Validate all AI-generated outputs for security vulnerabilities and logic errors before production deployment.

What we're looking for

• Formal training or certification on software engineering concepts and 3 years of applied experience.
• Good working knowledge of AWS, Databricks, and Python across the data lifecycle.
• Advanced proficiency in SQL including joins and aggregations, with a working understanding of NoSQL databases.
• Significant experience with statistical data analysis and selecting appropriate tools and patterns for analysis.
• Proficiency in AI Coding Assistants (e.g., Cursor, GitHub Copilot, Claude) and effective Prompt Engineering.
• Ability to critically evaluate, validate, and secure AI-generated code while following data sensitivity requirements.
• Familiarity with Medallion architecture, Aurora Postgres, MongoDB, and AWS Glue jobs (preferred).
• Skills in designing efficient data models and experience with containerization or CI/CD pipelines (preferred).