Data/Software Engineer

What you'll do

• Design, build, and maintain scalable, secure, and efficient data pipelines to transform raw data into actionable insights.
• Collect, cleanse, analyze, and validate data before storing it in application databases for organizational use.
• Construct and apply standard statistical analysis and models to verify data accuracy and acceptability.
• Develop manual and automated methods to test output and input based on data compliance and quality requirements.
• Perform regular audits, investigations, and reviews of data activity to ensure integrity and prepare summary reports.
• Execute Extract, Transform, and Load (ETL) processes individually or as part of a database team.
• Implement technical solutions that meet specific business and technical requirements gathered from customers.
• Participate in Agile rituals and follow Scaled Agile processes as set forth by the CDP Program team.

What we're looking for

• Must have 6-15+ years of relevant experience depending on the level.
• Must have a Bachelor’s degree in a STEM field or a closely related field.
• Must be a United States citizen or a lawful permanent resident alien with at least three years of U.S. residency.
• Must have experience developing and analyzing complex SQL on relational databases like PostgreSQL or MySQL.
• Must have experience using core AWS services to build and support data warehouse solutions.
• Must have experience with Python, PySpark, and Jupyter notebooks.
• Must have experience with a modern data stack including S3, Spark, Airflow, and Snowflake or RedShift.
• Must have experience using GitLab for repository management and version control.