remote
Senior Data Engineer, Analytics - Great Minds
Data Engineer
Senior Data Engineer leading the design, development, and optimization of analytics pipelines using Python, SQL, Snowflake, Airflow, and AWS to deliver actionable insights for educational content and outcomes.
About the role
Key Responsibilities
- Design, build, and maintain scalable data pipelines and ETL processes to ingest, transform, and store large volumes of educational data.
- Develop and optimize data models in Snowflake, ensuring high performance and reliability for analytics workloads.
- Implement workflow orchestration using Apache Airflow, managing job scheduling, monitoring, and error handling.
- Collaborate with data scientists, product managers, and educators to translate business requirements into robust data solutions.
- Apply best practices for data quality, governance, and security within an AWS cloud environment.
- Mentor junior engineers and champion continuous improvement of the data engineering stack.
Requirements
- 5+ years of professional experience in data engineering or a related field.
- Strong proficiency in Python and SQL, with hands‑on experience building production‑grade ETL pipelines.
- Deep knowledge of Snowflake (or comparable cloud data warehouse) and data modeling techniques.
- Experience with Apache Airflow for workflow orchestration and dbt for data transformation.
- Solid understanding of AWS services (S3, Redshift, Lambda, IAM) and cloud‑native best practices.
Skills
pythonsqlsnowflakeawsdbt