onsite
Data Engineering Lead - HUB24
Software Engineer
Lead a high‑performing data engineering team to design, build, and scale robust data pipelines and platforms using Python, SQL, Airflow, Snowflake and AWS services.
About the role
Key Responsibilities
- Define and execute the data engineering strategy, ensuring scalable, reliable pipelines that support analytics and product initiatives.
- Architect, develop, and maintain data ingestion, transformation, and storage solutions on Snowflake and AWS (S3, Redshift, Lambda).
- Lead a team of engineers, providing mentorship, code reviews, and fostering a culture of best practices and continuous improvement.
- Collaborate with data scientists, product managers, and business stakeholders to translate requirements into robust data models and ETL workflows.
- Implement monitoring, alerting, and performance tuning for data pipelines using Airflow and cloud-native tools.
Requirements
- 5+ years of hands‑on data engineering experience, with at least 2 years in a lead or senior role.
- Strong proficiency in Python and SQL, and deep experience building ETL pipelines with Apache Airflow.
- Expertise in cloud data platforms, particularly Snowflake and AWS services (S3, Glue, Lambda, Redshift).
- Solid understanding of data modeling, warehousing concepts, and big‑data processing frameworks.
- Proven ability to mentor engineers, drive technical decisions, and deliver production‑grade solutions at scale.
Skills
pythonsqlsnowflakeaws