remote
Lead Data Platform Engineer - saas.group
Data Engineer
Lead Data Platform Engineer driving scalable data pipelines and lakehouse architecture using Python, SQL, Spark, Airflow on AWS to support billions of media measurement events.
About the role
Key Responsibilities
- Design, build, and maintain end‑to‑end data pipelines ingesting billions of events per day.
- Architect and optimize a lakehouse solution on AWS (S3, Glue, Athena, Redshift).
- Implement data quality, monitoring, and alerting using Airflow and custom metrics.
- Collaborate with data scientists and product teams to expose clean, high‑value datasets.
- Lead a small team of engineers, mentoring and code‑reviewing.
Requirements
- 5+ years of data engineering experience with Python and SQL.
- Proven expertise in Spark, Airflow, and AWS data services.
- Strong understanding of data lakehouse patterns and performance tuning.
- Excellent communication skills and a collaborative mindset.
Skills
pythonsqlawsairflow