remoteonsite
Senior Data Engineer - Integrations - Assent
Data Engineer
Senior Data Engineer responsible for designing, building, and scaling integration pipelines that ingest, transform, and deliver supply‑chain sustainability data using Python, SQL, Airflow, and cloud data platforms.
About the role
Key Responsibilities
- Design and implement robust, high‑performance data integration pipelines to ingest regulatory and sustainability data from diverse external sources.
- Develop, schedule, and monitor ETL workflows using Apache Airflow, ensuring data quality, reliability, and timely delivery.
- Build and optimize data models and warehouses in Snowflake (or equivalent cloud data platform) to support analytics and reporting needs.
- Collaborate with product, compliance, and data science teams to translate business requirements into scalable data solutions.
- Implement best practices for data security, governance, and compliance within AWS cloud environments.
Requirements
- 5+ years of professional experience in data engineering, with a strong focus on integration and pipeline development.
- Proficiency in Python for data processing and automation, and advanced SQL for complex queries and data modeling.
- Hands‑on experience with workflow orchestration tools such as Apache Airflow.
- Deep knowledge of cloud data platforms (e.g., Snowflake, Redshift, BigQuery) and AWS services (S3, Lambda, Glue, IAM).
- Demonstrated ability to work cross‑functionally, solve complex data problems, and deliver production‑grade solutions in a fast‑moving environment.
Skills
pythonsqlairflowsnowflakeaws