onsite
Data Engineer - Jobgether
Data Engineer
Data Engineer needed to rebuild and modernize a regulated data environment, creating reliable, reproducible pipelines and transforming a centralized data lake into an analytics‑ready foundation for data science and risk modeling.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines using Python and Apache Airflow to ingest and process data from multiple sources.
- Transform and optimize the centralized data lake, ensuring data quality, reproducibility, and compliance with regulatory standards.
- Implement and manage Snowflake data warehouse structures, including schema design, partitioning, and performance tuning.
- Collaborate with data scientists and risk modelers to provide clean, analytics‑ready datasets and support downstream use cases.
- Establish monitoring, alerting, and validation frameworks to guarantee pipeline reliability and data integrity.
Requirements
- Strong experience with Python for data engineering tasks and building scalable pipelines.
- Proficiency in SQL and hands‑on experience with Snowflake or similar cloud data warehouses.
- Solid knowledge of Apache Airflow or comparable workflow orchestration tools.
- Experience working in AWS environments, including S3, IAM, and related services.
- Understanding of data modeling, data quality frameworks, and regulatory compliance in data pipelines.
Skills
pythonsqlsnowflakeaws