onsite
Cloud Data Engineer - Dataciders GmbH
Data Engineer
Drive cloud data pipelines and analytics solutions using Python, SQL, and AWS services, ensuring scalable, reliable data workflows with Spark and Airflow.
About the role
Key Responsibilities
- Design, develop, and maintain cloud-based data pipelines using Python and SQL on AWS services such as S3, Redshift, and Glue.
- Implement and optimize batch and streaming data workflows with Apache Spark and Airflow.
- Collaborate with data scientists and analysts to deliver high‑quality data models and dashboards.
- Monitor pipeline performance, troubleshoot issues, and implement best practices for data quality and security.
- Document architecture, processes, and code for maintainability and compliance.
Requirements
- 3+ years of experience in data engineering or related roles.
Skills
pythonsqlawsapache sparkairflow