onsite
Data Engineer - VIG IT - Digital Solutions GmbH
Data Engineer
Build and maintain scalable data pipelines using Python, SQL, and AWS services, ensuring data quality and performance for analytics and machine learning initiatives.
About the role
Key Responsibilities
- Design, develop, and optimize ETL pipelines to ingest, transform, and load data from diverse sources into data warehouses.
- Implement data modeling best practices, ensuring schema design supports business analytics and reporting.
- Leverage AWS services (S3, Redshift, Glue, Lambda) to build scalable, fault‑tolerant data workflows.
- Collaborate with data scientists and analysts to understand data requirements and deliver high‑quality datasets.
- Monitor pipeline performance, troubleshoot issues, and implement improvements for reliability and efficiency.
Requirements
- Proven experience with Python and SQL for data engineering tasks.
- Hands‑on knowledge of AWS data services and cloud architecture.
- Strong understanding of data modeling, normalization, and performance tuning.
- Experience with version control (Git) and CI/CD pipelines for data workflows.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.