onsite
Data Engineer - AIT Austrian Institute of Technology GmbH
Data Engineer
Data Engineer responsible for designing, building, and maintaining scalable data pipelines and infrastructure using Python, SQL, and AWS services to support analytics and machine learning initiatives.
About the role
Key Responsibilities
- Design, develop, and optimize ETL pipelines to ingest, transform, and load large volumes of structured and unstructured data into data lakes and warehouses.
- Implement data modeling best practices, ensuring data quality, consistency, and accessibility for downstream analytics and ML workloads.
- Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver reliable, high‑performance data solutions.
- Monitor and troubleshoot data pipeline performance, applying performance tuning and scaling strategies on AWS services such as S3, Redshift, Glue, and EMR.
- Document data architecture, pipeline workflows, and data governance policies to support compliance and auditability.
Requirements
- 3+ years of experience as a Data Engineer or similar role in a data‑centric environment.
- Proficiency in Python, SQL, and experience with data orchestration tools (Airflow, Prefect).
- Hands‑on experience with AWS data services (S3, Redshift, Glue, EMR, Athena).
- Strong understanding of data modeling, schema design, and performance optimization.
- Excellent problem‑solving skills and ability to work collaboratively in cross‑functional teams.