onsite
Data Engineer - ebswien klaranlage & tierservice Ges.m.b.H.
Data Engineer
Data Engineer responsible for designing, building, and maintaining scalable data pipelines and infrastructure using Python, SQL, Spark, and AWS services. Focus on data quality, performance, and collaboration with analytics teams.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines to ingest, transform, and store large volumes of structured and unstructured data.
- Optimize data workflows using Apache Spark, SQL, and other big‑data technologies for performance and scalability.
- Implement and manage data storage solutions on AWS (S3, Redshift, RDS) and ensure data security and compliance.
- Collaborate with data scientists and analysts to provide clean, reliable datasets for modeling and reporting.
- Monitor pipeline health, troubleshoot issues, and continuously improve data quality and processing efficiency.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or related field.
- 3+ years of experience in data engineering or ETL development.
Skills
pythonsqlapache sparkawsdockerkafka