onsite
Data Engineer - SCHICKLER Unternehmensberatung
Data Engineer
Data Engineer responsible for designing, building, and maintaining scalable data pipelines and infrastructure using Python, SQL, AWS, and Spark to support analytics and machine learning initiatives.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines and ETL processes to ingest, transform, and store large volumes of structured and unstructured data.
- Implement and optimize data models and schemas in relational and NoSQL databases, ensuring data quality and performance.
- Leverage AWS services (S3, Redshift, Glue, EMR) to build scalable, cost‑efficient data solutions.
- Collaborate with data scientists and analysts to provide clean, well‑documented datasets for modeling and reporting.
- Monitor, troubleshoot, and improve pipeline reliability, latency, and throughput.
Requirements
- Proven experience as a Data Engineer or similar role, with strong programming skills in Python.
- Deep knowledge of SQL and experience with data warehousing concepts.
- Hands‑on experience with AWS data services and Spark/Databricks.
- Solid understanding of data modeling, ETL best practices, and performance tuning.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.