onsite
Data Engineer - Jungheinrich Profishop AG & Co. KG
Data Engineer
Data Engineer responsible for designing, building, and maintaining scalable data pipelines and infrastructure, leveraging Python, SQL, AWS, Spark, and containerization to support B2B e‑commerce analytics and reporting.
About the role
Key Responsibilities
- Design, develop, and optimize data pipelines for ingesting, transforming, and storing large volumes of transactional and behavioral data.
- Implement and maintain data models and schemas in relational and distributed data stores (e.g., Redshift, Snowflake, S3).
- Collaborate with data scientists and product teams to provide clean, reliable datasets for analytics and machine‑learning projects.
- Automate data workflows using Airflow, Prefect, or similar orchestration tools, ensuring high availability and fault tolerance.
- Monitor pipeline performance, troubleshoot issues, and implement best practices for data quality and security.
Requirements
- 3+ years of experience in data engineering or related field.
- Strong proficiency in Python, SQL, and experience with AWS services (Glue, Lambda, Redshift, S3).
- Hands‑on experience with Apache Spark and distributed processing.
- Familiarity with containerization (Docker) and CI/CD pipelines.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
Skills
pythonsqlawsapache sparkdocker