onsite
Data Engineer - Bartels-Langness Handelsgesellschaft mbH & Co. KG
Data Engineer
Data Engineer responsible for designing, building, and maintaining scalable data pipelines and infrastructure using Python, SQL, AWS, Spark, and Docker to support analytics and machine learning initiatives.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines that ingest, transform, and store large volumes of structured and unstructured data.
- Implement data models and schemas in relational and NoSQL databases, ensuring optimal performance and data integrity.
- Leverage AWS services (S3, Redshift, Glue, EMR) to build scalable, cost‑efficient data solutions.
- Utilize Apache Spark for distributed data processing and real‑time analytics.
- Containerize services with Docker and orchestrate deployments using Kubernetes or ECS.
- Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver actionable insights.
Requirements
- 3+ years of experience as a Data Engineer or similar role.
Skills
pythonsqlawsapache sparkdocker