onsite
Senior Data Engineer - FERCHAU GmbH Niederlassung Oldenburg
Data Engineer
Lead end‑to‑end data pipeline development using Python, SQL, and AWS services, architecting scalable Spark solutions and ensuring robust data modeling and ETL processes for enterprise analytics.
About the role
Key Responsibilities
- Design, build, and maintain large‑scale data pipelines on AWS, leveraging services such as S3, Redshift, Glue, and EMR.
- Develop and optimize Spark jobs in Python/Scala to process terabyte‑scale datasets, ensuring performance and reliability.
- Collaborate with data scientists and business analysts to translate analytical requirements into efficient data models and schema designs.
- Implement robust ETL workflows, data quality checks, and monitoring solutions to guarantee data integrity and availability.
- Mentor junior engineers, conduct code reviews, and promote best practices in data engineering and DevOps.
Requirements
- 5+ years of experience in data engineering, with a strong background in Python and SQL.
- Proven expertise in AWS data services (Glue, Redshift, EMR, S3) and Spark-based processing.
- Solid understanding of data modeling, ETL design, and performance tuning.
- Experience with CI/CD pipelines, containerization (Docker), and infrastructure as code (Terraform/CloudFormation).
- Excellent problem‑solving skills and a collaborative mindset.
Skills
pythonsqlawsapache spark