onsite
Data Engineer - BUNDESRECHENZENTRUM GmbH
Data Engineer
Data Engineer responsible for designing, building, and maintaining scalable data pipelines and data warehouses using Python, SQL, and AWS services to support analytics and reporting.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines to ingest, transform, and load data from diverse sources into a centralized data warehouse.
- Implement data modeling best practices, ensuring optimal schema design for performance and scalability.
- Collaborate with data scientists and analysts to understand data requirements and deliver high‑quality datasets.
- Monitor pipeline performance, troubleshoot issues, and implement optimizations to reduce latency and improve reliability.
- Maintain documentation of data flows, architecture decisions, and data governance policies.
Requirements
- Proven experience with Python for data engineering tasks and automation.
- Strong SQL skills and experience with relational databases (e.g., PostgreSQL, Redshift).
- Hands‑on experience with AWS services such as S3, Glue, Redshift, and Lambda.
- Familiarity with data modeling concepts and best practices.
- Excellent problem‑solving skills and ability to work independently in a fast‑paced environment.