onsite
Data Engineer - Focus on Measurement Data Management & Ownership - Octopus Energy Germany GmbH
Data Engineer
Data Engineer responsible for managing and owning measurement data pipelines, ensuring data quality, and optimizing storage solutions using Python, SQL, and AWS services.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines for measurement data ingestion and processing.
- Implement data quality checks, validation rules, and monitoring to ensure high data integrity.
- Collaborate with cross‑functional teams to define data models, schemas, and metadata standards.
- Optimize storage and retrieval performance using AWS data services and best practices.
- Document processes, maintain data dictionaries, and provide support for data governance initiatives.
Requirements
- Proven experience as a Data Engineer or similar role, with strong Python and SQL skills.
- Hands‑on experience with ETL tools and AWS data services (S3, Redshift, Glue).
- Solid understanding of data modeling, data warehousing, and data lake concepts.
- Excellent problem‑solving abilities and a proactive approach to ownership and continuous improvement.