onsite
Data Engineer - 12 month fixed term - Npower Commercial Gas Limited
Data Engineer
Data Engineer tasked with designing, building, and maintaining scalable data pipelines and warehouses to support a £5bn B2B energy business, leveraging Python, SQL, ETL tools, and AWS services to deliver high‑quality data for analytics and decision‑making.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines that ingest, transform, and load large volumes of data from diverse sources into a centralized data warehouse.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into efficient, scalable solutions.
- Implement and optimize ETL processes using Python, SQL, and modern data orchestration tools, ensuring data quality, consistency, and reliability.
- Leverage AWS services (S3, Redshift, Glue, Lambda) to build and manage cloud‑based data infrastructure, ensuring high availability and performance.
- Monitor pipeline performance, troubleshoot issues, and continuously improve data workflows through automation and best practices.
- Document data models, pipeline logic, and operational procedures to support knowledge transfer and compliance.
Requirements
- Proven experience as a Data Engineer or similar role, with strong proficiency in Python and SQL.
- Hands‑on experience building ETL pipelines and working with data warehousing solutions.
- Solid understanding of AWS data services and cloud architecture.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.
- Strong communication skills and a proactive approach to continuous improvement.