onsite
Data Engineer - Gateshead Council
Data Engineer
Data Engineer building scalable data pipelines and warehouses using Python, SQL and AWS to empower data-driven decisions across Gateshead.
About the role
Key Responsibilities
- Design, develop and maintain robust ETL pipelines to ingest, transform and load data from diverse sources into a central data warehouse.
- Collaborate with data scientists, analysts and stakeholders to understand data requirements and deliver high‑quality, reproducible datasets.
- Implement data quality checks, monitoring and alerting to ensure accuracy and reliability of data assets.
- Optimize query performance and storage costs using AWS services such as Redshift, S3, Glue and Athena.
- Document data models, pipeline logic and best practices for future maintainability.
Requirements
- Proven experience building data pipelines with Python and SQL.
- Strong knowledge of ETL concepts and data warehousing principles.
- Hands‑on experience with AWS data services (Redshift, Glue, S3, Athena).
- Excellent problem‑solving skills and ability to work collaboratively in a hybrid environment.
- Good communication skills and a passion for using data to improve public services.