onsite
Senior Data Engineer - Ministry of Housing, Communities and Local Government
Data Engineer
Senior Data Engineer responsible for designing, building, and maintaining scalable data pipelines and warehouses, leveraging Python, SQL, and cloud services to support analytics and digital governance across government data services.
About the role
Key Responsibilities
- Design, develop, and optimise end‑to‑end data pipelines using Python, SQL and modern ETL tools.
- Build and maintain data warehouse solutions on cloud platforms (AWS/Azure) to support reporting and analytics.
- Implement workflow orchestration with Apache Airflow, ensuring reliable scheduling and monitoring of data jobs.
- Collaborate with data analysts, product owners and governance teams to define data models, quality standards and security controls.
- Provide technical leadership, code reviews and mentorship to junior engineers.
Requirements
- Proven experience (5+ years) as a Data Engineer building large‑scale pipelines and warehouses.
- Strong proficiency in Python and SQL, with hands‑on experience in cloud data services (AWS Redshift, Azure Synapse, etc.).
- Experience with ETL/ELT frameworks and workflow orchestration tools such as Apache Airflow.
- Solid understanding of data modelling, data governance and security best practices.
- Excellent problem‑solving skills and ability to work collaboratively in a cross‑functional environment.