onsite
Senior Data Engineer - MBDA
Data Engineer
Senior Data Engineer leading data fabric initiatives across engineering, simulation, test and corporate functions, designing scalable pipelines, data models and cloud‑based warehousing solutions using Python, SQL and modern big‑data technologies.
About the role
Key Responsibilities
- Design, develop and maintain robust data pipelines and ETL processes to support analytics across multiple directorates.
- Build and optimise data warehouse schemas and data models for high‑performance reporting and machine‑learning workloads.
- Implement and manage big‑data processing frameworks such as Apache Spark and streaming solutions.
- Collaborate with domain experts to translate business requirements into scalable data solutions.
- Ensure data quality, security and compliance with HMG BPSS standards.
Requirements
- 5+ years of experience in data engineering, with strong proficiency in Python and SQL.
- Hands‑on experience building ETL pipelines and data warehouses on cloud platforms (e.g., AWS, Azure).
- Solid understanding of big‑data technologies such as Apache Spark, Kafka or similar.
- Experience with data modelling, performance tuning and data governance.
- Ability to obtain and maintain required security clearance.
Skills
pythonsqlapache spark