remote
Lead Data Engineer - LSEG (London Stock Exchange Group)
Data Engineer
Lead Data Engineer responsible for designing, building, and maintaining a high‑performance data warehouse and reporting platform, leveraging Python, SQL, Snowflake, Airflow, Kafka and AWS to deliver resilient, scalable risk‑management solutions.
About the role
Key Responsibilities
- Architect, develop, and optimise the core data warehouse and reporting solution supporting Group Risk analytics.
- Design and implement robust ETL pipelines using Python, SQL, Apache Airflow and Kafka to ingest, transform, and load large‑scale financial data.
- Collaborate with QA and Business Analysis teams to ensure data quality, reliability, and compliance with regulatory standards.
- Drive performance tuning, capacity planning, and cost‑effective utilisation of AWS services and Snowflake resources.
- Mentor junior engineers, enforce coding standards, and champion best practices for maintainable, testable code.
Requirements
- 5+ years of hands‑on experience building data platforms in a financial or risk‑management environment.
- Strong proficiency in Python, advanced SQL, and data‑warehouse technologies such as Snowflake.
- Experience with workflow orchestration (Apache Airflow) and streaming platforms (Kafka).
- Solid understanding of cloud infrastructure, preferably AWS, including IAM, S3, and serverless services.
- Proven ability to deliver high‑quality, resilient solutions under tight deadlines and to mentor technical teams.
Skills
pythonsqlsnowflakekafkaaws