remoteonsite
Lead Data Engineer - Portfolio Management Group - BlackRock
Data Engineer
Lead the design, development, and optimisation of scalable data pipelines and platforms for a global fixed‑income portfolio team, leveraging Python, Spark, and AWS to deliver high‑quality data for alpha generation and risk management.
About the role
Key Responsibilities
- Architect and build robust, scalable data pipelines that ingest, transform, and serve large volumes of financial market and portfolio data.
- Collaborate with portfolio managers and sector specialists to translate business requirements into technical solutions.
- Implement data quality, governance, and security controls across the data platform.
- Optimize performance and cost of data workflows on AWS, using services such as S3, Redshift, Glue, and EMR.
- Mentor and lead a small team of data engineers, fostering best practices in coding, testing, and documentation.
Requirements
- 5+ years of experience in data engineering within a financial services or investment management environment.
- Proficiency in Python, SQL, and Apache Spark for large‑scale data processing.
- Hands‑on experience with AWS data services (S3, Redshift, Glue, EMR, Athena).
- Strong understanding of data modeling, ETL design, and data lake architecture.
- Excellent communication skills and ability to work cross‑functionally with portfolio teams.
Skills
pythonsqlapache sparkaws