onsite
Manager, Data Engineer - Brookfield Asset Management
Data Engineer
Lead a high‑performing data engineering team, designing and maintaining scalable data pipelines and warehouses using Python, Spark, and AWS services to support enterprise analytics and decision‑making.
About the role
Key Responsibilities
- Architect, develop, and maintain robust data pipelines and data warehouse solutions using Python, Spark, and AWS services (Redshift, S3, Glue).
- Collaborate with data scientists, analysts, and business stakeholders to define data requirements and deliver high‑quality, production‑ready datasets.
- Implement best practices for data quality, governance, and security, ensuring compliance with internal standards and external regulations.
- Mentor and grow a team of data engineers, fostering a culture of continuous improvement and technical excellence.
- Monitor pipeline performance, troubleshoot issues, and optimize for scalability and cost efficiency.
Requirements
- 5+ years of experience in data engineering, with a strong background in Python, SQL, and Spark.
- Hands‑on experience with AWS data services (Redshift, S3, Glue, Athena).
- Proven track record of designing and deploying large‑scale, production‑grade data pipelines.
- Excellent problem‑solving skills and ability to work cross‑functionally in a fast‑paced environment.
- Strong communication skills and a collaborative mindset.
Skills
pythonsqlapache sparkaws