remote
Senior Specialist - Data Engineer - Sun Life
Data Engineer
Senior Data Engineer responsible for designing, building, and optimizing data pipelines and platforms using Python, SQL, and cloud services to enable analytics and insights for business stakeholders.
About the role
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines that ingest, transform, and load data from multiple sources into cloud‑based data warehouses.
- Collaborate with data scientists, analysts, and business owners to understand data requirements and deliver reliable, high‑performance data solutions.
- Implement data quality, monitoring, and alerting frameworks to ensure pipeline reliability and data integrity.
- Optimize data storage and processing workloads using AWS services (e.g., S3, Redshift, Glue) and Apache Spark for large‑scale batch and streaming jobs.
- Document architecture, data models, and operational procedures, and mentor junior engineers on best practices.
Requirements
- 5+ years of professional experience in data engineering or related roles.
- Strong proficiency in Python and SQL for data manipulation and automation.
- Hands‑on experience building ETL pipelines and working with cloud platforms, preferably AWS.
- Familiarity with big‑data processing frameworks such as Apache Spark or Flink.
- Excellent problem‑solving skills and ability to work collaboratively in cross‑functional teams.
Skills
pythonsqlawsapache spark