remote
Senior Data Engineer - RBC
Data Engineer
Senior Data Engineer leading the design and automation of enterprise data platform infrastructure, leveraging Python, SQL, AWS, and CI/CD pipelines to support advanced machine learning research and large-scale data processing.
About the role
Key Responsibilities
- Architect and maintain scalable data platform infrastructure on AWS, ensuring high availability and performance for large datasets.
- Design and implement CI/CD pipelines and DevOps practices to automate data ingestion, transformation, and deployment workflows.
- Collaborate with data scientists and researchers to support machine learning initiatives, providing robust data pipelines and tooling.
- Optimize SQL queries and data models for efficient storage and retrieval across relational and big‑data systems.
- Monitor system health, troubleshoot issues, and implement continuous improvement strategies for reliability and cost efficiency.
Requirements
- 5+ years of experience in data engineering, with a strong focus on cloud (AWS) and infrastructure automation.
- Hands‑on experience building CI/CD pipelines and applying DevOps principles to data workflows.
- Solid understanding of machine learning data pipelines and the ability to collaborate with research teams.
- Excellent problem‑solving skills and a proactive approach to system optimization.
Skills
pythonsqlawscicdmachine learning