Job Title: Senior Data Engineer
Job Type: Permanent, Full-time
Location: Ottawa, Ontario
Work Model: Remote
Job Status: Existing Vacancy
Position Summary
The Senior Cloud Data Engineer is responsible for designing, building, and operating scalable, secure, and reliable cloud data platforms that power analytics, AI, and decision‑making across the organization. This role focuses on engineering high‑quality, production‑grade data pipelines and data products using Microsoft Azure, Microsoft Fabric, and Databricks, enabling downstream BI, Copilot, and AI/ML workloads.
Key Responsibilities
Data Pipeline & Platform Engineering
- Design, build, and maintain scalable cloud‑native data pipelines supporting batch and near‑real‑time use cases.
- Engineer and optimize data ingestion, transformation, and orchestration pipelines using Azure Data Factory, Microsoft Fabric, Databricks, and related services.
- Implement and maintain lakehouse and medallion architectures (bronze, silver, gold) to support analytics and AI workloads.
- Develop robust transformation logic using SQL, PySpark, and Python with a focus on performance and maintainability.
Data Integration & Analytics Enablement
- Partner with Analytics/BI Engineers to ensure datasets are optimized for semantic layers and AI consumption.
- Collaborate with data scientists to support feature engineering and model training workloads.
Data Quality, Governance & Security
- Implement data quality, validation, lineage, and observability solutions to ensure trust in data assets.
- Design and enforce data security practices including access controls, encryption, and data classification.
DataOps, Automation & Cost Optimization
- Automate deployment and operations using DataOps and infrastructure‑as‑code practices.
- Optimize cloud performance and costs across the data platform.
Documentation & Operational Support
- Create and maintain technical documentation, runbooks, and architecture diagrams.
Leadership & Mentorship
- Provide technical leadership and mentorship to junior data engineers.
Mandatory Requirements
- Legally eligible to work in Canada.
- Able to obtain Government of Canada Reliability or Secret security clearance.
- Fluent in English (speak, read, write).
Minimum Qualifications
- Bachelor’s degree in Computer Science, Data Engineering, Software Engineering, or a related field.
- Strong understanding of lakehouse, data warehouse, and medallion architecture patterns.
- 8+ years of relevant professional experience, including:
- 5+ years of professional experience in clou