onsite
Data Infrastructure Engineer - Ottawa Area ISD
Devops Engineer
Design, build, and maintain enterprise data pipelines and storage solutions, focusing on ingestion, processing, and cloud‑based infrastructure using Python, SQL, AWS, and streaming technologies.
About the role
Key Responsibilities
- Design and implement scalable data ingestion pipelines to collect and process structured and unstructured data from internal and external sources.
- Develop, test, and maintain ETL workflows using Python, SQL, and orchestration tools to ensure data quality and reliability.
- Architect and manage cloud‑based data platforms (e.g., AWS, Snowflake) for storage, transformation, and analytics.
- Implement real‑time streaming solutions with technologies such as Kafka to support low‑latency data processing.
- Monitor, troubleshoot, and optimize data pipelines and infrastructure for performance, security, and cost efficiency.
Requirements
- Strong experience with Python programming and SQL for data manipulation and pipeline development.
- Hands‑on experience designing and operating data pipelines on cloud platforms, preferably AWS, and data warehouses like Snowflake.
- Familiarity with streaming and messaging systems such as Kafka or similar technologies.
- Knowledge of Linux/Unix environments and infrastructure‑as‑code tools (e.g., Terraform, CloudFormation).
- Excellent problem‑solving skills and ability to work collaboratively in an agile, cross‑functional team.
Skills
pythonsqlawskafkasnowflake