remote
Senior Software Engineer - US Risk Technology - CIBC
Software Engineer
Senior Software Engineer focused on US risk management, building scalable ETL pipelines in Databricks, automating workflows, and leveraging Python, Spark, and SQL to deliver data-driven risk insights.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines using Databricks and Python to ingest, transform, and load risk data.
- Collaborate with risk analysts to translate business requirements into technical solutions and automated workflows.
- Implement and optimize Spark jobs, ensuring performance, scalability, and data quality across large datasets.
- Develop reusable components and libraries to support workflow automation and data processing.
- Participate in code reviews, unit testing, and continuous integration to uphold high code quality standards.
Requirements
- 5+ years of software engineering experience with a strong focus on data engineering.
- Proficiency in Python, Apache Spark, and SQL.
- Hands‑on experience building ETL solutions in Databricks or similar cloud data platforms.
- Solid understanding of workflow orchestration and automation tools.
- Excellent problem‑solving skills and a collaborative mindset.
Skills
pythondatabricksapache sparksql