onsite
Test Engineer – Data
Test Engineer
Test Engineer building and automating testing frameworks for Databricks-based data pipelines, Delta Lake tables, and data quality validation at a specialist financial services firm. Core stack: Databricks/Spark, PySpark, SQL, AWS; hybrid role with 3 days/week onsite in downtown Toronto.
About the role
Job Title: Test Engineer – Data
Job ID: 90661
Location: Toronto, Ontario
Overview:
Our client provides specialist financial services to alternative investment customers and private clients worldwide. Continuous investment in learning means you will work with people who are among the best in the industry. This is an opportunity to excel in an environment that genuinely supports your personal and professional development. As a Test Engineer – Data, you will be responsible for developing and implementing automated testing frameworks for Databricks-based solutions, data pipelines, and data quality validation. You will work closely with data engineering teams to ensure data accuracy and reliability across our Lakehouse architecture.
What you will be doing:
Data Pipeline Testing
Automate testing for ETL/ELT processes in Databricks
Implement Spark job testing and optimization validation
Create test cases for
Skills
agileaiawscadclaude codedata engineeringdata governancedata ingestiondata pipelinesdata qualitydata sciencedatabricksdelta lakeeltetlgitlakehouselambdapysparkpythons3sparksql