Lead hands-on Unity Catalog migration work with Databricks, SQL, and Python across Toronto’s enterprise data engineering environment. Support workloads moving from Hive Metastore.
About the role
Lead hands-on Unity Catalog migration work with Databricks, SQL, and Python across Toronto’s enterprise data engineering environment. Support workloads moving from Hive Metastore.
Apex Systems is seeking a Data Engineer focused on migration and centralization into an enterprise Databricks data hub. This contract assignment includes developing pipelines, transforming multiple source systems, and supporting users and workloads in Unity Catalog. You will collaborate with architecture, ADF, BI, and downstream teams.
Key Responsibilities:
Migrate jobs and workloads from Hive Metastore
Support Unity Catalog access and workload transitions
Transform data from Db2 and SQL Server
Assess jobs, users, dependencies, and migration data
Support Azure Data Factory integrations and pipelines
Requirements:
Hands-on Databricks engineering experience
Unity Catalog tables, objects, and access control