onsite
Azure Databricks
Azure Databricks
This role involves building and managing robust batch and real-time data pipelines, configuring data ingestion, and integrating workflows. You will be responsible for creating secure and scalable cloud data platforms, designing ETL processes, and developing Spark jobs and SQL pools. The position also includes implementing data migration to Azure and end-to-end data pipelines with Microsoft Fabric, as well as mentoring teams on modern data tools and troubleshooting production systems.
About the role
Build batch and real-time data pipelines
Configure data ingestion and integration workflows
Create cloud data platforms with security and scalability
Design and develop ETL and analytical processes
Develop Spark jobs and SQL pools
Develop streaming and orchestration pipelines
Implement data migration to Azure
Implement end-to-end data pipelines with Microsoft Fabric
Mentor application teams on modern data tools
Monitor debug troubleshoot production data systems
Translate business requirements into data models and integration workflows
Skills
Access ControlsApache SparkAzure DataAzure Data FactoryAzure Data LakeAzure Data Lake StorageAzure DatabricksAzure EventAzure Event HubsAzure LogicAzure Logic AppsAzure StreamAzure Stream AnalyticsAzure SynapseAzure Synapse AnalyticsBig DataCloud StorageData FactoryData GovernanceData Lake StorageData Modeling