onsite
Azure Databricks
Azure Databricks
This role involves building and managing data pipelines, both batch and real-time, on Azure Databricks. Key responsibilities include configuring data ingestion, developing ETL processes, and implementing data migration to Azure. The position also requires mentoring application teams and troubleshooting production data systems.
About the role
Tasks
Build batch and real-time data pipelines
Configure data ingestion and integration workflows
Create cloud data platforms with security and scalability
Design and develop ETL and analytical processes
Develop Spark jobs and SQL pools
Develop streaming and orchestration pipelines
Implement data migration to Azure
Implement end-to-end data pipelines with Microsoft Fabric
Mentor application teams on modern data tools
Monitor debug troubleshoot production data systems
Translate business requirements into data models and integration workflows
Perks/Benefits
N/A
Skills/Tech-stack
Access Controls | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Event | Azure Event Hubs | Azure Logic | Azure Logic Apps | Azure Stream | Azure Stream Analytics | Azure Synapse | Azure Synapse Analytics | Big Data | Cloud Storage | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Quality | Data Security | Data Warehousing | Event Hubs | Hadoop | IoT | Logic Apps | Microsoft Fabric | NoSQL | OneLake | Power BI | Python | RDBMS | SQL | Scala | Serverless architecture | Spark SQL | Stream Analytics | Synapse Analytics
Education
N/A
Roles
Data Engineer | Developer | ETL Developer | Engineer
Regions
Asia/Pacific
Countries
India
States
Telangana, IN
Cities
Hyderābād, Telangana, IN
Skills
Access ControlsApache SparkAzure DataAzure Data FactoryAzure Data LakeAzure Data Lake StorageAzure DatabricksAzure EventAzure Event HubsAzure LogicAzure Logic AppsAzure StreamAzure Stream AnalyticsAzure SynapseAzure Synapse AnalyticsBig DataCloud StorageData FactoryData GovernanceData Lake StorageData Modeling