onsite
Data Engineer
Data Engineer
As a Data Engineer, you will be responsible for automating data tasks, building and maintaining batch and streaming analytics pipelines, and developing data lake solutions. Your role will involve designing data pipelines, developing Databricks workflows, and implementing CI/CD pipelines. You will also manage Azure Data Lake and GitHub version control, optimize SQL queries, and orchestrate data workflows.
About the role
Tasks
Automate data tasks
Build batch and streaming analytics pipelines
Create unit tests for data quality
Design and build data pipelines
Develop and maintain Databricks workflows
Develop data lake solutions
Develop data transformations
Implement CI/CD pipelines
Manage Azure Data Lake
Manage GitHub version control
Optimize SQL queries
Orchestrate data workflows
Utilize Azure Data Explorer for real time analysis
Perks/Benefits
Diverse global teams
Flexible work environment
Home office
Learning and development
Skills/Tech-stack
Automation Runbooks | Azure Data | Azure Data Explorer | Azure Data Factory | Azure Data Lake | Azure DevOps | Azure Functions | CI/CD | Data Explorer | Data Factory | Data Lake | Data Modeling | Databricks | GitHub | Microsoft Azure | NumPy | Pandas | PySpark | Python | SQL | Unit Testing
Education
Bachelor of Science | Master of Science
Roles
Cloud Data Engineer | Cloud) | Data Engineer | Engineer
Regions
Europe
Countries
Hungary
States
Budapest, HU
Cities
Budapest, Budapest, HU
Skills
Automation RunbooksAzure DataAzure Data ExplorerAzure Data FactoryAzure Data LakeAzure DevOpsAzure FunctionsCI/CDData ExplorerData FactoryData LakeData ModelingDatabricksGitHubMicrosoft AzureNumPyPandasPySparkPythonSQLUnit Testing