This is a remote position.
Overview
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a deep understanding of Microsoft Azure's Data Analytics Platform and possess extensive experience with tools such as Azure Data Factory, Azure Synapse, Apache Spark or Databricks, and Power BI. Knowledge of Microsoft Fabric is preferred but not necessary. This role requires a leader capable of guiding a team or multiple teams of Data Engineers and delivering successful Data Engineering projects. With 5 to 8 years of experience in the field, the Senior Data Engineer will play a crucial role in transforming raw data into actionable insights that drive our business forward.
Responsibilities
- Design, build, and maintain scalable and robust data pipelines using Azure Data Factory, Azure Synapse, and other relevant tools.
- Leverage Apache Spark or Databricks for big data processing and analytics.
- Develop and optimize data models, schema design and architectures for data warehousing and business intelligence using Power BI and other analytics tools.
- Lead and mentor teams of Data Engineers, providing technical guidance and oversight to ensure project success.
- Collaborate with cross-functional teams, including data scientists, business analysts, and IT professionals, to understand data needs and deliver comprehensive data solutions.
- Implement and maintain data security and compliance measures in line with organizational policies and regulations.
- Stay abreast of industry trends and advancements in data engineering and analytics technologies, applying best practices to improve processes and solutions.
- Drive the adoption of innovative data engineering techniques and tools, fostering a culture of continuous improvement and learning.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
- 3 to 6 years of experience in data engineering, with a strong focus on Microsoft Azure's Data Analytics Platform.
- Proficiency in Azure Data Factory, Azure Synapse, Apache Spark or Databricks, and Power BI.
- Experience leading and managing teams of Data Engineers in a fast-paced environment.
- Strong understanding of data modeling, ETL processes, and data warehousing principles.
- Excellent problem-solving skills and the ability to work independently or as part of a team.
- Knowledge of Microsoft Fabric is preferred but not necessary.
- Excellent communication and interpersonal skills, with the ability to articulate complex technical concepts to non-technical stakeholders.
Originally posted on Himalayas