onsite
Senior Data Engineer - Hanson Wade
Data Engineer
Senior Data Engineer responsible for designing, building, and scaling data pipelines on Azure using Databricks and Airbyte, delivering high‑value SaaS analytics products and supporting AI‑driven insights.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines using Airbyte and custom Python/SQL code.
- Implement scalable data processing workflows on Databricks within Azure Cloud.
- Collaborate with product and analytics teams to translate business requirements into data solutions.
- Ensure data quality, reliability, and performance through monitoring, testing, and optimization.
- Contribute to the evolution of the data platform architecture, supporting AI and advanced analytics use cases.
Requirements
- 5+ years of hands‑on experience building data pipelines and data platforms.
- Strong proficiency with Azure services (e.g., Azure Data Lake, Azure Synapse) and Databricks.
- Experience using Airbyte or similar open‑source ELT/ETL tools.
- Advanced programming skills in Python and SQL for data transformation.
- Solid understanding of data modeling, warehousing, and best practices for data quality and governance.
Skills
azuredatabrickspythonsql