onsite
Lead Data Engineer / Data Architect - Enable Data
Data Engineer
Lead design, development, and modernization of enterprise‑scale data platforms on Azure, driving architecture, engineering excellence, and high‑performance data pipelines using PySpark, Python, SQL, and Azure Databricks.
About the role
Key Responsibilities
- Architect and implement scalable, reliable data solutions on Azure, leveraging Azure Databricks, Data Lake, and Synapse Analytics.
- Lead end‑to‑end data pipeline development using PySpark, Python, and SQL, ensuring performance, maintainability, and data quality.
- Analyze existing data products, identify bottlenecks, and drive refactoring and redesign initiatives to improve efficiency and scalability.
- Collaborate with cross‑functional teams to translate business requirements into robust data models and ETL workflows.
- Mentor and guide junior engineers, fostering best practices in data engineering and cloud architecture.
Requirements
- 5+ years of experience in data engineering and architecture on Azure.
- Experience with large‑scale data processing, performance tuning, and data governance.
- Excellent communication skills and a proven ability to lead technical initiatives.