remote
Lead Data Engineer - Delivery Lead - Capgemini
Data Engineer
Lead end‑to‑end migration from Teradata to Azure/Databricks, architecting scalable data pipelines, ensuring high‑quality delivery and stakeholder alignment. Requires deep expertise in data engineering, cloud platforms, and team leadership.
About the role
Key Responsibilities
- Lead the design, implementation, and delivery of a Teradata‑to‑Azure/Databricks migration project, ensuring on‑time, on‑budget completion.
- Architect scalable, maintainable data pipelines using SQL, Python, and Azure Data Factory or Databricks notebooks.
- Collaborate with data architects, business analysts, and stakeholders to define data quality, security, and governance standards.
- Mentor and coach a cross‑functional team of data engineers, fostering best practices and continuous improvement.
- Drive performance tuning, cost optimization, and automation across the data platform.
Requirements
- 5+ years of experience in data engineering with a focus on large‑scale migrations.
- Proven expertise in Teradata, Azure Synapse, Databricks, and related cloud services.
- Strong programming skills in Python and SQL, with experience in ETL/ELT tooling.
- Excellent communication, stakeholder management, and leadership abilities.
- Experience with data governance, security, and compliance frameworks is a plus.
Skills
azuredatabrickssqlpython