onsite
Senior Data Engineering and Data Governance Architect - Avanade
Software Engineer
Lead the design and implementation of enterprise‑scale data pipelines and governance frameworks, driving data quality, security, and compliance across cloud platforms using Python, SQL, AWS, and Spark.
About the role
Key Responsibilities
- Architect and deliver robust data pipelines and lakehouse solutions on AWS, ensuring high performance, scalability, and reliability.
- Define and enforce data governance policies, data quality standards, and metadata management practices across the organization.
- Collaborate with data scientists, business analysts, and stakeholders to translate business requirements into technical specifications and data models.
- Lead the migration of legacy data systems to modern cloud platforms, optimizing cost and performance.
- Mentor and coach junior engineers, fostering a culture of continuous improvement and best practices.
Requirements
- 10+ years of experience in data engineering, with a strong focus on cloud data platforms (AWS).
- Proficiency in Python, SQL, and Spark for data processing and transformation.
- Deep knowledge of data governance frameworks, data cataloging, and metadata management.
- Experience designing and implementing ETL/ELT pipelines and data lakehouse architectures.
- Excellent communication skills and a proven ability to lead cross‑functional teams.