onsite
IT Lead Data Engineer - BDO USA
Data Engineer
Lead data engineering initiatives, designing and building scalable ETL pipelines on AWS, leveraging Python, SQL, and Spark to transform and store enterprise data, while driving data governance and operational excellence.
About the role
Key Responsibilities
- Lead the design, development, and maintenance of end‑to‑end data pipelines that ingest, transform, and load data into enterprise data warehouses.
- Collaborate with business stakeholders to translate data requirements into technical specifications and scalable solutions.
- Architect and implement data models, ensuring data quality, consistency, and compliance with governance policies.
- Mentor and guide a team of data engineers, fostering best practices in coding, testing, and documentation.
- Optimize pipeline performance and cost on AWS, utilizing services such as S3, Redshift, Glue, and EMR.
Requirements
- 5+ years of experience in data engineering, with a strong background in Python, SQL, and ETL processes.
- Proven expertise in building data pipelines on AWS, including Glue, Redshift, and EMR.
- Hands‑on experience with Apache Spark and large‑scale data processing.
- Solid understanding of data modeling, data warehousing concepts, and data governance.
- Excellent communication skills and a track record of leading technical teams.
Skills
pythonsqlawsapache spark