onsite
Consultant - Data Engineer - Deloitte
Data Engineer
Senior data engineering consultant driving end‑to‑end data pipelines, cloud architecture, and automation to empower clients’ decision‑making. Expertise in Python, SQL, AWS, Spark, and data lake design is essential.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and lakehouse solutions on AWS, ensuring high performance and reliability.
- Implement ETL/ELT processes using Python, Spark, and SQL, optimizing for cost and speed.
- Collaborate with data scientists and business stakeholders to translate analytical requirements into robust data architectures.
- Automate data quality checks, monitoring, and alerting to support continuous delivery and operational excellence.
- Provide technical guidance and mentorship to junior team members and client teams.
Requirements
- 5+ years of professional experience in data engineering, with a strong focus on cloud (AWS) and big data technologies.
- Proficient in Python, SQL, and Apache Spark for large‑scale data processing.
- Hands‑on experience building and managing data lakes, data warehouses, and ETL pipelines.
- Solid understanding of data governance, security, and compliance best practices.
- Excellent communication skills and ability to translate complex technical concepts to non‑technical stakeholders.
Skills
pythonsqlawsapache spark