remote
Tech Advisory Data Engineering Manager - Crowe LLP
Engineering Manager
Lead a high‑impact data engineering team delivering AI‑enabled insights and technology‑powered solutions, leveraging Python, SQL, AWS, and Spark to build scalable data pipelines and analytics platforms.
About the role
Key Responsibilities
- Architect, develop, and maintain end‑to‑end data pipelines and lakehouse solutions on AWS, ensuring high performance and reliability.
- Lead a cross‑functional team of data engineers, fostering best practices in coding, testing, and documentation.
- Collaborate with data scientists and business stakeholders to translate analytical requirements into scalable data products.
- Implement CI/CD workflows, monitoring, and observability for data services, driving automation and operational excellence.
- Mentor team members, conduct code reviews, and promote continuous learning and career growth.
Requirements
- 5+ years of experience in data engineering, with a strong background in Python, SQL, and AWS services (Glue, Redshift, S3).
- Proficiency in Apache Spark and experience building large‑scale ETL pipelines.
- Hands‑on experience with data modeling, lakehouse architecture, and performance tuning.
- Excellent communication skills and a proven ability to lead technical teams.
- Experience with ML Ops or AI‑enabled analytics is a plus.
Skills
pythonsqlawsapache spark