onsite
Senior Data Engineer - Senior Manager
Data Engineer
Lead end‑to‑end data engineering for large-scale analytics, designing and maintaining data pipelines on AWS using Redshift, S3, and Spark for batch processing. Drive performance, reliability, and scalability while mentoring a high‑performing team.
About the role
Key Responsibilities
- Architect, build, and optimize large‑scale batch data pipelines on AWS, leveraging Redshift, S3, and Apache Spark.
- Collaborate with data scientists and product teams to translate business requirements into robust data solutions.
- Ensure data quality, governance, and security across all data assets.
- Mentor and lead a team of data engineers, fostering best practices and continuous improvement.
- Monitor pipeline performance, troubleshoot issues, and implement scalability enhancements.
Requirements
- 10+ years of experience in data engineering with a strong focus on AWS services.
- Proven expertise in Amazon Redshift, Amazon S3, and Apache Spark for batch processing.
- Deep understanding of data modeling, ETL design, and performance tuning.
- Excellent leadership, communication, and project management skills.
- Experience with CI/CD, monitoring, and automation tools in a cloud environment.