remote
Senior Data Engineer - AB InBev Growth Group
Data Engineer
Lead end‑to‑end data pipeline development, architecting scalable solutions on AWS and Spark to power personalized insights for a global consumer brand.
About the role
Key Responsibilities
- Design, build, and maintain robust data pipelines using Python, SQL, and Apache Spark to ingest, transform, and load large volumes of structured and unstructured data.
- Collaborate with data scientists and product teams to translate business requirements into scalable data models and analytics solutions.
- Implement and optimize ETL processes on AWS services (S3, Glue, Redshift, Athena) ensuring high performance and reliability.
- Ensure data quality, governance, and security through automated testing, monitoring, and documentation.
- Mentor junior engineers and drive best practices in coding, version control, and CI/CD for data workflows.
Requirements
- 5+ years of experience in data engineering with a strong background in Python and SQL.
- Proven expertise in Apache Spark and distributed data processing.
- Hands‑on experience with AWS data services (S3, Glue, Redshift, Athena).
- Solid understanding of data modeling, ETL design, and data lake architecture.
- Excellent problem‑solving skills and ability to work in a fast‑paced, cross‑functional environment.
Skills
pythonsqlapache sparkaws