remote
Lead Data Engineer - Mastercard
Data Engineer
Lead data engineering initiatives, architecting scalable pipelines and data models on AWS using Python, SQL, and Spark to enable secure, high‑performance analytics for global payment solutions.
About the role
Key Responsibilities
- Design, build, and maintain large‑scale data pipelines and lakehouse architectures on AWS.
- Lead a team of data engineers in developing ETL processes using Python, SQL, and Apache Spark.
- Collaborate with data scientists and product teams to deliver high‑quality, governed data assets.
- Implement data quality, monitoring, and security best practices across the data platform.
- Drive continuous improvement of data infrastructure, performance, and cost efficiency.
Requirements
- 10+ years of data engineering experience with a strong focus on cloud data platforms.
- Proficiency in Python, SQL, and Spark for large‑scale data processing.
- Hands‑on experience with AWS services (Redshift, S3, Glue, EMR, Lake Formation).
- Deep understanding of data modeling, ETL design, and data governance.
- Excellent communication skills and proven ability to lead cross‑functional teams.
Skills
pythonsqlapache sparkaws