onsite
Senior Data Engineer - abglobal
Data Engineer
Lead end‑to‑end data pipeline development, architect scalable solutions on AWS, and optimize large‑scale data processing with Spark and SQL. Drive data quality, governance, and performance for enterprise analytics.
About the role
Key Responsibilities
- Design, build, and maintain robust data pipelines using Python, SQL, and Spark on AWS infrastructure.
- Implement data modeling, schema design, and metadata management to support analytics and reporting.
- Optimize ETL processes for performance, reliability, and cost efficiency.
- Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver actionable insights.
- Ensure data quality, security, and compliance through automated testing, monitoring, and documentation.
Requirements
- 5+ years of experience in data engineering or related field.
- Proficiency in Python, SQL, and Spark for large‑scale data processing.
- Hands‑on experience with AWS services (S3, Redshift, Glue, EMR, Athena).
- Strong understanding of data modeling, ETL best practices, and data governance.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.