onsite
Data Engineer III - Walmart
Data Engineer
Senior Data Engineer responsible for designing, building, and maintaining scalable data pipelines and architectures on AWS, using Python, SQL, and Spark to deliver high‑quality, governed data for enterprise analytics.
About the role
Key Responsibilities
- Design, develop, and optimize large‑scale data pipelines using Python, SQL, and Spark on AWS services (Glue, Redshift, S3).
- Implement robust data modeling and schema design to support business analytics and reporting.
- Ensure data quality, lineage, and compliance through automated testing, monitoring, and governance frameworks.
- Collaborate with cross‑functional teams to translate complex business requirements into scalable data solutions.
- Drive continuous improvement of data architecture, performance, and cost efficiency.
Requirements
- 5+ years of experience in data engineering with a focus on cloud platforms.
- Proficiency in Python, SQL, and Spark for data transformation and orchestration.
- Hands‑on experience with AWS data services (Glue, Redshift, Athena, S3).
- Strong understanding of data modeling, ETL best practices, and data governance.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.