onsite
Senior Data Engineer - Walmart
Data Engineer
Lead the design, development, and deployment of scalable data pipelines and architectures in a cloud‑native environment, driving data quality, governance, and business insight through advanced analytics and engineering practices.
About the role
Key Responsibilities
- Architect, build, and maintain end‑to‑end data pipelines using Python, SQL, and Apache Spark on AWS services (Glue, Redshift, S3).
- Design and enforce data models, schemas, and governance policies to ensure data integrity and compliance across the organization.
- Collaborate with data scientists, product managers, and business stakeholders to translate complex requirements into robust, scalable data solutions.
- Optimize performance and cost of data workflows, implementing monitoring, alerting, and automated testing.
- Mentor junior engineers, conduct code reviews, and promote best practices in data engineering and DevOps.
Requirements
- 5+ years of experience in data engineering, with a strong background in cloud data platforms.
- Hands‑on experience with AWS services such as Glue, Redshift, Athena, and S3.
- Deep understanding of data modeling, ETL/ELT patterns, and data governance frameworks.
- Excellent problem‑solving skills, strong communication, and a collaborative mindset.
Skills
pythonsqlawsapache spark