onsite
Staff Data Engineer - Walmart
Data Engineer
Lead end‑to‑end data engineering for enterprise operations, designing scalable pipelines, ensuring data quality, and driving data‑driven decisions using Python, Spark, and AWS.
About the role
Key Responsibilities
- Architect, build, and maintain large‑scale data pipelines that support enterprise analytics and decision science initiatives.
- Design and enforce robust data quality frameworks, including automated testing, monitoring, and documentation.
- Collaborate with cross‑functional teams to translate business requirements into scalable data models and efficient ETL processes.
- Mentor and guide junior engineers, fostering a culture of technical excellence and continuous improvement.
- Evaluate and implement new technologies and best practices to enhance performance, reliability, and cost efficiency.
Requirements
- 10+ years of experience in data engineering, with a proven track record of delivering production‑grade pipelines.
- Expertise in Python, SQL, and Apache Spark for large‑scale data processing.
- Deep knowledge of AWS services (S3, Redshift, Glue, EMR, Lambda) and data lake architecture.
- Strong background in data modeling, ETL design, and data quality management.
- Excellent communication skills and ability to influence stakeholders across multiple business units.
Skills
pythonsqlapache sparkaws