onsite
Principal Data Engineer - Upside
Data Engineer
Lead the design and implementation of scalable data pipelines and analytics platforms, driving insights for brick‑and‑mortar commerce. Leverage Python, SQL, AWS, and Spark to build robust, high‑throughput data solutions that power profit measurement and attribution for millions of users.
About the role
Key Responsibilities
- Architect, develop, and maintain end‑to‑end data pipelines that ingest, transform, and store large volumes of transactional and behavioral data.
- Collaborate with data scientists and product teams to define data models, schemas, and metrics that support attribution, incrementality, and profit measurement.
- Optimize data workflows for performance, reliability, and cost using AWS services (S3, Redshift, Glue, Athena) and Spark.
- Implement data quality, lineage, and governance practices to ensure accuracy and compliance.
- Mentor and lead a small team of data engineers, fostering best practices and continuous improvement.
Requirements
- 10+ years of experience in data engineering, with a strong background in Python, SQL, and large‑scale data processing.
- Proven expertise in AWS data services and Spark for building scalable pipelines.
- Deep understanding of data modeling, ETL design, and performance tuning.
- Excellent communication skills and ability to translate business needs into technical solutions.
- Experience in the retail or e‑commerce domain is a plus.