remote
Data 360 Senior Engineer - MARGO
Software Engineer
Senior Data Engineer driving end‑to‑end data pipelines, leveraging Python, SQL, AWS, and Spark to build scalable data lakes and ML‑ready datasets for commerce intelligence.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines ingesting structured and unstructured data from multiple sources into a unified data lake on AWS.
- Implement ETL processes using Python, Spark, and SQL to transform raw data into high‑quality, analytics‑ready datasets.
- Collaborate with data scientists to expose clean, feature‑ready data for AI models and real‑time decisioning.
- Optimize pipeline performance, monitor job health, and troubleshoot issues across distributed environments.
- Document data models, pipeline logic, and best practices to ensure knowledge transfer and compliance.
Requirements
- 5+ years of experience in data engineering, with a strong focus on cloud (AWS) and big‑data technologies.
- Hands‑on experience building and managing data lakes, data warehouses, and ETL workflows.
- Solid understanding of machine‑learning data pipelines and feature engineering.
- Excellent problem‑solving skills and a collaborative mindset.
Skills
pythonsqlawsapache sparkmachine learning