remoteonsite
Senior Specialist, Data Engineering - Colgate Palmolive
Software Engineer
Senior Specialist in Data Engineering driving end‑to‑end data pipelines, leveraging Python, SQL, AWS, and Spark to deliver scalable, high‑quality data solutions for enterprise analytics.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines using Python, SQL, and Apache Spark on AWS infrastructure.
- Implement ETL processes to ingest, transform, and load large datasets into data warehouses.
- Collaborate with data scientists and business analysts to understand data requirements and deliver actionable insights.
- Optimize pipeline performance, monitor data quality, and troubleshoot issues across the data lifecycle.
- Document architecture, code, and best practices for reproducibility and knowledge sharing.
Requirements
- 5+ years of experience in data engineering or related roles.
- Experience designing data models and building data warehouses.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.
Skills
pythonsqlawsapache spark