remote
Data Engineer - Reed Technology
Data Engineer
Senior Data Engineer building scalable data platforms and pipelines using Python, SQL, AWS, and Spark to unlock business value for a major client.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines and ETL processes to ingest, transform, and load data from diverse sources into cloud data warehouses.
- Collaborate with stakeholders to define data requirements, data models, and performance metrics, ensuring data quality and integrity.
- Implement and optimize data solutions on AWS services (S3, Redshift, Glue, Athena) and Spark clusters for high‑throughput processing.
- Monitor pipeline performance, troubleshoot issues, and implement automated alerts and logging for reliability.
- Document architecture, data flows, and best practices to support knowledge transfer and future enhancements.
Requirements
- 5+ years of experience in data engineering with a strong focus on cloud data platforms.
- Hands‑on experience with AWS data services (S3, Redshift, Glue, Athena) and ETL tooling.
- Strong analytical skills, ability to translate business needs into technical solutions.
- Excellent communication and client‑facing skills, comfortable presenting complex concepts to non‑technical stakeholders.