remote
Senior Data Engineer - Archiving Squad Contract - EY
Data Engineer
Senior Data Engineer responsible for designing and implementing extraction, transformation, and migration pipelines to retire applications and archive enterprise data, leveraging Python, SQL, ETL tools, and AWS cloud services.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines for extracting, transforming, and loading data from legacy applications into archival storage.
- Collaborate with architecture and security teams to define data retention policies and ensure compliance with governance standards.
- Implement data migration strategies using AWS services (S3, Glue, Lambda) to move large datasets securely and efficiently.
- Optimize data models and storage formats for cost‑effective long‑term retention and fast retrieval.
- Monitor pipeline performance, troubleshoot failures, and continuously improve reliability and scalability.
Requirements
- 5+ years of hands‑on experience building data pipelines with Python and SQL.
- Strong knowledge of ETL concepts, data modeling, and relational/NoSQL databases.
- Proficiency with AWS data services (S3, Glue, Lambda, Redshift or Athena) and cloud‑based storage solutions.
- Experience in data migration, application retirement, or archival projects in an enterprise environment.
- Excellent problem‑solving skills and ability to work independently in a remote or distributed team.