remote
Senior Data Engineer - Archiving Squad - EY
Data Engineer
Senior Data Engineer responsible for designing and operating extraction, transformation, and migration pipelines to retire applications and archive enterprise data using Python, SQL, AWS and modern data orchestration tools.
About the role
Key Responsibilities
- Design, develop, and maintain ETL pipelines that extract, transform, and load data from legacy systems into archival storage.
- Implement data migration strategies for application retirement, ensuring data integrity, security, and compliance.
- Build and manage data models and warehousing solutions on cloud platforms (e.g., AWS S3, Redshift, Glacier).
- Automate workflow orchestration using Apache Airflow or similar tools to schedule and monitor archival jobs.
- Collaborate with cross‑functional teams to define archival requirements, data retention policies, and performance benchmarks.
- Provide technical guidance and mentorship to junior engineers on best practices for data archiving and migration.
Requirements
- 5+ years of experience in data engineering, with a focus on ETL, data migration, and archival solutions.
- Proficiency in Python and SQL for data manipulation and pipeline development.
- Hands‑on experience with cloud services (AWS S3, Glacier, Redshift, or equivalents) and infrastructure‑as‑code.
- Strong knowledge of workflow orchestration tools such as Apache Airflow, Prefect, or similar.
- Understanding of data governance, security, and compliance standards related to long‑term data storage.
Skills
pythonsqlawsairflow