onsite
Associate Data Engineer - New York Life
Data Engineer
Associate Data Engineer driving data pipelines and AI initiatives using Python, SQL, AWS, and Generative AI to enhance productivity and streamline processes across the organization.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python, SQL, and AWS services.
- Implement ETL processes and optimize data workflows for high‑volume datasets.
- Collaborate with data science teams to integrate Generative AI models into production environments.
- Monitor pipeline performance, troubleshoot issues, and ensure data quality and reliability.
- Document architecture, code, and best practices for future maintenance and knowledge transfer.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or related field.
- 1–2 years of experience in data engineering or related roles.
- Experience with ETL tools and data orchestration (Airflow, Prefect).
- Strong analytical skills and ability to work collaboratively in a hybrid environment.
Skills
pythonsqlawsgenerative aiapache spark