onsite
Associate Data Engineer - Cresset
Data Engineer
Associate Data Engineer building scalable data pipelines and analytics solutions using Python, SQL, AWS, and Spark to support investment insights and operational efficiency.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines that ingest, transform, and store large volumes of structured and unstructured data.
- Collaborate with data scientists and business stakeholders to understand data requirements and deliver actionable insights.
- Implement and optimize ETL processes using Python, SQL, and Apache Spark on AWS services such as S3, Redshift, and Glue.
- Ensure data quality, consistency, and security through rigorous testing, monitoring, and documentation.
- Participate in architecture reviews and contribute to the continuous improvement of data infrastructure and best practices.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or related field.
- 1–3 years of experience in data engineering or a related role.
Skills
pythonsqlawsapache spark