onsite
Data Engineer f/m/x
Data Engineer
Data Engineer role focused on building and maintaining scalable data pipelines using AWS Glue, Lambda, Redshift, and S3 to support analytics and reporting across the organization.
About the role
Key Responsibilities
- Design, develop, and maintain ETL pipelines using AWS Glue to ingest, transform, and load data into Amazon Redshift.
- Implement serverless data processing workflows with AWS Lambda, ensuring high availability and performance.
- Optimize data storage and retrieval in Amazon S3, including partitioning, compression, and lifecycle policies.
- Collaborate with data scientists and analysts to understand data requirements and deliver clean, reliable datasets.
- Monitor pipeline health, troubleshoot issues, and continuously improve data quality and processing efficiency.
Requirements
- Proven experience with AWS Glue, Lambda, Redshift, and S3 in a production environment.
- Strong SQL skills and familiarity with data modeling for analytical workloads.
- Experience with Python or Scala for data transformation scripts.
- Knowledge of data pipeline orchestration and monitoring tools.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.