onsite
Data Engineer - Creditreform
Data Engineer
Data Engineer responsible for designing, building, and maintaining scalable data pipelines and infrastructure using Python, SQL, and AWS services to support analytics and machine learning initiatives.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines to ingest, transform, and load data from diverse sources into data warehouses and lakes.
- Collaborate with data scientists and analysts to understand data requirements and deliver high‑quality, well‑documented datasets.
- Optimize data models and query performance for large‑scale analytics workloads on AWS services such as Redshift, S3, and Glue.
- Implement data quality checks, monitoring, and alerting to ensure data integrity and reliability.
- Stay current with emerging data technologies and recommend improvements to the data architecture.
Requirements
- Proven experience with Python, SQL, and AWS data services.
- Strong background in data modeling, ETL design, and performance tuning.
- Hands‑on experience with big data tools (e.g., Spark, Hive) is a plus.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.