onsite
Senior Data Engineer - Compunnel Inc.
Data Engineer
Lead the design and optimization of scalable cloud data platforms, building high‑performance ETL/ELT pipelines to deliver reliable datasets for analytics, BI, and machine learning using Python, SQL, and AWS services.
About the role
Key Responsibilities
- Architect, develop, and maintain scalable cloud‑based data pipelines (ETL/ELT) that support enterprise analytics, regulatory reporting, and machine learning workloads.
- Implement best practices for data quality, governance, and security across AWS data services (Redshift, S3, Glue, Lake Formation).
- Collaborate with data scientists, BI teams, and product owners to translate business requirements into robust data models and efficient data flows.
- Optimize query performance, monitor pipeline health, and troubleshoot issues in production environments.
- Document architecture, processes, and data lineage to ensure maintainability and compliance.
Requirements
- 5+ years of experience in data engineering with a strong focus on cloud platforms (AWS preferred).
- Proficiency in Python, SQL, and modern data orchestration tools (Airflow, dbt).
- Hands‑on experience building and optimizing data pipelines using AWS services such as Redshift, Glue, and S3.
- Solid understanding of data modeling, schema design, and performance tuning.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.