onsite
Consultant - Software Engineer - CLOUDSUFI
Software Engineer
Senior software engineer focused on designing and building robust ETL/ELT pipelines, automating data workflows, and ensuring data quality using Python, SQL, and modern data tools.
About the role
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines to ingest data from APIs, databases, and log sources.
- Write Python scripts to automate repetitive data tasks, monitor pipeline health, and trigger alerts.
- Implement comprehensive data validation and quality checks to prevent “garbage in, garbage out” scenarios.
- Document data lineage, technical workflows, and best practices to enable team scalability.
- Collaborate with data scientists and analysts to optimize data models and query performance.
Requirements
- Strong proficiency in Python with experience in Pandas or PySpark.
- Advanced SQL skills, including joins, window functions, and query optimization.
- Hands‑on experience building ETL/ELT pipelines and automating data workflows.
- Solid understanding of data quality principles and data validation techniques.
- Excellent communication skills and ability to document complex processes clearly.