onsite
Senior Data Engineer - INTERSOG
Data Engineer
Senior Data Engineer leading design, development, and optimization of large‑scale data pipelines and warehouses using Python, Spark, Airflow, and AWS to deliver reliable, high‑performance analytics solutions.
About the role
Key Responsibilities
- Design, build, and maintain scalable data pipelines and ETL processes on cloud platforms.
- Develop and optimize data models and warehouses using SQL and Big Data technologies such as Apache Spark.
- Implement workflow orchestration and scheduling with Apache Airflow.
- Collaborate with data scientists, analysts, and product teams to translate business requirements into technical solutions.
- Ensure data quality, reliability, and performance through testing, monitoring, and continuous improvement.
Requirements
- 5+ years of experience in data engineering or related fields.
- Proficiency in Python and SQL for data manipulation and scripting.
- Hands‑on experience with Apache Spark, Airflow, and cloud services (AWS preferred).
- Strong understanding of ETL design patterns, data modeling, and big‑data architectures.
- Ability to work independently and mentor junior engineers in a fast‑paced environment.
Skills
pythonsqlapache sparkaws