onsite
Senior Data Engineer - Platform Experience - INTERSOG
Data Engineer
Senior Data Engineer focused on building scalable data pipelines and platform services using Python, SQL, AWS, and Spark to deliver high‑quality data solutions for enterprise clients.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines and ETL processes to ingest, transform, and store large volumes of structured and unstructured data.
- Leverage AWS services (S3, Redshift, Glue, EMR) to build scalable, cost‑effective data infrastructure.
- Implement data quality, monitoring, and governance practices to ensure reliability and compliance.
- Collaborate with data scientists, analysts, and product teams to translate business requirements into technical solutions.
- Optimize performance of Spark jobs and SQL queries, and troubleshoot production issues.
Requirements
- 5+ years of experience in data engineering, with strong proficiency in Python and SQL.
- Hands‑on experience with AWS data services and Apache Spark.
- Solid understanding of data modeling, schema design, and ETL best practices.
- Experience with version control (Git) and CI/CD pipelines for data workflows.
- Excellent problem‑solving skills and ability to work independently in a fast‑paced environment.
Skills
pythonsqlawsapache spark