onsite
Senior Data Engineering Developer - Intact
Software Engineer
Lead end‑to‑end data pipeline development, architecting scalable solutions on AWS, leveraging Python, Spark, and SQL to deliver high‑performance analytics platforms.
About the role
Key Responsibilities
- Design, build, and maintain large‑scale data pipelines using Python, Spark, and SQL on AWS services (Glue, Redshift, S3).
- Implement robust ETL processes, ensuring data quality, lineage, and performance optimization.
- Collaborate with data scientists and product teams to translate business requirements into scalable data models.
- Automate deployment and monitoring of data workflows with Docker, CI/CD pipelines, and CloudWatch.
- Mentor junior engineers and conduct code reviews to uphold best practices.
Requirements
- 5+ years of experience in data engineering or related roles.
- Strong proficiency in Python, SQL, and Apache Spark.
- Hands‑on experience with AWS data services (Glue, Redshift, Athena, S3).
- Solid understanding of data modeling, ETL design, and performance tuning.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
Skills
pythonsqlawsapache sparkdocker