remote
Senior Data Developer - Plusgrade
Software Engineer
Senior Data Developer responsible for designing and deploying high‑performance batch and streaming data pipelines, optimizing cloud infrastructure, and mentoring mid‑level engineers on a large‑scale travel data platform.
About the role
Key Responsibilities
- Design, build, and maintain scalable batch and real‑time data pipelines using Python, Spark, and Kafka.
- Implement orchestration and workflow automation with Apache Airflow.
- Optimize cloud resources on AWS for cost efficiency, reliability, and performance.
- Collaborate with data scientists to integrate AI/ML models into production data flows.
- Mentor and guide intermediate engineers, promoting best practices in code quality and DevOps.
- Ensure data quality, monitoring, and alerting across the platform.
Requirements
- 5+ years of professional experience in data engineering or related fields.
- Strong proficiency in Python, SQL, and big‑data frameworks such as Apache Spark.
- Hands‑on experience with streaming technologies (Kafka) and workflow orchestration (Airflow).
- Deep understanding of AWS services (S3, Redshift, EMR, Lambda) and cloud‑native architecture.
- Proven ability to lead technical initiatives and mentor junior team members.
Skills
pythonsqlapache sparkkafkaawsairflow