remote
Senior Data Engineer - Plain Concepts
Data Engineer
Senior Data Engineer leading end‑to‑end data pipeline development using Python, Spark, and AWS services, driving scalable, high‑performance solutions for global analytics teams.
About the role
Key Responsibilities
- Design, build, and maintain robust data pipelines that ingest, transform, and deliver data across multiple cloud platforms.
- Collaborate with data scientists and product teams to translate business requirements into scalable data models and services.
- Optimize existing workflows for performance, reliability, and cost efficiency using Spark, SQL, and AWS services.
- Implement monitoring, alerting, and automated testing to ensure data quality and pipeline resilience.
- Mentor junior engineers and contribute to best‑practice documentation and knowledge sharing.
Requirements
- 5+ years of experience in data engineering with a strong focus on Python and SQL.
- Proficiency in Apache Spark, AWS (S3, Redshift, Glue, EMR), and workflow orchestration tools like Airflow.
- Solid understanding of data modeling, ETL processes, and performance tuning.
- Experience with version control (Git), CI/CD pipelines, and automated testing frameworks.
- Excellent communication skills and a collaborative mindset.
Skills
pythonsqlapache sparkawsairflow