remote
Staff Data Engineer - Rezdy
Data Engineer
Lead the design and maintenance of scalable data pipelines, leveraging Python, SQL, AWS, Spark, and Airflow to transform and deliver high‑quality data for business insights and product development.
About the role
Key Responsibilities
- Architect, build, and optimize large‑scale data pipelines that ingest, transform, and store data from diverse sources.
- Collaborate with data scientists, product managers, and engineering teams to define data models and ensure data quality and accessibility.
- Implement and maintain data workflows using Airflow, ensuring reliability, monitoring, and alerting.
- Leverage AWS services (S3, Redshift, Glue, EMR) to support scalable storage, processing, and analytics.
- Write efficient, maintainable Python and SQL code, and develop Spark jobs for batch and streaming workloads.
- Document architecture, processes, and best practices to enable knowledge sharing across the organization.
Requirements
- 5+ years of experience in data engineering or related roles.
- Proficiency in Python, SQL, and experience with Spark or similar big‑data frameworks.
- Hands‑on experience with AWS data services (S3, Redshift, Glue, EMR).
- Strong understanding of data modeling, ETL design, and workflow orchestration.
- Excellent problem‑solving skills and a passion for building reliable, scalable data solutions.
Skills
pythonsqlawsapache sparkairflow