onsite
Full Stack Data Engineer
Data Engineer
Full Stack Data Engineer responsible for designing, building, and maintaining data pipelines using Python, Airflow, Amazon Redshift, and Apache Spark, while also handling front‑end styling with CSS to support data dashboards and reporting tools.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines in Python, orchestrated with Airflow, to ingest, transform, and load data into Amazon Redshift.
- Leverage Apache Spark for large‑scale data processing and real‑time analytics, ensuring performance and reliability.
- Collaborate with data scientists and analysts to translate business requirements into efficient ETL workflows.
- Implement data quality checks, monitoring, and alerting to guarantee data integrity across the pipeline.
- Develop and style interactive dashboards and reports using CSS, ensuring a cohesive user experience.
Requirements
- Proven experience with Python, Airflow, Amazon Redshift, and Apache Spark.
- Strong understanding of SQL and data modeling best practices.
- Hands‑on experience with front‑end styling using CSS for data visualization components.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
Skills
pythonairflowapache spark