onsite
Data Engineer - Data Pipelines & ETL - Paramount
Data Engineer
Lead the design, development, and maintenance of scalable data pipelines and ETL processes using Python, SQL, Airflow, Spark, and AWS to deliver high‑quality data for analytics and business intelligence.
About the role
Key Responsibilities
- Design, build, and optimize robust data pipelines that ingest, transform, and load large volumes of data from diverse sources into data lakes and warehouses.
- Develop and maintain Airflow DAGs and Spark jobs, ensuring reliability, scalability, and performance.
- Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver clean, well‑documented datasets.
- Implement data quality checks, monitoring, and alerting to guarantee data integrity and availability.
- Leverage AWS services (S3, Redshift, Glue, EMR) to build cost‑effective, secure, and compliant data infrastructure.
Requirements
- 3+ years of experience as a data engineer or similar role, with a strong focus on ETL and pipeline development.
Skills
pythonsqlapache sparkaws