onsite
Data Engineer - MeridianLink
Data Engineer
Data Engineer building scalable pipelines with Python, SQL, Airflow, Spark on AWS, delivering high‑quality data for analytics and decision‑making.
About the role
Key Responsibilities
- Design, develop, and maintain end‑to‑end data pipelines using Python, SQL, and Apache Airflow.
- Implement and optimize Spark jobs for large‑scale data processing.
- Deploy and manage data infrastructure on AWS (S3, Redshift, EMR, Glue).
- Collaborate with data architects, analysts, and scientists to define data models and ensure data quality.
- Monitor pipeline performance, troubleshoot issues, and implement automated alerts.
Requirements
- 3+ years of experience building production data pipelines.
- Experience with data modeling, ETL best practices, and data quality frameworks.
- Excellent communication skills and ability to work cross‑functionally.
Skills
pythonsqlapache sparkaws