onsite
Data Engineer III - Fidelity International
Data Engineer
Senior Data Engineer driving large‑scale data pipelines and architecture using Python, Spark, and AWS to deliver reliable, high‑performance analytics solutions for enterprise clients.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python and Apache Spark on AWS infrastructure.
- Implement robust ETL processes, ensuring data quality, lineage, and performance optimization.
- Collaborate with data scientists and business stakeholders to translate analytical requirements into technical solutions.
- Define and enforce data modeling standards, schema design, and metadata management.
- Monitor pipeline health, troubleshoot issues, and continuously improve system reliability.
Requirements
- 5+ years of experience in data engineering with a strong focus on big data technologies.
- Proficiency in Python, SQL, and Spark (PySpark) for data processing.
- Hands‑on experience with AWS services such as S3, EMR, Glue, and Redshift.
- Solid understanding of data modeling, ETL best practices, and data governance.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.
Skills
pythonsqlapache sparkaws