remote
Data Engineering Lead - 9fin
Software Engineer
Lead a high‑impact data engineering team building scalable pipelines and data platforms for global debt markets, leveraging Python, SQL, AWS, and Spark to transform fragmented data into unified, high‑value insights.
About the role
Key Responsibilities
- Architect, develop, and maintain end‑to‑end data pipelines that ingest, cleanse, and transform large volumes of proprietary credit data.
- Lead a team of data engineers, providing mentorship, code reviews, and fostering a culture of continuous improvement.
- Collaborate with data scientists, product managers, and stakeholders to define data requirements and deliver actionable insights.
- Design and enforce data governance, security, and compliance standards across the platform.
- Optimize performance and cost of data workflows on AWS, utilizing services such as S3, Redshift, Glue, and EMR.
Requirements
- 5+ years of experience in data engineering, with a proven track record of leading teams.
- Strong proficiency in Python, SQL, and experience with Spark or similar big‑data frameworks.
- Hands‑on expertise with AWS data services (S3, Redshift, Glue, EMR, Athena).
- Deep understanding of data modeling, ETL design, and data quality best practices.
- Excellent communication skills and ability to translate complex technical concepts to non‑technical stakeholders.
Skills
pythonsqlawsapache spark