remote
Senior Lead Data Engineer Tech Lead Manager - JPMorganChase
Data Engineer
Senior Lead Data Engineer driving large‑scale data pipelines and analytics for a global consumer banking platform, leveraging Spark, Python, SQL and AWS to deliver high‑performance, scalable solutions.
About the role
Key Responsibilities
- Design, develop and maintain end‑to‑end data pipelines using Apache Spark and Python to ingest, transform and load millions of records daily.
- Lead a cross‑functional team of data engineers, ensuring best practices in code quality, testing, and documentation.
- Architect scalable data solutions on AWS (EMR, S3, Redshift, Glue) that support real‑time analytics and reporting.
- Collaborate with data scientists and product owners to translate business requirements into robust data models and services.
- Implement monitoring, alerting and performance tuning to guarantee high availability and optimal throughput.
Requirements
- 10+ years of experience in data engineering with a proven track record in large‑scale distributed systems.
- Expertise in Spark, Python, SQL and AWS data services.
- Strong leadership skills with experience managing and mentoring engineering teams.
- Excellent problem‑solving abilities and a passion for data quality and governance.
- Effective communication skills to collaborate with stakeholders across the organization.
Skills
apache sparkpythonsqlaws