remote
Lead Software Engineer - AWS - JPMorganChase
Software Engineer
Lead Software Engineer driving secure, scalable AWS‑based data lake platforms, building data pipelines with Spark and Kafka, and delivering CI/CD‑enabled solutions for AI/ML workloads.
About the role
Key Responsibilities
- Architect, design, and implement secure, highly‑available Data Lake solutions on AWS for enterprise AI/ML and analytics workloads.
- Develop and maintain data ingestion, processing, and streaming pipelines using Apache Spark, Kafka, and Python.
- Lead the adoption of CI/CD practices, containerization (Docker) and orchestration to ensure rapid, reliable delivery of services.
- Collaborate with cross‑functional product, data science, and security teams to translate business requirements into robust technical designs.
- Mentor junior engineers, conduct code reviews, and enforce best practices for performance, reliability, and security.
Requirements
- 5+ years of professional software engineering experience, with a focus on AWS cloud services and data platform development.
- Strong proficiency in Python and hands‑on experience with Apache Spark and Kafka for large‑scale data processing.
- Demonstrated expertise in building secure, scalable Data Lake architectures and implementing CI/CD pipelines using Docker and related tooling.
- Solid understanding of security, networking, and compliance considerations in cloud environments.
- Excellent problem‑solving skills and ability to lead technical discussions in an agile setting.
Skills
awspythonapache sparkkafkacicddocker