onsite
Software Engineer II - Python & Spark - JPMorganChase
Software Engineer
Senior software engineer focused on building secure, scalable data pipelines using Python and Spark, delivering analytics solutions for wealth management data.
About the role
Key Responsibilities
- Design, develop, and maintain high‑performance data pipelines and architectures using Python and Apache Spark.
- Collaborate with cross‑functional teams to translate business requirements into robust, secure data solutions.
- Implement data quality, governance, and control reviews to ensure compliance and protection of sensitive information.
- Optimize performance and scalability of data workflows on AWS infrastructure.
- Write comprehensive unit and integration tests, and participate in code reviews to uphold quality standards.
Requirements
- 3+ years of experience in data engineering or software development with Python and Spark.
- Strong SQL skills and experience with relational and distributed data stores.
- Hands‑on experience deploying and managing data pipelines on AWS (EMR, S3, Glue).
- Familiarity with agile development practices and CI/CD pipelines.
- Excellent problem‑solving skills and a commitment to data security and governance.
Skills
pythonapache sparksqlaws