onsite
Sr. Lead Software Engineer Python, Scala, Spark, AWS - Information Technology Senior Management Forum
Software Engineer
Lead backend engineering initiatives, architecting data‑centric solutions with Python, Scala, and Spark on AWS, driving high‑performance, scalable services in a fast‑paced, collaborative environment.
About the role
Key Responsibilities
- Architect and develop high‑throughput data pipelines using Python, Scala, and Spark on AWS infrastructure.
- Lead a cross‑functional team of backend engineers, mentoring and driving best practices in code quality, testing, and CI/CD.
- Collaborate with data scientists and product managers to translate business requirements into scalable, maintainable services.
- Optimize performance, reliability, and cost of cloud‑native applications, ensuring adherence to security and compliance standards.
- Champion continuous improvement, adopting emerging technologies and tools to enhance delivery velocity.
Requirements
- 10+ years of software development experience, with 5+ years in a senior or lead role.
- Deep expertise in Python, Scala, and Spark for large‑scale data processing.
- Proven experience designing and deploying applications on AWS (EC2, S3, EMR, Lambda, etc.).
- Strong architectural judgment, problem‑solving skills, and a track record of delivering production‑grade systems.
- Excellent communication and leadership abilities, with a passion for mentoring junior engineers.