onsite
Lead Software Engineer - Capital One
Software Engineer
Lead a team building scalable back‑end services using Python, Scala, Spark and AWS, driving data‑centric solutions for complex business problems.
About the role
Key Responsibilities
- Architect, design, and deliver high‑performance back‑end services on Python and Scala, leveraging Apache Spark for large‑scale data processing.
- Lead a cross‑functional engineering team, providing technical guidance, code reviews, and mentorship.
- Define and enforce best practices for cloud deployment, CI/CD pipelines, and observability on AWS.
- Collaborate with product, data science, and infrastructure partners to translate business requirements into robust, scalable solutions.
- Drive continuous improvement by introducing emerging technologies, performance optimizations, and automation.
Requirements
- 5+ years of professional software development experience, with deep expertise in Python and Scala.
- Strong hands‑on experience building data pipelines or services with Apache Spark.
- Proven experience designing, deploying, and operating applications on AWS (e.g., EC2, S3, Lambda, EMR, CloudFormation).
- Solid understanding of distributed systems, micro‑service architectures, and RESTful APIs.
- Excellent problem‑solving skills, ability to lead technical discussions, and mentor junior engineers.
Skills
pythonscalaapache sparkaws