onsite
Cloud Software Engineer 2 - Columbia Technology Partners
Software Engineer
Cloud Software Engineer focused on designing and building scalable big‑data backend systems in AWS, using Spark, Kubernetes, and SQL to deliver high‑performance distributed processing solutions.
About the role
Key Responsibilities
- Design, develop, and maintain backend components for large‑scale cloud data platforms.
- Implement distributed processing workflows with Apache Spark and other big‑data frameworks.
- Architect and optimize data pipelines for performance, reliability, and cost efficiency in AWS.
- Collaborate with data scientists and product teams to translate business requirements into scalable solutions.
- Monitor, troubleshoot, and improve system health using cloud monitoring tools and best practices.
Requirements
- 3+ years of backend development experience in a cloud environment.
Skills
pythonjavaapache sparkawskubernetessql