onsite
AWS Cloud Platform Lead - Advent Global Solutions, Inc.
Software Engineer
Lead the design and implementation of scalable batch and streaming data pipelines on AWS, leveraging Java, Python, and PySpark to deliver reliable, high‑performance data platforms for enterprise analytics.
About the role
Key Responsibilities
- Architect and develop end‑to‑end batch and streaming data pipelines using AWS services (Glue, Kinesis, Lambda, S3, Redshift).
- Implement event‑driven microservices in Java and Python, ensuring high availability and fault tolerance.
- Optimize data processing workflows with PySpark, tuning performance and cost efficiency.
- Collaborate with data scientists and analysts to translate business requirements into robust data solutions.
- Mentor and guide a small team of developers, conducting code reviews and promoting best practices.
Requirements
- 15+ years of professional experience in software engineering with a focus on cloud data platforms.
- Deep expertise in Java, Python, and PySpark, plus hands‑on experience with AWS data services.
- Proven track record designing event‑driven architectures and optimizing large‑scale data pipelines.
- Strong communication skills and ability to mentor junior engineers.
- Experience with CI/CD, monitoring, and security best practices in AWS.