remote
Senior Software Development Engineer - AWS Glue - Amazon.com
Software Engineer
Lead the design and implementation of large‑scale, distributed data integration services on AWS Glue, driving innovation in zero‑ETL and SaaS data replication for transactional data lakes and warehouses.
About the role
Key Responsibilities
- Architect and develop high‑throughput, fault‑tolerant data pipelines using AWS Glue, Spark, and related services.
- Collaborate with cross‑functional teams to define data integration requirements and translate them into scalable solutions.
- Optimize ETL workflows for performance, cost, and reliability, leveraging Glue Studio, Glue Jobs, and custom Java/Python code.
- Implement monitoring, logging, and automated testing to ensure data quality and system resilience.
- Mentor junior engineers and champion best practices in distributed system design and cloud architecture.
Requirements
- 5+ years of software engineering experience in cloud data platforms, with deep knowledge of AWS Glue and Spark.
- Proficiency in Python and Java, with experience building production‑grade ETL pipelines.
- Strong understanding of distributed systems, data replication, and zero‑ETL concepts.
- Hands‑on experience with AWS services such as S3, Athena, Redshift, and Lambda.
- Excellent problem‑solving skills and a passion for building reliable, scalable data solutions.
Skills
pythonjavaapache spark