onsite
Mid Software Engineer
Software Engineer
Mid-level engineer focused on building and optimizing data pipelines using AWS Glue, Amazon Athena, Amazon S3, and Apache Spark to deliver scalable analytics solutions.
About the role
Key Responsibilities
- Design, develop, and maintain data pipelines in AWS Glue to ingest, transform, and load data into Amazon S3 and Athena.
- Optimize Spark jobs for performance and cost-efficiency, ensuring high throughput and low latency.
- Collaborate with data scientists and analysts to translate business requirements into scalable ETL solutions.
- Implement monitoring, logging, and alerting for data workflows to ensure reliability and quick issue resolution.
- Document architecture, code, and best practices for future maintenance and knowledge transfer.
Requirements
- 3+ years of experience building data pipelines on AWS.
- Strong SQL skills and experience querying large datasets.
- Experience with version control (Git) and CI/CD pipelines.
- Excellent problem‑solving skills and ability to work independently.