remoteonsite
AWS Lead Data Engineer - Brillio LLC
Data Engineer
Senior data engineer leading AWS data platform design and implementation, driving scalable ETL pipelines, data warehousing, and lake formation using Athena, Glue, and PySpark.
About the role
Key Responsibilities
- Design, develop, and maintain large‑scale data pipelines on AWS using Athena, Glue, and PySpark.
- Implement and optimize ETL processes, ensuring data quality and performance across S3, Lake Formation, and Aurora.
- Collaborate with data scientists and analysts to model data and deliver actionable insights.
- Manage infrastructure components such as EC2, EBS/EFS, and CloudFront for high availability and cost efficiency.
- Lead troubleshooting, monitoring, and continuous improvement of data workflows.
Requirements
- 5–10 years of experience as a senior data engineer with deep AWS expertise.
- Hands‑on experience with AWS services: Athena, Glue, Lambda, Step Functions, Lake Formation, S3, EC2, EBS/EFS, Aurora, and CloudFront.
- Strong understanding of modern data platform fundamentals and data warehousing concepts.
- Excellent problem‑solving skills and ability to work in a hybrid/remote environment.