onsite
AWS Data Engineer - HCLTech
Data Engineer
Develop and maintain scalable data pipelines on AWS using Amazon Glue, SQL, and Python, delivering reliable data transformations and automation for business analytics.
About the role
Key Responsibilities
- Design, build, and operate robust data pipelines with Amazon Glue to extract, transform, and load data into data warehouses.
- Write complex SQL queries for data analysis, reporting, and ad‑hoc stakeholder requests.
- Develop and maintain Python scripts for automation, data processing, and workflow orchestration.
- Collaborate with cross‑functional teams to translate business requirements into technical solutions.
- Monitor pipeline performance, troubleshoot issues, and implement optimizations for reliability and cost efficiency.
Requirements
- Strong experience with Amazon Glue and other AWS data services (e.g., S3, Redshift, Athena).
- Proficiency in SQL for data manipulation and reporting.
- Solid Python programming skills, especially for automation and ETL tasks.
- Understanding of data modeling, warehousing concepts, and best practices for data pipelines.
- Excellent problem‑solving abilities and effective communication within a collaborative team environment.