remote
AWS Data Engineer - Tata Consultancy Services (TCS)
Data Engineer
Lead end‑to‑end data pipelines on AWS, designing and optimizing ETL workflows with Python and Spark, while ensuring data quality, governance, and performance for enterprise clients.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines on AWS services (Glue, Redshift, S3, Lambda).
- Implement ETL processes using Python and Apache Spark, optimizing for performance and cost.
- Model and structure data for analytics, ensuring data quality, lineage, and security compliance.
- Collaborate with data scientists, analysts, and stakeholders to translate business requirements into technical solutions.
- Monitor, troubleshoot, and optimize pipeline performance, implementing automated alerts and dashboards.
Requirements
- 3+ years of experience in data engineering with a strong focus on AWS.
- Hands‑on experience with AWS Glue, Redshift, S3, and related services.
- Solid understanding of data modeling, ETL best practices, and data governance.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
Skills
awssqlpythonapache spark