onsite
AWS Data Senior Technical Specialist - Glue, Snowflake & DevOps - HCLTech
Software Engineer
Lead the design, build, and operation of large‑scale ETL pipelines and data warehouses using AWS Glue, Snowflake, and modern DevOps practices. Drive data integrity, security, and model deployment while collaborating with data science and engineering teams.
About the role
Key Responsibilities
- Architect, develop, and maintain scalable ETL pipelines on AWS Glue and Snowflake to ingest, transform, and store enterprise data.
- Implement CI/CD workflows and containerized deployments (Docker, Kubernetes) for data services and ML model releases.
- Ensure data quality, security, and compliance across data lakes, warehouses, and cloud storage.
- Collaborate with data scientists, analysts, and software engineers to translate prototypes into production‑ready solutions.
- Monitor and troubleshoot data pipelines, performance bottlenecks, and system health using observability tools.
Requirements
- Proven experience with AWS Glue, Snowflake, and Python/SQL for data engineering.
- Strong background in Spark, Hadoop, and distributed data processing.
- Hands‑on expertise with Docker, Kubernetes, and CI/CD pipelines.
- Solid understanding of data security, governance, and compliance best practices.
- Excellent problem‑solving skills and ability to work cross‑functionally in a fast‑paced environment.
Skills
snowflakepythonsqldockerkubernetes