remote
Senior Data Engineer Delivery - Induansh Private Limited
Data Engineer
Lead the design and optimization of large‑scale data extraction and delivery pipelines for a compliance platform, leveraging Snowflake, Python, and AWS S3 to build scalable batch processes, REST APIs, and microservices.
About the role
Key Responsibilities
- Design, develop, and maintain high‑performance data delivery pipelines in Snowflake and AWS S3.
- Build and expose RESTful APIs and microservices to support downstream analytics and reporting.
- Optimize batch processing workflows and query performance for large datasets.
- Collaborate with data scientists, product managers, and DevOps to ensure secure, scalable, and compliant data flows.
- Implement monitoring, logging, and automated testing for data pipelines.
Requirements
- 7–10+ years of experience in data engineering with a focus on cloud platforms.
- Proficiency in Snowflake, Python, and AWS services (S3, Lambda, Glue).
- Strong background in building batch processing pipelines, REST APIs, and microservices.
- Experience optimizing SQL queries and managing large‑scale data workloads.
- Excellent problem‑solving skills and ability to work in a fast‑paced, cross‑functional environment.