onsite
Data Engineer - S&N Invent
Data Engineer
Design, build, and maintain scalable data pipelines and infrastructure using Python, SQL, and AWS services to support analytics and machine learning initiatives.
About the role
Key Responsibilities
- Develop and maintain robust ETL pipelines to ingest, transform, and load data from diverse sources into data warehouses.
- Design and implement data models, schemas, and indexing strategies to optimize query performance.
- Collaborate with data scientists and analysts to understand data requirements and deliver high‑quality datasets.
- Monitor pipeline health, troubleshoot issues, and implement automated alerts and recovery mechanisms.
- Ensure data quality, consistency, and compliance with security and governance policies.
Requirements
- Strong experience with Python, SQL, and data processing frameworks (e.g., Pandas, Spark).
- Hands‑on experience with AWS services such as S3, Redshift, Glue, and Lambda.
- Solid understanding of data modeling, ETL best practices, and performance tuning.
- Excellent problem‑solving skills and ability to work independently in a fast‑paced environment.