remoteonsite
Data Engineer - Aeries Technology Group
Data Engineer
Senior Data Engineer responsible for designing, building, and maintaining scalable data pipelines and warehouses using Python, SQL, AWS, and Spark to support analytics and business intelligence across global clients.
About the role
Key Responsibilities
- Design, develop, and optimize large-scale data pipelines and ETL processes using Python, SQL, and Apache Spark.
- Build and maintain data warehouses on AWS (Redshift, S3, Glue) to support analytics and reporting.
- Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver high‑quality data solutions.
- Implement data quality checks, monitoring, and performance tuning to ensure reliability and efficiency.
- Document data models, pipeline architecture, and best practices for future reference.
Requirements
- 8–12 years of experience in data engineering or related roles.
- Proficiency in Python, SQL, and experience with Spark or similar big‑data frameworks.
- Hands‑on experience with AWS data services (Redshift, S3, Glue, Athena).
- Strong understanding of data warehousing concepts, dimensional modeling, and ETL best practices.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
Skills
pythonsqlawsapache spark