onsite
Data Engineer - Analytics - Aditya Birla Group
Data Engineer
Lead end‑to‑end analytics data engineering, designing and maintaining scalable pipelines, data warehouses, and cloud solutions to support sales and financial services insights.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines using Python, SQL, and Spark to ingest, transform, and load data from diverse sources into cloud data warehouses.
- Collaborate with data scientists and business analysts to define data models, optimize queries, and ensure high data quality and integrity.
- Implement and manage ETL processes, data cataloging, and metadata management, ensuring compliance with data governance and security standards.
- Monitor pipeline performance, troubleshoot issues, and continuously improve throughput and reliability.
- Evaluate and integrate new data technologies, tools, and services to enhance analytics capabilities and reduce operational costs.
Requirements
- 3+ years of experience in data engineering within a financial services or related domain.
- Proficiency in Python, SQL, and experience with Spark or similar big‑data frameworks.
- Hands‑on experience with cloud platforms (AWS, Azure, or GCP) and data warehousing solutions (Redshift, Snowflake, BigQuery).
- Strong understanding of ETL concepts, data modeling, and data governance best practices.
- Excellent problem‑solving skills, attention to detail, and ability to work collaboratively in a fast‑paced environment.
Skills
pythonsqlapache sparkaws