We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing and implementing scalable data solutions, working with large datasets, and building robust data pipelines and leveraging APIs. This role requires strong expertise in cloud platforms and a deep understanding of data engineering best practices within the e-commerce industry.
Design, develop, and maintain data pipelines to process and transform large volumes of data efficiently.
- Normalize and aggregate data across multiple cloud platforms, including AWS, Azure, and Google BigQuery.
- Leverages APIs for data access and integration with internal and external systems
- Work with web and transactional data to support analytics and business intelligence initiatives.
- Ensure data quality, integrity, and security across all stages of the data lifecycle.
- Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.
Required Qualifications & Skills
Bachelor’s degree in Computer Science, Engineering, or related field from a reputed institute in India.
- Minimum of 8+ years of experience working in a large-scale organization
- Proven experience with AWS, Azure, and BigQuery for data storage and processing.
- Strong proficiency in SQL, Python, and data transformation tools is a must.
- Hands-on experience in building ETL pipelines, data orchestration frameworks, and RESTful APIs.
- Experience handling large-scale datasets and optimizing data workflows.
- Familiarity with e-commerce industry data, including web analytics and transactional data.
- Knowledge of data modeling, normalization, and aggregation techniques.
Education/ Experience :
Bachelor’s degree in Computer Science, Engineering, or related field
- Minimum of 8+ years of experience working in a large-scale organization
- Proven experience with AWS, Azure, and BigQuery for data storage and processing.
- Strong proficiency in SQL, Python, and data transformation tools is a must.
- Hands-on experience in building ETL pipelines, data orchestration frameworks, and RESTful APIs.
- Experience handling large-scale datasets and optimizing data workflows.
- Familiarity with e-commerce industry data, including web analytics and transactional data.
- Knowledge of data modeling, normalization, and aggregation techniques.
Skills and Ability :
- Experience with distributed systems and big data technologies (e.g., Spark, Redshift, Hadoop).
- Solid understanding of data governance, security, and compliance in cloud environments.
Work Conditions/ Physical Demands :