onsite
Senior Associate, Data Engineering
Software Engineer
Senior Data Engineering professional to design, build, and optimize scalable data pipelines and warehouses using Python, SQL, Spark, Airflow, and AWS services for complex analytics solutions.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines to ingest, transform, and load data from diverse sources.
- Build and optimize data models and warehouses on AWS platforms (Redshift, S3, Glue) to support analytical workloads.
- Implement workflow orchestration using Apache Airflow, ensuring reliability, monitoring, and alerting.
- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable data solutions.
- Apply best practices for data quality, governance, and security throughout the data lifecycle.
Requirements
- 5+ years of hands‑on experience in data engineering, with strong proficiency in Python and SQL.
- Deep knowledge of big‑data processing frameworks such as Apache Spark.
- Extensive experience with AWS services (Redshift, S3, Glue, Lambda, IAM) and cloud‑based data pipelines.
- Proven expertise in workflow orchestration tools, particularly Apache Airflow.
- Solid understanding of data modeling, warehousing concepts, and ETL best practices.