onsite
Data Engineer - Aviva
Data Engineer
Data Engineer responsible for designing, building, and maintaining scalable data pipelines on a large cloud platform, leveraging Python, SQL, and modern data warehousing tools to support analytics and business insights.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines to ingest, transform, and load data from diverse sources into the cloud data warehouse.
- Implement and optimise data models in Snowflake, ensuring high performance and reliability for analytical workloads.
- Automate workflow orchestration using Apache Airflow, monitoring job health and handling failures.
- Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver timely solutions.
- Apply best practices for data security, governance, and cost optimisation on AWS.
Requirements
- Strong programming experience in Python and proficiency with SQL for data manipulation.
- Hands‑on experience with AWS services (e.g., S3, Redshift, Glue) and modern data warehousing platforms such as Snowflake.
- Demonstrated ability to build and maintain ETL pipelines and workflow orchestration using tools like Airflow.
- Solid understanding of data modelling, schema design, and performance tuning.
- Excellent problem‑solving skills and ability to work collaboratively in an agile environment.
Skills
pythonsqlawssnowflakeairflow