remoteonsite
Senior Data Engineer - Barclays
Data Engineer
Senior Data Engineer driving scalable, secure data pipelines using Ab Initio, SQL, Unix, Python, and lakehouse platforms like Snowflake or Databricks to deliver robust infrastructure for digital payment solutions.
About the role
Key Responsibilities
- Design, develop, and maintain high‑performance ETL pipelines using Ab Initio and Python, ensuring data quality and reliability across the organization.
- Collaborate with data architects to implement lakehouse solutions on Snowflake or Databricks, optimizing storage and query performance.
- Manage Unix-based environments, automating deployment and monitoring of data workflows for continuous delivery.
- Lead data integration initiatives, translating business requirements into scalable technical solutions.
- Mentor junior engineers, fostering best practices in coding, testing, and documentation.
Requirements
- 5+ years of experience in data engineering with strong proficiency in Ab Initio, SQL, Unix, and Python.
- Hands‑on experience with lakehouse technologies such as Snowflake or Databricks.
- Deep understanding of ETL design principles, data modeling, and performance tuning.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
Skills
sqlpythonsnowflakedatabricks