onsite
Big Data Engineer, AVP - Barclays
Data Engineer
Senior Big Data Engineer responsible for designing, automating, and enhancing Hadoop-based data platforms, improving data quality, and streamlining enterprise data processes using UNIX and RFT architecture.
About the role
Key Responsibilities
- Analyze system requirements to automate and improve functionality across Hadoop and BDH environments.
- Identify gaps in existing data pipelines and deliver configuration, quality, and process enhancements.
- Oversee IT process flows, including Hadoop, UNIX, and RFT architecture, to support enterprise data platforms.
- Maintain, monitor, and enhance data quality and application performance for large-scale data sets.
- Collaborate with cross-functional teams to design scalable data solutions and ensure compliance with data governance standards.
Requirements
- Extensive experience with Hadoop ecosystem and UNIX-based systems.
- Strong background in data quality, data governance, and enterprise data platform architecture.
- Proficiency in scripting and automation for data pipeline management.
- Excellent problem‑solving skills and ability to work in a fast‑paced environment.
- Effective communication skills for collaborating with technical and non‑technical stakeholders.