onsite
AWS Data Engineer - Barclays
Data Engineer
AWS Data Engineer responsible for delivering location‑strategy projects, building scalable data pipelines on AWS using Python and PySpark, and driving digital transformation through robust data engineering practices.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines on AWS using Python and PySpark.
- Transform raw data into structured DataFrames and RDDs for analytics and reporting.
- Collaborate with cross‑functional teams to ensure data solutions meet budget, quality, and governance standards.
- Implement best practices for data security, performance optimization, and cost efficiency on the AWS platform.
- Support the evolution of the digital landscape by integrating emerging technologies and automation tools.
Requirements
- Hands‑on experience with Python and PySpark, including deep knowledge of DataFrames and RDD concepts.
- Proven expertise in AWS services relevant to data engineering (e.g., S3, Glue, Redshift, EMR).
- Strong understanding of data engineering principles, ETL processes, and data modeling.
- Ability to work in an agile environment, manage multiple priorities, and deliver high‑quality solutions on schedule.
- Excellent problem‑solving skills and a proactive attitude toward continuous improvement.