remote
Senior Data Engineer - National Grid
Data Engineer
Lead the design, development, and maintenance of scalable data pipelines and analytics solutions using Python, SQL, AWS, and Spark to empower data-driven decisions across the organization.
About the role
Key Responsibilities
- Design, build, and optimize large-scale data pipelines and ETL processes to ingest, transform, and store data from diverse sources.
- Develop and maintain data models, schemas, and metadata management in AWS data services such as Redshift, S3, and Glue.
- Collaborate with data scientists, analysts, and product teams to understand requirements and deliver high-quality data assets.
- Implement data quality, validation, and monitoring frameworks to ensure reliability and compliance.
- Leverage Spark and Python to process and analyze big data workloads efficiently.
Requirements
- 5+ years of experience in data engineering with a strong focus on cloud-based solutions.
- Proficiency in Python, SQL, and Spark for data processing and transformation.
- Hands‑on experience with AWS services (Redshift, S3, Glue, Lambda, EMR).
- Solid understanding of data modeling, ETL best practices, and data governance.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.