remote
Senior Data Engineer - RELX Group
Data Engineer
Senior Data Engineer building scalable, high‑performance data pipelines for large‑scale search and analytics, leveraging Python, Spark, SQL, AWS, Airflow, and robust data modeling to deliver reliable, business‑impactful solutions.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and services that support large‑scale search and analytics use cases.
- Implement and optimize data ingestion, transformation, and storage workflows using Python, Apache Spark, and SQL on AWS infrastructure.
- Collaborate with data scientists and product teams to translate business requirements into robust data solutions.
- Mentor junior engineers, conduct code reviews, and promote best practices in data engineering.
- Monitor pipeline performance, troubleshoot issues, and continuously improve reliability and efficiency.
Requirements
- 5+ years of experience in data engineering with a strong focus on large‑scale, high‑performance data pipelines.
- Experience with workflow orchestration tools (e.g., Airflow) and data modeling best practices.
- Strong analytical skills, ability to translate complex datasets into actionable insights.
- Excellent communication skills and a collaborative mindset.
Skills
pythonapache sparksqlawsairflow