onsite
Principal Data Engineer - RS21 A Data Science and Visualization Company
Data Engineer
Senior data engineering leader driving enterprise data platform strategy, architecture, and delivery using Python, SQL, AWS, Spark, and Airflow to build scalable, high‑performance data pipelines and solutions.
About the role
Key Responsibilities
- Lead the design, implementation, and optimization of enterprise‑scale data pipelines and lakehouse architectures on AWS.
- Define and enforce engineering standards, best practices, and reference architectures across cross‑functional teams.
- Collaborate with product, analytics, and client teams to translate business requirements into robust, scalable data solutions.
- Mentor and coach mid‑level engineers, fostering a culture of continuous improvement and technical excellence.
- Evaluate and recommend tooling, orchestration, and storage trade‑offs to balance performance, cost, and maintainability.
Requirements
- 10+ years of data engineering experience with a proven track record in large‑scale data platform delivery.
- Expertise in Python, SQL, AWS services (S3, Redshift, Glue, Athena), Apache Spark, and Airflow.
- Strong background in data modeling, ETL/ELT design, and performance tuning.
- Excellent communication skills and experience leading cross‑functional technical initiatives.
- Hands‑on experience with cloud‑native data services and modern data lakehouse patterns.
Skills
pythonsqlawsapache sparkairflow