onsite
Senior Data Engineer Consultant
Data Engineer
Senior Data Engineer Consultant driving large‑scale data pipelines using AWS, Azure, Apache Kafka and Spark, delivering robust batch processing solutions for enterprise clients.
About the role
Key Responsibilities
- Design, develop and maintain scalable data pipelines on AWS and Azure platforms.
- Implement real‑time streaming solutions with Apache Kafka and batch processing with Apache Spark.
- Optimize data workflows for performance, reliability and cost efficiency.
- Collaborate with data scientists and business stakeholders to translate requirements into technical specifications.
- Ensure data quality, governance and security across all processing stages.
Requirements
- 5+ years of experience in data engineering with a strong focus on cloud services.
- Hands‑on experience with Apache Kafka, Spark, and related ecosystem tools.
- Strong SQL skills and familiarity with data modeling best practices.
- Excellent problem‑solving abilities and effective communication skills.
Skills
awsapache sparkazure