onsite
Java Data Technical Lead
Engineering Manager
Lead a high‑performing data engineering team, architecting scalable Java solutions on AWS, integrating Kafka streams and Spark jobs, while driving continuous delivery and Agile best practices.
About the role
Key Responsibilities
- Architect and develop Java‑based data pipelines on AWS, ensuring high availability and scalability.
- Design and maintain Kafka topics, stream processing logic, and Spark batch jobs for real‑time analytics.
- Implement and manage CI/CD pipelines, automating build, test, and deployment workflows.
- Lead Agile ceremonies, mentor team members, and foster a culture of continuous improvement.
- Collaborate with data scientists and product owners to translate business requirements into technical solutions.
Requirements
- 5+ years of Java development experience with a strong focus on data engineering.
- Proven expertise in AWS services (EC2, S3, EMR, Kinesis) and experience deploying Spark workloads.
- Hands‑on experience with Apache Kafka, including topic design, consumer groups, and stream processing.
- Solid understanding of CI/CD tools (Jenkins, GitLab CI, or similar) and automated testing.
- Excellent communication skills and a track record of leading Agile teams.
Skills
javaawsapache sparkcicdagile