onsite
AWS Tech Lead - Data Engineering & Architecture - RealTek Consulting
Software Engineer
Lead the design and implementation of scalable batch and streaming data platforms on AWS, leveraging Java, Python, and PySpark to deliver robust, event-driven solutions for enterprise data engineering challenges.
About the role
Key Responsibilities
- Architect and build scalable batch and streaming data pipelines on AWS, ensuring high availability and performance.
- Lead a cross‑functional team in developing event‑driven solutions using Java, Python, and PySpark.
- Design data models, schema evolution strategies, and data governance frameworks for large‑scale analytics.
- Implement CI/CD pipelines, automated testing, and monitoring for data services.
- Collaborate with stakeholders to translate business requirements into technical specifications and roadmaps.
Requirements
- 15+ years of IT experience with a strong focus on data engineering and architecture.
- Deep expertise in AWS services (Glue, EMR, Kinesis, S3, Redshift, Lambda).
- Proficiency in Java, Python, and PySpark for data processing.
- Hands‑on experience designing event‑driven architectures and real‑time data pipelines.
- Excellent communication skills and proven ability to lead technical teams.