onsite
Senior Consultant Cloud Infrastructure Mumbai Engineering - Deloitte
Software Engineer
Senior Consultant leading design, deployment, and scaling of Apache Flink streaming clusters on AWS and Google Cloud, using Kubernetes, Terraform and CI/CD pipelines to deliver a hybrid multi‑cloud data platform.
About the role
Key Responsibilities
- Architect and implement highly available, cloud‑native Apache Flink clusters across AWS and Google Cloud environments.
- Design and automate infrastructure provisioning using Terraform and Kubernetes operators to support self‑service streaming for development teams.
- Develop CI/CD pipelines for continuous delivery of Flink jobs, ensuring reliable versioning, testing, and rollout.
- Collaborate with data engineers and application developers to optimize streaming workloads, latency, and resource utilization.
- Establish monitoring, logging, and alerting frameworks (e.g., Prometheus, Grafana) to maintain operational excellence.
Requirements
- 5+ years of experience designing and managing distributed streaming platforms, with deep expertise in Apache Flink.
- Strong hands‑on experience with AWS and Google Cloud services (e.g., EMR, GKE, Cloud Dataflow, Pub/Sub).
- Proficiency in container orchestration (Kubernetes) and infrastructure‑as‑code tools such as Terraform.
- Solid background in building CI/CD pipelines and automating deployments for data‑intensive applications.
- Excellent problem‑solving skills and ability to work cross‑functionally in a fast‑paced, multi‑cloud environment.
Skills
apache flinkawskubernetesterraformcicd