remote
Data Platform DevOps Engineer - Senior Consultant - Deloitte
Devops Engineer
Senior Data Platform DevOps Engineer leading cloud-native data infrastructure, automating pipelines, and ensuring high availability using AWS, Terraform, Kubernetes, and Python. Focus on scalable, secure, and resilient data solutions for enterprise clients.
About the role
Key Responsibilities
- Design, build, and maintain scalable data platform infrastructure on AWS, leveraging services such as S3, Redshift, Glue, and Lake Formation.
- Implement IaC with Terraform and automate deployments using CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps).
- Containerize data services with Docker, orchestrate with Kubernetes, and manage cluster lifecycle and scaling.
- Ensure security, compliance, and monitoring across the data stack using IAM, CloudWatch, GuardDuty, and Prometheus/Grafana.
- Collaborate with data engineers, architects, and stakeholders to optimize performance, cost, and reliability of data pipelines.
Requirements
- 5+ years of experience in data platform engineering and DevOps practices.
- Proficient with AWS, Terraform, Kubernetes, Docker, and Python scripting.
- Strong understanding of data lake and warehouse concepts, ETL/ELT workflows, and data governance.
- Experience with CI/CD tooling, monitoring, and incident response.
- Excellent communication skills and ability to work in a hybrid, cross‑functional team environment.
Skills
awsterraformkubernetespythoncicd