remote
Senior AI Platform & Data Engineer - Ad Hoc
Data Engineer
Lead the design and deployment of scalable AI and data pipelines on AWS, leveraging Python, Spark, and Kubernetes to deliver high‑impact public‑sector solutions.
About the role
Key Responsibilities
- Architect, build, and maintain end‑to‑end AI and data pipelines on AWS, ensuring high availability and performance.
- Develop and deploy machine learning models using Python, Spark, and containerized services.
- Collaborate with cross‑functional teams to translate business requirements into scalable technical solutions.
- Implement CI/CD workflows, infrastructure as code, and automated testing for rapid, reliable releases.
- Monitor, troubleshoot, and optimize data pipelines and model performance in production.
Requirements
- 5+ years of experience in data engineering and AI platform development.
- Proficiency with Python, SQL, Spark, and Kubernetes.
- Hands‑on experience deploying solutions on AWS (S3, Redshift, EMR, ECS/EKS).
- Strong understanding of CI/CD, IaC (Terraform/CloudFormation), and container orchestration.
- Excellent problem‑solving skills and a passion for delivering data‑driven public‑sector services.
Skills
pythonawsmachine learningsqlkubernetes