remote
Senior Data Platform Engineer - Karthik Consulting
Data Engineer
Lead the design and modernization of secure, cloud‑native data platforms for the Air Force Intelligence Community, driving DevSecOps automation, MLOps pipelines, and scalable data architectures using AWS/Azure, Kubernetes, and Terraform.
About the role
Key Responsibilities
- Design and implement secure, cloud‑based data architectures that support classified and unclassified workloads across the Air Force Intelligence Community.
- Build and maintain DevSecOps automation frameworks, including CI/CD pipelines, infrastructure‑as‑code, and continuous compliance monitoring.
- Develop and operationalize MLOps pipelines to enable secure model training, deployment, and monitoring within the classified cloud environment.
- Lead migration and modernization efforts from legacy on‑prem systems to commercial cloud platforms (AWS, Azure) while ensuring mission‑critical availability and security.
- Collaborate with senior stakeholders and cross‑functional teams to assess technical feasibility, define target‑state solutions, and align technology roadmaps with evolving mission requirements.
Requirements
- 5+ years of experience designing and operating large‑scale data platforms on public cloud (AWS, Azure, or GCP) with a focus on security and compliance.
- Proficiency in DevSecOps tools and practices, including Terraform, CI/CD (Jenkins, GitLab CI), container orchestration (Kubernetes), and automated security scanning.
- Hands‑on experience building MLOps pipelines using Python, ML frameworks (TensorFlow, PyTorch), and model serving technologies.
- Strong background in data engineering concepts such as data ingestion, streaming, warehousing, and governance for classified environments.
- Excellent communication skills and ability to work directly with senior Air Force staff and cross‑agency partners to translate mission needs into technical solutions.
Skills
mlopskubernetesterraformpython