remote
AI/ML Test Engineer - MTSI
QA Engineer
AI/ML Test Engineer responsible for end‑to‑end evaluation of machine learning models, performing integration, drift detection, and automated pipeline testing using Python and CI/CD practices.
About the role
Key Responsibilities
- Execute system‑level AI/ML evaluation activities within a Test & Evaluation environment, ensuring mission‑critical performance.
- Perform integration testing, data capture, and drift detection across AI/ML workflows.
- Develop and maintain automated and semi‑automated evaluation pipelines, leveraging Python and CI/CD tools.
- Design and refine data annotation workflows to support model training and validation.
- Collaborate with cross‑functional teams to troubleshoot and optimize model performance.
Requirements
- Strong programming skills in Python and experience with ML libraries (e.g., TensorFlow, PyTorch).
- Hands‑on experience with test automation frameworks and CI/CD pipelines.
- Knowledge of data annotation tools and best practices for ML datasets.
- Excellent analytical and problem‑solving abilities.
- U.S. citizenship with TS/SCI clearance and CI Polygraph (required).
Skills
pythonmachine learningtest automationcicd