remote
QA Tester - AI Observability & Monitoring - Testunity
Software Engineer
QA Tester focused on AI observability and monitoring, ensuring traceability, explainability, and performance of AI/ML systems in regulated environments using automated and manual testing techniques.
About the role
Key Responsibilities
- Design, develop, and execute test cases for AI/ML observability and monitoring frameworks.
- Validate traceability, explainability, and performance metrics of AI models in production.
- Collaborate with data scientists, DevOps, and compliance teams to define monitoring KPIs and alerting rules.
- Automate regression and performance tests using industry‑standard tools.
- Document findings, create defect reports, and track resolution in a regulated environment.
Requirements
- 8+ years of QA experience with a minimum of 2 years in AI/ML projects.
- Strong background in observability and monitoring of AI systems.
- Proficiency in test automation frameworks and scripting (e.g., Python, Java).
- Experience with CI/CD pipelines and monitoring tools (e.g., Prometheus, Grafana).
- Excellent analytical, communication, and documentation skills.