QA Engineer
AI Test Engineer II responsible for designing and executing automated tests for AI/ML models, ensuring accuracy and reliability across the payment integrity platform. Utilizes Python, Selenium, and CI/CD pipelines to deliver high-quality, data-driven solutions.
At TREND Health Partners, a tech-enabled payment integrity company, our mission is to facilitate collaboration between payers and providers for mutual benefit and waste reduction, ultimately improving access to healthcare. We achieve this by aligning the common goals of payers and providers and fostering collaboration through a shared technology platform and seamless workflows.
Joining TREND Health Partners means becoming a part of a dynamic growing organization that promotes a collaborative and innovative work environment. Our comprehensive compensation package includes competitive salaries, highly valued health insurance, a 401(k) plan with employer match, paid parental leave, and more.The AI Test Engineer II's primary responsibility is validating the quality, reliability, and safety of AI powered systems across TREND's platform.
Role and Responsibilities
• AI Testing & Validation o Design and execute test strategies for AI/ML models, including functional, regression, and scenario-based testing o Validate accuracy, consistency, and reliability of AI-generated outputs (e.g., summaries, classifications, recommendations) o Develop test cases for edge cases, model drift, and unexpected behavior scenarios o Evaluate model performance against defined success criteria and business requirements • Agent & Workflow Testing o Test agent-driven workflows (multi-step AI processes, automation pipelines, orchestration logic) o Validate interactions between AI agents, APIs, and downstream systems o Identify failure points in end-to-end AI workflows and recommend improvements • Data Quality & Integrity o Validate training, validation, and test datasets for completeness, accuracy, and bias risks o Perform data validation testing across pipelines to ensure integrity of inputs and outputs o Partner with Data Engineering to detect anomalies, inconsistencies, and gaps • Automation & Tooling o Build and maintain automated test frameworks for AI-enabled systems o Develop scripts and tools to support repeatable testing of AI outputs at scale o Integrate testing into CI/CD pipelines to enable continuous validation • AI Risk & Guardrails o Help define and validate guardrails for AI systems (accuracy thresholds, explainability, fallback logic) o Identify risks related to hallucinations, bias, and model drift o Partner with Engineering and AI teams to improve reliability and safety • Collaboration & Continuous Improvement o Work cross-functionally with Engineering, QA, AI, Product, and Operations teams o Participate in sprint planning, backlog refinement, and release validation o Contribute to testing standards, best practices, and documentation o Support root cause analysis for AI-related defects and production issues
Qualifications
• Bachelor’s degree in Computer Science, Data Science, Engineering, or related field (or equivalent experience) • Experience in QA, testing, or a related engineering role • Exp
Posted June 23, 2026