hybrid
AI Quality Engineer - Smarter.Codes
QA Engineer
QA Engineer to design scalable testing frameworks for AI-powered software, validate outputs, and automate regression suites using Python.
About the role
Key Responsibilities
- Design, execute, and maintain test cases for web applications, APIs, and AI-driven systems
- Perform functional and regression testing across products and workflows
- Validate AI-generated outputs using scoring systems, evaluation criteria, and benchmarking methodologies
- Develop and maintain automation testing scripts and frameworks using Python
- Collaborate with engineering teams to identify defects and ensure timely resolution
- Create structured QA documentation for workflows and edge cases
Requirements
- Strong understanding of software testing fundamentals and API testing strategies
- Proficiency in Python scripting for testing and automation
- Familiarity with CI/CD pipelines and quality validation processes
- Knowledge of AI evaluation methodologies and benchmarking concepts
- Structured documentation and reporting habits with a curiosity-driven validation mindset
Skills
pythonapi testingautomation testingregression testingci cdai evaluation