Test Automation Engineer (AI & QA Focus)Job OverviewWe are seeking a dynamic and detail-oriented Test Automation Engineer to join our innovative software development team. In this role, you will drive the quality and efficiency of our testing processes by designing, developing, and maintaining automated test frameworks. Your expertise will ensure our applications meet the highest standards of performance, functionality, and reliability. You will collaborate closely with cross-functional teams to streamline testing workflows, implement continuous integration practices, and support release management. This position offers an exciting opportunity to leverage your technical skills in a fast-paced environment committed to delivering exceptional software solutions. Key Responsibilities
- AI & LLM Quality Assurance:
- Execute counterfactual bias testing, similarity-cascade evaluation, theme-tagging precision/recall, and accessibility AI assessments.
- Conduct mandatory LLM testing and evaluation using RAG techniques, Python, scikit-learn, and sentence-transformers.
- Test Design & Execution:
- Write detailed test cases based on business requirements and technical specifications to ensure thorough coverage of all critical functionalities.
- Support release management activities by verifying software builds, conducting system testing prior to deployment, and documenting test results for compliance.
- Defect & Root Cause Analysis:
- Conduct root cause analysis for defects identified during testing phases.
- Collaborate with developers to troubleshoot issues related to APIs, web services (SOAP/REST), databases (MySQL, Oracle, SQL Server), and system configurations.
- Cross-Functional Collaboration:
- Collaborate with product owners and business analysts during requirements gathering to understand project scope and define clear acceptance criteria.
Required Experience & Qualifications
- AI & LLM Testing:
- Mandatory hands-on experience in LLM testing and LLM evaluation .
- Proficiency in Python, scikit-learn, sentence-transformers, and LLM/RAG testing frameworks.
- Automation & Scripting:
- Proven experience in software testing automation within Agile (Scrum) or Waterfall environments.
- Strong proficiency with test automation tools (Selenium WebDriver, Cucumber, TestNG, JUnit) and scripting languages (Python or JavaScript).
- CI/CD & DevOps:
- Hands-on experience with CI/CD tools, including Jenkins, GitHub/GitLab repositories, Azure DevOps, or TFS for seamless test integration into build pipelines.
- Software Engineering & QA Best Practices:
- Solid understanding of the SDLC, QA methodologies, and best practices across web and mobile platforms.
- Ability to work effectively within collaborative environments using tools like Jira, TFS, and version control systems (Git/SVN).