onsite
Thesis: Can AI Agents Replace the Tester? Comparing LLM Browser Agents and Scripted End-to-End Tests
AI Engineer
High Level Description End-to-end (E2E) tests verify that a web application works the way a user experiences it. They are valuable but expensive: scripted tests (e.g., Playwright, Cypress) take time to write, break when the user interface changes, and only find the bugs someone thought of in advance. A new alternative is LLM-based agents that control a real browser. They read the screen, click, type and judge whether the application behaves correctly, much like a human exploratory tester. This t
About the role
High Level Description
End-to-end (E2E) tests verify that a web application works the way a user experiences it. They are valuable but expensive: scripted tests (e.g., Playwright, Cypress) take time to write, break when the user interface changes, and only find the bugs someone thought of in advance. A new alternative is LLM-based agents that control a real browser. They read the screen, click, type and judge whether the application behaves correctly, much like a human exploratory tester. This thesis will compare AI-driven exploratory testing with traditional scripted E2E tests on open-source web applications with deliberately planted bugs, to find out which approach finds more bugs, how reliable, and at what cost.
Cost is a central question: AI agents are cheap to set up but every test run consumes paid model usage, while scripted tests are expensive to write and maintain but cheap to run.
Project
Skills
agentic aiaiapicypressgdprllmplaywright