Visual regression testing for programming intelligent agents
UI Verify is a visual regression testing tool specifically designed for AI-powered programming agents. While unit tests and end-to-end tests can detect logical errors, they are unable to identify issues such as changes in button colors or misaligned layouts on mobile devices. UI Verify fills this gap by addressing these kinds of problems.
It supports Playwright, Storybook, Vitest, as well as mobile platforms. Whenever a pull request is submitted, it takes screenshots of all the affected pages and compares them pixel by pixel with the baseline version. It then provides a detailed analysis in the pull request, stating things like “1 expected change and 1 potential regression.” In the case of a regression, the merge request will be automatically rejected. What’s more crucial is that this intelligent system itself can visualize the effects of each modification, allowing issues to be fixed before the request is actually submitted.
The access method involves providing an instruction to the intelligent entity, allowing it to install the necessary components on its own. There is a free version available, which is ideal for teams that need to use AI to modify large amounts of front-end code.