We pointed AI testing agents at our own apps. 36/100, 79 issues. Here is what they found and what we fixed.
Disclosure first: I work on Preetest (Yamama Software, Saudi Arabia). This post is about running our own product on our own apps. Every number below comes from a real report, and the report links are public. This write-up was drafted by the AI assistant that runs our testing and fixes, from those r
Disclosure first: I work on Preetest (Yamama Software, Saudi Arabia). This post is about running our own product on our own apps. Every number below comes from a real report, and the report links are public. This write-up was drafted by the AI assistant that runs our testing and fixes, from those reports, at the founder's direction.
You give it a URL (and a login if the app needs one). It runs a set of AI testing agents, each with a specialty (accessibility, performance, security headers, mobile layout, SEO, forms, caching and so on; 17 in all), and writes one report: a score out of 100, every issue with severity and the element it found it on, and a fix prompt per issue that you can paste into Cursor, Claude Code or whatever you build with.
A 10-page signed-in scan of the staff suite we use ourselves (documents, mail, calendar, chat).
Score: 36/100. 79 issues: 3 high, 31 medium, 45 low. Report: https://app.preetest.com/r/z1LctGGKyBvPlZIcTkeh4w
We fixed the export confirmation and one accessible-name issue, re-ran with the same settings, and got 29/100 with 101 issues. Report: https://app.preetest.com/r/AIykp03BiPhDdXf2jn-Lww
Why worse? The second run reached more screens (the calendar, the staff guide, the privacy and download pages), so it found more. Coverage is budget-based: each run stops when its token reservation runs out, and the two runs stopped at different pages. So this is not a clean before/after, and I am not going to present it as one. What the second run added was the most useful finding of the day:
Score: 53/100. 27 issues: 5 high, 11 medium, 10 low. 100 % coverage, 143 tokens used. Report: https://app.preetest.com/r/BTlW0oUUg-ybJZQxCpPyKA
So: a sharp junior QA that works at 3 a.m., not an oracle. Read the report, do not paste every fix prompt blindly.
The free plan is 50 tokens. Our smallest real run above used 143, so the free tokens get you a project set up and a look at the flow, not a full inspection. A standard inspection is roughly 1,000 tokens, which is the $29/month plan. It also refuses to scan its own domain, so you cannot run it on preetest.com.
If you try it on your own app, I would genuinely like to hear where it was wrong. That list above is the one we work from.