AI assisted. Not AI driven.

You read more and more about artificial intelligence (AI) in testing. The benefits of an AI driven testing are more and more challenged. What is beneficial in the eyes of experts like Gartner is an AI assisted testing.

AI driven is dangerous

A vendor that is selling you an AI driven solution should be able to answer you a single question: How did you test your artificial intelligence? AI today, is perfect if you have millions of examples and the AI needs to find something that is like these examples.

In testing we have a different challenge: We need to proof with 100 percent certainty that something is working as expected. Most are tempted to bring in AI for exploratory testing. It is too obvious, try something based on previous experience. But for this, the AI would need to understand the intended use of your software. And today, AI cannot do this. What it can is: Randomly exercise your application till it crashes. Studies from Google and Facebook as shown that random clicking is statistically better than AI in these cases.

AI assisted saves times

But assisting AI can save time. Imagine you need to identify controls on the screen. Doing it manually takes 2 minutes. AI can help by identify potential controls and pre-identify them for you. This saves you roughly 50 percent.

AI can also help to identify potential new problems. Imagine that a test is executed 15 times and the 15th time that screen looks a bit different. The AI can detect the difference and give you an indication that something changed. That is, what we call the Human Factor.

In summary, assisting AI saves you time and gives you additional insights. A pure AI driven testing is dangerous and mainly unpredictable. Keep in mind if a test tool vendor cannot answer you “How did you test your AI” in a understandable way, rather take a step back.

Book your FREE demo now!