AI Business is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 3099067.

Intelligent testing: the radical new business disruptor

by CiarŠn Daly
Article ImageBy Dr. John Bates

Forget coding, programming or even security. The way businesses use the intelligence they get from testing their core products will be fundamental to their success in 2018. For successful ecommerce businesses, this isnít about testing code, but about using intelligent testing to determine whether the business is actually achieving its objectives.

Intelligent testing is the combination of AI, machine learning and analytics coming together to help businesses address the unexpected, as well as to mitigate against traffic and cybersecurity issues that can ground even the most sophisticated website. In simple terms, intelligent testing tests, monitors, and fixes business problems and ensures that business applications are achieving their defined business goals.

Intelligent testing is also about demanding more actionable intelligence from testing: when automation, cognitive systems and advanced analytics become integral parts of a testing ecosystem, we should have great expectations, especially when proactively dealing with issues surrounding user interfaces and user experience. Businesses who stop at Ďthis software works and meets user expectationsí are really selling themselves short.

When it comes to intelligent testing, itís not about testing whether the code or application works, but whether the business works. Intelligent testing can inform every area of your business development, including exceeding your sales targets and beating your competitors, to name just a few critical drivers. When youíve got advanced analytics in place, thereís no excuse not to use them to inform your key metrics, and then to monitor your business based on those dimensions of user experience, functionality, and performance.

Intelligent testing 101: A typical use case

A company had an ecommerce target to sell 10 million dollarsí worth of merchandise, but they were only achieving five million. Via close analysis of the system, the company noticed that it was the millennials that were not buying, which gave the analytics team the ability to focus on particular views of the user journey.

Using intelligent testing, the company automatically came up with a model of the system by analysing it, which allowed it to build tests from this model to pinpoint the exact areas causing the disconnect for millennial users.

It turned out that the responsiveness of the site was more than three seconds and at times up to 10 seconds before a user arrived at their basket, which caused people (millennials in particular) to become frustrated and move on elsewhere before completing purchases. Needless to say, gaining this intelligence enabled the companies to fix some key performance issues which were affecting responsiveness of the site, allowing them to get all users to a view of their basket quicker so that purchases were not abandoned.

Read - The Augmented Boardroom: Bringing AI To The C-Suite

Intelligent and continuous testing

As the use case points out, itís essential that companies take user experience and the user interface seriously: itís got to be about looking at the user interface, understanding what all the elements of the application are and how they are feeding together, and how people are using it. Itís only then that companies can really deploy intelligent testing and automatically generate and prioritise the right tests from it.

When all working parts are in order, intelligent testing can actually build models by itself to watch and understand the system continuously. Different aspects of AI can look at the interface and identify all the different parts of a workflow, seeing how people use the system to understand and explore the unanticipated.

The machine learning aspect is critical for developing a testing model that can continually build itself by monitoring and understanding the system it is applied to. Because AI identifies all the different parts of a workflow, it can see how differing applications use the system on a regular basis and update its learning model to anticipate how new user devices and behaviour patterns could disrupt the website.

What will intelligent testing look like by the end of 2018?

By the end of this year, forward thinking companies will be knee deep in learning feedback loops, analysing testing results to see what worked and what didnít, while also thoroughly analysing feedback from continuous testing and monitoring that actively shows where real users run into problems. Intelligent testing will give companies the power to zoom in on problems quickly and fix them, providing remedies and solid strategy to test with the means to continuously improve the business.

By the end of this year, those that will win will have grasped that the results of the testing process hold far more value and insight if AI and machine learning driven. Testing has become more intelligent than ever before, and can and will become a key business accelerator for those businesses who choose to nurture it.


Dr. John Bates is CEO of Testplant, and a respected visionary and dynamic business leader with a strong track record in enterprise software. He has founded and grown cutting edge businesses, and has also served in a range of C-level roles at public software companies.

Practitioner Portal - for AI practitioners


Danish students develop tool to measure the carbon footprint of AI


One training session with GPT-3 uses the same amount of energy as 126 homes in Denmark do in a year


Open source ML framework Streamlit raises $21m, launches sharing platform


ďItís like we gave the machine learning community a new superpower,Ē CEO Adrien Treuille tells AI Business

Practitioner Portal


More EBooks

Upcoming Webinars

More Webinars
AI Knowledge Hub

Experts in AI

Partner Perspectives

content from our sponsors

Research Reports

More Research Reports


Smart Building AI

Infographics archive

Newsletter Sign Up

Sign Up