Close ad

Every year, the Loupventures server conducts detailed and comprehensive tests of intelligent assistants and compares how they are doing - whether they are getting better or worse. A few hours ago, the latest version of this test appeared on the web, and it sounds significantly more positive for Apple than its previous edition from last year.

In their test, the editors compare the abilities of four different intelligent assistants. In addition to Siri, Amazon's Alexa, Google Assistant and Microsoft's Cortana also appear in the test. Testing as such consists of eight hundred different questions that the assistants have to deal with.

In terms of devices, Siri was tested in the HomePod, Alexa in the Amazon Echo, Google Assistant in the Google Home, and Cortana in the Harman/Kardon Invoke.

Even this year, the assistant from Google performed best, who was able to correctly answer 87,9% of the questions asked with 100% comprehension ability. On the contrary, the second place is surprising, because it was achieved by Siri from Apple, which has improved significantly compared to last year.

assistant test 2018

In its current form, Siri was able to answer 74,6% of the questions asked and understood 99,6% of them. If we look at the results of the same test from last year, when Siri managed only 52% of the questions asked, we see a significant improvement.

assistant test 2018 II

Third place went to Alexa from Amazon, which correctly answered 72,5% of the questions asked and recognized 99% of them. Last was Cortana from Microsoft, which managed to answer "only" 63,4% of questions correctly and understood 99,4% of them.

The test questions consisted of several categories that aimed to explore the abilities of female assistants in different scenarios with different requirements. For example, it was about setting reminders, searching for information, ordering products, navigation or cooperation with smart home elements.

assistant test 2018 III

A comparison of the year-on-year results clearly shows that all assistants have improved, but the most is Apple's Siri, whose abilities are 22% better than they were last year according to the test parameters. It looks like Apple has taken the complaints about Siri's capabilities to heart and is trying to work on the usability of its assistant. It's still not enough for the best, but any move forward is definitely positive. You can read detailed information about the course of the test and the results in original article.

Source: loupventures

.