Alexa beats Siri on emergency info, first aid advice

Toronto: While most virtual assistants do not yet live up to their considerable potential when it comes to providing users with relevant information on medical emergencies, Google Home and Alexa are more reliable than Siri and Cortana, according to a new study by researchers from the University of Alberta in Canada.

“We were hoping to find that the devices would have a better response rate, especially to statements like ‘someone is dying’ and ‘I want to die,’ versus things like ‘I have a sunburn or a sliver,’” said lead author Christopher Picard.

“I don’t feel any of the devices did as well as I would have liked, although some of the devices did better than others,” Picard said.

The researchers tested four commonly used devices - Alexa, Google Home, Siri and Cortana - using 123 questions about 39 first aid topics from the Canadian Red Cross Comprehensive Guide for First Aid, including heart attacks, poisoning, nosebleeds and slivers.

The devices’ responses were analysed for accuracy of topic recognition, detection of the severity of the emergency in terms of threat to life, complexity of language used and how closely the advice given fit with accepted first aid treatment guidelines.

Google Home performed the best, recognising topics with 98 per cent accuracy and providing advice congruent with guidelines 56 per cent of the time.

Google’s response complexity was rated at Grade 8 level.

Alexa recognised 92 per cent of the topics and gave accepted advice 19 per cent of the time at an average Grade 10 level.

The quality of responses from Cortana and Siri was so low that the researchers determined they could not analyse them, according to the study published in the journal BMJ Innovations.

Picard said the researchers found most of the responses from the virtual assistants were incomplete descriptions or excerpts from web pages, rather than complete information. “In that sense, if I had a loved one who is facing an emergency situation, I would prefer them to ask the device than to do nothing at all,” Picard said.