Hopes and fears surrounding AI in health care
There has been increasing interest in using health “big data” for artificial intelligence (AI) research. As such, it is important to understand which uses of health data are supported by the public and which are not.
Previous studies have shown that members of the public see health data as an asset that should be used for research provided there is a public benefit and concerns about privacy, commercial motives and other risks are addressed.
However, this general support may not extend to health AI research because of concerns about the potential for AI-related job losses and other negative impacts.
Our research team conducted six focus groups in Ontario in October 2019 to learn more about how members of the general public perceive the use of health data for AI research. We found that members of the public supported using health data in three realistic health AI research scenarios, but their approval had conditions and limits.
ROBOT FEARS
Each of our focus groups began with a discussion of participants’ views about AI in general. Consistent with the findings from other studies, people had mixed — but mostly negative — views about AI. There were multiple references to malicious robots, like the Terminator in the 1984 James Cameron film.
Additionally, several people shared their belief that there is already AI surveillance of their own behaviour, referencing targeted ads that they have received for products they had only spoken privately about.
Some participants commented on how AI could have positive impacts, as in the case of autonomous vehicles. However, most of the people who said positive things about AI also expressed concern about how AI will affect society.
SUPPORTING SCENARIOS
In contrast, focus group participants reacted positively to three realistic health AI research scenarios. In one of the scenarios, some perceived that health data and AI research could actually save lives, and most people were also supportive of two other scenarios which didn’t include potential life-saving benefits.
They commented favourably about the potential for health data and AI research to generate knowledge that would otherwise be impossible
to obtain. For example, they reacted very positively to the potential for an AIbased test to save lives by identifying origin of cancers so treatment can be tailored. Participants also noted practical advantages of AI including the ability to sift through large amounts of data, perform real-time analyses and provide recommendations to healthcare providers and patients.
PROTECTING PRIVACY
The focus group participants were not positively disposed towards all possible uses of health data in AI research.
They were concerned the health data provided for one health AI purpose might be sold or used for other purposes that they do not agree with. Participants also worried about the negative impacts if AI research creates products that lead to lack of human touch, job losses and a
decrease in human skills over time because people become overly reliant on computers.
The focus group participants also suggested ways to address their concerns. Foremost, they spoke about how important it is to have assurance that privacy will be protected and transparency about how data are used in health AI research. Several people stated the condition that health AI research should create tools that function in support of humans, rather than autonomous decision-making systems.
INVOLVING THE PUBLIC
Engaging with members of the public took time and effort. In particular, considerable work was required to develop, test and refine realistic, plain language health AI scenarios that deliberately included potentially contentious points. But there was a large
return on investment.
The focus group participants — none of whom were AI experts — had some important insights and concrete suggestions about how to make health AI research more responsible and acceptable to members of the public.
Studies like ours can be important inputs into policies and practice guides for health data and AI research. Consistent with the Montréal Declaration for Responsible Development of AI, we believe researchers, scientists and policy makers need to work with members of the public to take the science of health AI in directions that members of the public support.
By understanding and addressing public concerns, we can establish trustworthy and socially beneficial ways of using health data in AI research.