Fail: Computerized Clinical Decision Support Systems for Medical Imaging

Computer programs that aim to help physicians make clinical decisions fail most of the time, says study

2 min read
Fail: Computerized Clinical Decision Support Systems for Medical Imaging
Photo: Ron Levine/Getty Images

Computerized systems that help physicians make clinical decisions fail two-thirds of the time, according to a study published today in the Journal of the American Medical Association (JAMA). With the use of such systems expanding—and becoming mandatory in some settings—developers must work quickly to fix the programs and their algorithms, the authors said. The two-year study, which is the largest of its kind, involved over 3,300 physicians. 

Computerized clinical decision support (CDS) systems make recommendations to physicians about next steps in treatment or diagnostics for patients. The physician enters information about the patient and the ailment, and based on a database of criteria, algorithms come up with a score for how appropriate certain next clinical steps would be. These databases of “appropriateness criteria” have been developed by national medical specialty societies and are used across various CDS systems. They aim to reduce overuse of care that can be costly and harmful to patients. 

[shortcode ieee-pullquote quote=""These seem like solvable problems, but we need to get working on this pretty quickly becaue this is going to be mandatory in a couple of years"" float="left" expand=1]

But according to the JAMA study, the leading CDS systems don’t work most of the time. The study tracked more than 117,000 orders input by physicians for advanced diagnostic imaging procedures such as magnetic resonance imaging (MRI) and computed tomography (CT). For two-thirds of those orders, the computer program could not come up with any feedback. “Basically it says, ‘I don’t have a guideline for you. I can’t help you,’” says Peter Hussey, a senior policy researcher at RAND Corporation and the lead author of the study. “When that happens two-thirds of the time...the physicians start to get more negative about it.”

That’s a problem, because these computerized decision makers will soon be mandated by the U.S. federal government. The Protecting Access to Medicare Act of 2014 says that, starting in 2017, CDS systems must be allowed to weigh in on whether advanced diagnostic imaging should be ordered for Medicare patients. CDS systems are already used in the private sector as well, but not widely, Hussey says.   

The systems’ problems are likely caused by lackluster databases and algorithms that fall short, says Hussey. “There are lots of different kinds of patients with different problems, and the criteria just haven’t been created for some of those. In other cases, it’s likely that the criteria were out there but the CDS tools couldn’t find them,” he explains. “These seem like solvable problems, but we need to get working on this pretty quickly becaue this is going to be mandatory in a couple of years.”

When the time comes to comply with the Medicare law, Hussey recommends a staged implementation of CDS systems, with pilot programs that pair a small number of them with a few physicians before rolling them out on a large scale. “Once you do something like this and it doesn’t work, a lot of times you’ve lost physicians’ trust and attention and it’s hard to get that back,” says Hussey. 

The Conversation (0)

A New Treatment for Arthritis: Vagus-Nerve Stimulation

Studies will soon show whether electroceuticals outperform pharmaceuticals

5 min read
A tablet computer, a smartphone, a grey belt with white stripes, a grey disc, and a small silver rectangle with a wire curled beside it.

Galvani’s system includes a nerve stimulator that attaches to the splenic nerve.

Galvani Bioelectronics

Monique Robroek once had such crippling arthritis that, even with the best available medications, she struggled to walk across a room. But thanks to an electronic implant fitted under her skin, she managed to wean herself off all her drugs and live pain-free for nearly a decade—until recently, when a viral illness made her rheumatoid arthritis (RA) flare up again.

This article is part of our special report Top Tech 2023.

Robroek’s long remission is “very impressive” and rare among patients with RA, says her doctor Frieda Koopman, a rheumatologist at Amsterdam UMC, in the Netherlands. Robroek’s experience highlights the immense potential of so-called bioelectronic medicine, also known as electroceuticals, an emerging field of treatment for diseases that have traditionally been managed with pharmaceuticals alone.

Keep Reading ↓Show less