More than a year after it won the quiz show Jeopardy! , IBM’s supercomputer is learning how to help doctors diagnose patients

(Image: Giulio Sarchi/Contrasto/eyevine) Contestants Ken Jennings and Brad Rutter compete against Watson at a press conference to discuss the upcoming Jeopardy! competition at the IBM T. J. Watson Research Center on 13 January 2011 in Yorktown Heights, New York (Image: Ben Hider/Getty Images)

IT IS more than a year since Watson, IBM’s famous supercomputer, opened a new frontier for artificial intelligence by beating human champions of the quiz show Jeopardy!. Now Watson is learning to use its language skills to help doctors diagnose patients.


Progress is most advanced in cancer care, where IBM is working with several US hospitals to build a virtual physicians’ assistant. “It’s a machine that can read everything and forget nothing,” says Larry Norton, a doctor at the Memorial Sloan-Kettering Cancer Center in New York, who is collaborating with IBM.

When playing Jeopardy!, Watson analysed each question in a bid to guess what it was about. Then it looked for possible answers in its database, made up of sources such as encyclopaedias, scoring each according to the evidence associated with it and answering with the highest rated answer. The system takes a similar approach when dealing with medical questions, although in this case it draws on information from medical journals and clinical guidelines.

To test the system, Watson was first tasked with answering questions taken from Doctor’s Dilemma, a competition for trainee doctors that takes place at the annual meeting of the American College of Physicians. Watson was given 188 questions that it had not seen before and achieved around 50 per cent accuracy – not bad for an early test, but hardly ideal (Artificial Intelligence, doi.org/h6m).

To improve, Watson is now absorbing records – tens of thousands at Sloan-Kettering alone – of treatments and outcomes associated with individual patients. Given data on a new patient, Watson looks for information on those with similar symptoms, as well as the treatments that have been the most successful. The idea is it will give doctors a range of possible diagnoses and treatment options, each with an associated level of confidence. The result will be a system that its creators say can suggest nuanced treatment plans that take into account factors like drug interactions and a patient’s medical history.

Watson will give doctors a range of possible diagnoses and treatment options to choose from

William Audeh, a doctor at Cedars-Sinai Medical Center in Los Angeles, who is working with IBM, says the last few months have involved “filling Watson’s brain” with medical data. Watson is answering basic questions based on the treatment guidelines that are published by medical societies and is showing “very positive” results, he adds.

The technology is particularly useful in oncology because doctors struggle to keep up with the explosion of genomic and molecular data generated about each cancer type. This means it can take years for findings to translate into medical practice. By contrast, Watson can absorb new results and relay them to doctors quickly, together with an estimate of their potential usefulness. “Watson really has great potential,” says Audeh. “Cancer needs it most because it’s becoming so complicated so quickly.”

The IBM system could also approve treatment requests more quickly. At WellPoint, one of the largest insurers in the US, nurses use guidelines and patient history to determine if a request is in line with company policy. Nurses are now training Watson by feeding it test requests and observing the answers. Progress is good and the system could be deployed next year, says WellPoint’s Cindy Wakefield. “Now it can take up to a couple of days,” she says. “We hope Watson can return the accurate recommendation in a matter of minutes.”