For instance, I wrote recently about a Californian company that is requesting mammogram images from women with breast cancer to allow them to train their algorithms to accurately spot breast cancer.
Another Californian company, the California Healthcare Foundation (CHCF), are applying a similar technique towards solving diabetic retinopathy, which is a complication in diabetics caused by damage to blood vessels that supply the retina.
If it’s untreated it can lead to blindness, and is common in up to 80% of diabetics. This damage can usually be treated by laser, drugs or surgery, providing it is caught early on. The problem is, there aren’t really many symptoms in the early stages and so the best bet is for patients to have frequent check-ups.
Given the huge number of diabetes patients however, and the strain on doctors schedules, this seldom happens. An automated approach, therefore, seems ideally suited to this scenario.
Automated decision support
The team setup a challenge on Kaggle, the challenge website for data scientists, which saw thousands of retina images uploaded and a $100,000 bounty offered to the people who could best make sense of them.
The participants in the challenge used the uploaded images to train algorithms to successfully identify the subtle signs of disease. The winning entrant, from Warwick University, managed to devise an algorithm that could successfully identify the disease (as verified by a doctor) 85% of the time.
So it was providing comparable accuracy to a doctor, but without the very human limitations of a doctor in terms of their cost and availability. For instance, they can be installed in a facility as quickly as it takes to copy the system over. No training is required. What’s more, they also don’t require images sent back and forth in order to get images and results to the right people.
An interesting part of the challenge was a requirement that any winning solution be open source, and the plan is to roll it out throughout California, but there remain certain regulatory issues to overcome before that occurs.
A slightly more pressing challenge to overcome is one of perception. Recent research suggests that despite the often superior decisions that such systems can give us, we are often more likely to accept inferior decisions if they’re given by people rather than trust the machines.
The study, led by Wharton’s Cade Massey, was instigated after Massey had experienced first hand the objections to accepting machine based intelligence within organizations.
“We know that people don’t like [those data-driven answers], but we didn’t really understand why. And we sure didn’t have any insight into what we could do to make people more open to them,” he says.
Experiments revealed that we are generally much more forgiving of an erroneous decision if it’s made by a human. If a machine makes one mistake then that is usually enough for us to discard what it can offer for good.
So whilst there may be very tangible benefits to be had from utilizing automated decision making, I suspect it will be a little way off yet before it becomes deployed in the mainstream.