Toward Harnessing User Feedback For Machine Learning
Abstract
There has been little research into how end users might be able to communicate advice to machine learning systems. If this resource-the users themselves-could somehow work hand-in-hand with machine learning systems, the accuracy of learning systems could be improved and the users? understanding and trust of the system could improve as well. We conducted a think-aloud study to see how willing users were to provide feedback and to understand what kinds of feedback users could give. Users were shown explanations of machine learning predictions and asked to provide feedback to improve the predictions. We found that users had no difficulty providing generous amounts of feedback. The kinds of feedback ranged from suggestions for reweighting of features to proposals for new features, feature combinations, relational features, and wholesale changes to the learning algorithm. The results show that user feedback has the potential to significantly improve machine learning systems, but that learning algorithms need to be extended in several ways to be able to assimilate this feedback.
Document Details
- Document Type
- Technical Report
- Publication Date
- Oct 02, 2006
- Accession Number
- ADA471484
Entities
People
- Erin Sullivan
- Jonathan Herlocker
- Lida Li
- Margartet Burnett
- Russell Drummond
- Simone Stumpf
- Thomas G. Dietterich
- Vidya Rajaram
Organizations
- Oregon State University