Preference for human or algorithmic forecasting advice does not predict if and how it is used

Abstract

Past research has found that people treat advice differently depending on its source. In many cases, people seem to prefer human advice to algorithms, but in others, there is a reversal, and people seem to prefer algorithmic advice. Across two studies, we examine the persuasiveness of, and judges' preferences for, advice from different sources when forecasting geopolitical events. We find that judges report domain‐specific preferences, preferring human advice in the domain of politics and algorithmic advice in the domain of economics. In Study 2, participants report a preference for hybrid advice, that combines human and algorithmic sources, to either one on it's own regardless of domain. More importantly, we find that these preferences did not affect persuasiveness of advice from these different sources, regardless of domain. Judges were primarily sensitive to quantitative features pertaining to the similarity between their initial beliefs and the advice they were offered, such as the distance between them and the relative advisor confidence, when deciding whether to revise their initial beliefs in light of advice, rather than the source that generated the advice.

Document Details

Document Type
Pub Defense Publication
Publication Date
May 20, 2022
Source ID
10.1002/bdm.2285

Entities

People

  • David V. Budescu
  • Mark Himmelstein

Organizations

  • Fordham University
  • Intelligence Advanced Research Projects Activity

Tags

Fields of Study

  • Psychology

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Military History of the United States in the 20th Century.
  • Systems Analysis and Design