Conditional Reasoning: An Integrated Approach to Item Analysis

Abstract

This article provides a review of the approach that James used when conducting item analyses on his conditional reasoning test items. That approach was anchored in classical test theory. Our article extends this work in two important ways. First, we offer a set of test development protocols that are tailored to the unique nature of conditional reasoning tests. Second, we further extend James’s approach by integrating his early test validation protocols (based on classical test theory) with more recent protocols (based on item response theory). We then apply our integrated item analytic framework to data collected on James’s first test, the conditional reasoning test for relative motive strength. We illustrate how this integrated approach furnishes additional diagnostic information that may allow researchers to make more informed and targeted revisions to an initial set of items.

Document Details

Document Type
Pub Defense Publication
Publication Date
Oct 20, 2019
Source ID
10.1177/1094428119879756

Entities

People

  • Daniel R. Smith
  • James M LeBreton
  • Michael E. Hoffman

Organizations

  • Johnson & Johnson
  • Pennsylvania State University
  • U.S. Army Research Institute for the Behavioral and Social Sciences
  • United States Military Academy

Tags

Readers

  • Artificial Intelligence
  • Software Engineering
  • Theoretical Analysis.