Extracting Information from Wrong Answers in Computerized Adaptive Testing
Abstract
A brief review of the history of polychotomous (i.e., multi-category) item response models is provided. After describing a new polychotomous item response model (Model 8), examples of the Operating Characteristic Functions obtained when Model 8 is applied to real test data are given. In general, inspection of 'goodness-of-fit' plots indicates that Model 8 provides superior data fit and higher item information functions than the well-known 3-parameter logistic (dichotomous) item response model. A simulation of computerized adaptive testing (CAT) that used the actual item responses of applicants for military enlistment shows that Model 8 would be superior to the 3-parameter logistic model in a CAT environment. In this investigation, Model 8 increased test reliability by an amount that is equivalent to a 25% increase in test length. Computerized testing, selection, classification, training, testing, item response theory psychometric models, Computerized Adaptive Testing-Armed Services Vocational Apt Battery, CAT-ASVAB, item scoring, polychotomous scoring, polytomous scoring.
Document Details
- Document Type
- Technical Report
- Publication Date
- Oct 01, 1993
- Accession Number
- ADA272832
Entities
People
- J. B. Sympson