The Effect of Item Parameter Estimation Error on Decisions made Using the Sequential Probability Ratio Test
Abstract
A series of computer simulations were performed in order to observe the effects of item response theory(IRT)item parameter estimation error on decisions made using an IRT-based sequential probability ratio test. Specifically, the effects of such error on misclassification rates and the average number of items required for either a mastery(pass)or nonmastery(fail) decision were observed under varied SPRT conditions. These conditions include the a priori or nominal type I(alpha)and typeII(beta)error rates, the simple hypotheses tested by the SPRT procedure, and the composition of the item pool(specifically the a, b, and c parameters which characterized the items according to a three-parameter logistic model)used to administer the SPRT. The results of these simulations showed that these SPRT decisions are not greatly affected by this particular level of error in parameter estimates modeled in this study. Misclassification error rates were slightly greater when estimation error in the item parameters was present, but such differences appear to be negligible. Keywords: Adaptive testing.
Document Details
- Document Type
- Technical Report
- Publication Date
- Oct 01, 1987
- Accession Number
- ADA196674
Entities
People
- Judith A. Spray
- Mark D. Reckase