Multi-Test Extensions of Practical and Optimal Appropriateness Indices.
Abstract
Natural extensions of practical and optimal appropriateness indices developed for long unidimensional tests are here applied to real and simulated data of examinees taking several short unidimensional tests. Sixteen conditions are investigated based on the factors of type of aberrance (raised or lowered), severity (15% or 30% of items affected), and ability level (very low, low, low average, high average, high, and very high -- the first four for raised scores and the last four for lowered scores). Eight practical indices are compared relatively and to two extensions of optimal indices. Most indices are based on item response theory, though the tests are not adaptive. For simulated data, three practical indices -- log probability and Tatsuoka's T-2 and T-4 -- when summed over tests and then standardized, are found to have detection rates comparable to those found for long unidimensional tests with roughly the same number of items. For real data, similar results hold on these same indices for the raised aberrant scores, but slightly lower detection rates are obtained for the lowered aberrant scores. It is concluded that these three indices are powerful detectors of inappropriate response patterns when all assumptions are satisfied. Keywords: ASVAB(Armed Services Vocational Aptitude Battery).
Document Details
- Document Type
- Technical Report
- Publication Date
- Mar 01, 1987
- Accession Number
- ADA178342
Entities
People
- Fritz Drasgow
- Mary E. Mclaughlin
- Michael V. Levine
Organizations
- Universal Energy Systems