Factors Influencing the Psychometric Characteristics of an Adaptive Testing Strategy for Test Batteries.
Abstract
A monte carlo simulation was conducted to assess the effects in an adaptive testing strategy for test batteries of varying subtest order, subtest termination criterion, and variable versus fixed entry on the psychometric properties of an existent achievement test battery. Comparisons were made among conventionally administered tests and adaptive tests using adaptive intra-subtest item selection with and without inter-subtest branching. Data consisted of responses of 300 simulees to a 201-item achievement test battery. Mean test battery length was reduced from 42.5% to 52.3% using adaptive intra-subtest item selection with variable termination. Reductions in mean subtest lengths ranged from 27% to 67%. When inter-subtest branching was added, additional test length reductions of 1% to 2% were observed for individual subtests. The reductions in test length were achieved with no significant loss of fidelity or psychometric information. The addition of inter-subtest branching resulted in levels of mean test battery information more similar to those of the full test battery, even with mean test battery reductions of 50% in number of items administered. Subtest order was shown to have no effect on the evaluative criteria employed. The results generally supported previous studies of this adaptive testing strategy. Suggestions for future research are presented. (Author)
Document Details
- Document Type
- Technical Report
- Publication Date
- Nov 01, 1981
- Accession Number
- ADA109666
Entities
People
- David J. Weiss
- Vincent A. Maurelli
Organizations
- University of Minnesota