Application of a Distribution-Based Assessment of Mission Readiness Systems for the Evaluation of Technical Training.
Abstract
The present study summarizes research focusing on ways to improve the usefulness of organizational level measures of unit readiness/effectiveness through the evaluation of numerous aircraft maintenance related measures of performance. In addition, a measurement approach using unit level outcome measures is presented, which adapts and extends the performance distribution assessment approach proposed by Kane (1986; 1992). It is demonstrated that, while originally used with subjective performance judgements, the system is readily adapted to regularly collected unit level outcomes. An important characteristic of the measurement system presented a focus on the range of performance observed, which considers the fluctuation or variability in performance as well as the level of performance. In addition, the system incorporates a relativistic scaling of performance information. That is, performance is expressed as a ratio of measured performance to some benchmark distribution'. This benchmark distribution may represent established standards, expected, or previously attained levels of performance. This scaling process serves to express actual performance in terms relative to some previously established range of performance. The representation of performance in distributional form along with relativistic scaling has several important advantages to traditional measurement approaches. It allows for an assessment of the consistency of performance ant the extent to which negatively valued outcomes are avoided, which serves to facilitate the comparison and combination of data across diverse performance measures. The current study presents a demonstration of the proposed measurement system with aircraft maintenance data. Preliminary results indicate that this approach does in fact have the potential to improve the utility of or animation level criterion measures.
Document Details
- Document Type
- Technical Report
- Publication Date
- Dec 01, 1998
- Accession Number
- ADA368461
Entities
People
- David J. Woehr
- Michael J. Miller
- Winston Bennett Jr.
Organizations
- Texas A&M University