Distributed Mission Operations Within-Simulator Training Effectiveness Baseline Study. Volume 2. Metric Development and Objectively Quantifying the Degree of Learning
Abstract
The current work reports only the objective data from AFRL-HE-AZ-TR-2006-0015, Volume I, Distributed Mission Operations Within-Simulator Training Effectiveness: Summary Report, but here we expand the reporting of objective data both in depth and breadth. We examined F-16 pilots participating in week-long Distributed Mission Operation (DMO) training exercises and compared extensive computer-collected data between beginning-of-week and end-of-week pilot performance on mirror-image scenarios. The DMO research environment in Mesa, AZ consisted of four high-fidelity F-16 simulators and one high-fidelity Airborne Warning and Control System simulator. Participating F-16 teams flew over 40 total scenarios according to a five-day syllabus, book-ended on Monday and Friday by mirror-image point defense air combat benchmark scenarios. Seven mission outcome measures were found to be significantly better on Friday than Monday: A 58.33% decrease in enemy strikers reaching their target, 38.10% greater distance from the base the F-16s disposed of the strikers, 54.77% fewer F-16 mortalities, 75.26% more enemy striker kills (before reaching base), 6.82% higher proportion of Viper Advanced Medium Range Air-to-Air Missile (AMRAAM) shots resulting in a kill, 51.60% lower proportion of enemy Alamo missile shots resulting in a kill, and a highly impressive 314.21% increase in an overall summary scoring scheme developed by subject matter experts. Significant trends were also found for a number of other metrics assessing skills. Of all the measures investigated in the current work, not a single offensive/defensive trade-off was observed, which significantly strengthens our conclusion that significant within-simulator learning took place.
Document Details
- Document Type
- Technical Report
- Publication Date
- Jul 01, 2006
- Accession Number
- ADA461867
Entities
People
- Brian T. Schreiber
- William A. Stock
- Winston Bennett Jr.