Determining How Much Testing is Enough: An Exploration of Progress in the Department of Defense Test and Evaluation Community
Abstract
In 1994, MORS (Military Operations Research Society) and ITEA (International Test and Evaluation Association) co-sponsored a mini-symposium to tackle the question, "How Much Testing is Enough?" in test and evaluation (T and E). Participants from the symposium produced a report detailing the discussions and recommendations from the three-day event. The question that inspired the symposium is still hotly debated within the T and E community. The intervening years have seen substantial progress made in areas like the use of experimental design for sizing tests, combining data from developmental and operational test to improve efficiency, and the widespread adoption of modeling and simulation in T and E. Less progress has been made in cost transparency and integration of technology demonstrations with the T and E process. Since 1994, new challenges like cybersecurity and autonomy have emerged, presenting new challenges to determining the right amount of testing. Despite the many improvements made over the years, there are still no simple answers to the question, How much testing is enough?
Document Details
- Document Type
- Technical Report
- Publication Date
- Feb 01, 2021
- Accession Number
- AD1148071
Entities
People
- Heather M. Wojton
- James R. Simpson
- Matthew R. Avery
- Rebecca Medlin
Organizations
- Institute for Defense Analyses