"How Much Testing is Enough?" 25 Years Later
Abstract
In 1994, MORS (Military Operations Research Society) and ITEA (International Test and Evaluation Association) co-sponsored a mini-symposium to tackle the question, "How Much Testing is Enough?" in test and evaluation (T and E). Participants from the symposium produced a report detailing the discussions and recommendations from the three-day event. Twenty five years later, the question that inspired the symposium is still hotly debated within the T and E community. The intervening years have seen substantial progress made in areas like the use of experimental design for sizing tests, combining data from developmental and operational test to improve efficiency, and the wide-spread adoption of modeling and simulation in T and E. Less progress has been made in cost transparency and integration of technology demonstrations with the T and E process. Since 1994, new challenges like cybersecurity and autonomy have emerged, presenting new challenges to determining the right amount of testing. Despite the many improvements made over the past twenty-five years, there are still no simple answers to the question, How much testing is enough?
Document Details
- Document Type
- Technical Report
- Publication Date
- Dec 01, 2019
- Accession Number
- AD1148057
Entities
People
- James R. Simpson
- Matthew R. Avery
Organizations
- Institute for Defense Analyses