Extending the Reach of Statistical Software Testing

Abstract

Statistical software testing is a promising technique for reducing the software testing burden by applying test cases to the software under test according to a model of the expected usage of the system in operation, called an operational profile. However, current statistical testing techniques have not been put into general practice, as they do not scale well as the complexity of the systems under test increases. In particular, as system complexity increases, the matrices required to generate test cases and perform model analysis can grow dramatically, even exponentially, overwhelming the test generation and analysis applications. In this work, a new technique for representing the operational profile is proposed to mitigate the complexity issue for statistical test case generation. The use of a state-based requirements specification model as the basis of the operational profile leverages parallelism to reduce the visible size of the model. The specification model can then be extended to include conditional probabilities of input data occurrence. * This work also proposes a statistical testing framework using this specification-based operational profile to generate and execute test cases. Such a framework allows us to evaluate the effectiveness and efficiency of this statistical testing technique.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Feb 01, 2004
Accession Number
ADA421743

Entities

People

  • Robert J. Weber

Organizations

  • Air Force Institute of Technology

Tags

Communities of Interest

  • Biomedical
  • C4I
  • Energy and Power Technologies
  • Ground and Sea Platforms
  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Air Force
  • Complex Systems
  • Computer Programming
  • Control Systems
  • Engineering
  • Language
  • Probability
  • Probability Distributions
  • Reliability
  • Simulators
  • Software Development
  • Software Testing
  • Statistical Analysis
  • Statistical Tests
  • Test And Evaluation
  • Test Management
  • Test Methods

Fields of Study

  • Computer science
  • Engineering

Readers

  • Computational Modeling and Simulation
  • Joint Military Operations and Doctrine.
  • Software Engineering.