Composing Effective Software Security Assurance Workflows

Abstract

In an effort to determine how to make secure software development more cost effective, the SEI conducted a research study to empirically measure the effects that security toolsprimarily auto-mated static analysis toolshad on costs (measured by developer effort and schedule) and bene-fits (measured by defect and vulnerability reduction). The data used for this research came from 35 projects in three organizations that used both the Team Software Process and at least one auto-mated static analysis (ASA) tool on source code or source code and binary. In every case quality levels improved when the tools were used, though modestly. In two organizations, use of the tools reduced total development effort. Effort increased in the third organization, but defect removal costs were reduced compared to the costs of fixes in system test. This study indicates that organizations should employ ASA tools to improve quality and reduce effort. There is some evidence, however, that using the tools could crowd out other defect removal activities, reducing the potential benefit. To avoid overreliance, the tools should be employed after other activities where practicable. When system test cycles require expensive equipment, ASA tools should precede test; otherwise, there are advantages to applying them after system test

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Oct 01, 2018
Accession Number
AD1062423

Entities

People

  • Aaron Volkman
  • David Sweeney
  • James D Mchale
  • William R. Nichols
  • William Snavely

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Engineered Resilient Systems

DTIC Thesaurus Topics

  • Acceptance Tests
  • Air Force
  • Application Software
  • Case Studies
  • Computer Programming
  • Computer Programs
  • Computer Science
  • Computers
  • Data Analysis
  • Databases
  • Department Of Defense
  • Engineers
  • Information Science
  • Security
  • Software Development
  • Statistical Analysis
  • Systems Engineering

Fields of Study

  • Computer science
  • Engineering

Readers

  • Cellular and Molecular Pathways of Apoptosis.
  • Software Engineering.
  • Systems Analysis and Design