Human Capital: Quality of DOD Status of Forces Surveys Could Be Improved by Performing Nonresponse Analysis of the Results

Abstract

The Defense Manpower Data Center (DMDC) conducts a series of Web-based surveys called Status of Forces surveys, which help enable decision makers within the Department of Defense (DOD) to (1) evaluate existing programs and policies, (2) establish baselines before implementing new programs and policies, and (3) monitor the progress of programs and policies and their effects on the total force. In recent years, we have discussed the results of these surveys in several of our reports. While we have generally found the survey results to be sufficiently reliable for the purposes of our reporting, several of our reports have discussed low response rates and the potential for bias in the survey results. Nonresponse analysis is an established practice in survey research that helps determine whether nonresponse bias (i.e., survey results that do not accurately reflect the population) might occur due to under- or overrepresentation of some respondents' views on survey questions. When nonresponse analysis is performed, survey researchers can use the results to select and adjust the statistical weighting techniques they use that help ensure that survey results accurately reflect the survey population. Because we have noted, in reports referring to the Status of Forces surveys, the potential for bias and because of DMDC's role in supporting DOD decision making, we initiated this review under the Comptroller General's statutory authority to conduct evaluations on his own initiative. Specifically, our objective was to determine the extent to which DMDC performs nonresponse analysis of the results of its Status of Forces surveys to determine whether reported results of respondents' views might be under- or overrepresented.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 12, 2010
Accession Number
ADA525317

Entities

Organizations

  • United States Government Accountability Office

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Business Administration
  • Congress
  • Data Centers
  • Department Of Defense
  • Electronic Mail
  • Governments
  • House Of Representatives
  • Management Personnel
  • Military Personnel
  • Money
  • National Governments
  • Security Personnel
  • Social Sciences
  • Test And Evaluation
  • United States
  • United States Government
  • Websites

Readers

  • Defense Financial Management and Audit.
  • Gender and Food Studies
  • Systems Analysis and Design