An Analysis of Data Validity for Measures of Effectiveness of Information Systems

Abstract

This thesis examines validity issues associated with the use of data collection techniques in information systems research. It presents an analysis of 37 studies that purported to empirically assess the effectiveness of information systems. These studies were evaluated to determine the validity of measures of effectiveness of information systems. Each study was reviewed to identify (1) data collection techniques used, (2) purported measures of the techniques, (3) ways in which the techniques were administered, and (4) discussions of validity issues arising from the use of the techniques. Findings indicate that information systems researchers have adopted data collection techniques commonly used by social scientists; however, they largely ignore or are unaware of associated validity issues. Over three-quarter of the studies involved questionnaires and fewer than a quarter addressed validity issues. Consequently, the credibility of information systems research is vulnerable to challenge.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Mar 01, 1991
Accession Number
ADA242684

Entities

People

  • Gregory M. Regens

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Biomedical
  • Human Systems

DTIC Thesaurus Topics

  • Business Administration
  • Data Analysis
  • Data Science
  • Databases
  • Decision Support Systems
  • Experimental Design
  • Information Processing
  • Information Science
  • Information Systems
  • Management Personnel
  • Measuring Instruments
  • Organizational Structure
  • Personnel Management
  • Social Sciences
  • Surveys
  • Systems Management
  • United States

Readers

  • Instructional Design and Training Evaluation.
  • Systems Analysis and Design