Validity of Empirical Studies of Information System Effectiveness

Abstract

This thesis reviewed 45 studies that purported to empirically assess the effectiveness of information systems. They were evaluated for (a) vulnerability to alternative explanations of reported findings, (b) effect of data collection methods upon their conclusions, (c) capacity to establish causal inference, (d) how they defined system success and (e) reported changes in organizations following information system implementation. MIS research methods do not provide a basis for establishing causal inference. This, in turn, denies the possibility of constructing a formal theory to describe, explain or predict the successful implementation of information systems. This deficiency is worsened by the emergence of antagonistic schools of thought among MIS researchers as to how system effectiveness should be evaluated. Recommendations are made for improvements in MIS research designs and data collection techniques. Suggestions are made for ways by which line managers and commanders as well as managers of MIS activities must become informed consumers of MIS academic research on system effectiveness. Keywords: Bibliographics; Productivity.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 1989
Accession Number
ADA214474

Entities

People

  • M. A. Mustofa

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Communication Systems
  • Cost Reductions
  • Databases
  • Decision Support Systems
  • Economic Analysis
  • Information Processing
  • Information Systems
  • Management Information Systems
  • Management Personnel
  • Organizational Structure
  • Personal Computers
  • Personnel Management
  • Psychology
  • Software Development
  • Students
  • Systems Management
  • United States

Readers

  • Artificial Intelligence
  • Systems Analysis and Design
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference