Informed Prefetching and Caching,

Abstract

The underutilization of disk parallelism and file cache buffers by traditional file systems induces I/O stall time that degrades the performance of modern microprocessor-based systems. In this paper, we present aggressive mechanisms that tailor file system resource management to the needs of I/O-intensive applications. In particular, we show how to use application-disclosed access patterns (hints) to expose and exploit I/O parallelism and to allocate dynamically file buffers among three competing demands: prefetching hinted blocks, caching hinted blocks for reuse, and caching recently used data for unhinted accesses. Our approach estimates the impact of alternative buffer allocations on application execution time and applies a cost-benefit analysis to allocate buffers where they will have the greatest impact. We implemented informed prefetching and caching in DEC's OSF/1 operating system and measured its performance on a 150 MHz Alpha equipped with 15 disks running a range of applications including text search, 3D scientific visualization, relational database queries, speech recognition, and computational chemistry. Informed prefetching reduces the execution time of the first four of these applications by 20% to 87%. Informed caching reduces the execution time of the fifth application by up to 30%.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 11, 1995
Accession Number
ADA295490

Entities

People

  • Daniel Stodolsky
  • Eka Ginting
  • Garth A. Gibson
  • Jim Zelenka
  • R. H. Patterson

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Algorithms
  • Automated Speech Recognition
  • Computations
  • Computer Programming
  • Computer Science
  • Computers
  • Cost Benefit Analysis
  • Databases
  • Equations
  • Estimators
  • Language
  • Measurement
  • Operating Systems
  • Probability
  • Relational Databases
  • Resource Management
  • Three Dimensional

Fields of Study

  • Computer science

Readers

  • Database Systems and Applications
  • Parallel and Distributed Computing.

Technology Areas

  • AI & ML
  • AI & ML - Machine Translation