The Statistical Properties of Host Load.

Abstract

Understanding how host load changes over time is instrumental in predicting the execution time of tasks or jobs, such as in dynamic load balancing and distributed soft real-time systems. To improve this understanding, we collected week-long, 1 Hz resolution Unix load average traces on 38 different machines including production and research cluster machines, compute servers, and desktop workstations Separate sets of traces were collected at two different times of the year. The traces capture all of the dynamic load information available to user-level programs on these machines. We present a detailed statistical analysis of these traces here, including summary statistics, distributions, and time series analysis results. Two significant new results are that load is self-similar and that it displays epochal behavior. All of the traces exhibit a high degree of self similarity with Hurst parameters ranging from .63 to .97, strongly biased toward the top of that range. The traces also display epochal behavior in that the local frequency content of the load signal remains quite stable for long periods of time (150-450 seconds mean) and changes abruptly at epoch boundaries. CMS-9318163,

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 01, 1998
Accession Number
ADA352337

Entities

People

  • Peter A. Dinda

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Algorithms
  • Autocorrelation
  • Computer Science
  • Data Science
  • Frequency
  • Frequency Domain
  • Information Science
  • Load Distribution
  • Normal Distribution
  • Operating Systems
  • Simulations
  • Stationary Processes
  • Statistical Analysis
  • Statistics
  • Stochastic Processes
  • Time Domain
  • Time Series Analysis

Fields of Study

  • Computer science

Readers

  • Atmospheric Science / Meteorology, specifically Wind Wave Turbulence.
  • Computational Modeling and Simulation
  • Parallel and Distributed Computing.