Communication Overhead on the Intel Paragon, IBM SP2 and Meiko CS-2.

Abstract

Interprocessor communication overhead is a crucial measure of the power of parallel computing systems--its impact can severely limit the performance of parallel programs. This report presents measurements of communication overhead on three contemporary commercial multicomputer systems: the Intel Paragon, the IBM SP2 and the Meiko CS-2. In each case the time to communicate between processors is presented as a function of message length. The time for global synchronization and memory access is discussed. The performance of these machines in emulating hypercubes and executing random pair-wise exchanges is also investigated.It is shown that the interprocessor communication time depends heavily on the specific communication pattern required. These observations contradict the commonly held belief that communication over-head on contemporary machines is independent of the placement of tasks on processors. The information presented in this report permits the evaluation of the efficiency of parallel algorithm implementations against standard baselines.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 01, 1995
Accession Number
ADA301368

Entities

People

  • Shahid H. Bokhari

Tags

Communities of Interest

  • Biomedical
  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Algorithms
  • Clocks
  • Communication Networks
  • Computer Programming
  • Computers
  • Data Transmission
  • Digital Communications
  • Efficiency
  • Electrical Engineering
  • Engineering
  • High Resolution
  • Measurement
  • Networks
  • Operating Systems
  • Parallel Computing
  • Parallel Processors
  • Standards

Fields of Study

  • Computer science

Readers

  • Parallel and Distributed Computing.