Activity Detection for Information Access to Oral Communication

Abstract

Oral communication is ubiquitous and carries important information yet it is also time consuming to document. Given the development of storage media and networks one could just record and store a conversation for documentation. The question is, however, how an interesting information piece would be found in a large database. Traditional information retrieval techniques use a histogram of keywords as the document representation but oral communication may offer additional indices such as the time and place of the rejoinder and the attendance. An alternative index could be the activity such as discussing, planning, informing, story-telling, etc. This paper addresses the problem of the automatic detection of those activities in meeting situation and everyday rejoinders. Several extensions of this basic idea are being discussed and/or evaluated: Similar to activities one can define subsets of larger database and detect those automatically which is shown on a large database of TV shows. Emotions and other indices such as the dominance distribution of speakers might be available on the surface and could be used directly. Despite the small size of the databases used some results about the effectiveness of these indices can be obtained.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2001
Accession Number
ADA458656

Entities

People

  • Alex Waibel
  • Klaus Ries

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Abstracts
  • Accuracy
  • Automatic
  • Classification
  • Computational Linguistics
  • Computer Programming
  • Databases
  • Detection
  • Histograms
  • Information Retrieval
  • Information Science
  • Language
  • Linguistics
  • Machine Learning
  • Materials
  • Neural Networks
  • Recognition

Readers

  • Academic Conference Management
  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Library and Information Science

Technology Areas

  • AI & ML