Using Prosody for Automatic Sentence Segmentation of Multi-Party Meetings

Abstract

We explore the use of prosodic features beyond pauses, including duration, pitch, and energy features, for automatic sentence segmentation of ICSI meeting data. We examine two different approaches to boundary classification: score-level combination of independent language and prosodic models using HMMs, and feature-level combination of models using a boosting-based method (BoosTexter). We report classification results for reference word transcripts as well as for transcripts from a state-of-the-art automatic speech recognizer (ASR). We also compare results using the lexical model plus a pause-only prosody model, versus results using additional prosodic features. Results show that (1) information from pauses is important, including pause duration both at the boundary and at the previous and following word boundaries; (2) adding duration, pitch, and energy features yields significant improvement over pause alone; (3) the integrated boosting-based model performs better than the HMM for ASR conditions; (4) training the boosting-based model on recognized words yields further improvement.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2006
Accession Number
ADA459015

Entities

People

  • Eilzabeth Shriberg
  • Jachym Kolar
  • Yang Liu

Organizations

  • International Computer Science Institute

Tags

Communities of Interest

  • Autonomy
  • C4I
  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Artificial Intelligence Software
  • Automata Theory
  • Automated Speech Recognition
  • Automated Text Summarization
  • Automatic
  • Computational Science
  • Computer Languages
  • Computer Science
  • Computer Vision
  • Hidden Markov Models
  • Language
  • Machine Learning
  • Markov Models
  • Natural Language Processing
  • Natural Languages
  • Probability
  • Recognition

Readers

  • Speech Processing/Speech Recognition.