Cross-Lingual Lexical Triggers in Statistical Language Modeling

Abstract

We propose new methods to take advantage of text in resource-rich languages to sharpen statistical language models in resource-deficient languages. We achieve this through an extension of the method of lexical triggers to the cross-language problem, and by developing a likelihoodbased adaptation scheme for combining a trigger model with an N-gram model. We describe the application of such language models for automatic speech recognition. By exploiting a side-corpus of contemporaneous English news articles for adapting a static Chinese language model to transcribe Mandarin news stories, we demonstrate significant reductions in both perplexity and recognition errors. We also compare our cross-lingual adaptation scheme to monolingual language model adaptation, and to an alternate method for exploiting cross-lingual cues, via crosslingual information retrieval and machine translation, proposed elsewhere.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2003
Accession Number
ADA459581

Entities

People

  • Sanjeev Khudanpur
  • Woosung Kim

Organizations

  • Johns Hopkins University

Tags

Communities of Interest

  • Weapons Technologies

DTIC Thesaurus Topics

  • Abstracts
  • Automated Speech Recognition
  • Chinese Language
  • Computer Science
  • Dictionaries
  • Information Operations
  • Information Retrieval
  • Language
  • Machine Translation
  • Military Research
  • Natural Language Processing
  • New York
  • Probability
  • Training
  • Translations
  • Vocabulary

Fields of Study

  • Computer science

Readers

  • Computational Linguistics
  • Computational Modeling and Simulation
  • Speech Processing/Speech Recognition.

Technology Areas

  • AI & ML
  • AI & ML - Machine Translation