Intricacies of Collins' Parsing Model

Abstract

This paper documents a large set of heretofore unpublished details Collins used in his parser, such that, along with Collins' thesis (Collins, 1999), this paper contains all information necessary to duplicate Collins' benchmark results. Indeed, these as-yet-unpublished details account for an 11% relative increase in error from an implementation including all details to a clean-room implementation of Collins' model. We also show a cleaner and equally-well-performing method for the handling of punctuation and conjunction, and reveal certain other probabilistic oddities about Collins' parser. We analyze not only the effect of the unpublished details, but also reanalyze the effect of certain well-known details, revealing that bilexical dependencies are barely used by the model and that head choice is not nearly as important to overall parsing performance as once thought. Finally, we perform experiments that show that the true discriminative power of lexicalization appears to lie in the fact that unlexicalized syntactic structures are generated conditioning on the head word and its part of speech.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2005
Accession Number
ADA436395

Entities

People

  • Daniel M. Bikel

Organizations

  • University of Pennsylvania

Tags

Communities of Interest

  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Abstracts
  • Algorithms
  • Computational Linguistics
  • Computational Science
  • Decoding
  • Generative Models
  • Grammars
  • Information Science
  • Language
  • Linguistics
  • Machine Learning
  • Models
  • Natural Language Processing
  • Natural Languages
  • Probabilistic Models
  • Probability
  • Statistics

Readers

  • Analytical Chemistry
  • Computational Linguistics
  • Theoretical Analysis.