An All-Fragments Grammar for Simple and Accurate Parsing

Abstract

We present a simple but accurate parser which exploits both large tree fragments and symbol refinement. We parse with all fragments of the training set, in contrast to much recent work on tree selection in data-oriented parsing and tree-substitution grammar learning. We require only simple, deterministic grammar symbol refinement, in contrast to recent work on latent symbol refinement. Moreover, our parser requires no explicit lexicon machinery, instead parsing input sentences as character streams. Despite its simplicity, our parser achieves accuracies of over 88% F1 on the standard English WSJ task, which is competitive with substantially more complicated state-of-the-art lexicalized and latent-variable parsers. Additional specific contributions center on making implicit all-fragments parsing efficient, including a coarse-to-fine inference scheme and a new graph encoding.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Mar 21, 2012
Accession Number
ADA561721

Entities

People

  • Daniel Klein
  • Mohit Bansal

Organizations

  • University of California, Berkeley

Tags

DTIC Thesaurus Topics

  • Accuracy
  • Algorithms
  • Coding
  • Computational Complexity
  • Computational Linguistics
  • Computer Science
  • Electrical Engineering
  • Grammars
  • Language
  • Learning
  • Linguistics
  • Machine Translation
  • Personality
  • Standards
  • Symbols
  • Test Sets
  • Training

Fields of Study

  • Computer science

Readers

  • Computational Linguistics
  • Neural Network Machine Learning.

Technology Areas

  • AI & ML
  • AI & ML - Machine Translation
  • AI & ML - Neural Networks