A Linear Programming Formulation for Global Inference in Natural Language Tasks

Abstract

Given a collection of discrete random variables representing outcomes of learned local predictors in natural language. e.g.. named entities and relations. we seek an optimal global assignment to the variables in the presence of general (non-sequential) constraints. Examples of these constraints include the type of arguments a relation can take, and the mutual activity of different relations. etc. We develop a linear programing formulation for this problem and evaluate it in the context of simultaneously learning named entities and relations. Our approach allows us to efficiently incorporate domain and task specific constraints at decision time, resulting in significant improvements in the accuracy and the "human-like" quality of the inferences.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2004
Accession Number
ADA460702

Entities

People

  • Dan Roth
  • Wen-tau Yih

Organizations

  • University of Illinois Urbana–Champaign

Tags

Communities of Interest

  • Air Platforms
  • C4I
  • Energy and Power Technologies
  • Human Systems

DTIC Thesaurus Topics

  • Algorithms
  • Artificial Intelligence
  • Computer Programming
  • Computer Science
  • Information Processing
  • Information Systems
  • Integer Programming
  • Language
  • Linear Programming
  • Machine Learning
  • Natural Languages
  • Neural Networks
  • Optimization
  • Pattern Recognition
  • Probabilistic Models
  • Reasoning
  • Recognition

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Artificial Intelligence
  • Operations Research

Technology Areas

  • AI & ML
  • AI & ML - Machine Learning Algorithms