Joint Group and Topic Discovery from Relations and Text

Abstract

We present a probabilistic generative model of entity relationships and textual attributes; the model simultaneously discovers groups among the entities and topics among the corresponding text. Block models of relationship data have been studied in social network analysis for some time, however here we cluster in multiple modalities at once. Significantly, joint inference allows the discovery of groups to be guided by the emerging topics, and vice-versa. We present experimental results on two large data sets: sixteen years of bills put before the U.S. Senate, comprising their corresponding text and voting records, and 43 years of similar data from the United Nations. We show that in comparison with traditional, separate latent-variable models for words or block structures for votes, our Group-Topic model's joint inference improves both the groups and topics discovered. Additionally, we present a non-Markov continuous-time group model to capture shifting group structure over time.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2006
Accession Number
ADA477401

Entities

People

  • Andrew McCallum
  • Natasha Mohanty
  • Xuerui Wang

Organizations

  • University of Massachusetts Amherst

Tags

Communities of Interest

  • Biomedical
  • Energy and Power Technologies
  • Weapons Technologies

DTIC Thesaurus Topics

  • Agreements
  • Commerce
  • Data Sets
  • Education
  • Europe
  • Human Rights
  • Intergovernmental Organizations
  • International Organizations
  • Law
  • Mathematical Models
  • Models
  • Monte Carlo Method
  • Political Science
  • Probabilistic Models
  • Probability
  • Social Networks
  • Ussr

Fields of Study

  • Computer science

Readers

  • Artificial Intelligence
  • Business Analytics
  • Statistical inference.

Technology Areas

  • AI & ML
  • AI & ML - Information Retrieval