Affect-LM: A Neural Language Model for Customizable Affective Text Generation

Abstract

Human verbal communication includes affective messages which are conveyed through use of emotionally colored words. There has been a lot of research in this direction but the problem of integrating state-of-the-art neural language models with affective information remains an area ripe for exploration. In this paper, we propose an extension to an LSTM (Long Short-Term Memory) language model for generating conversational text, conditioned on affect categories. Our proposed model, Affect-LM enables us to customize the degree of emotional content in generated sentences through an additional design parameter. Perception studies conducted using Amazon Mechanical Turk show that Affect-LM generates naturally looking emotional sentences without sacrificing grammatical correctness. Affect-LM also learns affect discriminative word representations, and perplexity experiments show that additional affective information in conversational text can improve language model prediction.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 01, 2017
Accession Number
AD1157773

Entities

People

  • Eugene Laksana
  • Louis-Philippe Morency
  • Mathieu Chollet
  • Sayan Ghosh
  • Stefan Scherer

Organizations

  • University of Southern California

Tags

Communities of Interest

  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Artificial Intelligence Software
  • Automated Speech Recognition
  • Cognition
  • Computational Linguistics
  • Computational Science
  • Computer Languages
  • Computing System Architectures
  • Information Processing
  • Information Science
  • Language
  • Linguistics
  • Machine Learning
  • Machine Translation
  • Natural Languages
  • Neural Networks
  • Perception
  • Recurrent Neural Networks

Fields of Study

  • Computer science

Readers

  • Computational Linguistics
  • Prostate Cancer Biology.
  • Psychological Intervention/Treatment for Stress, Anxiety, PTSD, and Related Emotional and Cognitive Health Symptoms.