Extracting Major Topics From Survey Text Responses Using Natural Language Processing

Abstract

In this thesis, we enhance the comment analysis approach of Cairolis 2017 Naval Postgraduate School thesis, to help the fleet analyze comment responses in Department of Defense surveys and utilize the results to make important decisions. This methodology automates applying descriptive labels to a comment and then uses those labels to categorize comments into a small set of meaningful prevalent topics. We apply this methodology to comments from two recent surveys: a command climate survey as well as an investigation survey looking into the recent increase of physiological episodes experienced by T-45 and F/A-18 aircrews. When applying novel approaches to different data, unexpected matters emerge. These matters shed light on areas of the approach that may need expansion or modification. Motivated by our analysis of text comments from two very different Navy surveys, we extend Cairolis approach in four ways. Our modifications lead to a generalized model; an approach independent of the need to acquire and preprocess an external reference corpus; more automation of the topic discovery process; and an added element that allows a comment to have more than one topic.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 01, 2018
Accession Number
AD1065423

Entities

People

  • Christine Layug

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Air Platforms
  • Biomedical

DTIC Thesaurus Topics

  • Abstracts
  • Accuracy
  • Aircrafts
  • Automation
  • Availability
  • California
  • Coefficients
  • Computations
  • Data Set
  • Department Of Defense
  • Dielectric Gases
  • Digital Data
  • Errors
  • Extraction
  • Frequency
  • Governments
  • Information Operations
  • Information Science
  • Language
  • Motivation
  • Natural Language Processing
  • Natural Languages
  • Naval Aviation
  • Naval Personnel
  • Navy
  • Operations Research
  • Preprocessing
  • Schools
  • Standards
  • Text Mining
  • Training
  • United States
  • United States Naval Academy

Readers

  • Computational Linguistics
  • Organizational Psychology.
  • Systems Analysis and Design

Technology Areas

  • AI & ML
  • AI & ML - Information Retrieval