Learning Multisensory Representations

Abstract

Peoples everyday experiences are multisensory. For example, while eating breakfast, we both see and grasp our coffee cup. Moreover, multisensory perception is critical in some highly important situations, as when a TSA agent searches a passengers bag by both looking inside the bag and touching its contents or when a police officer frisks a person using both visual and tactile inspection. In brief, our research program uses experimental and computational methodologies to study how people acquire multisensory representations and how the use of these representations influences perceptual judgements and decision making. The program focuses on peoples performances in visual-haptic and visual-auditory environments. Funding from this grant supported research reported in 7 journal publications and 3 conference publications (manuscripts based on 2 of the conference publications are currently being prepared for journal submission).

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 23, 2016
Accession Number
AD1010311

Entities

People

  • Robert A. Jacobs

Organizations

  • University of Rochester

Tags

Communities of Interest

  • Engineered Resilient Systems

DTIC Thesaurus Topics

  • Air Force
  • Air Force Research Laboratories
  • Artificial Intelligence
  • Auditory Perception
  • Classification
  • Cognition
  • Cognitive Science
  • Contracts
  • Convolutional Neural Networks
  • Electronic Mail
  • Environment
  • Judgment
  • Language
  • Learning
  • Neural Networks
  • Perception
  • Psychology

Fields of Study

  • Psychology

Readers

  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.
  • Technical Research and Report Writing.
  • Vision Science/Vision Psychology/Cognitive Neuroscience.