Decoding the neural representation of story meanings across languages
Abstract
Drawing from a common lexicon of semantic units, humans fashion narratives whose meaning transcends that of their individual utterances. However, while brain regions that represent lower‐level semantic units, such as words and sentences, have been identified, questions remain about the neural representation of narrative comprehension, which involves inferring cumulative meaning. To address these questions, we exposed English, Mandarin, and Farsi native speakers to native language translations of the same stories during fMRI scanning. Using a new technique in natural language processing, we calculated the distributed representations of these stories (capturing the meaning of the stories in high‐dimensional semantic space), and demonstrate that using these representations we can identify the specific story a participant was reading from the neural data. Notably, this was possible even when the distributed representations were calculated using stories in a different language than the participant was reading. Our results reveal that identification relied on a collection of brain regions most prominently located in the default mode network. These results demonstrate that neuro‐semantic encoding of narratives happens at levels higher than individual semantic units and that this encoding is systematic across both individuals and languages. Hum Brain Mapp 38:6096–6106, 2017. © 2017 Wiley Periodicals, Inc.
Document Details
- Document Type
- Pub Defense Publication
- Publication Date
- Sep 20, 2017
- Source ID
- 10.1002/hbm.23814
Entities
People
- Andrew S. Gordon
- Antonio Damasio
- Ashish Vaswani
- Jason D. Zevin
- Joe Hoover
- Jonas T. Kaplan
- Kingson Man
- Mary Helen Immordino‐yang
- Morteza Dehghani
- Reihane Boghrati
- Sarah I Gimbel
Organizations
- Defense Advanced Research Projects Agency
- Google Brain
- University of Southern California