Inferring Depictions in Natural-Language Captions for Efficient Access to Picture Data

Abstract

Multimedia data can require significant examination time to find desired features ('content analysis'). An alternative is using natural-language captions to describe the data, and matching captions to English queries. But it is hard to include everything in the caption of a complicated datum, so significant content analysis may still seem required. We discuss linguistic clues in captions, both syntactic and semantic, than can simplify or eliminate content analysis. We introduce the notion of concept depiction and rules for depiction inference. Our approach is implemented in an expert system which demonstrated significant increases in recall in experiments.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 19, 1993
Accession Number
ADA271396

Entities

People

  • Neil C. Rowe

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Weapons Technologies

DTIC Thesaurus Topics

  • Abstracts
  • Aerial Warfare
  • Aircrafts
  • Artificial Intelligence
  • Classification
  • Computer Science
  • Computers
  • Data Analysis
  • Databases
  • Expert Systems
  • Information Processing
  • Information Retrieval
  • Information Systems
  • Language
  • Media
  • Natural Language Processing
  • Natural Languages

Fields of Study

  • Computer science

Readers

  • Computational Linguistics
  • Computational Modeling and Simulation

Technology Areas

  • AI & ML
  • AI & ML - Machine Translation