Automatic Keyframe Summarization of User-Generated Video

Abstract

The explosive growth of user-generated video presents opportunities and challenges. The videos may possess valuable information that was once unavailable. On the other hand, the information may be buried or difficult to access with traditional methods. Automatic keyframe video summarization technologies exist that attempt to address this problem. A keyframe summary can often be viewed quicker than the underlying video. However, a theoretical framework for objectively assessing keyframe summary quality has been absent. The work presented here bridges this gap by presenting a semantically high-level, stakeholder-centered evaluation framework. The framework can capture common stakeholder concerns and quantitatively measure the extent to which they are satisfied by keyframe summaries.With this framework, keyframe summary stakeholders and algorithm developers can now identify when success has been achieved. This work also develops a number of novel keyframe summarization algorithms and shows, using the evaluation framework, that they outperform baseline methods.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 2014
Accession Number
ADA607607

Entities

People

  • Eric C. Eckstrand

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Energy and Power Technologies
  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Algorithms
  • Automated Text Summarization
  • Automatic
  • Cameras
  • Computer Programs
  • Computer Vision
  • Computers
  • Construction
  • Detection
  • Detectors
  • Social Media
  • Supervised Machine Learning
  • Test And Evaluation
  • Training
  • United States
  • United States Naval Academy
  • Video Frames

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Organizational Process Management (OPM).
  • Systems Analysis and Design