Activity Detection in Untrimmed Videos Using Chunk-based Classifiers

Abstract

Activity detection in untrimmed videos - the process of detecting and localizing human activities in potentially long videos - is a challenging problem in computer vision. We propose an algorithm which is based on the proposition that despite the differences between activity classification and detection, a strong classifier can still be used to achieve state-of-the-art performance in detection by breaking the video into multiple overlapping chunks and classifying each individually. We further introduce two new auxiliary tasks which we call chunk inclusion and localization. The outputs of these tasks, when carefully applied, can be used to dramatically improve performance. We call our method Chunk Aggregation. It is straight-forward to implement and use, and is agnostic to the backbone activity classification architecture used. We also demonstrate the effectiveness of chunk association by presenting results and a series of ablation experiments on the THUMOS14 and ActEV datasets.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Mar 01, 2020
Accession Number
AD1154834

Entities

People

  • Carlos D. Castillo
  • Joshua Gleason
  • Jun-Cheng Chen
  • Rajeev Ranjan
  • Rama Chellappa
  • Steven Schwarcz

Organizations

  • University of Maryland

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Artificial Intelligence Software
  • Bayesian Networks
  • Computer Languages
  • Computer Vision
  • Computers
  • Detection
  • Dimensionality Reduction
  • False Alarms
  • Image Processing
  • Information Processing
  • Information Systems
  • Intelligence Community (United States)
  • Machine Learning
  • Neural Networks
  • Pattern Recognition
  • Probabilistic Models
  • Recognition
  • Three Dimensional

Fields of Study

  • Computer science

Readers

  • Parallel and Distributed Computing.
  • Sensor Fusion and Tracking Systems.
  • Systems Analysis and Design

Technology Areas

  • AI & ML
  • AI & ML - Neural Networks