Adaptive Maritime Video Surveillance

Abstract

Maritime assets such as ports, harbors, and vessels are vulnerable to a variety of near-shore threats such as small-boat attacks. Currently, such vulnerabilities are addressed predominantly by watchstanders and manual video surveillance, which is manpower intensive. Automatic maritime video surveillance techniques are being introduced to reduce manpower costs, but they have limited functionality and performance. For example, they only detect simple events such as perimeter breaches and cannot predict emerging threats. They also generate too many false alerts and cannot explain their reasoning. To overcome these limitations, we are developing the Maritime Activity Analysis Workbench (MAAW), which will be a mixed-initiative, real-time maritime video surveillance tool that uses an integrated supervised machine learning approach to label independent and coordinated maritime activities. It uses the same information to predict anomalous behavior and explain its reasoning. This is an important capability for watchstander training and for collecting performance feedback. In this paper, we describe MAAW's functional architecture, which includes the following pipeline of components: (1) a video acquisition and preprocessing component that detects and tracks vessels in video images, (2) a vessel categorization and activity labeling component that uses standard and relational supervised machine learning methods to label maritime activities, and (3) an ontology-guided vessel and maritime activity annotator to enable subject matter experts (e.g., watchstanders) to provide feedback and supervision to the system. We report our findings from a preliminary system evaluation on river traffic video.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2009
Accession Number
ADA552763

Entities

People

  • David W. Aha
  • Kalyan M. Gupta
  • Philip G. Moore
  • Ralph Hartley

Organizations

  • Knexus Research (United States)

Tags

Communities of Interest

  • Counter WMD
  • Ground and Sea Platforms
  • Human Systems
  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Acquisition
  • Automatic Identification Systems
  • Computer Vision
  • Databases
  • Detection
  • Detectors
  • Image Processing
  • Information Processing
  • Information Science
  • Machine Learning
  • Maritime Domain Awareness
  • Naval Vessels
  • Ontologies
  • Security
  • Supervised Machine Learning
  • Uss Cole
  • Warning Systems

Fields of Study

  • Computer science

Readers

  • Maritime Security/Maritime Homeland Security
  • Neural Network Machine Learning.

Technology Areas

  • AI & ML