360-Degree Visual Detection and Target Tracking on an Autonomous Surface Vehicle

Abstract

This paper describes perception and planning systems of an autonomous sea surface vehicle (ASV) whose goal is to detect and track other vessels at medium to long ranges and execute responses to determine whether the vessel is adversarial. The Jet Propulsion Laboratory (JPL) has developed a tightly integrated system called CARACaS (Control Architecture for Robotic Agent Command and Sensing) that blends the sensing, planning, and behavior autonomy necessary for such missions. Two patrol scenarios are addressed here: one in which the ASV patrols a large harbor region and checks for vessels near a fixed asset on each pass and one in which the ASV circles a fixed asset and intercepts approaching vessels. This paper focuses on the ASV's central perception and situation awareness system, dubbed Surface Autonomous Visual Analysis and Tracking (SAVAnT), which receives images from an omnidirectional camera head, identifies objects of interest in these images, and probabilistically tracks the objects' presence over time, even as they may exist outside of the vehicle's sensor range. The integrated CARACaS/SAVAnT system has been implemented on U.S. Navy experimental ASVs and tested in on-water field demonstrations.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Dec 01, 2010
Accession Number
ADA531455

Entities

People

  • Andrew J. Howard
  • Ashitey Trebi-ollennu
  • Christopher Assad
  • David C. Zhu
  • Hrand Aghazarian
  • Michael T. Wolf
  • Terry Huntsberger
  • Thomas Lu
  • Yoshiaki Kuwata

Organizations

  • California Institute of Technology

Tags

Communities of Interest

  • Autonomy
  • Ground and Sea Platforms
  • Materials and Manufacturing Processes
  • Space

DTIC Thesaurus Topics

  • Autonomous Navigation
  • Autonomous Surface Vehicles
  • Autonomous Systems
  • Change Detection
  • Collision Avoidance
  • Computer Vision
  • Detection
  • Detectors
  • Jet Propulsion
  • Motion Planning
  • Multitarget Tracking
  • Navigation
  • Robots
  • Situational Awareness
  • Target Tracking
  • Unmanned Systems
  • Unmanned Vehicles

Readers

  • Computer Vision.
  • Maritime Security/Maritime Homeland Security
  • Phased Array Antenna Design.

Technology Areas

  • AI & ML
  • AI & ML - Autonomous Systems
  • Autonomy
  • Autonomy - Autonomous System Control