A Tracker Assessment Tool for Comparing Tracker Performance

Abstract

This technical report describes a method for assessing the performance of automatic tracking systems against various metrics. These metrics are grouped in the categories of track establishment, track maintenance, track error and false tracks. A desired performance level is defined for each metric, and the probability that a particular track will meet this performance level is empirically approximated from archived sensor data. The individual metric probabilities are combined using a weighted average to produce an overall tracker rating. An important feature of the approach is that absolute truth is assumed to be unavailable, and output of the trackers under test is instead compared with incomplete truth. The incomplete truth is produced by manual inspection of the data and through editing the output of the best available tracking algorithm. This report also discusses an implementation of the assessment method for Over-the-Horizon Radar. This software package is referred to as the Tracker Assessment Tool, and is used to compare four alternative tracking algorithms.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Mar 01, 2005
Accession Number
ADA432575

Entities

People

  • B. Cheung
  • S. B. Colegrove
  • S. J. Davcy

Organizations

  • Defence Science and Technology Group

Tags

Communities of Interest

  • C4I
  • Sensors

DTIC Thesaurus Topics

  • Data Sets
  • Detection
  • Detectors
  • Engineering
  • Information Processing
  • Information Science
  • Measurement
  • Multiple Hypothesis Tracking
  • Multitarget Tracking
  • Probability
  • Signal Processing
  • Standards
  • Surveillance
  • Systems Engineering
  • Target Tracking
  • Test And Evaluation
  • Warfare

Fields of Study

  • Engineering

Readers

  • Computational Modeling and Simulation
  • Sensor Fusion and Tracking Systems.