Nonlinear Filtering in High Dimension

Abstract

The goal of filtering theory is to compute the filter distribution, that is, the conditional distribution of a stochastic model given observed data. While exact computations are rarely possible, sequential Monte Carlo algorithms known as particle filters have been successfully applied to approximate the filter distribution, providing estimates whose error is uniform in time. However, the number of Monte Carlo samples needed to approximate the filter distribution is typically exponential in the number of degrees of freedom of the model. This issue, known as curse of dimensionality, has rendered sequential Monte Carlo algorithms largely useless in high-dimensional applications such as multi-target tracking, weather prediction, and oceanography. While over the past twenty years many heuristics have been suggested to run particle filters in high dimension, no principled approach has ever been proposed to address the core of the problem. In this thesis we develop a novel framework to investigate high-dimensional filtering models and to design algorithms that can avoid the curse of dimensionality. Using concepts and tools from statistical mechanics, we show that the decay of correlations property of high-dimensional models can be exploited by implementing localization procedures on ordinary particle filters that can lead to estimates whose approximation error is uniform both in time and in the model dimension. Ergodic and spatial mixing properties of conditional distributions play a crucial role in the design of filtering algorithms, and they are of independent interest in probability theory. To better capture ergodicity quantitatively, we develop new com- parison theorems to establish dimension-free bounds on high-dimensional probability measures in terms of their local conditional distributions. At a qualitative level, we investigate previously unknown phenomena that can only arise from conditioning in infinite dimension.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 02, 2014
Accession Number
ADA623651

Entities

People

  • Patrick Rebeschini

Organizations

  • Princeton University

Tags

Communities of Interest

  • C4I

DTIC Thesaurus Topics

  • Computational Complexity
  • Computational Science
  • Differential Equations
  • Hidden Markov Models
  • Markov Chains
  • Markov Models
  • Markov Processes
  • Mathematical Filters
  • Mechanics
  • Monte Carlo Method
  • Partial Differential Equations
  • Probabilistic Models
  • Probability
  • Random Variables
  • Statistical Sampling
  • Two Dimensional
  • Weather Forecasting

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Mathematical Modeling and Probability Theory.
  • Regression Analysis.