Constrained Local Neural Fields for Robust Facial Landmark Detection in the Wild

Abstract

Facial feature detection algorithms have seen great progress over the recent years. However, they still struggle in poor lighting conditions and in the presence of extreme pose or occlusions. We present the Constrained Local Neural Field model for facial landmark detection. Our model includes two main novelties. First, we introduce a probabilistic patch expert (landmark detector) that can learn non-linear and spatial relationships between the input pixels and the probability of a landmark being aligned. Secondly, our model is optimised using a novel Non-uniform Regularised Landmark Mean-Shift optimisation technique, which takes into account the reliabilities of each patch expert. We demonstrate the benefit of our approach on a number of publicly available datasets over other state-of-the-art approaches when performing landmark detection in unseen lighting conditions and in the wild.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Dec 02, 2013
Accession Number
AD1158305

Entities

People

  • Louis-Philippe Morency
  • Peter Robinson
  • Tadas Baltrusaitis

Organizations

  • University of Southern California

Tags

DTIC Thesaurus Topics

  • Algorithms
  • Computations
  • Detection
  • Detectors
  • Errors
  • European Communities
  • Generative Models
  • Illumination
  • Models
  • Neural Networks
  • Orientation (Direction)
  • Probability
  • Probability Distributions
  • Recognition
  • Reliability
  • Test Sets
  • Training

Fields of Study

  • Computer science

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Computer Vision.