Finding Tiny Faces

Abstract

Though tremendous strides have been made in object recognition, one of the remaining open challenges is detecting small objects. We explore three aspects of the problem in the context of finding small faces: the role of scale invariance, image resolution, and contextual reasoning. While most recognition approaches aim to be scale-invariant, the cues for recognizing a 3px tall face are fundamentally different than those for recognizing a 300px tall face. We take a different approach and train separate detectors for different scales. To maintain efficiency, detectors are trained in a multi-task fashion: they make use of features extracted from multiple layers of single (deep) feature hierarchy. While training detectors for large objects is straightforward, the crucial challenge remains training detectors for small objects. We show that context is crucial, and define templates that make use of massively-large receptive fields (where 99 of the template extends beyond the object of interest). Finally, we explore the role of scale in pre-trained deep networks, providing ways to extrapolate networks tuned for limited scales to rather extreme ranges. We demonstrate state-of-the-art results on massively-benchmarked face datasets (FDDB and WIDER FACE). In particular, when compared to prior art on WIDER FACE, our results reduce error by a factor of 2 (our models produce an AP of 81 while prior art ranges from 29-64 ).

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 21, 2017
Accession Number
AD1155434

Entities

People

  • Deva Ramanan
  • Peiyun Hu

Organizations

  • Carnegie Mellon University Robotics Institute

Tags

Communities of Interest

  • Sensors

DTIC Thesaurus Topics

  • Accuracy
  • Artificial Intelligence Software
  • Cognitive Science
  • Computer Vision
  • Computers
  • Detection
  • Detectors
  • High Resolution
  • Image Recognition
  • Information Processing
  • Information Science
  • Information Systems
  • Low Resolution
  • Neural Networks
  • Object Recognition
  • Pattern Recognition
  • Recognition

Fields of Study

  • Computer science

Readers

  • Neural Network Machine Learning.
  • Systems Analysis and Design
  • Vision Science/Vision Psychology/Cognitive Neuroscience.

Technology Areas

  • AI & ML
  • AI & ML - Neural Networks