Mirror mirror
Abstract
We describe a method for providing feedback on portrait expressions, and for selecting the most attractive expressions from large video/photo collections. We capture a video of a subject's face while they are engaged in a task designed to elicit a range of positive emotions. We then use crowdsourcing to score the captured expressions for their attractiveness. We use these scores to train a model that can automatically predict attractiveness of different expressions of a given person. We also train a cross-subject model that evaluates portrait attractiveness of novel subjects and show how it can be used to automatically mine attractive photos from personal photo collections. Furthermore, we show how, with a little bit ($5-worth) of extra crowdsourcing, we can substantially improve the cross-subject model by "fine-tuning" it to a new individual using active learning. Finally, we demonstrate a training app that helps people learn how to mimic their best expressions.
Document Details
- Document Type
- Pub Defense Publication
- Publication Date
- Nov 19, 2014
- Source ID
- 10.1145/2661229.2661287
Entities
People
- Alexei A. Efros
- Aseem Agarwala
- Eli Shechtman
- Jue Wang
- Jun-yan Zhu
Organizations
- Adobe
- Office of Naval Research
- University of California, Berkeley