Temporally coherent completion of dynamic video
Abstract
We present an automatic video completion algorithm that synthesizes missing regions in videos in a temporally coherent fashion. Our algorithm can handle dynamic scenes captured using a moving camera. State-of-the-art approaches have difficulties handling such videos because viewpoint changes cause image-space motion vectors in the missing and known regions to be inconsistent. We address this problem by jointly estimating optical flow and color in the missing regions. Using pixel-wise forward/backward flow fields enables us to synthesize temporally coherent colors. We formulate the problem as a non-parametric patch-based optimization. We demonstrate our technique on numerous challenging videos.
Document Details
- Document Type
- Pub Defense Publication
- Publication Date
- Nov 11, 2016
- Source ID
- 10.1145/2980179.2982398
Entities
People
- Jia-bin Huang
- Johannes Kopf
- Narendra Ahuja
- Sing Bing Kang
Organizations
- Microsoft
- Office of Naval Research
- University of Illinois Urbana–Champaign
- Virginia Tech