Time-Offset Conversations on a Life-Sized Automultiscopic Projector Array
Abstract
We present a system for creating and displaying interactive life-sized 3D digital humans based on pre-recorded interviews. We use 30 cameras and an extensive list of questions to record a large set of video responses. Users access videos through a natural conversation interface that mimics face-to-face interaction. Recordings of answers, listening and idle behaviors are linked together to create a persistent visual image of the person throughout the interaction .The interview subjects are rendered using flowed light fields and shown life-size on a special rear-projection screen with an array of 216 video projectors. The display allows multiple users to see different 3D perspectives of the subject in proper relation to their viewpoints, without the need forstereo glasses. The display is effective for interactive conversations since it provides 3D cues such as eye gaze and spatial hand gestures.
Document Details
- Document Type
- Technical Report
- Publication Date
- Jan 01, 2016
- Accession Number
- AD1159866
Entities
People
- Andrew K. Jones
- Hsuan-yueh Peng
- Jay Busch
- Joseph Barreto
- Koki Nagano
- Mark Bolas
- Oleg Alexander
- Paul Debevec
- Xueming Yu
Organizations
- University of Southern California