Communication through Gestures, Expression and Shared Perception
Abstract
The goals or DARPA Communicating with Computers program arc to advance the state or the art in lellt and video analylics lo the extent that the machine and the human operator have the same mental model. This requires that the mochine be able to understand the human intent. and that con explain back, to the human, in ways that makes use or the context and prior knowledge. Three challenge problems were chosen: Block world, Bio curation end Story generation. Furthermore, an Offeror could choose to address live different task areas: TA1 - apparatus for the block world, TA2 - Elementary Composnble Ideas, TA3 - Composition or Ideas thnl takes context into account. T A4- Whnt to say or Do nnd TAS - Eveluntion. The Offeror s tnsk is to nddrcss T Al. The proposed work will address recognition of gestures and fnciol expressions us the main form or communication. During the first two phases of the project, the Offeror proposes to build a system in which users nnd computers cooperate to accomplish tasks in 1he blocks world domain. The results will be used to build Elementary Composable Ideas (ECls) ns trajectories in pose space ei1prcsscd as sequences or generalized Frcnct-Scrret frames. During the third phnse of the project, the Offerer will combine their ECls with !hose of others, especially those that process language well, to crcnte an entire set of ECfs usable by other tusk area participants. Finally, validation will be driven by program wide evaluntions (as conducted by TAS participant).
Document Details
- Document Type
- DoD Grant Award
- Publication Date
- Jan 12, 2017
- Source ID
- W911NF1510459
Entities
People
- Bruce A. Draper
Organizations
- Army Contracting Command
- Colorado State University
- Defense Advanced Research Projects Agency