Perceptually-Enabled Task Guidance (PTG)
Abstract
The Perceptually-Enabled Task Guidance (PTG) program is developing artificial intelligence (AI) technology that guides users in the performance of a wide range of cognitively challenging physical tasks. PTG leverages recent advances in machine perception, automated reasoning, and augmented reality. The program connects perception to reasoning and reasoning to augmented reality (AR) so as to create personalized, real-time feedback and contextualized assistance. To connect perception and reasoning, PTG develops AI technologies for (1) perceptual grounding, to create a shared vocabulary for perception and reasoning, and (2) perceptual attention, to select important information from large volumes of perceptual data. To connect reasoning with AR, PTG develops AI technologies for (3) knowledge transfer, to derive task models from instructions intended for humans, and (4) user modeling, to determine if, when, and how to best convey task information to the user. Together, PTG technologies will lay the foundation for perceptually-enabled guidance and a qualitatively new type of AI device that enables mechanics, medics, and other military specialists to perform physical tasks within and beyond their skillsets with greater accuracy and efficiency.
Document Details
- Document Type
- Accomplishment
- Publication Date
- Oct 01, 2024
- Source ID
- 613b3f50e5f9b102754d339ebe880bb7