Perceptually-Enabled Task Guidance (PTG)*
Abstract
*Formerly Application-Tailored Artificial Intelligence (APTAI) The Perceptually-Enabled Task Guidance (PTG) program will develop artificial intelligence (AI) technology that guides users in the performance of a wide range of cognitively challenging physical tasks. PTG will leverage recent advances in machine perception, automated reasoning, and augmented reality. The program will connect perception to reasoning and reasoning to augmented reality (AR) so as to create personalized, real-time feedback and contextualized assistance. To connect perception and reasoning, PTG will develop AI technologies for (1) perceptual grounding, to create a shared vocabulary for perception and reasoning, and (2) perceptual attention, to select important information from large volumes of perceptual data. To connect reasoning with AR, PTG will develop AI technologies for (3) knowledge transfer, to derive task models from instructions intended for humans, and (4) user modeling, to determine if, when, and how to best convey task information to the user. Together, the PTG technologies will lay the foundation for perceptually-enabled guidance and a qualitatively new type of AI device that would enable mechanics, medics, and other specialists to perform tasks within and beyond their skillsets with greater accuracy and efficiency.
Document Details
- Document Type
- Accomplishment
- Publication Date
- Oct 01, 2022
- Source ID
- e69b354b8a85d5c9da1a6924afb9f422