Improving Web search using image snippets
Abstract
The Web has become the largest information repository in the world; thus, effectively and efficiently searching the Web becomes a key challenge. Interactive Web search divides the search process into several rounds, and for each round the search engine interacts with the user for more knowledge of the user's information requirement. Previous research mainly uses the text information on Web pages, while little attention is paid to other modalities. This article shows that Web search performance can be significantly improved if imagery is considered in interactive Web search. Compared with text, imagery has its own advantage: the time for “reading” an image is as little as that for reading one or two words, while the information brought by an image is as much as that conveyed by a whole passage of text. In order to exploit the advantages of imagery, a novel interactive Web search framework is proposed, where image snippets are first extracted from Web pages and then provided, along with the text snippets, to the user for result presentation and relevance feedback, as well as being presented alone to the user for image suggestion. User studies show that it is more convenient for the user to identify the Web pages he or she expects and to reformulate the initial query. Further experiments demonstrate the promise of introducing multimodal techniques into the proposed interactive Web search framework.
Document Details
- Document Type
- Pub Defense Publication
- Publication Date
- Sep 01, 2008
- Source ID
- 10.1145/1391949.1391955
Entities
People
- Xiao-bing Xue
- Zhi-hua Zhou
- Zhongfei (mark) Zhang
Organizations
- Air Force Office of Scientific Research
- Air Force Research Laboratory
- Binghamton University
- Division of Information and Intelligent Systems
- Foundation for the Author of National Excellent Doctoral Dissertation of the People's Republic of China
- Nanjing University
- National Natural Science Foundation of China
- Natural Science Foundation of Jiangsu Province