Static index pruning in web search engines: combining term and document popularities with query views

Date
2012
Authors
Altingovde, I. S.
Ozcan, R.
Ulusoy, O.
Editor(s)
Advisor
Supervisor
Co-Advisor
Co-Supervisor
Instructor
Source Title
ACM Transactions on Information Systems
Print ISSN
1046-8188
Electronic ISSN
Publisher
Association for Computing Machinery
Volume
30
Issue
1
Pages
2-1 - 2-28
Language
English
Journal Title
Journal ISSN
Volume Title
Series
Abstract

Static index pruning techniques permanently remove a presumably redundant part of an inverted file, to reduce the file size and query processing time. These techniques differ in deciding which parts of an index can be removed safely; that is, without changing the top-ranked query results. As defined in the literature, the query view of a document is the set of query terms that access to this particular document, that is, retrieves this document among its top results. In this paper, we first propose using query views to improve the quality of the top results compared against the original results. We incorporate query views in a number of static pruning strategies, namely term-centric, document-centric, term popularity based and document access popularity based approaches, and show that the new strategies considerably outperform their counterparts especially for the higher levels of pruning and for both disjunctive and conjunctive query processing. Additionally,we combine the notions of term and document access popularity to form new pruning strategies, and further extend these strategies with the query views. The new strategies improve the result quality especially for the conjunctive query processing, which is the default and most common search mode of a search engine. © 2012 ACM.

Course
Other identifiers
Book Title
Citation
Published Version (Please cite this version)