Timestamp-based result cache invalidation for web search engines

Date
2011
Advisor
Supervisor
Co-Advisor
Co-Supervisor
Instructor
Source Title
SIGIR'11 - Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval
Print ISSN
Electronic ISSN
Publisher
ACM
Volume
Issue
Pages
973 - 982
Language
English
Type
Conference Paper
Journal Title
Journal ISSN
Volume Title
Series
Abstract

The result cache is a vital component for efficiency of large-scale web search engines, and maintaining the freshness of cached query results is the current research challenge. As a remedy to this problem, our work proposes a new mechanism to identify queries whose cached results are stale. The basic idea behind our mechanism is to maintain and compare generation time of query results with update times of posting lists and documents to decide on staleness of query results. The proposed technique is evaluated using a Wikipedia document collection with real update information and a real-life query log. We show that our technique has good prediction accuracy, relative to a baseline based on the time-to-live mechanism. Moreover, it is easy to implement and incurs less processing overhead on the system relative to a recently proposed, more sophisticated invalidation mechanism.

Course
Other identifiers
Book Title
Keywords
Cache invalidation, Freshness, Result cache, Web search, Cache invalidation, Document collection, Freshness, Generation time, Invalidation mechanism, New mechanisms, Prediction accuracy, Processing overhead, Query logs, Query results, Research challenges, Result cache, Time-to-live, Web searches, Wikipedia, Research, Search engines, User interfaces, Websites, Information retrieval
Citation
Published Version (Please cite this version)