Memory resident parallel inverted index construction

Date
2012
Advisor
Supervisor
Co-Advisor
Co-Supervisor
Instructor
Source Title
Computer and Information Sciences II
Print ISSN
Electronic ISSN
Publisher
Springer, London
Volume
Issue
Pages
99 - 105
Language
English
Type
Conference Paper
Journal Title
Journal ISSN
Volume Title
Series
Abstract

Advances in cloud computing, 64-bit architectures and huge RAMs enable performing many search related tasks in memory.We argue that term-based partitioned parallel inverted index construction is among such tasks, and provide an efficient parallel framework that achieves this task. We show that by utilizing an efficient bucketing scheme we can eliminate the need for the generation of a global index and reduce the communication overhead without disturbing balancing constraint. We also propose and investigate assignment schemes that can further reduce communication overheads without disturbing balancing constraints. The conducted experiments indicate promising results. © 2012 Springer-Verlag London Limited.

Course
Other identifiers
Book Title
Keywords
64-bit architectures, Communication overheads, Global index, Inverted indices, Memory-resident, Parallel framework, Communication, Information science, Random access storage, Cost reduction
Citation