• About
  • Policies
  • What is openaccess
  • Library
  • Contact
Advanced search
      View Item 
      •   BUIR Home
      • Scholarly Publications
      • Faculty of Engineering
      • Department of Computer Engineering
      • View Item
      •   BUIR Home
      • Scholarly Publications
      • Faculty of Engineering
      • Department of Computer Engineering
      • View Item
      JavaScript is disabled for your browser. Some features of this site may not work without it.

      A parallel framework for in-memory construction of term-partitioned inverted indexes

      Thumbnail
      View / Download
      467.4 Kb
      Author
      Kucukyilmaz, T.
      Turk, A.
      Aykanat, Cevdet
      Date
      2012
      Source Title
      The Computer Journal
      Print ISSN
      0010-4620
      Publisher
      Oxford University Press
      Volume
      55
      Issue
      11
      Pages
      1317 - 1330
      Language
      English
      Type
      Article
      Item Usage Stats
      144
      views
      115
      downloads
      Abstract
      With the advances in cloud computing and huge RAMs provided by 64-bit architectures, it is possible to tackle large problems using memory-based solutions. Construction of term-based, partitioned, parallel inverted indexes is a communication intensive task and suitable for memory-based modeling. In this paper, we provide an efficient parallel framework for in-memory construction of term-based partitioned, inverted indexes. We show that, by utilizing an efficient bucketing scheme, we can eliminate the need for the generation of a global vocabulary. We propose and investigate assignment schemes that can reduce the communication overheads while minimizing the storage and final query processing imbalance. We also present a study on how communication among processors should be carried out with limited communication memory in order to reduce the total inversion time. We present several different communication-memory organizations and discuss their advantages and shortcomings. The conducted experiments indicate promising results. © 2012 The Author. Published by Oxford University Press on behalf of The British Computer Society.
      Keywords
      Index inversion
      Memory - based inversion
      Parallel inversion
      Term - based partitioning
      Permalink
      http://hdl.handle.net/11693/21282
      Published Version (Please cite this version)
      http://dx.doi.org/10.1093/comjnl/bxr133
      Collections
      • Department of Computer Engineering 1398
      Show full item record

      Browse

      All of BUIRCommunities & CollectionsTitlesAuthorsAdvisorsBy Issue DateKeywordsTypeDepartmentsThis CollectionTitlesAuthorsAdvisorsBy Issue DateKeywordsTypeDepartments

      My Account

      Login

      Statistics

      View Usage StatisticsView Google Analytics Statistics

      Bilkent University

      If you have trouble accessing this page and need to request an alternate format, contact the site administrator. Phone: (312) 290 1771
      Copyright © Bilkent University - Library IT

      Contact Us | Send Feedback | Off-Campus Access | Admin | Privacy