• About
  • Policies
  • What is open access
  • Library
  • Contact
Advanced search
      View Item 
      •   BUIR Home
      • Scholarly Publications
      • Faculty of Engineering
      • Department of Computer Engineering
      • View Item
      •   BUIR Home
      • Scholarly Publications
      • Faculty of Engineering
      • Department of Computer Engineering
      • View Item
      JavaScript is disabled for your browser. Some features of this site may not work without it.

      Automatic performance evaluation of Web search engines

      Thumbnail
      View / Download
      630.5 Kb
      Author(s)
      Can, F.
      Nuray, R.
      Sevdik, A. B.
      Date
      2004
      Source Title
      Information Processing and Management
      Print ISSN
      0306-4573
       
      1873-5371
       
      Publisher
      Elsevier
      Volume
      40
      Issue
      3
      Pages
      495 - 514
      Language
      English
      Type
      Article
      Item Usage Stats
      214
      views
      471
      downloads
      Abstract
      Measuring the information retrieval effectiveness of World Wide Web search engines is costly because of human relevance judgments involved. However, both for business enterprises and people it is important to know the most effective Web search engines, since such search engines help their users find higher number of relevant Web pages with less effort. Furthermore, this information can be used for several practical purposes. In this study we introduce automatic Web search engine evaluation method as an efficient and effective assessment tool of such systems. The experiments based on eight Web search engines, 25 queries, and binary user relevance judgments show that our method provides results consistent with human-based evaluations. It is shown that the observed consistencies are statistically significant. This indicates that the new method can be successfully used in the evaluation of Web search engines. © 2003 Elsevier Ltd. All rights reserved.
      Keywords
      Information retrieval
      Performance
      Search engine
      World Wide Web
      Algorithms
      Data processing
      Database systems
      Indexing (of information)
      Metadata
      Parameter estimation
      Search engines
      Statistics
      World Wide Web
      Automatic performance evaluation
      Human-based evaluations
      Query response time
      Information retrieval
      Permalink
      http://hdl.handle.net/11693/24289
      Published Version (Please cite this version)
      http://dx.doi.org/10.1016/S0306-4573(03)00040-2
      Collections
      • Department of Computer Engineering 1561
      Show full item record

      Browse

      All of BUIRCommunities & CollectionsTitlesAuthorsAdvisorsBy Issue DateKeywordsTypeDepartmentsCoursesThis CollectionTitlesAuthorsAdvisorsBy Issue DateKeywordsTypeDepartmentsCourses

      My Account

      Login

      Statistics

      View Usage StatisticsView Google Analytics Statistics

      Bilkent University

      If you have trouble accessing this page and need to request an alternate format, contact the User and Access Services. Phone: (312) 290 1298
      © Bilkent University - Library IT

      Contact Us | Send Feedback | Off-Campus Access | Admin | Privacy