• About
  • Policies
  • What is open access
  • Library
  • Contact
Advanced search
      View Item 
      •   BUIR Home
      • Scholarly Publications
      • Faculty of Economics, Administrative And Social Sciences
      • Department of Economics
      • View Item
      •   BUIR Home
      • Scholarly Publications
      • Faculty of Economics, Administrative And Social Sciences
      • Department of Economics
      • View Item
      JavaScript is disabled for your browser. Some features of this site may not work without it.

      Taking PISA seriously: how accurate are low-stakes exams?

      Thumbnail
      View / Download
      3.4 Mb
      Author(s)
      Akyol, Pelin
      Krishna, K.
      Wang, J.
      Date
      2021-06
      Source Title
      Journal of Labor Research
      Print ISSN
      0195-3613
      Electronic ISSN
      1936-4768
      Publisher
      Springer
      Volume
      42
      Pages
      184 - 243
      Language
      English
      Type
      Article
      Item Usage Stats
      38
      views
      102
      downloads
      Abstract
      PISA is seen as the gold standard for evaluating educational outcomes worldwide. Yet, being a low-stakes exam, students may not take it seriously resulting in downward biased scores and inaccurate rankings. This paper provides a method to identify and account for non-serious behavior in low-stakes exams by leveraging information in computer-based assessments in PISA 2015. Our method corrects for non-serious behavior by fully imputing scores for items not taken seriously. We compare the scores/rankings calculated by our method to the scores/rankings calculated by giving zero points to skipped items as well as to the scores/rankings calculated by treating skipped items at the end of the exam as if they were not administered, which is the procedure followed by PISA. We show that a country can improve its ranking by up to 15 places by encouraging its own students to take the exam seriously and that the PISA approach corrects for only about half of the bias generated by the non-seriousness.
      Keywords
      Low-stakes exams
      Computer-based assessments
      PISA
      Biased rankings
      Item response data
      Permalink
      http://hdl.handle.net/11693/77373
      Published Version (Please cite this version)
      https://doi.org/10.1007/s12122-021-09317-8
      Collections
      • Department of Economics 724
      Show full item record

      Browse

      All of BUIRCommunities & CollectionsTitlesAuthorsAdvisorsBy Issue DateKeywordsTypeDepartmentsCoursesThis CollectionTitlesAuthorsAdvisorsBy Issue DateKeywordsTypeDepartmentsCourses

      My Account

      Login

      Statistics

      View Usage StatisticsView Google Analytics Statistics

      Bilkent University

      If you have trouble accessing this page and need to request an alternate format, contact the site administrator. Phone: (312) 290 2976
      © Bilkent University - Library IT

      Contact Us | Send Feedback | Off-Campus Access | Admin | Privacy