Taking PISA seriously: how accurate are low-stakes exams?

Simple item page
buir.contributor.authorAkyol, Pelin
buir.contributor.orcidAkyol, Pelin|0000-0002-1017-8844
dc.citation.epage243en_US
dc.citation.spage184en_US
dc.citation.volumeNumber42en_US
dc.contributor.authorAkyol, Pelin
dc.contributor.authorKrishna, K.
dc.contributor.authorWang, J.
dc.date.accessioned2022-02-15T10:52:11Z
dc.date.available2022-02-15T10:52:11Z
dc.date.issued2021-06
dc.departmentDepartment of Economicsen_US
dc.description.abstractPISA is seen as the gold standard for evaluating educational outcomes worldwide. Yet, being a low-stakes exam, students may not take it seriously resulting in downward biased scores and inaccurate rankings. This paper provides a method to identify and account for non-serious behavior in low-stakes exams by leveraging information in computer-based assessments in PISA 2015. Our method corrects for non-serious behavior by fully imputing scores for items not taken seriously. We compare the scores/rankings calculated by our method to the scores/rankings calculated by giving zero points to skipped items as well as to the scores/rankings calculated by treating skipped items at the end of the exam as if they were not administered, which is the procedure followed by PISA. We show that a country can improve its ranking by up to 15 places by encouraging its own students to take the exam seriously and that the PISA approach corrects for only about half of the bias generated by the non-seriousness.en_US
dc.identifier.doi10.1007/s12122-021-09317-8en_US
dc.identifier.eissn1936-4768
dc.identifier.issn0195-3613
dc.identifier.urihttp://hdl.handle.net/11693/77373
dc.language.isoEnglishen_US
dc.publisherSpringeren_US
dc.relation.isversionofhttps://doi.org/10.1007/s12122-021-09317-8en_US
dc.source.titleJournal of Labor Researchen_US
dc.subjectLow-stakes examsen_US
dc.subjectComputer-based assessmentsen_US
dc.subjectPISAen_US
dc.subjectBiased rankingsen_US
dc.subjectItem response dataen_US
dc.titleTaking PISA seriously: how accurate are low-stakes exams?en_US
dc.typeArticleen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Taking_PISA_seriously_how_accurate_are_low-stakes_exams.pdf
Size:
3.41 MB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.69 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Department of Economics