Hit or miss? Test taking behavior in multiple choice exams

Date
2022-09
Advisor
Instructor
Source Title
Annals of Economics and Statistics
Print ISSN
Electronic ISSN
1968-3863
Publisher
Groupe des Ecoles Nationales d'Economie et Statistique (GENES)
Volume
Issue
147
Pages
3 - 50
Language
English
Type
Article
Journal Title
Journal ISSN
Volume Title
Abstract

This paper is the first to structurally model how a test taker answers questions in a multiple choice exam. We allow for the possibility of a penalty for a wrong answer which makes risk averse examinees more likely to skip questions. Despite the lack of item response data, we can estimate the model by using the insight that skipping behavior, together with penalties for wrong answers, makes certain scores much more likely than others. Using data from the Turkish University Entrance Exam, we estimate the model and find that candidates’ attitudes towards risk differ according to their gender and ability with females and those with high ability being significantly more risk-averse. However, the impact of differences in risk aversion on scores is small. As a result, a higher guessing penalty increases the precision of the exam, and does so with a minimal impact on gender bias.

Course
Other identifiers
Book Title
Keywords
Multiple-choice exams, Guessing penalty, Risk aversion
Citation
Published Version (Please cite this version)