Browsing by Author "Kalender, İlker"

Now showing 1 - 8 of 8

Open Access
An Analysis of the Resilient Students' Profile based on PISA 2012
(Eğitimde ve Psikolojide Ölçme ve Değerlendirme Derneği, 2015) Kalender, İlker
The present study sought to define resilient students' profile in comparison with low achieving/low SES students. To this end, several school- and teacher-related variables, taken from PISA 2012 student questionnaire, that were considered to be influential on students' reading literacy were examined. A total number of 28 items from 5 dimensions were selected. They are: Student-Teacher Relations (5 items), Sense of Belonging (9 items), Attitude towards Learning at School (4 items), Attitude toward School (4 items), and Perceived Control (6 items). Using binary logistic regression, significant variables were defined explaining literacy differences between two groups of students. Then, profile of resilient students was defined. Results indicated that resilient students had more positive attitudes towards school and teachers compared with low achievers. The findings of the present may provide significant information as to increase rate of resilient students.
Open Access
Computerized adaptive testing for student selection to higher education
(Deomed, 2012) Kalender, İlker
The purpose of the present study is to discuss applicability of computerized adaptive testing format as an alternative for current student selection examinations to higher education in Turkey. In the study, first problems associated with current student selection system are given. These problems exerts pressure on students that results in test anxiety, produce measurement experiences that can be criticized, and lessen credibility of student selection system. Next, computerized adaptive test are introduced and advantages they provide are presented. Then results of a study that used two research designs (simulation and live testing) were presented. Results revealed that (i) computerized adaptive format provided a reduction up to 80% in the number of items given to students compared to paper and pencil format of student selection examination, (ii) ability estimations have high reliabilities. Correlations between ability estimations obtained from simulation and traditional format were higher than 0.80. At the end of the study solutions provided by computerized adaptive testing implementation to the current problems were discussed. Also some issues for application of CAT format for student selection examinations in Turkey are given.
Open Access
Contaminating factors in university students' evaluation of instructors
(Turk Egitim Dernegi, 2011) Kalender, İlker
The present study seeks to determine the variables explaining differences between the scores of student ratings given to instructors within the context of the university through discriminant analysis. Ratings given by students were grouped into two groups based on their means and instructors were labeled as low-rated and high-rated. Predictors identified by discriminant analysis are (i) class size, (ii) credit, (iii) grade level, (iv) mean grade, and (v) number of sections. Results of the study suggested that low rated instructors are those who teach courses with smaller number of students, lower credits, higher grade levels, higher mean grades, and one section. Identification of source of differences between ratings may provide invaluable information for those who are interested in assessment of instructional effectiveness.
Open Access
IRT-based classification analysis of an english language reading proficiency subtest
(SAGE, 2022) Kaya, Elif; O’Grady, Stefan; Kalender, İlker
Language proficiency testing serves an important function of classifying examinees into different categories of ability. However, misclassification is to some extent inevitable and may have important consequences for stakeholders. Recent research suggests that classification efficacy may be enhanced substantially using computerized adaptive testing (CAT). Using real data simulations, the current study investigated the classification performance of CAT on the reading section of an English language proficiency test and made comparisons with the paper based version of the same test. Classification analysis was carried out to estimate classification accuracy (CA) and classification consistency (CC) by applying different locations and numbers of cutoff points. The results showed that classification was suitable when a single cutoff score was used, particularly for high- and low-ability test takers. Classification performance declined significantly when multiple cutoff points were simultaneously employed. Content analysis also raised important questions about construct coverage in CAT. The results highlight the potential for CAT to serve classification purposes and outline avenues for further research.
Open Access
The measurement invariance of university students’ ratings of instruction
(Hacettepe University, 2019) Kalender, İlker; Berberoğlu, G.
The invariance in the scores of student rating of instruction was studied across high and low achieving classrooms. Achievement levels were determined by the two criteria such as self-reported expected grades and end of semester grades. The data included 625 classrooms. The equality of (i) factorial structure, (ii) factor loadings, (iii) item intercepts, and (iv) error variances of the 7 item rating scale were studied across these groups. With respect to self-reported expected grades, high and low achieving classes produced invariant scale characteristics except strict invariance. On the other hand, with respect to end of semester grades, full equality in item intercepts and error variances were not achieved. It seems that comparing the rating results across the classrooms and courses independent of the achievement levels of the students may be misleading especially for the high-stake decisions since the origin of the scale is not the same across high and low achieving groups.
Open Access
Profiling instructional effectiveness to reveal its relationship to learning
(Springer, 2014) Kalender, İlker
The purpose of the present study is to define instructional profiles and investigate the relationship between these profiles and learning indicators such as end-of-semester grades and self-reported amount of learning. Instructional profiles were obtained using a segmentation method. Student ratings were used as indicators of instructional effectiveness. Results revealed that instructors who receive higher scores from students seem to be effective instructors in learning. However, instructors with high ratings from students did not receive high scores for all measures of instructional effectiveness. Effective instructors seem to have varying scores due to the imperfect relationship between instructional effectiveness and learning. It can be concluded that the definition of an effective instructor can vary across subgroups. For an instructor to be defined as effective, it is not necessary for them to receive higher scores for all measures. Low-rated aspects of effectiveness can be compensated for by showing high performance in other areas. Based on the results of the present study, instructional profiles or any other related traits should be investigated under subgroups that show differences.
Open Access
Simulate_CAT: a computer program for post-hoc simulation for computerized adaptive testing
(Eğitimde ve Psikolojide Ölçme ve Değerlendirme Derneği, 2015) Kalender, İlker
This paper presents a computer software developed by the author. The software conducts post-hoc simulations for computerized adaptive testing based on real responses of examinees to paper and pencil tests under different parameters that can be defined by user. In this paper, short information is given about post-hoc simulations. After that, the working principle of the software is provided and a sample simulation with required input files is shown. And last, output files are described.
Open Access
Study efforts, learning strategies and test anxiety when striving for language competence: the role of utility value, self-efficacy, and reasons for learning English
(Routledge, 2020) Üner, Ayça; Mouratidis, Athanasios; Kalender, İlker
Previous research has shown that utility value and expectancy for success, as well as the reasons for academic striving, could partly explain academic engagement. Yet, their joint role in predicting learning strategies and test anxiety has not been thoroughly understood, especially in contexts where pressure for success is high. We examined this issue in a sample of Turkish university students who were attending a language preparatory school (N = 1009; 53% males, Mage = 19.14 years; SD = 1.08) and were under the psychological pressure to pass their qualifying exams. Regression analyses showed that next to self-efficacy beliefs, it was intrinsic reasons which positively and consistently predicted learning strategies; in contrast, self-worth concerns positively predicted test anxiety. These relations emerged even among students who experienced failure and were thus psychologically pressed to succeed. Our findings suggest that intrinsic reasons for academic striving might play a decisive role even in psychologically pressuring contexts.