|
|
|
 |
Search published articles |
 |
|
Showing 4 results for Evaluation
Masoumeh Ahmadi Shirazi,
Volume 16, Issue 1 (3-2013)
Abstract
The present study reports the processes of development and use of an Analytic Dichotomous Evaluation Checklist (ADEC) which aims at enhancing both inter- and intra-rater reliability of writing evaluation. The ADEC consists of a total of 68 items that comprises five subscales of content, organization, grammar, vocabulary, and mechanics. Eight raters assessed the writing performance of 20 Iranian EFL students using the ADEC. Also, the raters were asked to rate the same sample of essays holistically based on Test of Written English (TWE) scale. To examine the inter-rater and intra-rater reliability of the ADEC, multiple approaches were employed including correlation coefficient, the dichotomous Rasch Model, and many-faceted Rasch measurement (MFRM). The findings of the study confirmed that the ADEC introduces higher reliability into scoring procedure compared with holistic scoring. Future research with greater number of raters and examinees may provide robust evidence to use analytic scale rather than holistic one.
Gholam Reza Kiany, Monireh Norouzi,
Volume 19, Issue 2 (9-2016)
Abstract
Performance assessment is exceedingly considered a key concept in teacher education programs worldwide. Accordingly, in Iran, a national assessment system was proposed by Farhangian University to assess the professional competencies of its ELT graduates. The concerns regarding the validity and authenticity of traditional measures of teachers' competencies have motivated us to devise a localized performance assessment scheme. Therefore, the present study aimed to develop a performance assessment scheme to be used as a benchmark for assessing the professional competencies of ELT graduates of this university. To this end, three assessment tasks and rating scales were developed, piloted, and administered. Next, Haertel's participatory approach was employed to set passing standards for the assessment tasks as well as the whole assessment scheme. Analysis of the data revealed inter-rater and intra-rater reliability coefficients of 0.85 and 0.89. The validity of the assessment scheme was also confirmed by experts' judgments made, to a large extent, on the correspondence between the target domain and test domain skills. Based on the results, the proposed assessment scheme is rendered more efficient and reliable in comparison to traditional tests with regard to the following dimensions: a) higher degrees of reliability and validity of the assessment scheme aimed at the improvement of licensure and program development; b) stronger evidence for inter-/intra- rater reliability and consistency of scoring; and c) an optimized and systematic procedure for setting passing standards based on the consensus of experts' judgments. It is believed that further development of the proposed assessment scheme unlocks its potential to be used as a large-scale teacher assessment model for Farhangian University.
Zahra Masoumpanah, Mohammad Hassan Tahririan, Ahmad Alibabaee, Katayoon Afzali,
Volume 20, Issue 2 (9-2017)
Abstract
| This study was an attempt to evaluate the undergraduate TEFL program at Farhangian University. The university specializes in educating prospective teachers and the program is important since it is expected to equip the student teachers with the knowledge and skills necessary for qualified teachers. Hence, in this study, measures were taken to investigate the merits and demerits of the implemented TEFL program and explore the domains in which the program needs to be improved. The study assessed the program from the perspectives of 220 student teachers, 32 teacher educators, and 12 heads of departments and experts including the university deans, deputies, and research and teaching staff, through using three instruments, i.e. questionnaires, interviews, and observations in a mixed methods design .The findings indicated that the TEFL program did not address some educational and administrative needs as the participants believed that they were not enriched with the necessary skills, the practice of the learned theories, problem solving, critical thinking, flexibility, and innovation. Furthermore, this study demonstrated several theory- practice gaps in the curriculum. |
Mohammad Ghasemi Bagherabadi, Golnar Mazdayasna,
Volume 24, Issue 1 (3-2021)
Abstract
Teaching English as a second or foreign language has internationally turned into a determiner of success for societies. Thus, the demand has risen for changes in English Language Teaching (ELT) curricula in different contexts. In response to the growing globalization and the dissatisfaction of many Iranian ELT stakeholders with the former program in lower and upper high-school levels, the Ministry of Education, in 2010, initiated the renovation of national policy documents, coursebooks, and the introduction of Communicative Language Teaching (CLT) orientations. The present study is part of a larger project that aims to qualitatively scrutinize the implementational complexities of the new program using a systematic language-in-education planning (LEP) framework. In this respect, 30 experienced headteachers' perspectives and voices from several provinces were explored through open-ended semi-structured interviews designed based on the analysis of school-based documents and observations of ELT goings-on in state schools. Interviews were then transcribed and the content was analyzed to identify the recurring themes. Key findings indicated that the new received program suffers from drawbacks like underbudgeting, students’ unequal access to quality ELT, the shortage of prepared teachers, etc. We further found that the program still requires dedicated support of the macro- meso- and micro-level agents at the national scale. Correspondingly, implications for revisions and suggestions for future research are offered.
|
|
