|
|
|
 |
Search published articles |
 |
|
Showing 6 results for Evaluation
Masoumeh Ahmadi Shirazi,
Volume 16, Issue 1 (3-2013)
Abstract
The present study reports the processes of development and use of an Analytic Dichotomous Evaluation Checklist (ADEC) which aims at enhancing both inter- and intra-rater reliability of writing evaluation. The ADEC consists of a total of 68 items that comprises five subscales of content, organization, grammar, vocabulary, and mechanics. Eight raters assessed the writing performance of 20 Iranian EFL students using the ADEC. Also, the raters were asked to rate the same sample of essays holistically based on Test of Written English (TWE) scale. To examine the inter-rater and intra-rater reliability of the ADEC, multiple approaches were employed including correlation coefficient, the dichotomous Rasch Model, and many-faceted Rasch measurement (MFRM). The findings of the study confirmed that the ADEC introduces higher reliability into scoring procedure compared with holistic scoring. Future research with greater number of raters and examinees may provide robust evidence to use analytic scale rather than holistic one.
Gholam Reza Kiany, Monireh Norouzi,
Volume 19, Issue 2 (9-2016)
Abstract
Performance assessment is exceedingly considered a key concept in teacher education programs worldwide. Accordingly, in Iran, a national assessment system was proposed by Farhangian University to assess the professional competencies of its ELT graduates. The concerns regarding the validity and authenticity of traditional measures of teachers' competencies have motivated us to devise a localized performance assessment scheme. Therefore, the present study aimed to develop a performance assessment scheme to be used as a benchmark for assessing the professional competencies of ELT graduates of this university. To this end, three assessment tasks and rating scales were developed, piloted, and administered. Next, Haertel's participatory approach was employed to set passing standards for the assessment tasks as well as the whole assessment scheme. Analysis of the data revealed inter-rater and intra-rater reliability coefficients of 0.85 and 0.89. The validity of the assessment scheme was also confirmed by experts' judgments made, to a large extent, on the correspondence between the target domain and test domain skills. Based on the results, the proposed assessment scheme is rendered more efficient and reliable in comparison to traditional tests with regard to the following dimensions: a) higher degrees of reliability and validity of the assessment scheme aimed at the improvement of licensure and program development; b) stronger evidence for inter-/intra- rater reliability and consistency of scoring; and c) an optimized and systematic procedure for setting passing standards based on the consensus of experts' judgments. It is believed that further development of the proposed assessment scheme unlocks its potential to be used as a large-scale teacher assessment model for Farhangian University.
Zahra Masoumpanah, Mohammad Hassan Tahririan, Ahmad Alibabaee, Katayoon Afzali,
Volume 20, Issue 2 (9-2017)
Abstract
| This study was an attempt to evaluate the undergraduate TEFL program at Farhangian University. The university specializes in educating prospective teachers and the program is important since it is expected to equip the student teachers with the knowledge and skills necessary for qualified teachers. Hence, in this study, measures were taken to investigate the merits and demerits of the implemented TEFL program and explore the domains in which the program needs to be improved. The study assessed the program from the perspectives of 220 student teachers, 32 teacher educators, and 12 heads of departments and experts including the university deans, deputies, and research and teaching staff, through using three instruments, i.e. questionnaires, interviews, and observations in a mixed methods design .The findings indicated that the TEFL program did not address some educational and administrative needs as the participants believed that they were not enriched with the necessary skills, the practice of the learned theories, problem solving, critical thinking, flexibility, and innovation. Furthermore, this study demonstrated several theory- practice gaps in the curriculum. |
Mohammad Ghasemi Bagherabadi, Golnar Mazdayasna,
Volume 24, Issue 1 (3-2021)
Abstract
Teaching English as a second or foreign language has internationally turned into a determiner of success for societies. Thus, the demand has risen for changes in English Language Teaching (ELT) curricula in different contexts. In response to the growing globalization and the dissatisfaction of many Iranian ELT stakeholders with the former program in lower and upper high-school levels, the Ministry of Education, in 2010, initiated the renovation of national policy documents, coursebooks, and the introduction of Communicative Language Teaching (CLT) orientations. The present study is part of a larger project that aims to qualitatively scrutinize the implementational complexities of the new program using a systematic language-in-education planning (LEP) framework. In this respect, 30 experienced headteachers' perspectives and voices from several provinces were explored through open-ended semi-structured interviews designed based on the analysis of school-based documents and observations of ELT goings-on in state schools. Interviews were then transcribed and the content was analyzed to identify the recurring themes. Key findings indicated that the new received program suffers from drawbacks like underbudgeting, students’ unequal access to quality ELT, the shortage of prepared teachers, etc. We further found that the program still requires dedicated support of the macro- meso- and micro-level agents at the national scale. Correspondingly, implications for revisions and suggestions for future research are offered.
Anis Askarpoor, Mansoor Ganji, Ali Beikian,
Volume 25, Issue 2 (9-2022)
Abstract
Teacher professional development plays a critical role in enhancing educational outcomes, with Teacher Training Courses (TTCs) serving as a primary avenue for improving teaching quality. This study evaluates the effectiveness of an English TTC conducted at the Iran Language Institute (ILI) by employing a concurrent mixed-methods approach. Data were gathered from TTC candidates, attendees, and ILI teachers to assess their expectations, immediate evaluation, and delayed evaluation of the TTC. Seven interviews with TTC candidates were conducted to capture expectations, while 69 questionnaires from attendees and 85 from ILI teachers provided immediate and delayed evaluations respectively. Both interviews and questionnaires were structured around the five standards of the California Standards for the Teaching Profession (CSTP), and the data were analyzed using content analysis and descriptive statistics. The findings indicate that candidates expected the TTC to focus on modern teaching techniques, syllabus design, classroom management, and supporting diverse learners. Besides, satisfaction levels were higher among female teachers and TTC attendees compared to male teachers and ILI teachers respectively. All in all, areas such as supporting diverse learners and professional development emerged with the lowest levels of satisfaction. These findings underscore the importance of tailoring TTCs to address specific needs, particularly in areas where satisfaction levels are suboptimal, to ensure the continued improvement of teaching quality and student outcomes.
Ali Beikian, Mansoor Ganji,
Volume 26, Issue 1 (3-2023)
Abstract
In order to cater for the ever-increasing demand for learning English, private language institutes have mushroomed across Iran. These institutes adopt different policies such as designing their own Teacher Training Course (TTC), following the syllabus of Certificate for Teaching English to Adults (CELTA), or localizing it for the Iranian context to train competent English teachers. Surprisingly, there exists little research evaluating these TTC's or investigating if localizing CELTA is an effective strategy for the Iranian context. This study aimed to fill this gap by delineating the steps taken by a widely-known Iranian language institute in localizing CELTA for the Iranian context, and secondly to determine if the teachers were satisfied with this localized TTC. Data collected through the websites and interviews were subjected to conceptual content analysis; while the data mined through evaluation questionnaires were analysed through quantitative descriptive statistics. The findings revealed that the Iranianized TTC suffered from discrepancies such as unreliable selection of the participants, lack of opportunities for teaching practices, not observing experienced teachers' classes, and focusing on received rather than experiential knowledge. These findings are discussed, and a number of practical suggestions are offered to improve the Iranian TTC.
|
|
