Faculty of Education - Theses

Permanent URI for this collection

Search Results

Now showing 1 - 2 of 2
  • Item
    Thumbnail Image
    Rater consistency and judgment in the direct assessment of second language writing ability within the certificates in spoken and written English
    Smith, David R ( 1998)
    The introduction of competency-based models of language and literacy education in Australia has, to a large degree, coincided with an increased emphasis on direct assessment as the most common means of evaluating second language writing ability within the Adult Migrant English Program. The key problem in directly assessing writing ability is having two or more raters arrive at a similar judgment or rating for the same piece of writing. While there is a long tradition of research on rater consistency and judgment in the holistic assessment of writing ability, similar research on the direct assessment of second language writing ability within the context of competency-based language and literacy education is almost non-existent. This study aims to determine the degree to which the performance criteria designed to assess second language writing ability within the Certificates in Spoken and Written English can ensure acceptable levels of rater consistency, and to describe the decision-making behaviours and strategies used by raters when reading for the purposes of assessment. The think-aloud verbal reports of six experienced ESL raters assessing three texts written by intermediate level adult ESL learners were transcribed and subjected to a rigorous interpretive analysis. In terms of rater consistency, analysis of raters verbal reports indicated that while there was generally a high degree of rater consistency at the overall performance or text level there was considerably tess agreement at the level of individual performance criteria. Analysis of the data revealed that raters adopted distinctive styles or approaches to reading for the purposes of assessment and that raters interpreted and applied the performance criteria statements in a range of different ways. These findings have significant implications not only for the development of competency-based assessment procedures but also for the training of raters. v11
  • Item
    Thumbnail Image
    A case study of Japanese students: e-mail exchange in English: feedback focusing on communicability
    Matsuo, Naoko ( 2007)
    English education in Japan has been struggling to improve the communicative proficiency of students. Previous studies reveal that low motivation, a lack of confidence in using English and few opportunities to use English for communication are the factors that inhibit the communicative proficiency of Japanese students. Although writing has been gaining significance in communication in English in the era of the Internet, writing has been an area disregarded among the communication skills in classrooms in Japan. This study explores ways to improve Japanese students' motivation and confidence through writing by setting e-mail exchanges for Japanese students with Australian native English speakers. A discrepancy exists between the goal of writing and the feedback provided to students' written work in English classrooms in Japan. Great attention is still paid only to the grammatical accuracy while communication is emphasized as the goal of English learning. Excessive attention to grammatical accuracy is one of the factors inhibiting Japanese students in improving their confidence and motivation for learning English. In order to change that situation, this study compares specific feedback focusing on 'communicability', the intelligibility of writing for readers with the traditional error correction technique. The error correction type feedback has been shown to have a negative influence on students' motivation and confidence, and consequently their attitude towards English learning. On the other hand, the feedback focusing on communicability is found effective in improving students' motivation, confidence in English and attitude towards English learning. E-mail exchange has also been found to be effective in enhancing students' motivation. The study recommends incorporating e-mail writing and the feedback focusing on communicability into English classrooms in Japan. These can be positive means of improving students' communicative proficiency and willingness to communicate in English.