Melbourne Graduate School of Education - Theses

Permanent URI for this collection

Search Results

Now showing 1 - 2 of 2
  • Item
    Thumbnail Image
    Rater consistency and judgment in the direct assessment of second language writing ability within the certificates in spoken and written English
    Smith, David R ( 1998)
    The introduction of competency-based models of language and literacy education in Australia has, to a large degree, coincided with an increased emphasis on direct assessment as the most common means of evaluating second language writing ability within the Adult Migrant English Program. The key problem in directly assessing writing ability is having two or more raters arrive at a similar judgment or rating for the same piece of writing. While there is a long tradition of research on rater consistency and judgment in the holistic assessment of writing ability, similar research on the direct assessment of second language writing ability within the context of competency-based language and literacy education is almost non-existent. This study aims to determine the degree to which the performance criteria designed to assess second language writing ability within the Certificates in Spoken and Written English can ensure acceptable levels of rater consistency, and to describe the decision-making behaviours and strategies used by raters when reading for the purposes of assessment. The think-aloud verbal reports of six experienced ESL raters assessing three texts written by intermediate level adult ESL learners were transcribed and subjected to a rigorous interpretive analysis. In terms of rater consistency, analysis of raters verbal reports indicated that while there was generally a high degree of rater consistency at the overall performance or text level there was considerably tess agreement at the level of individual performance criteria. Analysis of the data revealed that raters adopted distinctive styles or approaches to reading for the purposes of assessment and that raters interpreted and applied the performance criteria statements in a range of different ways. These findings have significant implications not only for the development of competency-based assessment procedures but also for the training of raters. v11
  • Item
    Thumbnail Image
    A cohesion analysis of texts written by adult Mandarin ESL students
    Beaumont, Merrilyn F. ( 2001)
    This project aims to explore the written cohesive strategies employed by Mandarin English as a Second Language (ESL) learners, which knowledge will enable educators to better address their specific needs. The participants were members of an adult literacy class of both native and non-native speakers. Students completed several preliminary tasks in order to establish their familiarity with the specific grammatical resources utilised in English. Using a prompt, they wrote letters of complaint, which provided the research data. These were analysed from a functional systemic perspective, identifying patterns of usage of cohesive devices. Questionnaires and individual interviews provided qualitative insights into students' language practices. The study demonstrated that Mandarin students employed a higher percentage of cohesive ties than did the native speakers, which phenomenon may be explained by factors including level of first language literacy, years of formal English language study, and years of residency in Australia. The study suggests that Mandarin ESL learners might moderate their density of cohesive ties, to attain native-like written rhetorical structure. Secondly, register variables proved to have significant implications for cohesive paradigms, in conjunction with contrastive rhetoric cultural conventions. Lexical cohesive patterns point to the crucial role of vocabulary acquisition, an aspect of language acquisition which ought to be addressed in the teaching field. The study also explores the eclectic nature of the language practices acquired by students who have received considerable EFL teaching, and have often lived in English speaking communities for extended periods. Ultimately, this research highlights the need for further study in adult literacy contexts; drawing on larger samples from more diverse language backgrounds, with a specific focus on the role of politeness theory, register variables and contrastive rhetoric.