Faculty of Education - Theses
Permanent URI for this collection
Search Results
1 - 3 of 3
-
ItemRater consistency and judgment in the direct assessment of second language writing ability within the certificates in spoken and written English( 1998)The introduction of competency-based models of language and literacy education in Australia has, to a large degree, coincided with an increased emphasis on direct assessment as the most common means of evaluating second language writing ability within the Adult Migrant English Program. The key problem in directly assessing writing ability is having two or more raters arrive at a similar judgment or rating for the same piece of writing. While there is a long tradition of research on rater consistency and judgment in the holistic assessment of writing ability, similar research on the direct assessment of second language writing ability within the context of competency-based language and literacy education is almost non-existent. This study aims to determine the degree to which the performance criteria designed to assess second language writing ability within the Certificates in Spoken and Written English can ensure acceptable levels of rater consistency, and to describe the decision-making behaviours and strategies used by raters when reading for the purposes of assessment. The think-aloud verbal reports of six experienced ESL raters assessing three texts written by intermediate level adult ESL learners were transcribed and subjected to a rigorous interpretive analysis. In terms of rater consistency, analysis of raters verbal reports indicated that while there was generally a high degree of rater consistency at the overall performance or text level there was considerably tess agreement at the level of individual performance criteria. Analysis of the data revealed that raters adopted distinctive styles or approaches to reading for the purposes of assessment and that raters interpreted and applied the performance criteria statements in a range of different ways. These findings have significant implications not only for the development of competency-based assessment procedures but also for the training of raters. v11
-
ItemFrom "great!" to "gr8!" : register shifts across CMC modes : a case study of three boys with varying literacy abilities( 2007)The aims of the current study were to observe A) the extent to which various ability level students demonstrate control over register in the three CMC modes of SMS, email and Word documents; and B) the extent to which these students are aware of these shifts in register. Data was collected by using a video recorder to capture how three students, Alex, Jasper and Eric, typed an SMS, an email, and a school-based text as a Microsoft Word document. Each student then discussed their texts in an interview, using the footage as a think-aloud protocol. All sessions were carried out with individual students, each lasting no more than 20 minutes. Data were analysed using the Hallidayan theory of register, taking into account its sub-categories of field, tenor and mode (Halliday, 1985a; 1985b; Eggins, 2004). The video footage indicated that Alex and Jasper, the students with higher literacy abilities, were able to switch between abbreviated codes and academic written English, demonstrating an understanding of the different communicative requirements of both informal and formal texts. The linguistic analysis illustrated that these students were very comfortable in using both Shorthand codes and conventional spelling in their SMS and email messages, and demonstrated a sophisticated use of the generic, syntactic and especially, lexical structures in their formal texts. However, Eric, identified by his teacher as having lower literacy abilities, was less comfortable in using abbreviations in his SMS and email; a less sophisticated structure in his formal text even showed some register confusion. The interviews revealed Alex's and Jasper's awareness of their register choices, evident across their texts. Although Eric also showed an awareness of these, his texts show he demonstrated these shifts to a lesser extent. Alex and Jasper also revealed positive attitudes towards, and an exploratory use of CMC modes. However, Eric's surprising aversion to technology suggests that some teenagers may be uncomfortable with the abbreviated language associated with some forms of CMC. Results show that, contrary to populist beliefs, (such as Texting 'is not bar to literacy;' cited in Thurlow, 2006, p. 699) the relationship between Shorthand codes and academic written English is multifaceted. Alex's and Jasper's awareness of composing texts with varied tenor allowed them to make appropriate register choices, whereas Eric's choices of code were more restricted. This study suggests that clearly, there are more complex variables operating, which should be examined in a wider array of students in future investigations.
-
ItemCaught in the middle : teachers' perceptions of the usefulness of the Record of oral language when used with ESL students( 2004)In the present educational context, large-scale literacy reform has been hotly debated in the media by various stakeholders while on the other hand the " voice that has been largely absent from these debates has been that of teachers". This study attempts to correct this imbalance by reporting on a study of teachers' perceptions of the usefulness of the ROL as a testing tool for students learning English as a second language. It was designed to offer the researcher, the participants and other stakeholders great insight into the current complexities that teachers face when assessing the oral competence of students learning English as a second language. Teachers were given the opportunity to critically examine their own assumptions, beliefs and practices about oral language learning and assessment and challenge the current use of the ROL in the Children's Literacy Success Strategy (CLaSS) program. A qualitative case study approach was selected to allow the voices of the participants and the researcher to be heard in a familiar setting. Thirty minute semi-structured interviews were conducted separately so that teachers could speak freely thus enabling the researcher to follow individual trains of thought and obtain in-depth responses. The study concluded that the usefulness of the Record of Oral Language as a testing tool for students from language backgrounds other than English was not the central issue. Research findings instead highlighted the difficulties faced by mainstream teachers expected to effectively assess the oral language skills of students for whom English is a second language without effective Professional Development support. The central issue that has emerged in this study is the place of teacher professional knowledge for these teachers of ESL students. Not only are ESL students disadvantaged in the current educational climate but so are the mainstream teachers. Teachers' responses to this study reaffirm the need for Professional Development in ESL pedagogy as a way to effectively support the Oral Language and Literacy Learning of ESL which was valued pre Literacy Advance.