Faculty of Education - Theses
Permanent URI for this collection
Search Results
1 - 7 of 7
-
ItemRater consistency and judgment in the direct assessment of second language writing ability within the certificates in spoken and written English( 1998)The introduction of competency-based models of language and literacy education in Australia has, to a large degree, coincided with an increased emphasis on direct assessment as the most common means of evaluating second language writing ability within the Adult Migrant English Program. The key problem in directly assessing writing ability is having two or more raters arrive at a similar judgment or rating for the same piece of writing. While there is a long tradition of research on rater consistency and judgment in the holistic assessment of writing ability, similar research on the direct assessment of second language writing ability within the context of competency-based language and literacy education is almost non-existent. This study aims to determine the degree to which the performance criteria designed to assess second language writing ability within the Certificates in Spoken and Written English can ensure acceptable levels of rater consistency, and to describe the decision-making behaviours and strategies used by raters when reading for the purposes of assessment. The think-aloud verbal reports of six experienced ESL raters assessing three texts written by intermediate level adult ESL learners were transcribed and subjected to a rigorous interpretive analysis. In terms of rater consistency, analysis of raters verbal reports indicated that while there was generally a high degree of rater consistency at the overall performance or text level there was considerably tess agreement at the level of individual performance criteria. Analysis of the data revealed that raters adopted distinctive styles or approaches to reading for the purposes of assessment and that raters interpreted and applied the performance criteria statements in a range of different ways. These findings have significant implications not only for the development of competency-based assessment procedures but also for the training of raters. v11
-
ItemThe academic achievements of language centre students at a secondary college( 2001)What are the academic achievements of adolescent new-arrival English as a Second Language (ESL) students at secondary schools in Victoria, Australia? Research on Non-English Speaking Background (NESB) students in Australia has tended to neglect new arrival ESL students. To examine the academic achievements of this important subgroup of NESB students, the current study will highlight the academic achievements of a cohort of Victorian Language Centre students at a Secondary College over six years with interruption to schooling in their first language (L1) as the key variable linked to academic achievement in their second language (L2). Victorian Language Centres provide new-arrival ESL students with the English skills they need to start their secondary educations in L2. The current study examined the academic achievement of two groups of Language Centre students, those who completed their Victorian Certificate of Education (VCE) and those who left the Secondary College prior to completing VCE. Their academic results were summarised into spreadsheets for quantitative analysis. Subsequent to the quantitative analysis interviews were conducted with four ESL students from the Language Centre currently completing their VCE studies to provide further insight into the factors that enabled them to do their VCE. Results indicate that the academic achievements of this cohort of ESL Language Centre students are poor and that interruption to education in Ll had a major impact on the students' ability to achieve academically at the Secondary College. The study suggests that L1 education is the key variable influencing the student's ability to acquire the academic language skills necessary to meet the academic demands of secondary education, particularly the VCE. Other factors such as support for learning and strong motivation were found to help students overcome difficulties encountered in their secondary education. However, students who were unable to overcome these difficulties left the College prior to completing VCE. It was concluded that the majority of Language Centre students faced uncertain economic futures once they left the Secondary College. The results of the study suggest that Language Centre students need more support and assistance to enable them to complete VCE or to access educational alternatives to the VCE. This study also suggests that more research into the effect of L1 education on L2 education be conducted as this was found to be the key variable in the students' ability to acquire the academic language skills necessary to meet the academic demands of VCE.
-
ItemApplications of item response theory to identify and correct for suspect rater data( 2006)This thesis describes a plausible values imputation approach for deriving population estimates on several language proficiency domains. The approach harnessed a multi-dimensional item response analysis combining student responses, rater judgements and student background variables. The target student population was lower grade primary school students enrolled in the Hong Kong schooling system. The raters consisted of local teachers of English employed within the sampled target schools. The primary objective of this research was to impute plausible values where no data was provided or where rater data was deemed suspect. By necessity, a secondary objective of this study was to establish rules for justly excluding particular data on the basis of questionable validity. Surveys such as TIMSS, PISA and NAEP have used such "plausible value" methodologies to account for incomplete test designs and person non-response (Beaton & Johnson, 1990; Yamamoto & Kulick, 2000; Adams & Wu, 2002). The point of difference between this study and other similar studies was the use of item response theory (in particular plausible values imputation) to identify and correct for invalid rater judgements in a large-scale educational survey. An additional research outcome included a derived index of rater data quality based upon imputation scores.
-
ItemHuman capital : a case study of the AMEP( 1995)This study is an investigation of the Human Capital Approach to education in Australia. It examines whether or not the Commonwealth Government is steering education towards the incorporation of policies that invest greater emphasis and resources into human beings as contributors to economic productivity than it invests in their cultural and aesthetic value. The study incorporates the philosophies of the Human Capitalists and how successive Commonwealth and State Governments apply these philosophies in education policy formulation - particularly the provision of English language to adult migrants through the Adult Migrant Education Program in Victoria. The methodology used is a questionnaire of closed and open-ended questions distributed to AMEP teachers. The researcher duly followed up the questionnaire with interviews of four AMEP teachers in an endeavour to shed more light on the reasons behind the responses given by teachers in the questionnaire. The researcher undertook an analysis of the responses in order to investigate whether or not the Commonwealth Government gives primacy to economic objectives of the migration program over its social, cultural and linguistic objectives. The findings are that the AMEP teachers surveyed believe that the Commonwealth Government does emphasize economic objectives over all other objectives of the migration program. A Human Capital approach to education, reflected in the application of Economic Rationalism, is apparent in Australia's education system according to AMEP teachers surveyed and that such has been the case since the late 1970s. The literary works of Schultz, Smith, Dawkins, Piore, Crittenden, Benovat, Green, Pusey, Kennedy, Marginson and Grubb are included in this study. These works form the literature review of the Human Capital approach. As well, the Reports chaired by Karmel, Williams, Kirby, Fitzgerald and Campbell, and a variety of Commonwealth Reports and Working Party Papers into various aspects of education in Australia are represented in an investigation of the application of the Human Capital approach to education in Australia's main education policies. The findings of this research are that the Human Capital approach to education is influencing the AMEP and that this has wider implications for the national education system in Australia. Almost all AMEP teachers surveyed believe the AMEP no longer follows its own National Plan, in which it spells out its aims and objectives, but pursues the Commonwealth Government's primary objective of pursuing the economic aims and benefits of the migration program.
-
ItemLearning literacy : a case study of the development of English literacy skills in two adult ESL students( 1997)This minor thesis reports on the findings of a study done of two adult international students of English as a Second Language. The study attempts to outline the issue of difficulties experienced by these students while learning to write in English in preparation for tertiary studies in Australia. The main aim of the study was to attempt to illustrate that international students need to be instructed by their teachers in how to write in the genre required for tertiary study. An attempt was made to measure the language level of the two students to determine how thoroughly prepared they were in the genre they were mainly required to write in their tertiary study. For these two students, this genre was business report writing. It was realised that although the two students had received practice in responding to General English writing tasks, they had not been taught how to write business reports. This conclusion was drawn through the study in which qualitative techniques of research and text analysis were used. Firstly, the students were given a series of reading and writing tasks to perform to determine their levels of English at the start of the study. At the end of the study there was a similar set of tasks for the students to perform. Secondly, the students and two of their teachers were interviewed. The students tried to reveal their perception of what their English Language intensive courses had taught them. The teachers who had taught these students attempted, through their responses to the interview questions, to outline the objectives of the courses they had delivered Thirdly, the students' attempt at writing report genres in their tertiary study was commented upon. At the end a short business report was selected as the target text and this was analysed. Systemic functional grammar was drawn upon to analyse the target text. The analysis of this model text was used to compare the analyses of the responses of the students to business report writing tasks. A summary of the findings is presented in this thesis and comparisons made in order to come to a conclusion that there does exist a need for overseas students intending to go on to further tertiary study to be taught explicitly through deconstruction of model texts by the teacher. The genre of the model text has to be directly related to the tertiary course of study that the students are going to follow. The students need to be provided with close guidance by their teachers, and constant practice of the genre is required.
-
ItemCaught in the middle : teachers' perceptions of the usefulness of the Record of oral language when used with ESL students( 2004)In the present educational context, large-scale literacy reform has been hotly debated in the media by various stakeholders while on the other hand the " voice that has been largely absent from these debates has been that of teachers". This study attempts to correct this imbalance by reporting on a study of teachers' perceptions of the usefulness of the ROL as a testing tool for students learning English as a second language. It was designed to offer the researcher, the participants and other stakeholders great insight into the current complexities that teachers face when assessing the oral competence of students learning English as a second language. Teachers were given the opportunity to critically examine their own assumptions, beliefs and practices about oral language learning and assessment and challenge the current use of the ROL in the Children's Literacy Success Strategy (CLaSS) program. A qualitative case study approach was selected to allow the voices of the participants and the researcher to be heard in a familiar setting. Thirty minute semi-structured interviews were conducted separately so that teachers could speak freely thus enabling the researcher to follow individual trains of thought and obtain in-depth responses. The study concluded that the usefulness of the Record of Oral Language as a testing tool for students from language backgrounds other than English was not the central issue. Research findings instead highlighted the difficulties faced by mainstream teachers expected to effectively assess the oral language skills of students for whom English is a second language without effective Professional Development support. The central issue that has emerged in this study is the place of teacher professional knowledge for these teachers of ESL students. Not only are ESL students disadvantaged in the current educational climate but so are the mainstream teachers. Teachers' responses to this study reaffirm the need for Professional Development in ESL pedagogy as a way to effectively support the Oral Language and Literacy Learning of ESL which was valued pre Literacy Advance.
-
ItemPreservice teacher education for the preparation of secondary teachers of english as a second language in Australia( 2003)English as a Second Language (ESL) education in Australia has undergone tremendous changes in the last thirty years or so. Along with the changes in policy, the roles of the ESL teacher have also changed, reflecting the changing socio-cultural, economic and political climate of the time. Several new roles that have emerged can be seen as being particular only to this group of teachers. Student-teachers need to be effectively prepared for the roles that they will take on upon completion of their teacher education programs. This study investigates the effectiveness of one preservice ESL teacher education program, particularly from the perspectives of student-teachers, in preparing them for their future roles as ESL teachers. The study reveals the varied opinions that student-teachers have regarding different aspects of their course di study and the factors which influence their perceptions. It also discusses suggestions of improvement made for such a teacher education program, from the perspectives of student-teachers, their course lecturers and a sample of trained ESL teachers.