Faculty of Education - Theses
Permanent URI for this collection
Search Results
1 - 3 of 3
-
ItemApplications of item response theory to identify and correct for suspect rater data( 2006)This thesis describes a plausible values imputation approach for deriving population estimates on several language proficiency domains. The approach harnessed a multi-dimensional item response analysis combining student responses, rater judgements and student background variables. The target student population was lower grade primary school students enrolled in the Hong Kong schooling system. The raters consisted of local teachers of English employed within the sampled target schools. The primary objective of this research was to impute plausible values where no data was provided or where rater data was deemed suspect. By necessity, a secondary objective of this study was to establish rules for justly excluding particular data on the basis of questionable validity. Surveys such as TIMSS, PISA and NAEP have used such "plausible value" methodologies to account for incomplete test designs and person non-response (Beaton & Johnson, 1990; Yamamoto & Kulick, 2000; Adams & Wu, 2002). The point of difference between this study and other similar studies was the use of item response theory (in particular plausible values imputation) to identify and correct for invalid rater judgements in a large-scale educational survey. An additional research outcome included a derived index of rater data quality based upon imputation scores.
-
ItemCaught in the middle : teachers' perceptions of the usefulness of the Record of oral language when used with ESL students( 2004)In the present educational context, large-scale literacy reform has been hotly debated in the media by various stakeholders while on the other hand the " voice that has been largely absent from these debates has been that of teachers". This study attempts to correct this imbalance by reporting on a study of teachers' perceptions of the usefulness of the ROL as a testing tool for students learning English as a second language. It was designed to offer the researcher, the participants and other stakeholders great insight into the current complexities that teachers face when assessing the oral competence of students learning English as a second language. Teachers were given the opportunity to critically examine their own assumptions, beliefs and practices about oral language learning and assessment and challenge the current use of the ROL in the Children's Literacy Success Strategy (CLaSS) program. A qualitative case study approach was selected to allow the voices of the participants and the researcher to be heard in a familiar setting. Thirty minute semi-structured interviews were conducted separately so that teachers could speak freely thus enabling the researcher to follow individual trains of thought and obtain in-depth responses. The study concluded that the usefulness of the Record of Oral Language as a testing tool for students from language backgrounds other than English was not the central issue. Research findings instead highlighted the difficulties faced by mainstream teachers expected to effectively assess the oral language skills of students for whom English is a second language without effective Professional Development support. The central issue that has emerged in this study is the place of teacher professional knowledge for these teachers of ESL students. Not only are ESL students disadvantaged in the current educational climate but so are the mainstream teachers. Teachers' responses to this study reaffirm the need for Professional Development in ESL pedagogy as a way to effectively support the Oral Language and Literacy Learning of ESL which was valued pre Literacy Advance.
-
ItemThe public examination of English in Victoria : a study of one external influence on the secondary school English curriculum( 1980)The secondary school English curriculum was determined by groups outside schools during the period 1944-1974. External domination of teaching content and methodology was ensured by a system of Public and Matriculation Examinations which empowered agents of the universities to prescribe courses and to assess students' performance in those courses. The University of Melbourne exercised these functions through its Professorial Board and the Schools Board before relinquishing its powers to the Victorian Universities and Schools Examination Board in 1965. Statute and tradition allowed these bodies to establish themselves as a centre apart from schools, and to legitimise their authority through the institutionalised processes of prescription, examination and review of performance. The effect of these processes was to subordinate schools, teachers and pupils. There was immense inertia in the Victorian system of external prescription and examination. Courses and examination papers remained essentially unmodified for long periods. Significant development in the conception and content of English courses occurred, effectively, only at Year 12 in response to social and educational pressures which had previously led to the withdrawal of Public Intermediate and Leaving Examinations. Broadening the goals of H.S.C. English did not, however, signal diminished control over curriculum from the centre. The fact of competitive examinations at the end of secondary schooling continued to shape content and methodology in the earlier years. Competitive examinations engendered in schools, teachers and pupils a narrow conformity, the results of which can most clearly be seen in the failure of the Class A system to produce school-based curriculum initiatives of any substance. The effect of external prescription and examination of English courses was profound. Relationships between teachers and pupils were strongly mediated by the system, reducing the autonomy of both by subjugating their intentions to the instrumental demands of evaluation. So much of a student's 'life chance' depended upon examination success that teachers and taught were continually constrained to focus their attention on the tasks expected in examinations. Fragmentation, in line with the different sections of examination papers, rather than integration became, therefore, the organising principle for teaching aimed at developing those techniques believed to be essential for success in the examination game. External examinations dictated that the English classroom was a place where pupils met to prepare for their encounters with examinations rather than to explore the nature and richness of experience through literature and their own use of language for real ends. The system of Public and Matriculation Examinations established in 1944 was a potent influence on the secondary school English curriculum. The system rested upon a powerful, conservative centre whose legitimacy was so thoroughly entrenched that it was able to admit reform only on its own terms. Thus, it was possible after twenty-five years of relative stasis to negotiate evolution in the details of the school English curriculum without alteration to the essential power relationships. After thirty years, English teachers were still without autonomy. Year 12 English courses continued to exert the pressures and to exact the dependence which had constrained mother tongue studies throughout secondary schools since 1944.