Melbourne Graduate School of Education - Theses

Permanent URI for this collection

Search Results

Now showing 1 - 10 of 21
  • Item
    Thumbnail Image
    Rater consistency and judgment in the direct assessment of second language writing ability within the certificates in spoken and written English
    Smith, David R ( 1998)
    The introduction of competency-based models of language and literacy education in Australia has, to a large degree, coincided with an increased emphasis on direct assessment as the most common means of evaluating second language writing ability within the Adult Migrant English Program. The key problem in directly assessing writing ability is having two or more raters arrive at a similar judgment or rating for the same piece of writing. While there is a long tradition of research on rater consistency and judgment in the holistic assessment of writing ability, similar research on the direct assessment of second language writing ability within the context of competency-based language and literacy education is almost non-existent. This study aims to determine the degree to which the performance criteria designed to assess second language writing ability within the Certificates in Spoken and Written English can ensure acceptable levels of rater consistency, and to describe the decision-making behaviours and strategies used by raters when reading for the purposes of assessment. The think-aloud verbal reports of six experienced ESL raters assessing three texts written by intermediate level adult ESL learners were transcribed and subjected to a rigorous interpretive analysis. In terms of rater consistency, analysis of raters verbal reports indicated that while there was generally a high degree of rater consistency at the overall performance or text level there was considerably tess agreement at the level of individual performance criteria. Analysis of the data revealed that raters adopted distinctive styles or approaches to reading for the purposes of assessment and that raters interpreted and applied the performance criteria statements in a range of different ways. These findings have significant implications not only for the development of competency-based assessment procedures but also for the training of raters. v11
  • Item
    Thumbnail Image
    Defining the characteristics of a good middle school teacher in an Australian setting
    Douglas, Linda Jane ( 1995)
    The purpose of this study is to. identify the characteristics of a middle school teacher that define that teacher as a good teacher in the eyes of their Australian colleagues. A model of the good middle school teacher was developed from the North American literature. This formed the basis for interviews with Australian teachers who have been identified as good middle school teachers by their school community. This has led to the establishment of a model based on the responses from the Australian teachers. The focus centred on the characteristics of the teacher but at times has included reference to curriculum and other structures within the school. The report's results reflect the Australian teacher's approval for child centred teaching but with a subject focus. The teachers feel a need for teachers to retain a passion for a subject area in order to inspire and enthuse their students, but doing this within a context of a curriculum focussed on young people and their needs. This study clearly suggests the strong link between teaching philosophy and curriculum and the need to cater towards the needs of both the staff and students in order to educate successfully.
  • Item
    Thumbnail Image
    Television viewing and dramatic play behaviour of pre-schoolers
    O'Neill, Carole ( 1995)
    The main purpose of this study was to examine the relationship between television and dramatic play by exploring the impact of television viewing upon the play content and play behaviour of pre-school children. This research extends the findings of previous research which assumed that there was a direct causal link between television viewing and the themes, roles and content of children's dramatic play. The results of this research suggest that this view is far too simplistic. They suggest that the outcomes of dramatic play may be modified by a number of factors including: the situational context, the role of adults, and the role of other children. This thesis advances three major findings. Firstly, that others such as parents, peers and teachers have significant influence over pre-schoolers' dramatic play decisions such as in roles, themes and content. Secondly, that the physical environment within which play occurs must be taken into consideration as the situational context can influence and modify the nature of dramatic play. Thirdly, that the child is an active, reasoning participant in dramatic play as the child can choose from the resources available from television and 'replay' only a selection of what was viewed. It is suggested that each child must be considered as a 'selector' exerting control over his/her role in dramatic play.
  • Item
    Thumbnail Image
    Museum exhibitions : the development and application of a cyclic evaluation model
    Stanton, Janeen Cynthia ( 1995)
    This thesis makes a contribution to exhibition evaluation by providing a cyclic model designed to encourage museum professionals to adopt museum exhibition evaluation within an Australian context. The rationale for the thesis is that museums rarely, if ever, undertake systematic evaluations of exhibitions or attempt to understand the nature of the visitor experience. This, it is argued, is firstly because of the lack of appropriate methodological tools and models which can be applied to the museum setting and secondly because of the poor culture of evaluation currently existing within museums. The model incorporates both front-end, formative and summative evaluation within the various stages of the process of developing an exhibition. It proposes the formulation of hypothesis about visitor behaviour and exhibition design issues which can be tested out in future exhibitions, and encourages the sharing of findings within the museum profession. It suggests that Australia should develop, through evaluation studies, its own body of knowledge about visitor behaviour as the visitor experience within an Australian context may be quite different to that in other countries. The Cyclic Evaluation Model was developed by the writer of the thesis both through her role as a facilitator of exhibitions and her study of evaluation taking place in the museum environment in western countries. One stage of the model (Summative Study) has been used to evaluate a specific museum exhibition. Only time will tell if it will be adopted by the museum professsion, and only if and when it is adopted can any assessment be made as to its effectiveness in encouraging the profession in Australia to embrace evaluation techniques.
  • Item
    Thumbnail Image
    Developing guidelines to enhance the evaluation of overseas development projects
    McDonald, Diane E ( 1997)
    This thesis focuses on the cross-cultural evaluation of overseas development projects. It identifies key factors which need to be considered, in order that the evaluation process lead to the empowerment of local stakeholders. Review of prior research revealed some important components that should be examined. This resulted in the development of seven broad 'guidelines' relating to: participation; education; methodology; feedback and utilisation; enhancement of local capacity; partnership; and cross-cultural teaming. Rather than being definitive, the proposed list indicates significant aspects which could be of assistance to those working in the field. Two methods were used to validate the usefulness and comprehensiveness of the criteria listed. Firstly, a meta-evaluation was undertaken of a project evaluation conducted in Vietnam, using an open-ended schedule sent to key participants in the study. Further insights were drawn from the writer's own experience in reviewing a second Vietnamese project. The findings largely support the concepts included in the 'guidelines'. However, they provide important insights regarding possible historical, cultural and logistical constraints that might inhibit their achievement. They stress the need to focus deliberate attention on enabling the project community to design and undertake ongoing processes of self-evaluation, which recognise and extend their existing capabilities. In this context, the evaluator acts as facilitator, adviser and learner; and partnership, extending beyond the life of the project, must be carefully nurtured. The interrelationship between the 'guidelines' themselves is also noted. To neglect the notions included in one could impact negatively upon another. These new insights provide a helpful addition to the proposed list. However, the ideas need to be tested and extended further, based on the experiences of others engaged in international development evaluation in various project settings and cultural contexts. In so doing, particular attention should be given to seeking, and listening to, the views of indigenous stakeholders.
  • Item
    Thumbnail Image
    The international ambulance benchmarking and best practice project
    Tuohey, Therese ( 1999)
    This thesis addresses issues related to benchmarking, a topic of major current interest to those working in evaluation, management and cognate fields. These issues were explored through a case study in which the principles of benchmarking were applied to the monitoring of ambulance services. The case study involved the collection of data from ambulance services in several countries within an Australian project known as The International Benchmarking Project [IBP]. Consulting each of the international partner organisations via a telephone interview led to the identification of dimensions of best practice that were important in ambulance service delivery. Performance indicators were developed by translating the identified dimensions of best practice into a useful data set for monitoring the performance of ambulance services. An instrument was developed based on the best practice dimensions identified and their associated performance indicators. The structure and content of the questionnaire were developed to improve the quality of the information provided to the managers of each partner service involved. There are no examples of benchmarking in national or international ambulance studies. This thesis describes a case study of benchmarking in ambulance services, and provides a practical example of how the theories of benchmarking might be used practice. Postmodern thought provided a valuable contribution to the Project as it supported a critical review, and provided direction for addressing the issues raised. This study should contribute to understanding how benchmarking can be used to support decision making and the improvement of service provision in real life settings.
  • Item
    Thumbnail Image
    The impact of writing for different kinds of audience on a group of year 11 students' writing proficiency at an inner city secondary college in Victoria
    Rozimela, Yenni ( 1993)
    This study was carried out with the purpose of finding out the influence of audience on the students writing proficiency It was carried out with the help of forty students who were studying at Year 1 1 at an inner city secondary college. The students belonged to three different classes or three intact groups. Each student produced three pieces of writing one of which was for no audience the second one of which was for an imaginary audience and the third one of which was for a real audience. Since the sequence of tasks could be a compounding variable in this study it was decided to give the three groups of students the tasks in three different orders. The students writings were assessed by three raters using a multitrait method of scoring. The components of writing and scales used were derived from those proposed by Hamp Lyons (1986). For any large discrepancy a fourth rater was invited to rate the specific samples of writing again. The data was analysed by ANOVA and F comparison. The results of the study reveal that audience has a significant impact on the students writing proficiency. However when the students wrote for an imaginary audience their writing was rated as less proficient than when they wrote for no audience. The most interesting result was the one relating to students writing for a real audience In this case students proficiency was judged by the raters to be greater than for the other two types of audience. This research has provided some interesting insights for teachers and composition and direct writing assessment researchers.
  • Item
    Thumbnail Image
    Effective Catholic secondary schools : the findings of two case studies
    Sheehan, Mark Gregory ( 1996)
    This study utilises both qualitative and quantitative methods to investigate school effectiveness in Catholic secondary schools. While some researchers, both in Australia and overseas, tend to rely on quantitative methods when they examine school effectiveness, the current study adopts a case study approach, involving both qualitative and quantitative methods. In adopting this approach, the researcher's aim is to investigate and portray the various factors or processes in schools, which are perceived to make them effective. This process approach differs from that of many researchers, who have adopted an "outcomes" approach in investigating school effectiveness in Western education over the past thirty years, and thus sheds additional light on the various factors within schools which contribute to their overall effectiveness. Also, as this study is focused specifically on Catholic secondary schools it illustrates some of the more specific factors operating within this context. The major finding of the study is that there are several pivotal factors which influence the effectiveness of a Catholic secondary school.
  • Item
    Thumbnail Image
    Human capital : a case study of the AMEP
    McElgunn, Barry ( 1995)
    This study is an investigation of the Human Capital Approach to education in Australia. It examines whether or not the Commonwealth Government is steering education towards the incorporation of policies that invest greater emphasis and resources into human beings as contributors to economic productivity than it invests in their cultural and aesthetic value. The study incorporates the philosophies of the Human Capitalists and how successive Commonwealth and State Governments apply these philosophies in education policy formulation - particularly the provision of English language to adult migrants through the Adult Migrant Education Program in Victoria. The methodology used is a questionnaire of closed and open-ended questions distributed to AMEP teachers. The researcher duly followed up the questionnaire with interviews of four AMEP teachers in an endeavour to shed more light on the reasons behind the responses given by teachers in the questionnaire. The researcher undertook an analysis of the responses in order to investigate whether or not the Commonwealth Government gives primacy to economic objectives of the migration program over its social, cultural and linguistic objectives. The findings are that the AMEP teachers surveyed believe that the Commonwealth Government does emphasize economic objectives over all other objectives of the migration program. A Human Capital approach to education, reflected in the application of Economic Rationalism, is apparent in Australia's education system according to AMEP teachers surveyed and that such has been the case since the late 1970s. The literary works of Schultz, Smith, Dawkins, Piore, Crittenden, Benovat, Green, Pusey, Kennedy, Marginson and Grubb are included in this study. These works form the literature review of the Human Capital approach. As well, the Reports chaired by Karmel, Williams, Kirby, Fitzgerald and Campbell, and a variety of Commonwealth Reports and Working Party Papers into various aspects of education in Australia are represented in an investigation of the application of the Human Capital approach to education in Australia's main education policies. The findings of this research are that the Human Capital approach to education is influencing the AMEP and that this has wider implications for the national education system in Australia. Almost all AMEP teachers surveyed believe the AMEP no longer follows its own National Plan, in which it spells out its aims and objectives, but pursues the Commonwealth Government's primary objective of pursuing the economic aims and benefits of the migration program.
  • Item
    Thumbnail Image
    Learning literacy : a case study of the development of English literacy skills in two adult ESL students
    Rao, Usha ( 1997)
    This minor thesis reports on the findings of a study done of two adult international students of English as a Second Language. The study attempts to outline the issue of difficulties experienced by these students while learning to write in English in preparation for tertiary studies in Australia. The main aim of the study was to attempt to illustrate that international students need to be instructed by their teachers in how to write in the genre required for tertiary study. An attempt was made to measure the language level of the two students to determine how thoroughly prepared they were in the genre they were mainly required to write in their tertiary study. For these two students, this genre was business report writing. It was realised that although the two students had received practice in responding to General English writing tasks, they had not been taught how to write business reports. This conclusion was drawn through the study in which qualitative techniques of research and text analysis were used. Firstly, the students were given a series of reading and writing tasks to perform to determine their levels of English at the start of the study. At the end of the study there was a similar set of tasks for the students to perform. Secondly, the students and two of their teachers were interviewed. The students tried to reveal their perception of what their English Language intensive courses had taught them. The teachers who had taught these students attempted, through their responses to the interview questions, to outline the objectives of the courses they had delivered Thirdly, the students' attempt at writing report genres in their tertiary study was commented upon. At the end a short business report was selected as the target text and this was analysed. Systemic functional grammar was drawn upon to analyse the target text. The analysis of this model text was used to compare the analyses of the responses of the students to business report writing tasks. A summary of the findings is presented in this thesis and comparisons made in order to come to a conclusion that there does exist a need for overseas students intending to go on to further tertiary study to be taught explicitly through deconstruction of model texts by the teacher. The genre of the model text has to be directly related to the tertiary course of study that the students are going to follow. The students need to be provided with close guidance by their teachers, and constant practice of the genre is required.