Faculty of Education - Theses
Permanent URI for this collection
Search Results
1 - 10 of 16
-
ItemRater consistency and judgment in the direct assessment of second language writing ability within the certificates in spoken and written English( 1998)The introduction of competency-based models of language and literacy education in Australia has, to a large degree, coincided with an increased emphasis on direct assessment as the most common means of evaluating second language writing ability within the Adult Migrant English Program. The key problem in directly assessing writing ability is having two or more raters arrive at a similar judgment or rating for the same piece of writing. While there is a long tradition of research on rater consistency and judgment in the holistic assessment of writing ability, similar research on the direct assessment of second language writing ability within the context of competency-based language and literacy education is almost non-existent. This study aims to determine the degree to which the performance criteria designed to assess second language writing ability within the Certificates in Spoken and Written English can ensure acceptable levels of rater consistency, and to describe the decision-making behaviours and strategies used by raters when reading for the purposes of assessment. The think-aloud verbal reports of six experienced ESL raters assessing three texts written by intermediate level adult ESL learners were transcribed and subjected to a rigorous interpretive analysis. In terms of rater consistency, analysis of raters verbal reports indicated that while there was generally a high degree of rater consistency at the overall performance or text level there was considerably tess agreement at the level of individual performance criteria. Analysis of the data revealed that raters adopted distinctive styles or approaches to reading for the purposes of assessment and that raters interpreted and applied the performance criteria statements in a range of different ways. These findings have significant implications not only for the development of competency-based assessment procedures but also for the training of raters. v11
-
ItemDefining the characteristics of a good middle school teacher in an Australian setting( 1995)The purpose of this study is to. identify the characteristics of a middle school teacher that define that teacher as a good teacher in the eyes of their Australian colleagues. A model of the good middle school teacher was developed from the North American literature. This formed the basis for interviews with Australian teachers who have been identified as good middle school teachers by their school community. This has led to the establishment of a model based on the responses from the Australian teachers. The focus centred on the characteristics of the teacher but at times has included reference to curriculum and other structures within the school. The report's results reflect the Australian teacher's approval for child centred teaching but with a subject focus. The teachers feel a need for teachers to retain a passion for a subject area in order to inspire and enthuse their students, but doing this within a context of a curriculum focussed on young people and their needs. This study clearly suggests the strong link between teaching philosophy and curriculum and the need to cater towards the needs of both the staff and students in order to educate successfully.
-
ItemTelevision viewing and dramatic play behaviour of pre-schoolers( 1995)The main purpose of this study was to examine the relationship between television and dramatic play by exploring the impact of television viewing upon the play content and play behaviour of pre-school children. This research extends the findings of previous research which assumed that there was a direct causal link between television viewing and the themes, roles and content of children's dramatic play. The results of this research suggest that this view is far too simplistic. They suggest that the outcomes of dramatic play may be modified by a number of factors including: the situational context, the role of adults, and the role of other children. This thesis advances three major findings. Firstly, that others such as parents, peers and teachers have significant influence over pre-schoolers' dramatic play decisions such as in roles, themes and content. Secondly, that the physical environment within which play occurs must be taken into consideration as the situational context can influence and modify the nature of dramatic play. Thirdly, that the child is an active, reasoning participant in dramatic play as the child can choose from the resources available from television and 'replay' only a selection of what was viewed. It is suggested that each child must be considered as a 'selector' exerting control over his/her role in dramatic play.
-
ItemMuseum exhibitions : the development and application of a cyclic evaluation model( 1995)This thesis makes a contribution to exhibition evaluation by providing a cyclic model designed to encourage museum professionals to adopt museum exhibition evaluation within an Australian context. The rationale for the thesis is that museums rarely, if ever, undertake systematic evaluations of exhibitions or attempt to understand the nature of the visitor experience. This, it is argued, is firstly because of the lack of appropriate methodological tools and models which can be applied to the museum setting and secondly because of the poor culture of evaluation currently existing within museums. The model incorporates both front-end, formative and summative evaluation within the various stages of the process of developing an exhibition. It proposes the formulation of hypothesis about visitor behaviour and exhibition design issues which can be tested out in future exhibitions, and encourages the sharing of findings within the museum profession. It suggests that Australia should develop, through evaluation studies, its own body of knowledge about visitor behaviour as the visitor experience within an Australian context may be quite different to that in other countries. The Cyclic Evaluation Model was developed by the writer of the thesis both through her role as a facilitator of exhibitions and her study of evaluation taking place in the museum environment in western countries. One stage of the model (Summative Study) has been used to evaluate a specific museum exhibition. Only time will tell if it will be adopted by the museum professsion, and only if and when it is adopted can any assessment be made as to its effectiveness in encouraging the profession in Australia to embrace evaluation techniques.
-
ItemDeveloping guidelines to enhance the evaluation of overseas development projects( 1997)This thesis focuses on the cross-cultural evaluation of overseas development projects. It identifies key factors which need to be considered, in order that the evaluation process lead to the empowerment of local stakeholders. Review of prior research revealed some important components that should be examined. This resulted in the development of seven broad 'guidelines' relating to: participation; education; methodology; feedback and utilisation; enhancement of local capacity; partnership; and cross-cultural teaming. Rather than being definitive, the proposed list indicates significant aspects which could be of assistance to those working in the field. Two methods were used to validate the usefulness and comprehensiveness of the criteria listed. Firstly, a meta-evaluation was undertaken of a project evaluation conducted in Vietnam, using an open-ended schedule sent to key participants in the study. Further insights were drawn from the writer's own experience in reviewing a second Vietnamese project. The findings largely support the concepts included in the 'guidelines'. However, they provide important insights regarding possible historical, cultural and logistical constraints that might inhibit their achievement. They stress the need to focus deliberate attention on enabling the project community to design and undertake ongoing processes of self-evaluation, which recognise and extend their existing capabilities. In this context, the evaluator acts as facilitator, adviser and learner; and partnership, extending beyond the life of the project, must be carefully nurtured. The interrelationship between the 'guidelines' themselves is also noted. To neglect the notions included in one could impact negatively upon another. These new insights provide a helpful addition to the proposed list. However, the ideas need to be tested and extended further, based on the experiences of others engaged in international development evaluation in various project settings and cultural contexts. In so doing, particular attention should be given to seeking, and listening to, the views of indigenous stakeholders.
-
ItemThe international ambulance benchmarking and best practice project( 1999)This thesis addresses issues related to benchmarking, a topic of major current interest to those working in evaluation, management and cognate fields. These issues were explored through a case study in which the principles of benchmarking were applied to the monitoring of ambulance services. The case study involved the collection of data from ambulance services in several countries within an Australian project known as The International Benchmarking Project [IBP]. Consulting each of the international partner organisations via a telephone interview led to the identification of dimensions of best practice that were important in ambulance service delivery. Performance indicators were developed by translating the identified dimensions of best practice into a useful data set for monitoring the performance of ambulance services. An instrument was developed based on the best practice dimensions identified and their associated performance indicators. The structure and content of the questionnaire were developed to improve the quality of the information provided to the managers of each partner service involved. There are no examples of benchmarking in national or international ambulance studies. This thesis describes a case study of benchmarking in ambulance services, and provides a practical example of how the theories of benchmarking might be used practice. Postmodern thought provided a valuable contribution to the Project as it supported a critical review, and provided direction for addressing the issues raised. This study should contribute to understanding how benchmarking can be used to support decision making and the improvement of service provision in real life settings.
-
ItemClinical teaching styles : an evaluation by clinicians and students( 1987)This study examined an important aspect of clinical education - clinical teaching styles - from the viewpoint of both students and clinical educators. In February 1986 physiotherapy students in their third year of the Bachelor of Applied Science course at Lincoln Institute and physiotherapy clinical educators from Lincoln Institute and metropolitan and country hospitals viewed videotapes of three teaching styles and completed a questionnaire which required the respondent to rate these styles. It was hypothesized that clinicians and students would observe and react to the presentation of styles from different perspectives and therefore their ratings of the styles would differ. The results show that this hypothesis is confirmed in that while both groups preferred the "prompting" style to the "explanatory" and "non-intervention" styles, there was also a statistically significant difference between students and clinicians in rating the "explanatory" style - students higher than clinicians. Neither group rated the "non-intervention" style as helpful to learning. Students also differentiated between the effectiveness of styles for different aspects of their treatment of patients; clinicians rated the "prompting" style as appropriate for all clinical tasks. Clinical educators should take account of these differences in perception of teaching styles which may influence the effectiveness of the clinical learning experience of students.
-
ItemLearning literacy : a case study of the development of English literacy skills in two adult ESL students( 1997)This minor thesis reports on the findings of a study done of two adult international students of English as a Second Language. The study attempts to outline the issue of difficulties experienced by these students while learning to write in English in preparation for tertiary studies in Australia. The main aim of the study was to attempt to illustrate that international students need to be instructed by their teachers in how to write in the genre required for tertiary study. An attempt was made to measure the language level of the two students to determine how thoroughly prepared they were in the genre they were mainly required to write in their tertiary study. For these two students, this genre was business report writing. It was realised that although the two students had received practice in responding to General English writing tasks, they had not been taught how to write business reports. This conclusion was drawn through the study in which qualitative techniques of research and text analysis were used. Firstly, the students were given a series of reading and writing tasks to perform to determine their levels of English at the start of the study. At the end of the study there was a similar set of tasks for the students to perform. Secondly, the students and two of their teachers were interviewed. The students tried to reveal their perception of what their English Language intensive courses had taught them. The teachers who had taught these students attempted, through their responses to the interview questions, to outline the objectives of the courses they had delivered Thirdly, the students' attempt at writing report genres in their tertiary study was commented upon. At the end a short business report was selected as the target text and this was analysed. Systemic functional grammar was drawn upon to analyse the target text. The analysis of this model text was used to compare the analyses of the responses of the students to business report writing tasks. A summary of the findings is presented in this thesis and comparisons made in order to come to a conclusion that there does exist a need for overseas students intending to go on to further tertiary study to be taught explicitly through deconstruction of model texts by the teacher. The genre of the model text has to be directly related to the tertiary course of study that the students are going to follow. The students need to be provided with close guidance by their teachers, and constant practice of the genre is required.
-
ItemSearching for a fair assessment( 1995)The full implementation of the VCE in 1992 represented significant changes to senior secondary schooling in Victoria. These changes were strikingly evident in the new assessment methods and procedures of the Art test CAT. The difference between the HSC Art Appreciation examination process and the 1992 VCE Art test CAT assessment was more than a difference in practices and methods. The ideological foundations of the two examination systems were vastly different. The HSC system served to rank students so that universities could select the best candidates. The BOS promoted the VCE as more 'equitable', 'accountable' and 'inclusive 'than the HSC. These concepts derived from the recommendations of the Blackburn Report (1985) which advocated major reform of the senior curricula and assessment. I interviewed five experienced Art Appreciation examiners in order to acquire a perspective of the two examination systems during' a time of change (1987-92) and ultimately focused upon the fairness values that were evident in the examination process. I compared published policy statements regarding fairness and equity with the examination practices that the five examiners described and analysed during our interviews. The theories of Foucault and Bourdieu enabled me to understand that examinations are part of a systematic social selection process. How can 'fairness' be defined and embodied in examination practices if examinations inherently represent a form of social power? Bourdieu and Foucault nourished this type of reflection. The Blackburn Report, the views of the five examiners and the social theories of Foucault and Bourdieu led me to consider the Art test CAT (1992) as a representation of the equity values that were defended by the BOS. Fullan's theories revealed that disorder usually accompanies educational change and added -another dimension to this investigation of 'fairness and justice' in the Art Appreciation examination (1987-92). In addition, this research study evaluates the practice of the BOS policy regarding equity and fairness, as evident in the VCE Art test CAT assessment process (1992), because the Board promoted the view that the VCE would provide greater equity and fairness to all Victorian students than the HSC.
-
ItemThe graduate nursing program : an exercise in reality orientation for the beginning practitioner in transition( 1995)Graduate Nurse Education, so long taken for granted, has of recent times been trust into the clinical spotlight. This, from the clinician practitioners, as much as anyone, has come about from the changed focus of undergraduate preparation. Whilst completing baccalaureate preparation in a University has had perceived positive results from a professional perspective it has arguably resulted in graduates demonstrating different attributes to their predecessors. No longer bureaucratically encultured, and with limited exposure to the clinical setting, the requirements of the contemporary graduate program is vastly different to its historical counterpart. Whilst the academics argue the role and place of the "Graduate Year Program" this dissertation seeks to illuminate the requirements of such a program from the unique perspective of the graduate clinician participants. That a program is a requirements is taken as granted, and arguments into the role and place of these programs are presented. The abundant literature related to the experience is discussed, in a focussed sense, within the constructs of its Australian application and in particular the Victorian precepts. The sense of "de ja vue" experienced whilst reviewing the Kramer and Benner experience arguably illuminates the discussion. The Phenomenological approach to the research task, utilising the notion of grounded theory facilitates the story of the Graduates as they experience the first three months of clinical practice in a major metropolitan hospital. An attempt is made to return to the academic agenda the notion of the "Graduate Internship" with recognition of the differing emotions that this notion evokes. The experience is further validated by canvassing the Nurse Unit Manager perceptions of the process. The findings demonstrate the importance of a clinically based transition program, one that this author believes is best offered as a component of a service based practice year. The components of a practice based year are demonstrated as best being advocated by the clinician participants of the program. The validity of their insight into their requirements are born out in this dissertation. What is important is their continued exposure to the rigours of clinical practice. This, to best translate their theoretical preparation into a capacity to meet clinical service needs. Whether these objectives have been successfully achieved will be judged by the readers of this work. Make no mistake, however, that this is an important topic and requires of the profession critical reflection and revision of the impact of the critical first few months of clinical experience for the neophyte practitioner. This is a testament to their own experiences. Experiences that they have agreed to share with us. Listen to the lesson they give, and learn for the future, the future of the Nursing Profession.