Faculty of Education - Theses
Permanent URI for this collection
Search Results
1 - 4 of 4
-
ItemApplications of item response theory to identify and correct for suspect rater data( 2006)This thesis describes a plausible values imputation approach for deriving population estimates on several language proficiency domains. The approach harnessed a multi-dimensional item response analysis combining student responses, rater judgements and student background variables. The target student population was lower grade primary school students enrolled in the Hong Kong schooling system. The raters consisted of local teachers of English employed within the sampled target schools. The primary objective of this research was to impute plausible values where no data was provided or where rater data was deemed suspect. By necessity, a secondary objective of this study was to establish rules for justly excluding particular data on the basis of questionable validity. Surveys such as TIMSS, PISA and NAEP have used such "plausible value" methodologies to account for incomplete test designs and person non-response (Beaton & Johnson, 1990; Yamamoto & Kulick, 2000; Adams & Wu, 2002). The point of difference between this study and other similar studies was the use of item response theory (in particular plausible values imputation) to identify and correct for invalid rater judgements in a large-scale educational survey. An additional research outcome included a derived index of rater data quality based upon imputation scores.
-
ItemDiagnostic reasoning teaching : an analysis of expert teacher behaviour in a clinical setting( 2008)Clinical reasoning is a cognitive process that uses data collected from and about a patient to make a diagnosis and develop and implement a therapeutic plan. Clinical reasoning may be usefully divided into diagnostic and therapeutic reasoning. Diagnostic reasoning is a problem solving task of categorization where information from the patient interview, physical examination and investigations are used formulate diagnostic hypotheses (a differential diagnosis) and eventually (and ideally) a single diagnosis. Therapeutic reasoning derives a therapeutic plan from the diagnosis and the wishes of the patient and implements the plan in the context of specific measurable outcomes. The diagnostic reasoning processes of novices and experts have been extensively evaluated. A variety of reasoning strategies have been identified including causal, probabilistic, deterministic and hypothetico-deductive reasoning and pattern recognition. Clinicians use, at different times and with different patient problems, any or all of these strategies. Novices are more likely to use causal and hypothetico-deductive reasoning whereas experts are more likely to apply pattern recognition. The quality and fidelity of the diagnostic reasoning process is also (and substantially) influenced by the knowledge organization of the clinician. Novices are more likely to have their knowledge organized as prototypes and instance scripts which rely on bioscience knowledge and less clinical experience whereas experts use illness scripts and semantic networks which are rich in data collected from their previous experience and relies little on bioscience knowledge. The teaching of diagnostic reasoning changed substantially with the implementation of problem-based learning (PBL) curricula by medical schools from the late 1960s onwards. PBL employs the principles of adult learning theory and hypothetico-deductive reasoning to explore clinical cases in the bioscience years of the medical course. The implementation of PBL curricula resulted in greater student and teacher satisfaction but there is little evidence that the knowledge and skills of the students are different to traditional more didactic curricula. A small body of evidence suggests that students of PBL courses have better diagnostic reasoning skills. The teaching of diagnostic reasoning in the clinical years of a medical course is less well understood. Traditional patient-based discussions at the bedside or in a tutorial room have been the mainstay of clinical education for many years. The effectiveness of this style of this traditional "bedside" clinical teaching to teach diagnostic reasoning has not been evaluated but many recommendations about teaching and learning styles have been published. In order to examine the teaching of diagnostic reasoning by expert clinician teachers a model of novice diagnostic reasoning was developed from the literature which was used as a framework for analysis. In this model three phases of novice diagnostic reasoning were identified - data acquisition, problem representation and hypothesis generation and refinement. The study presented in this thesis examined teacher behaviour in six seminaturalistic "bedside" tutorials designed to promote diagnostic reasoning discussions. Each tutorial was led by an expert teacher, who had won the teacher of the year award (determined by student vote), with a group of medical students in their first clinical year and an experienced simulated patient. The simulated patient delivered a script that was deliberately diagnostically inconclusive. Each session was videotaped and analysed using Studiocode (video analysis software). The coding first attributed each utterance to the teacher, a student or the patient. The teacher utterances were then sub-coded to the phases of the novice diagnostic reasoning process (data acquisition, problem representation and hypothesis generation/refinement). Teacher utterances in each phase of the novice diagnostic reasoning model were examined to identify illustrative examples of teaching behaviours consistent with excellent teachers (derived from the previous literature) including requests, direct instruction, questioning/probing, scaffolding, modeling and feedback. Finally, in the hypothesis generation and refinement phase of each tutorial, teacher utterances were further examined for illustrative examples of the teaching of causal, probabilistic, deterministic and hypothetico-deductice reasoning and pattern recognition. Six expert teachers participated in the tutorials (3 physicians and 3 surgeons, 4 male and 2 female). The teachers, on average, spoke for 56% (range 43-64%) of the tutorial (average length 56 minutes). Physicians and surgeon talk proportions were not different (56% vs 56%). Of the teacher utterances 55% were coded to the hypothesis generation/refinement phase, 31% to the data acquisition phase and 3% to the problem representation phase. During the data acquisition and hypothesis generation/refinement phases of the tutorial illustrative examples of direct instruction, questioning/probing, scaffolding, modeling and feedback were identified in the teacher utterances. In the problem representation phase only illustrative examples of direct instruction, modeling and feedback were identified. In the hypothesis generation and refinement phase illustrative examples of the teaching of causal, probabilistic and hypothetico-deductive reasoning and pattern recognition course but not deterministic reasoning were identified in the teacher utterances. This study examined the behaviour of expert teachers in semi naturalistic tutorials designed to promote the teaching of diagnostic reasoning. In these tutorials the teacher typically spoke for more than half of the tutorial. The teacher utterances were coded into all three phases of the novice diagnostic reasoning model but least time was spent in the problem representation phase. Illustrative examples of excellent teaching behaviour were identified in most of the phases of the novice diagnostic reasoning process. Illustrative examples of most diagnostic reasoning types were identified in the tutorials. The results of this study would suggest that further research is required to determine the "optimum" teacher talk time in a clinical (and other) tutorial and the effectiveness of teaching about the problem representation phase of diagnostic reasoning.
-
ItemFactors affecting student choice of environmental science and outdoor and environmental studies as senior secondary school subjects within Victoria( 2008)The purpose of this study was to explore whether gender, ethnic, socioeconomic, and aspiration differences could be found among Year 10 students who chose and did not choose the Victorian Certificate of Education (VCE) subjects Environmental Science (ES) and Outdoor and Environmental Studies (OES) for Year 11. This study also sought to explore whether differences in levels of environmental concern could be detected among those selecting and those not selecting these subjects, and what the major reasons for students' choices were. Descriptive statistical procedures were employed to answer the research questions on the convenience sample that was obtained, which was composed of 126 students from eight different secondary schools (seven government and one Catholic) in 2007. Specifically, quantitative and qualitative methods of data analysis were used. Boys, in comparison with girls, were found to be more likely to enrol in ES and OES. Similarly, students from English speaking backgrounds were found to be more likely to enrol in these subjects than students from non-English speaking backgrounds. Students from lower socioeconomic backgrounds were shown to be more likely to enrol in ES than those from higher socioeconomic backgrounds, and students with aspirations to higher education (as opposed to those without such aspirations) and middle status occupations (as opposed to those aiming for lower and higher status occupations) were more likely to enrol in OES. It was also found that, within the sample, students had similar levels of environmental concern regardless of what subjects they had chosen, suggesting that students' choice of ES and OES was influenced by other factors. Finally, the major reasons students believed they chose or did not choose ES and OES were explored using qualitative techniques. It was found that the major reasons for choosing ES were: the perception that the subject would be interesting/enjoyable, a desire to learn about the environment, a desire to care for the environment, a love of animals and the perceived career value of the subject (consecutively). Conversely, the major reasons for not choosing ES were (in order): the perception that ES would be uninteresting/boring, the perceived lack of career value of the subject, a preference for other subjects, a dislike of science, and a lack of care for the environment. The major reasons that sampled students claimed to choose OES were, in descending order: love of the outdoors and physical activity, the perception that OES would be interesting/enjoyable, the perception that OES would be different to traditional VCE subjects, a desire to learn about the environment, and a desire to care for the environment. On the other hand, the biggest reasons for not choosing this subject were: the perceived lack of career value of the subject, a preference for other subjects, the perception that OES would be uninteresting/boring, a professed ignorance about OES, and a dislike of science (consecutively). This study addressed a gap in knowledge regarding the factors that affect students' choice of environmental subjects when these courses are made available, contributing to the already significant body of literature on both the student voice in EE, and subject selection. A model of participation was built up for each subject based on the results of this analysis, that could serve as a practical guide for educators of ES and OES in terms of improving the marketing of their subjects, and that could potentially help turn around the worryingly low enrolments in both these courses at VCE. Recommendations for the direction of further research into EE were also made.
-
ItemEvaluating the Santa Maria College information literacy program( 2007)This is an impact study, which evaluates an Information Literacy Program that has been running in the Santa Maria College Library since February 2000. It investigates the effectiveness of the Program inputs and processes and seeks to identify impacts on learning in student outputs and College wide outcomes. The study builds on previous research that was conducted from 2000 to 2004 and seeks to develop new understandings through new methods. This study draws on literature that examines methods of collecting evidence of learning impact in school libraries. The literature recommends micro-research in secondary schools that examines students' skills before and after they have been involved in integrated information literacy instruction, as well as empirical studies about the impact of the six step research process model on learning. The literature also suggests investigation of the impact of school libraries on the broad aspects of learning, and the development and application of new methods for collecting qualitative data in the library setting. From Terms One to Term Four in 2005, mixed methods were used to capture evidence of student learning in the Santa Maria College Library. Students were observed as they carried out Program research tasks. The assignments that they produced at the end of the research process were assessed. Surveys and focus group interviews explored the perceptions of a sample of the students and teachers who participated in the Program. In exploring the data, changes in learning behaviour and attitudes to the research process were identified and analysed. The effectiveness of various aspects of the Program such as task design, explicit process instruction, cognitive strategies, note taking scaffolds and assessment practices were examined. Two theoretical frameworks synthesised from the literature were used in the research. The first framework is based on criteria for effective libraries such as staffing, funding, collection size and technological infrastructure. The second framework combines the effective approaches to learning in school libraries that are evident in the literature. Those frameworks were applied to assess the pre-conditions for learning in the Santa Maria Library. A third framework based on criteria that identify outcomes and indicators of student learning in school libraries, was used to identify evidence of student learning across the data sets. The key research questions were used to organise the discussion of the findings. The findings demonstrated that student outcomes have improved in a broad range of learning experiences. The study deepened my understanding of the distinctive features of the Program and its strengths and weaknesses. The strengths included: the use of constructivist pedagogy and inquiry learning; the collaborative planning, implementation and review processes; the infusion of the learning activities in real units of work; the learning scaffolds and instructional interventions at the point of need; and the assessment and feedback strategies. All of those inputs and processes are critical success factors in the Program. The note taking grids and the associated skill development in reading for meaning, identifying and recording key points, and combining information for final products are particularly effective aspects of the Program, which were highly regarded by the students. The weaknesses of the Program included: the gradual erosion of collaborative planning, implementation and evaluation processes; a general feeling of Program fatigue; the fact that the assessment of student outputs to track Progress is not standard practice; and the lack of a process for fading scaffolds in the Year 9 and 10 levels to shift control of the learning process from the teachers and teacher librarians to the students as they move through the Program. The study incorporates a series of recommendations for ongoing monitoring, and future Program delivery and implementation.