Faculty of Education - Theses
Permanent URI for this collection
Search Results
1 - 10 of 13
-
ItemRater consistency and judgment in the direct assessment of second language writing ability within the certificates in spoken and written English( 1998)The introduction of competency-based models of language and literacy education in Australia has, to a large degree, coincided with an increased emphasis on direct assessment as the most common means of evaluating second language writing ability within the Adult Migrant English Program. The key problem in directly assessing writing ability is having two or more raters arrive at a similar judgment or rating for the same piece of writing. While there is a long tradition of research on rater consistency and judgment in the holistic assessment of writing ability, similar research on the direct assessment of second language writing ability within the context of competency-based language and literacy education is almost non-existent. This study aims to determine the degree to which the performance criteria designed to assess second language writing ability within the Certificates in Spoken and Written English can ensure acceptable levels of rater consistency, and to describe the decision-making behaviours and strategies used by raters when reading for the purposes of assessment. The think-aloud verbal reports of six experienced ESL raters assessing three texts written by intermediate level adult ESL learners were transcribed and subjected to a rigorous interpretive analysis. In terms of rater consistency, analysis of raters verbal reports indicated that while there was generally a high degree of rater consistency at the overall performance or text level there was considerably tess agreement at the level of individual performance criteria. Analysis of the data revealed that raters adopted distinctive styles or approaches to reading for the purposes of assessment and that raters interpreted and applied the performance criteria statements in a range of different ways. These findings have significant implications not only for the development of competency-based assessment procedures but also for the training of raters. v11
-
ItemApplications of item response theory to identify and correct for suspect rater data( 2006)This thesis describes a plausible values imputation approach for deriving population estimates on several language proficiency domains. The approach harnessed a multi-dimensional item response analysis combining student responses, rater judgements and student background variables. The target student population was lower grade primary school students enrolled in the Hong Kong schooling system. The raters consisted of local teachers of English employed within the sampled target schools. The primary objective of this research was to impute plausible values where no data was provided or where rater data was deemed suspect. By necessity, a secondary objective of this study was to establish rules for justly excluding particular data on the basis of questionable validity. Surveys such as TIMSS, PISA and NAEP have used such "plausible value" methodologies to account for incomplete test designs and person non-response (Beaton & Johnson, 1990; Yamamoto & Kulick, 2000; Adams & Wu, 2002). The point of difference between this study and other similar studies was the use of item response theory (in particular plausible values imputation) to identify and correct for invalid rater judgements in a large-scale educational survey. An additional research outcome included a derived index of rater data quality based upon imputation scores.
-
ItemInstitutional influences on approaches to teaching within a flexible university : a cultural historical investigation( 2010)This study investigated the teaching approaches of two business academics located within an Australian university developing its flexible teaching and learning practices over the past twenty years. The interview subjects are highly regarded educators with formative backgrounds in on-campus or off-campus distance teaching. Each has had a long professional relationship with the researcher in her centrally situated position's as an educational developer within the institution. A review of the student learning literature pertaining to teaching and learning approaches in the higher education sector over the last thirty years, shows that "teaching approaches" can influence "student learning approaches"(Ramsden, Paul 2003) and outcomes, (Biggs, J. 2003; Lizzio, Alf, Wilson, Keithia & Simons, Roland 2002) however "institutional influences" upon teaching approaches seems to be substantially overlooked. (Kernber & Kwan 2000) The academics were invited to participate in this study agreeing to retrospectively review and discuss their teaching in three progressive phases of their working history. They were invited to consider their teaching approach using the Approach to Teaching Inventory (Trigwell, Prosser et. al. 2005) in order to reflect upon their personal positioning (Harre September 2004), institutional practice and societal rhetoric in relation to an academic life in various periods of their teaching history. Discursive analysis has been undertaken of the resulting conversations guided by Cultural Historical Analysis Theory, (Vygotsky 1978, Engestrom 1987). This investigation reveals profound institutional influences on the approaches of teachers to their work. Influences on academic life have usually been studied independent of the Higher education teaching and learning literature. This study points to an urgent need to integrate these research interests to inform understanding of material transformative activity for policy makers in higher education.
-
ItemClinical teaching styles : an evaluation by clinicians and students( 1987)This study examined an important aspect of clinical education - clinical teaching styles - from the viewpoint of both students and clinical educators. In February 1986 physiotherapy students in their third year of the Bachelor of Applied Science course at Lincoln Institute and physiotherapy clinical educators from Lincoln Institute and metropolitan and country hospitals viewed videotapes of three teaching styles and completed a questionnaire which required the respondent to rate these styles. It was hypothesized that clinicians and students would observe and react to the presentation of styles from different perspectives and therefore their ratings of the styles would differ. The results show that this hypothesis is confirmed in that while both groups preferred the "prompting" style to the "explanatory" and "non-intervention" styles, there was also a statistically significant difference between students and clinicians in rating the "explanatory" style - students higher than clinicians. Neither group rated the "non-intervention" style as helpful to learning. Students also differentiated between the effectiveness of styles for different aspects of their treatment of patients; clinicians rated the "prompting" style as appropriate for all clinical tasks. Clinical educators should take account of these differences in perception of teaching styles which may influence the effectiveness of the clinical learning experience of students.
-
ItemLearning literacy : a case study of the development of English literacy skills in two adult ESL students( 1997)This minor thesis reports on the findings of a study done of two adult international students of English as a Second Language. The study attempts to outline the issue of difficulties experienced by these students while learning to write in English in preparation for tertiary studies in Australia. The main aim of the study was to attempt to illustrate that international students need to be instructed by their teachers in how to write in the genre required for tertiary study. An attempt was made to measure the language level of the two students to determine how thoroughly prepared they were in the genre they were mainly required to write in their tertiary study. For these two students, this genre was business report writing. It was realised that although the two students had received practice in responding to General English writing tasks, they had not been taught how to write business reports. This conclusion was drawn through the study in which qualitative techniques of research and text analysis were used. Firstly, the students were given a series of reading and writing tasks to perform to determine their levels of English at the start of the study. At the end of the study there was a similar set of tasks for the students to perform. Secondly, the students and two of their teachers were interviewed. The students tried to reveal their perception of what their English Language intensive courses had taught them. The teachers who had taught these students attempted, through their responses to the interview questions, to outline the objectives of the courses they had delivered Thirdly, the students' attempt at writing report genres in their tertiary study was commented upon. At the end a short business report was selected as the target text and this was analysed. Systemic functional grammar was drawn upon to analyse the target text. The analysis of this model text was used to compare the analyses of the responses of the students to business report writing tasks. A summary of the findings is presented in this thesis and comparisons made in order to come to a conclusion that there does exist a need for overseas students intending to go on to further tertiary study to be taught explicitly through deconstruction of model texts by the teacher. The genre of the model text has to be directly related to the tertiary course of study that the students are going to follow. The students need to be provided with close guidance by their teachers, and constant practice of the genre is required.
-
ItemTIMSS : a question of validity( 2000)The Third International Mathematics and Science Study (TIMSS), the largest comparative study of its kind, was administered to approximately 500,000 students worldwide. In Australia, the results of this study are being used to compare our students and schools to other students and schools around the world. The results may also influence decisions about curriculum reform and allocation of educational funding within Australia. This thesis sets out to investigate the TIMSS test items for Population 2, with the objective of determining the degree of validity of these test items to Australian mathematics teachers and their students. By eliciting feedback from a sample of Australian mathematics teachers, their thoughts on the validity of the TIMSS test items were documented. This was achieved through a mail out questionnaire that included a representative sample of 32 TIMSS test items from population 2. Four review questions were developed to target teacher beliefs as to whether enough content had been taught to Australian students by the time TIMSS was administered, the validity of including such items in the TIMSS study, the usefulness of the TIMSS test items for ascertaining student competence, and student familiarity with the item styles used in TIMSS. The results from the questionnaire were used to establish the overall validity of the TIMSS test items to Australian Mathematics teachers and the students they teach. In total, 154 teachers, representing Government, Catholic and Independent schools, from around Australia replied to the questionnaire. The study found widespread variability in the type and amount of content taught by teachers to their Australian students. Consequently, differences in content validity of the TIMSS study were found to exist across Australia. These differences appeared to be more apparent between states and territories than between school sectors. Respondents also expressed concern about the general appearance and layout of the TIMSS test items. In particular, some of the language used in test items relating to Proportionality, appeared not to be used in Australian classrooms. In addition to this, teachers reported that the TIMSS test items were not particularly useful for ascertaining student competence. This casts doubt over the value of any inferences made from the results of TIMSS. Furthermore, this research found significant variability in student familiarity with the item formats used in the TIMSS study. Overall, students were found to be most familiar with the short answer format and least familiar with extended response and performance assessment formats. This is a particularly important result as the TIMSS designers placed great emphasis on the use of extended response and performance assessment formats.
-
ItemCaught in the middle : teachers' perceptions of the usefulness of the Record of oral language when used with ESL students( 2004)In the present educational context, large-scale literacy reform has been hotly debated in the media by various stakeholders while on the other hand the " voice that has been largely absent from these debates has been that of teachers". This study attempts to correct this imbalance by reporting on a study of teachers' perceptions of the usefulness of the ROL as a testing tool for students learning English as a second language. It was designed to offer the researcher, the participants and other stakeholders great insight into the current complexities that teachers face when assessing the oral competence of students learning English as a second language. Teachers were given the opportunity to critically examine their own assumptions, beliefs and practices about oral language learning and assessment and challenge the current use of the ROL in the Children's Literacy Success Strategy (CLaSS) program. A qualitative case study approach was selected to allow the voices of the participants and the researcher to be heard in a familiar setting. Thirty minute semi-structured interviews were conducted separately so that teachers could speak freely thus enabling the researcher to follow individual trains of thought and obtain in-depth responses. The study concluded that the usefulness of the Record of Oral Language as a testing tool for students from language backgrounds other than English was not the central issue. Research findings instead highlighted the difficulties faced by mainstream teachers expected to effectively assess the oral language skills of students for whom English is a second language without effective Professional Development support. The central issue that has emerged in this study is the place of teacher professional knowledge for these teachers of ESL students. Not only are ESL students disadvantaged in the current educational climate but so are the mainstream teachers. Teachers' responses to this study reaffirm the need for Professional Development in ESL pedagogy as a way to effectively support the Oral Language and Literacy Learning of ESL which was valued pre Literacy Advance.
-
ItemThe graduate nursing program : an exercise in reality orientation for the beginning practitioner in transition( 1995)Graduate Nurse Education, so long taken for granted, has of recent times been trust into the clinical spotlight. This, from the clinician practitioners, as much as anyone, has come about from the changed focus of undergraduate preparation. Whilst completing baccalaureate preparation in a University has had perceived positive results from a professional perspective it has arguably resulted in graduates demonstrating different attributes to their predecessors. No longer bureaucratically encultured, and with limited exposure to the clinical setting, the requirements of the contemporary graduate program is vastly different to its historical counterpart. Whilst the academics argue the role and place of the "Graduate Year Program" this dissertation seeks to illuminate the requirements of such a program from the unique perspective of the graduate clinician participants. That a program is a requirements is taken as granted, and arguments into the role and place of these programs are presented. The abundant literature related to the experience is discussed, in a focussed sense, within the constructs of its Australian application and in particular the Victorian precepts. The sense of "de ja vue" experienced whilst reviewing the Kramer and Benner experience arguably illuminates the discussion. The Phenomenological approach to the research task, utilising the notion of grounded theory facilitates the story of the Graduates as they experience the first three months of clinical practice in a major metropolitan hospital. An attempt is made to return to the academic agenda the notion of the "Graduate Internship" with recognition of the differing emotions that this notion evokes. The experience is further validated by canvassing the Nurse Unit Manager perceptions of the process. The findings demonstrate the importance of a clinically based transition program, one that this author believes is best offered as a component of a service based practice year. The components of a practice based year are demonstrated as best being advocated by the clinician participants of the program. The validity of their insight into their requirements are born out in this dissertation. What is important is their continued exposure to the rigours of clinical practice. This, to best translate their theoretical preparation into a capacity to meet clinical service needs. Whether these objectives have been successfully achieved will be judged by the readers of this work. Make no mistake, however, that this is an important topic and requires of the profession critical reflection and revision of the impact of the critical first few months of clinical experience for the neophyte practitioner. This is a testament to their own experiences. Experiences that they have agreed to share with us. Listen to the lesson they give, and learn for the future, the future of the Nursing Profession.
-
ItemDiagnostic reasoning teaching : an analysis of expert teacher behaviour in a clinical setting( 2008)Clinical reasoning is a cognitive process that uses data collected from and about a patient to make a diagnosis and develop and implement a therapeutic plan. Clinical reasoning may be usefully divided into diagnostic and therapeutic reasoning. Diagnostic reasoning is a problem solving task of categorization where information from the patient interview, physical examination and investigations are used formulate diagnostic hypotheses (a differential diagnosis) and eventually (and ideally) a single diagnosis. Therapeutic reasoning derives a therapeutic plan from the diagnosis and the wishes of the patient and implements the plan in the context of specific measurable outcomes. The diagnostic reasoning processes of novices and experts have been extensively evaluated. A variety of reasoning strategies have been identified including causal, probabilistic, deterministic and hypothetico-deductive reasoning and pattern recognition. Clinicians use, at different times and with different patient problems, any or all of these strategies. Novices are more likely to use causal and hypothetico-deductive reasoning whereas experts are more likely to apply pattern recognition. The quality and fidelity of the diagnostic reasoning process is also (and substantially) influenced by the knowledge organization of the clinician. Novices are more likely to have their knowledge organized as prototypes and instance scripts which rely on bioscience knowledge and less clinical experience whereas experts use illness scripts and semantic networks which are rich in data collected from their previous experience and relies little on bioscience knowledge. The teaching of diagnostic reasoning changed substantially with the implementation of problem-based learning (PBL) curricula by medical schools from the late 1960s onwards. PBL employs the principles of adult learning theory and hypothetico-deductive reasoning to explore clinical cases in the bioscience years of the medical course. The implementation of PBL curricula resulted in greater student and teacher satisfaction but there is little evidence that the knowledge and skills of the students are different to traditional more didactic curricula. A small body of evidence suggests that students of PBL courses have better diagnostic reasoning skills. The teaching of diagnostic reasoning in the clinical years of a medical course is less well understood. Traditional patient-based discussions at the bedside or in a tutorial room have been the mainstay of clinical education for many years. The effectiveness of this style of this traditional "bedside" clinical teaching to teach diagnostic reasoning has not been evaluated but many recommendations about teaching and learning styles have been published. In order to examine the teaching of diagnostic reasoning by expert clinician teachers a model of novice diagnostic reasoning was developed from the literature which was used as a framework for analysis. In this model three phases of novice diagnostic reasoning were identified - data acquisition, problem representation and hypothesis generation and refinement. The study presented in this thesis examined teacher behaviour in six seminaturalistic "bedside" tutorials designed to promote diagnostic reasoning discussions. Each tutorial was led by an expert teacher, who had won the teacher of the year award (determined by student vote), with a group of medical students in their first clinical year and an experienced simulated patient. The simulated patient delivered a script that was deliberately diagnostically inconclusive. Each session was videotaped and analysed using Studiocode (video analysis software). The coding first attributed each utterance to the teacher, a student or the patient. The teacher utterances were then sub-coded to the phases of the novice diagnostic reasoning process (data acquisition, problem representation and hypothesis generation/refinement). Teacher utterances in each phase of the novice diagnostic reasoning model were examined to identify illustrative examples of teaching behaviours consistent with excellent teachers (derived from the previous literature) including requests, direct instruction, questioning/probing, scaffolding, modeling and feedback. Finally, in the hypothesis generation and refinement phase of each tutorial, teacher utterances were further examined for illustrative examples of the teaching of causal, probabilistic, deterministic and hypothetico-deductice reasoning and pattern recognition. Six expert teachers participated in the tutorials (3 physicians and 3 surgeons, 4 male and 2 female). The teachers, on average, spoke for 56% (range 43-64%) of the tutorial (average length 56 minutes). Physicians and surgeon talk proportions were not different (56% vs 56%). Of the teacher utterances 55% were coded to the hypothesis generation/refinement phase, 31% to the data acquisition phase and 3% to the problem representation phase. During the data acquisition and hypothesis generation/refinement phases of the tutorial illustrative examples of direct instruction, questioning/probing, scaffolding, modeling and feedback were identified in the teacher utterances. In the problem representation phase only illustrative examples of direct instruction, modeling and feedback were identified. In the hypothesis generation and refinement phase illustrative examples of the teaching of causal, probabilistic and hypothetico-deductive reasoning and pattern recognition course but not deterministic reasoning were identified in the teacher utterances. This study examined the behaviour of expert teachers in semi naturalistic tutorials designed to promote the teaching of diagnostic reasoning. In these tutorials the teacher typically spoke for more than half of the tutorial. The teacher utterances were coded into all three phases of the novice diagnostic reasoning model but least time was spent in the problem representation phase. Illustrative examples of excellent teaching behaviour were identified in most of the phases of the novice diagnostic reasoning process. Illustrative examples of most diagnostic reasoning types were identified in the tutorials. The results of this study would suggest that further research is required to determine the "optimum" teacher talk time in a clinical (and other) tutorial and the effectiveness of teaching about the problem representation phase of diagnostic reasoning.
-
ItemFactors affecting student choice of environmental science and outdoor and environmental studies as senior secondary school subjects within Victoria( 2008)The purpose of this study was to explore whether gender, ethnic, socioeconomic, and aspiration differences could be found among Year 10 students who chose and did not choose the Victorian Certificate of Education (VCE) subjects Environmental Science (ES) and Outdoor and Environmental Studies (OES) for Year 11. This study also sought to explore whether differences in levels of environmental concern could be detected among those selecting and those not selecting these subjects, and what the major reasons for students' choices were. Descriptive statistical procedures were employed to answer the research questions on the convenience sample that was obtained, which was composed of 126 students from eight different secondary schools (seven government and one Catholic) in 2007. Specifically, quantitative and qualitative methods of data analysis were used. Boys, in comparison with girls, were found to be more likely to enrol in ES and OES. Similarly, students from English speaking backgrounds were found to be more likely to enrol in these subjects than students from non-English speaking backgrounds. Students from lower socioeconomic backgrounds were shown to be more likely to enrol in ES than those from higher socioeconomic backgrounds, and students with aspirations to higher education (as opposed to those without such aspirations) and middle status occupations (as opposed to those aiming for lower and higher status occupations) were more likely to enrol in OES. It was also found that, within the sample, students had similar levels of environmental concern regardless of what subjects they had chosen, suggesting that students' choice of ES and OES was influenced by other factors. Finally, the major reasons students believed they chose or did not choose ES and OES were explored using qualitative techniques. It was found that the major reasons for choosing ES were: the perception that the subject would be interesting/enjoyable, a desire to learn about the environment, a desire to care for the environment, a love of animals and the perceived career value of the subject (consecutively). Conversely, the major reasons for not choosing ES were (in order): the perception that ES would be uninteresting/boring, the perceived lack of career value of the subject, a preference for other subjects, a dislike of science, and a lack of care for the environment. The major reasons that sampled students claimed to choose OES were, in descending order: love of the outdoors and physical activity, the perception that OES would be interesting/enjoyable, the perception that OES would be different to traditional VCE subjects, a desire to learn about the environment, and a desire to care for the environment. On the other hand, the biggest reasons for not choosing this subject were: the perceived lack of career value of the subject, a preference for other subjects, the perception that OES would be uninteresting/boring, a professed ignorance about OES, and a dislike of science (consecutively). This study addressed a gap in knowledge regarding the factors that affect students' choice of environmental subjects when these courses are made available, contributing to the already significant body of literature on both the student voice in EE, and subject selection. A model of participation was built up for each subject based on the results of this analysis, that could serve as a practical guide for educators of ES and OES in terms of improving the marketing of their subjects, and that could potentially help turn around the worryingly low enrolments in both these courses at VCE. Recommendations for the direction of further research into EE were also made.