Minerva Elements Records

Permanent URI for this collection

Search Results

Now showing 1 - 10 of 25
  • Item
    Thumbnail Image
    Feedback in higher education: aligning academic intent and student sensemaking
    Ryan, T ; Henderson, M ; Ryan, K ; Kennedy, G (ROUTLEDGE JOURNALS, TAYLOR & FRANCIS LTD, 2022-01-25)
    Research indicates that effective learner-centred feedback requires learner agency, impact and sensemaking. While scholars are focusing on supporting agency and impact, limited research has addressed sensemaking. This is problematic, because if learners fail to understand feedback, impact is likely to be reduced. In response, this study examines (non) alignment between teacher intent and student sensemaking of authentic feedback comments. The sample included four teachers and eighteen students from two Australian universities. Data were collected via stimulated recall interviews and a feedback coding task. The results suggest that sensemaking of strength-based comments, critiques and actionable information was aided when the comments were clear and specific. On the other hand, sensemaking was limited when comments were designed to mitigate against negative affect, overloaded with multiple intentions, or overly brief. This study informs theory around learner-centred feedback design which, in turn, improves the likelihood that teacher comments will be interpreted accurately by learners.
  • Item
    Thumbnail Image
    The role of students’ motivation and participation in predicting performance in a MOOC Motivation and participation in MOOCs
    DE BARBA, P ; Kennedy, G ; Ainley, M (John Wiley & Sons, 2016)
    Over the last 5 years, massive open online courses (MOOCs) have increasingly provided learning opportunities across the world in a variety of domains. As with many emerging educational technologies, why and how people come to MOOCs needs to be better understood and importantly what factors contribute to learners’ MOOC performance. It is known that online learning environments require greater levels of self-regulation, and that high levels of motivation are crucial to activate these skills. However, motivation is a complex construct and research on how it functions inMOOCs is still in its early stages. Research presented in this article investigated how motivation and participation influence students’ performance in a MOOC, more specifically those students who persist to the end of the MOOC. Findings indicated that the strongest predictor of performance was participation, followed by motivation. Motivation influenced and was influenced by students’ participation during the course.Moreover, situational interest played a crucial role in mediating the impact of general intrinsic motivation and participation on performance. The results are discussed in relation to how educators and designers of MOOCs can use knowledge emerging from motivational assessments and participation measures gleaned from learning analytics to tailor the design and delivery of courses.
  • Item
    Thumbnail Image
    Region-Specific Automated Feedback in Temporal Bone Surgery Simulation
    Wijewickrema, S ; Ioannou, I ; Zhou, Y ; Piromchai, P ; Bailey, J ; Kennedy, G ; O'Leary, S ; Traina, C ; Rodrigues, PP ; Kane, B ; Mazzoncini de Azevedo Marques, P ; Traina, AJM (IEEE, 2015)
    The use of virtual reality simulators for surgical training has gained popularity in recent years, with an ever increasing body of evidence supporting the benefits and validity of simulation-based training. However, a crucial component of effective skill acquisition has not been adequately addressed, namely the provision of timely performance feedback. The utility of a surgical simulator is limited if it still requires the presence of experts to guide trainees. Automated feedback that emulates the advise provided by experts is necessary to facilitate independent learning. We propose an automated system that provides region-specific feedback on surgical technique within a temporal bone surgery simulator. The design of this system allows easy transfer of feedback models to multiple temporal bone specimens in the simulator. The system was validated by an expert otologist and was found to provide highly accurate and timely feedback.
  • Item
    Thumbnail Image
    Presentation of automated procedural guidance in surgical simulation: results of two randomised controlled trials
    Wijewickrema, S ; Zhou, Y ; Ioannou, I ; Copson, B ; Piromchai, P ; Yu, C ; Briggs, R ; Bailey, J ; Kennedy, G ; O'Leary, S (Cambridge University Press, 2018-03)
    OBJECTIVE: To investigate the effectiveness and usability of automated procedural guidance during virtual temporal bone surgery. METHODS: Two randomised controlled trials were performed to evaluate the effectiveness, for medical students, of two presentation modalities of automated real-time procedural guidance in virtual reality simulation: full and step-by-step visual presentation of drillable areas. Presentation modality effectiveness was determined through a comparison of participants' dissection quality, evaluated by a blinded otologist, using a validated assessment scale. RESULTS: While the provision of automated guidance on procedure improved performance (full presentation, p = 0.03; step-by-step presentation, p < 0.001), usage of the two different presentation modalities was vastly different (full presentation, 3.73 per cent; step-by-step presentation, 60.40 per cent). CONCLUSION: Automated procedural guidance in virtual temporal bone surgery is effective in improving trainee performance. Step-by-step presentation of procedural guidance was engaging, and therefore more likely to be used by the participants.
  • Item
    Thumbnail Image
    The Construct Validity and Reliability of an Assessment Tool for Competency in Cochlear Implant Surgery
    Piromchai, P ; Kasemsiri, P ; Wijewickrema, S ; Ioannou, I ; Kennedy, G ; O'Leary, S (HINDAWI LTD, 2014)
    INTRODUCTION: We introduce a rating tool that objectively evaluates the skills of surgical trainees performing cochlear implant surgery. METHODS: Seven residents and seven experts performed cochlear implant surgery sessions from mastoidectomy to cochleostomy on a standardized virtual reality temporal bone. A total of twenty-eight assessment videos were recorded and two consultant otolaryngologists evaluated the performance of each participant using these videos. RESULTS: Interrater reliability was calculated using the intraclass correlation coefficient for both the global and checklist components of the assessment instrument. The overall agreement was high. The construct validity of this instrument was strongly supported by the significantly higher scores in the expert group for both components. CONCLUSION: Our results indicate that the proposed assessment tool for cochlear implant surgery is reliable, accurate, and easy to use. This instrument can thus be used to provide objective feedback on overall and task-specific competency in cochlear implantation.
  • Item
    Thumbnail Image
    Writing analytics across essay tasks with different cognitive load demands
    Oliveira, EA ; Conijn, R ; Galvao De Barba, P ; Trezise, K ; van Zaanen, M ; Kennedy, G ; Gregory, S ; Warburton, S ; Parkes, M (ASCILITE, 2020)
    Essay tasks are a widely used form of assessment in higher education. Writing analytics can assist with challenges related to using essay tasks at scale and to identifying different issues in academic integrity. In this paper, we combined two techniques to investigate how students’ writing analytics varied across essay tasks with different cognitive load, considering both their typing behavior (i.e., writing process) and writing style (i.e., writing product). We also examined their relationship across these essay tasks. Findings showed that writing processes change across tasks with different cognitive load: when cognitive load increases, the interword intervals (indicator of planning and/or reviewing processes) increased, the burst length (indicator of translation processes) decreased, and the number of revisions per minute (indicator of reviewing processes) decreased. In contrast to the relation between the writing process and cognitive load, the relation between the writing product and cognitive load was found less clear. The results showed small and mixed effects of the tasks differing in cognitive load on the different writing product metrics. Hence, although the writing product follows from the writing process, the relation between cognitive load and the writing product and process appears to be less straightforward.
  • Item
    Thumbnail Image
    Do experts practice what they profess?
    Zhou, Y ; Wijewickrema, S ; Ioannou, I ; Bailey, J ; Kennedy, G ; Nestel, D ; O'Leary, S ; Dalby, AR (PUBLIC LIBRARY SCIENCE, 2018-01-05)
    We investigated the variation of drilled regions of expert and trainee surgeons performing virtual temporal bone surgery to identify their compliance with standard drilling procedures. To this end, we recruited seven expert and six trainee ENT surgeons, who were asked to perform the surgical preparations for cochlear implantation on a virtual temporal bone. The temporal bone was divided into six regions using a semi-automated approach. The drilled area in each region was compared between groups using a sign test. Similarity within groups was calculated as a ratio of voxels (3D points) drilled by at least 75% of surgeons and at least 25% of surgeons. We observed a significant difference between groups when performing critical tasks such as exposing the facial nerve, opening the facial recess, and finding the round window. In these regions, experts' practice is more similar to each other than that between trainees. Consistent with models of skills development, expertise and expert-performance, the outcome of the analysis shows that experts perform similarly in critical parts of the procedure, and do indeed practice what they profess.
  • Item
    Thumbnail Image
    Models for understanding student engagement in digital learning environments
    Wiseman, P ; KENNEDY, G ; Lodge, J ; Baker, S ; Dawson, S ; Pardo, A ; Colvin, C (Australasian Society for Computers in Learning in Tertiary Education, 2016)
    Digital learning environments are increasingly prevalent in higher education. The flexible and less constrained nature of these environments, means students often need to be more autonomous in managing their own learning. This implies that students are sufficiently self­motivated to successfully engage in autonomous learning. The concept of "student engagement" has shown promise in assisting researchers' and educators' understanding of how students' general involvement in study, and their more specific completion of learning tasks, can lead to beneficial outcomes in digital learning environments. However, student engagement has taken on multiple, diffuse definitions in higher education creating confusion about what engagement is and how best to promote it. In this paper we build on a model of engagement from organisational psychology that offers insight into task-level engagement. Established models in the area of student motivation are integrated to bring clarity to the construct at task-level in digital learning environments.
  • Item
    Thumbnail Image
    Editorial: Brain, mind and educational technology
    Lodge, J ; Kennedy, G ; Lockyer, L (ASCILITE, 2016)
    There has been substantial hype around the growing body of research investigating how learning occurs in the brain. Over the last century, in particular, we have learned more about how the brain functions than has been discovered throughout history (Albright, Jessell, Kandel & Posner, 2000). New imaging techniques, such as electroencephalography (EEG) and functional magnetic resonance imaging (fMRI), have been pivotal in driving this research agenda. The emergence of the field of cognitive neuroscience has further helped to align foundational work on uncovering how the brain works with what is known about learning from the psychological sciences. In combination with education, new fields such as ‘educational neuroscience’ have emerged with the aim of translating the findings from the laboratory to the classroom (e.g. Ansari, Coch & De Smedt, 2011).
  • Item
    Thumbnail Image
    All roads lead to Rome: Tracking students’ affect as they overcome misconceptions
    Kennedy, G ; LODGE, J ; Barker, S ; Dawson, S ; Pardo, A ; Colvin, C (ASCILITE, 2016-11-28)
    Helping students to overcome misconceptions is a complex problem in digital learning environments in which students need to monitor their own progress and self-regulate their own learning. This is particularly so in flexible, discovery-based environments that have been criticised for the lack of support and structure provided to students. Emerging evidence suggests that discovery-based environments might be ineffective due to students becoming confused, frustrated or bored. In the study reported here, we examined the affective experience of students as they worked to overcome a common misconception in a discovery-based environment. While the results suggest that students experience a range of emotions, they all successfully overcame their initial misconception. Implications for the investigation of student affect in discovery-based environments and the design of these environments are also discussed.