Faculty of Education - Research Publications

Permanent URI for this collection

http://hdl.handle.net/11343/161

Filters

2003 - 2009 8
Reset filters

Settings
Statistics
Citations
End date: 2009 × Type: Journal Article × Author: Griffin, Patrick ×

Search Results

Now showing 1 - 8 of 8
  • Item
    Thumbnail Image
    Rasch scaling procedures for informing development of a valid Fetal Surveillance Education Program multiple-choice assessment
    Zoanetti, N ; Griffin, P ; Beaves, M ; Wallace, EM (BMC, 2009-04-29)
    BACKGROUND: It is widely recognised that deficiencies in fetal surveillance practice continue to contribute significantly to the burden of adverse outcomes. This has prompted the development of evidence-based clinical practice guidelines by the Royal Australian and New Zealand College of Obstetricians and Gynaecologists and an associated Fetal Surveillance Education Program to deliver the associated learning. This article describes initial steps in the validation of a corresponding multiple-choice assessment of the relevant educational outcomes through a combination of item response modelling and expert judgement. METHODS: The Rasch item response model was employed for item and test analysis and to empirically derive the substantive interpretation of the assessment variable. This interpretation was then compared to the hierarchy of competencies specified a priori by a team of eight subject-matter experts. Classical Test Theory analyses were also conducted. RESULTS: A high level of agreement between the hypothesised and derived variable provided evidence of construct validity. Item and test indices from Rasch analysis and Classical Test Theory analysis suggested that the current test form was of moderate quality. However, the analyses made clear the required steps for establishing a valid assessment of sufficient psychometric quality. These steps included: increasing the number of items from 40 to 50 in the first instance, reviewing ineffective items, targeting new items to specific content and difficulty gaps, and formalising the assessment blueprint in light of empirical information relating item structure to item difficulty. CONCLUSION: The application of the Rasch model for criterion-referenced assessment validation with an expert stakeholder group is herein described. Recommendations for subsequent item and test construction are also outlined in this article.
  • Item
  • Item
    Thumbnail Image
    Standards-referenced assessment for vocational education and training in schools
    Griffin, P ; Gillis, S ; Calvitto, L (AUSTRALIAN COUNCIL EDUCATIONAL RES LIMITED, 2007-04)
    This study examined a model of assessment that could be applied nationally for Year Twelve Vocational Education and Training (VET) subjects and which could yield both a differentiating score and recognition of competence. More than fifty colleges across all states and territories of Australia field-tested the approach over one school year. Results showed that the model allowed for a standards-referenced model to be used: that the approach was compatible with the diverse range of senior secondary assessment systems in use throughout Australia and that there were considerable cost benefits to be had in adopting the logic of item response modelling for the development of rubrics for scoring performances on units of competence from National Training Packages. A change in the logic of competency assessment was proposed, in that the performance indicators were not rated using a dichotomy but with a series of quality ordered criteria to indicate how well students performed specified tasks in the workplace or its simulation. The study validated the method of assessment development, demonstrated the method's consistency, and showed how the method could address the issue of consistency across states. The study also proposed a set of principles for a joint assessment of both quality and competence.
  • Item
    Thumbnail Image
    Reading achievements of Vietnamese Grade 5 pupils
    Griffin, P ; Thi Thanh, M (Informa UK Limited, 2006-01-01)
  • Item
    Thumbnail Image
    A 20-year study of mathematics achievement
    Griffin, P ; Callingham, R (NATL COUNCIL TEACHERS MATHEMATICS-NCTM, 2006-05)
  • Item
  • Item
  • Item
    Thumbnail Image
    The Development of an Extended Course Experience Questionnaire
    GRIFFIN, PE ; COATES, HB ; MCINNIS, CV ; JAMES, RH (Carfax Publishing, 2003)