Melbourne Graduate School of Education - Theses
Permanent URI for this collection
Search Results
1 - 4 of 4
-
ItemEvaluation for Evidence-Based Performance Management: Understanding and Measuring Performance Managers’ Perceptions( 2020)A common claim is that high-performing organizations use evidence-based practice to manage staff performance, herein called performance management. The literature showed that the implementation of performance management policies is crucial because even well-designed performance management models fail if they are not implemented as intended (Armstrong, 2015). Given that behavior can be mediated by perception, this thesis focused on the perceptions held by implementers of performance management that might mediate their implementation of performance management policies. This is important because, despite the research on evidence-based performance management, there remains a gap in understanding and measuring the perceptions held by the implementers. Moreover, there is a sizeable gap between performance management research and practice due to a plethora of obstacles like poor access to reliable research. Three sequential research stages were conducted focusing on item generation, scale development and scale refinement and validation, respectively. An initial set of 130 items was developed, based on a thematic analysis in the narrative literature review and a scoping literature review study (Stage 1). These items were reduced to a set of 55, then 41 items in Stages 2 and 3, respectively, using exploratory and confirmatory factor analyses, Cronbach’s alpha calculations and examination of conceptual importance of data from a combined 589 survey respondents. Furthermore, the effect of several antecedent factors was tested using multivariate analysis of variance. The thesis findings enhanced the extant understanding by presenting perception of performance management as a broad concept encompassing two higher order factors (Perception of Efforts and Perception of Results) and eight lower order factors (perception of Performance Evaluation, Documentation, Organizational Support, Supervisory Support, Climate, Turnover, Critical staff Withdrawal and New staff Withdrawal). The findings also added to the literature on the effect of antecedent factors, particularly age, work role, organizational size, industry sector and workforce experience. Finally, the thesis further narrowed the gap between research and practice by creating a theoretically grounded and empirically validated performance management perceptions scale for organizations to use in in evidence-based performance management.
-
ItemAn evaluation of quality assurance implementation at a higher education institution in Bangkok( 2005)This study aimed to investigate the implementation of Quality Assurance (OA) regarding two compulsory English courses in a Rajabhat University in Bangkok. Quality of these courses is considered to be crucial because they are required for the completion of all undergraduate degrees in every program of study in the Rajabhat. The study intended particularly, to examine the level of success of QA implementation in order to recommend improvements to the implementation process. The study employed a qualitative case study of the institution to reveal factors affecting QA implementation and to construct an improved QA management model for such courses. Document analysis and semi-structured interviews were used to collect data. The participants of the research were purposively selected according to their levels of participation in the QA program, namely, policy makers, transmitters of the policy and implementers. Miles & Huberman-style grids were employed to facilitate data analysis and then Fullan's theory of change was used as a framework for discussion of the findings. Analysis revealed that QA was thought to be needed but the level of success of the QA implementation was rather low at the course level due to a lack of efficient communication between the systems level and implementers on the ground. Consequently, teaching staff's knowledge and understanding of the QA operation was inadequate. However, strengths of the program included availability of financial and physical supports, i.e. multi-media teaching materials, IT infrastructure and provision of professional development. Perhaps the most important strength was the awareness and willingness of lecturers to implement QA during routine teaching. Nevertheless, IT literacy, teamwork skills and explicit systematic QA implementation documents were inadequate. Overall, this study has demonstrated a limited level of success regarding QA implementation in this Thai context due to various factors. Therefore, recommendations for improvement are presented and a QA model for Teaching English to Speakers of Other Languages (TESOL) is proposed.
-
ItemSocial area indicators and educational achievement( 1982)This study was concerned with the development and validation of a national indicator of educational disadvantage which would be suitable for guiding resource allocation decisions associated with the Disadvantaged Schools Program in Australia. The national indicator was constructed by using a series of stepwise regression analyses in order to obtain a linear combination of census based descriptions of school neighbourhoods which would be highly correlated with school mean achievement scores. A correlational investigation of the properties of this indicator showed that it was an appropriate tool for the identification of schools in which there were high proportions of students who (1) had not mastered the basic skills of Literacy and Numeracy, (2) displayed behavioural characteristics which formed barriers to effective learning, and (3) lived in neighbourhoods having social profiles which were typical of communities suffering from deprivation and poverty. A theoretical model was developed in order to estimate the optimal level of precision with which indicators of educational disadvantage could be used to deliver resources to those students who were in most need of assistance. This model was used to demonstrate that resource allocation programs which employ schools as the units of identification and funding must take into account the nature of the variation of student characteristics between and within schools. The technique of factor analysis was employed to investigate the dimensions of residential differentiation associated with the neighbourhoods surrounding Australian schools. Three dimensions emerged from these analyses which were congruent with the postulates of the Shevky- Bell Social Area Analysis model. The interrelationships between these dimensions and school scores on the national indicator of educational disadvantage presented a picture of the 'social landscape' surrounding educationally disadvantaged schools in Australia as one in which there were: high concentrations of persons in the economically and socially vulnerable position of having low levels of educational attainment and low levels of occupational skill, low concentrations of persons living according to the popular model of Australian family life characterized by single family households, stable families, and separate dwellings, high concentrations of persons likely to have language communication problems because they were born in non-English speaking countries.
-
ItemInitiating formal evaluation practices in Victorian secondary schools: a meta-evaluation of whole-school and part-school evaluation strategies( 1987)The purpose of this meta-evaluation was to investigate the merit of an apparent shift in evaluation policy on the part of the present government from whole-school evaluation with external validation and input to internal part-school evaluation as alternative strategies for initiating formal evaluation practices in Victorian secondary schools. While the study provides an overview of the strategies and outcomes pertaining to both approaches to evaluation, it focuses specifically on the implications of the scope of evaluation for the planning process in schools, the role and impact of the use of external expertise and the significance of staff perceptions on the process of evaluation and its outcomes. Data was collected using qualitative research methods and a retrospective study of eight carefully selected case study schools was carried out. Four of these schools had completed whole-school evaluations and the remaining four had completed part-school evaluations. While informal observation and document collection constituted an important part of the research strategy, heavy reliance was placed on data emerging from one-to-one interviews with individual members of staff across different levels of the school hierarchy. This methodology was adopted because it was believed to be the most effective way of discovering the more sensitive, less tangible outcomes related to evaluations, and because the attitudes and perceptions of staff towards evaluations represented an important outcome of the evaluation in their own right. A basic premise of this research is that the effectiveness of school-based evaluation initiatives in bringing about school improvement will be largely dependent upon the willing support of the staff who are called upon to participate in the evaluation and in any change initiatives which flow from it. While caution should be exercised in generalising from the findings of a limited number of case study schools to all schools, the findings support the general trend towards initiating formal evaluation practices via part-school evaluation strategy. However, they also underline the need for schools to initiate evaluation studies in ways which will ensure that they contribute effectively to, and become an integral part of, school development. In response to this need, an alternative model or approach to evaluation is proposed.