Surgery (St Vincent's) - Research Publications

Permanent URI for this collection

Search Results

Now showing 1 - 6 of 6
  • Item
    Thumbnail Image
    An Economic Model for Estimating Trial Costs with an Application to Placebo Surgery Trials
    Schilling, C ; Tew, M ; Bunzli, S ; Shadbolt, C ; Lohmander, LS ; Balogh, ZJ ; Paolucci, F ; Choong, PF ; Dowsey, MM ; Clarke, P (SPRINGER INT PUBL AG, 2023-03)
    BACKGROUND AND OBJECTIVE: Waste in clinical trials remains rife. We developed an economic model to predict the cost of trials based on input costs, duration, power, number of sites, recruitment eligibility and consenting rates. METHODS: We parameterised the model for three proxy placebo-controlled surgical trials using data from a systematic review, a bespoke cost survey, and from the literature. We used the model to compare target and actual trial performance for (i) a trial that was completed on time but with more sites, (ii) a trial that completed after a time extension, and (iii) an incomplete trial. RESULTS: Successful trials more accurately anticipated the true recruitment rate that they achieved and those that overestimated this were most likely to fail. The costs of overestimating recruitment rates were dramatic: all proxy trials had significantly higher costs than planned, with additional funding of at least AUD$600,000 (50% above budget) required for trials that completed after adding more sites or more time, and over AUD$2 million (260% above budget) for incomplete trials. CONCLUSIONS: This model shows the trade-offs between time and cost, or both, when recruitment is lower than anticipated. Greater consideration is needed to improve trial planning, reviewing, and funding of these trials to avoid costly overruns and incomplete trials.
  • Item
    No Preview Available
    Analysis of Rates of Completion, Delays, and Participant Recruitment in Randomized Clinical Trials in Surgery
    Shadbolt, C ; Naufal, E ; Bunzli, S ; Price, V ; Rele, S ; Schilling, C ; Thuraisingam, S ; Lohmander, LS ; Balogh, ZJ ; Clarke, P ; Choong, P ; Dowsey, M (JAMA Network, 2023-01-17)
    IMPORTANCE: Discontinuation and nonpublication are established sources of avoidable waste among surgical trials, but rates of delayed completion and recruiting shortfalls remain unclear. OBJECTIVES: To examine the rate of delayed completion, incomplete enrollment, and discontinuation among randomized clinical trials in surgical populations and the duration of delays and extent of recruiting shortfalls among these trials. DESIGN, SETTING, AND PARTICIPANTS: This cross-sectional study examined randomized clinical trials in surgical populations registered on ClinicalTrials.gov between January 1, 2010, and December 31, 2014. Analysis was conducted between October 27, 2021, and June 30, 2022. MAIN OUTCOMES AND MEASURES: The main outcomes were the percentages of trials completed on time or with full enrollment. Delays and recruiting shortfalls were identified by comparing projected enrollment and study timeframes prespecified at the time of registration with the actual study duration and enrollment reported on completion or discontinuation. Absolute and relative differences between planned and actual trial conduct were presented for discontinued trials and those completed with delays or recruiting shortfalls. RESULTS: In total, 2542 randomized clinical trials in surgical populations were included in the study sample, of which 370 (14.6%; 95% CI, 13.2%-15.9%) were completed both on time and with full enrollment. Approximately 1 in 5 trials (20.4%; 95% CI, 18.9%-22.0%) were completed within their planned timeframe, and 1166 trials (45.9%; 95% CI, 43.9%-47.8%) met their prespecified enrollment target. The median delay among completed trials was 12.2 months (IQR, 5.1-24.3 months) or 66.7% (IQR, 30.1%-135.8%) longer than planned. Among completed trials that did not meet their prespecified enrollment target, the median recruiting shortfall was equivalent to 31.0% (IQR, 12.7%-55.5%) of the planned study sample. A total of 546 trials (21.5%; 95% CI, 19.9%-23.1%) were discontinued. The median time to discontinuation was 26.4 months (IQR, 15.2-45.7 months), and the median recruiting shortfall among discontinued trials was equivalent to 92.7% (IQR, 65.0%-100.0%) of the trial's prespecified enrollment target. CONCLUSIONS AND RELEVANCE: This cross-sectional study found that delayed completion, recruiting shortfalls, and untimely discontinuation were common among surgical trials. These findings highlight the importance of ensuring that investigators and funders do not overestimate the feasibility of planned trials.
  • Item
    Thumbnail Image
    Patient and clinician characteristics and preferences for increasing participation in placebo surgery trials: a scoping review of attributes to inform a discrete choice experiment
    Hinwood, M ; Wall, L ; Lang, D ; Balogh, ZJ ; Smith, A ; Dowsey, M ; Clarke, P ; Choong, P ; Bunzli, S ; Paolucci, F (BMC, 2022-04-12)
    BACKGROUND: Orthopaedic surgeries include some of the highest volume surgical interventions globally; however, studies have shown that a significant proportion of patients report no clinically meaningful improvement in pain or function after certain procedures. As a result, there is increasing interest in conducting randomised placebo-controlled trials in orthopaedic surgery. However, these frequently fail to reach recruitment targets suggesting a need to improve trial design to encourage participation. The objective of this study was to systematically scope the available evidence on patient and clinician values and preferences which may influence the decision to participate in placebo surgery trial. METHODS: A systematic review was conducted via a literature search in the MEDLINE, Embase, PsycInfo, CINAHL, and EconLit databases as of 19 July 2021, for studies of any design (except commentaries or opinion pieces) based on two key concepts: patient and clinician characteristics, values and preferences, and placebo surgery trials. RESULTS: Of 3424 initial articles, we retained 18 eligible studies. Characteristics, preferences, values, and attitudes of patients (including levels of pain/function, risk/benefit perception, and altruism) and of clinicians (including concerns regarding patient deception associated with placebo, and experience/training in research) influenced their decisions to participate in placebo-controlled trials. Furthermore, some aspects of trial design, including randomisation procedures, availability of the procedure outside of the trial, and the information and consent procedures used, also influenced decisions to participate. CONCLUSION: Participant recruitment is a significant challenge in placebo surgery trials, and individual decisions to participate appear to be sensitive to preferences around treatment. Understanding and quantifying the role patient and clinician preferences may play in surgical trials may contribute to the optimisation of the design and implementation of clinical trials in surgery.
  • Item
    Thumbnail Image
    Placebo Surgery Controlled Trials Do They Achieve What They Set Out To Do? A Systematic Review
    Bunzli, S ; Choong, E ; Shadbolt, C ; Wall, L ; Nelson, E ; Schilling, C ; Wilding, H ; Lohmander, LS ; Balogh, ZJ ; Paolucci, F ; Clarke, P ; Choong, PFM ; Dowsey, MM (LIPPINCOTT WILLIAMS & WILKINS, 2021-06)
    OBJECTIVE: To explore whether placebo surgery controlled trials achieve what they set out to do by investigating discrepancy between projected and actual design aspects of trials identified through systematic review methods. SUMMARY BACKGROUND: Interest in placebo surgery controlled trials is growing in response to concerns regarding unnecessary surgery and the societal cost of low-value healthcare. As questions about the justifiability of using placebo controls in surgery have been addressed, attention is now being paid to more practical concerns. METHODS: Six databases were searched from inception - May 2020 (MEDLINE, Embase, Emcare, APA PsycInfo, CINAHL, Cochrane Library). Placebo surgery controlled trials with a published protocol were included. Three authors extracted "projected" design aspects from protocols and "actual" design aspects from main findings papers. Absolute and relative difference between projected and actual design aspects were presented for each trial. Trials were grouped according to whether they met their target sample size ("completed") and were concluded in a timely fashion. Pairs of authors assessed risk of bias. RESULTS: Of 24 trials with data available to analyse; 3 were completed and concluded within target timeframe; 10 were completed and concluded outside the target timeline; 4 were completed without clear target timeframes; 2 were incomplete and concluded within the target framework; 5 were incomplete and concluded outside the target timeline. Trials which reached the recruitment target underestimated trial duration by 88% and number of recruitment sites by 87%. CONCLUSIONS: Trialists need to factor additional time and sites into future placebo surgery controlled trials. A robust reporting framework of projected and actual trial design is imperative for trialists to learn from their predecessors. REVIEW REGISTRATION: PROSPERO (CRD42019133296).
  • Item
    Thumbnail Image
    Factors Underlying Patient and Surgeon Willingness to Participate in a Placebo Surgery Controlled trial: A Qualitative Investigation.
    Bunzli, S ; Nelson, E ; Wall, L ; Schilling, C ; Lohmander, LS ; Balogh, ZJ ; Tran, P ; Paolucci, F ; Clarke, P ; Choong, PFM ; Dowsey, MM (Ovid Technologies (Wolters Kluwer Health), 2021-12)
    OBJECTIVE: To investigate the factors underlying willingness to participate in a hypothetical trial among patients and surgeons, to inform the design of future placebo surgery controlled trials. BACKGROUND: Placebo surgery controlled trials are the gold standard for testing the efficacy of surgical procedures. However, these trials commonly fail to meet the target sample size and terminate underpowered. METHODS: From October 2019 to July 2020, eligible patients were identified from the orthopedic waiting list at a single tertiary hospital and surgeons were identified from orthopedic clinics at three tertiary hospitals in Australia. Qualitative interviews explored factors underlying willingness to participate in a hypothetical trial, including understanding of trial concepts; attitudes; and trial design preferences. Data collection and analysis were conducted in parallel. Recruitment ceased when no new concepts emerged. Interview data were analyzed using reflexive thematic analysis. RESULTS: The majority of surgeons and only a few patients indicated a willingness to participate in a placebo surgery controlled trial. Factors underlying willingness were captured in four themes: (1) Understanding and attitudes toward placebo; (2) Attitudes towards randomization/perception of equipoise; (3) Perception of risk; and (4) Ethical concerns. CONCLUSIONS: To optimize recruitment in the future, trialists may consider embedding strategies into the recruitment process that validate patients' symptoms, encourage an altruistic mindset, address surgeon biases, and involve surgeons in explaining trial concepts to patients. Trialists may also consider designing three arm trials that meet surgeons' preferences for a "low" and "high" fidelity placebo.
  • Item
    Thumbnail Image
    Attitudes of patients and surgeons towards sham surgery trials: a protocol for a scoping review of attributes to inform a discrete choice experiment
    Wall, L ; Hinwood, M ; Lang, D ; Smith, A ; Bunzli, S ; Clarke, P ; Choong, PFM ; Dowsey, MM ; Paolucci, F (BMJ PUBLISHING GROUP, 2020-03)
    INTRODUCTION: In order to properly evaluate the efficacy of orthopaedic procedures, rigorous, randomised controlled sham surgery trial designs are necessary. However, randomised controlled trials (RCTs) for surgery involving a placebo are ethically debated and difficult to conduct with many failing to reach their desired sample size and power. A review of the literature on barriers and enablers to recruitment, and patient and surgeon attitudes and preferences towards sham surgery trials, will help to determine the characteristics necessary for successful recruitment. METHODS AND ANALYSIS: This review will scope the diverse literature surrounding sham surgery trials with the aim of informing a discrete choice experiment to empirically test patient and surgeon preferences for different sham surgery trial designs. The scoping review will be conducted in accordance with the methodological framework described in Arksey and O'Malley (2005) and reported using the Preferred Reporting Items for Systematic Reviews and Meta-analyses Protocols extension for Scoping Reviews. The review will be informed by a systematic search of Medline, Embase, PsycInfo, CINAHL and EconLit databases (from database inception to 21 June 2019), a Google Scholar search, and hand searching of reference lists of relevant studies or reviews. Studies or opinion pieces that involve patient, surgeon or trial characteristics, which influence the decision to participate in a trial, will be included. Study selection will be carried out independently by two authors with discrepancies resolved by consensus among three authors. Data will be charted using a standardised form, and results tabulated and narratively summarised with reference to the research questions of the review. ETHICS AND DISSEMINATION: The findings from this review will inform the design of a discrete choice experiment around willingness to participate in surgical trials, the outcomes of which can inform decision and cost-effectiveness models of sham surgery RCTs. The qualitative information from this review will also inform patient-centred outcomes research. The review will be published in a peer-reviewed journal. TRIAL REGISTRATION NUMBER: CRD42019133296.