Editors can lead researchers to confidence intervals, but can't make them think - Statistical reform lessons from medicine
AuthorFidler, F; Thomason, N; Cumming, G; Finch, S; Leeman, J
Source TitlePsychological Science
PublisherSAGE PUBLICATIONS INC
University of Melbourne Author/sFIDLER, FIONA MARGARET; Thomason, Neil; Finch, Susan; Fidler, Fiona; CUMMING, GEOFFREY; LEEMAN, JOANNA MARTA ISABEZ
AffiliationMelbourne Graduate School Of Education
Document TypeJournal Article
CitationsFidler, F., Thomason, N., Cumming, G., Finch, S. & Leeman, J. (2004). Editors can lead researchers to confidence intervals, but can't make them think - Statistical reform lessons from medicine. PSYCHOLOGICAL SCIENCE, 15 (2), pp.119-126. https://doi.org/10.1111/j.0963-7214.2004.01502008.x.
Access StatusThis item is currently not available from this repository
C1 - Journal Articles Refereed
Since the mid-1980s, confidence intervals (CIs) have been standard in medical journals. We sought lessons for psychology from medicine's experience with statistical reform by investigating two attempts by Kenneth Rothman to change statistical practices. We examined 594 American Journal of Public Health (AJPH) articles published between 1982 and 2000 and 110 Epidemiology articles published in 1990 and 2000. Rothman's editorial instruction to report CIs and not p values was largely effective: In AJPH, sole reliance on p values dropped from 63% to 5%, and CI reporting rose from 10% to 54%; Epidemiology showed even stronger compliance. However, compliance was superficial: Very few authors referred to CIs when discussing results. The results of our survey support what other research has indicated: Editorial policy alone is not a sufficient mechanism for statistical reform. Achieving substantial, desirable change will require further guidance regarding use and interpretation of CIs and appropriate effect size measures. Necessary steps will include studying researchers' understanding of CIs, improving education, and developing empirically justified recommendations for improved statistical practice.
KeywordsHistory and Philosophy of Science and Technology ; Studies in Human Society
- Click on "Export Reference in RIS Format" and choose "open with... Endnote".
- Click on "Export Reference in RIS Format". Login to Refworks, go to References => Import References