Editors can lead researchers to confidence intervals, but can't make them think - Statistical reform lessons from medicine
Author
Fidler, F; Thomason, N; Cumming, G; Finch, S; Leeman, JDate
2004-02-01Source Title
PSYCHOLOGICAL SCIENCEPublisher
SAGE PUBLICATIONS INCUniversity of Melbourne Author/s
FIDLER, FIONA MARGARET; Thomason, Neil; Fidler, Fiona; CUMMING, GEOFFREY; LEEMAN, JOANNA MARTA ISABEZAffiliation
Melbourne Graduate School Of EducationMetadata
Show full item recordDocument Type
Journal ArticleCitations
Fidler, F., Thomason, N., Cumming, G., Finch, S. & Leeman, J. (2004). Editors can lead researchers to confidence intervals, but can't make them think - Statistical reform lessons from medicine. PSYCHOLOGICAL SCIENCE, 15 (2), pp.119-126. https://doi.org/10.1111/j.0963-7214.2004.01502008.x.Access Status
This item is currently not available from this repositoryDescription
C1 - Journal Articles Refereed
Abstract
Since the mid-1980s, confidence intervals (CIs) have been standard in medical journals. We sought lessons for psychology from medicine's experience with statistical reform by investigating two attempts by Kenneth Rothman to change statistical practices. We examined 594 American Journal of Public Health (AJPH) articles published between 1982 and 2000 and 110 Epidemiology articles published in 1990 and 2000. Rothman's editorial instruction to report CIs and not p values was largely effective: In AJPH, sole reliance on p values dropped from 63% to 5%, and CI reporting rose from 10% to 54%; Epidemiology showed even stronger compliance. However, compliance was superficial: Very few authors referred to CIs when discussing results. The results of our survey support what other research has indicated: Editorial policy alone is not a sufficient mechanism for statistical reform. Achieving substantial, desirable change will require further guidance regarding use and interpretation of CIs and appropriate effect size measures. Necessary steps will include studying researchers' understanding of CIs, improving education, and developing empirically justified recommendations for improved statistical practice.
Keywords
History and Philosophy of Science and Technology ; Studies in Human SocietyExport Reference in RIS Format
Endnote
- Click on "Export Reference in RIS Format" and choose "open with... Endnote".
Refworks
- Click on "Export Reference in RIS Format". Login to Refworks, go to References => Import References