Cross-sectional analysis of bibliometrics and altmetrics: comparing the impact of qualitative and quantitative articles in the British Medical Journal

Abstract

OBJECTIVES: In comparison to quantitative research, the impact of qualitative articles in the medical literature has been questioned by the BMJ; to explore this, we compared the impact of quantitative and qualitative articles published in BMJ. DESIGN: Cross-sectional survey. SETTING: Articles published in the BMJ between 2007 and 2017. MAIN OUTCOME MEASURES: Bibliometric and altmetric measures of research impact were collected using Web of Science, Google Scholar, Scopus, Plum Analytics and ProQuest Altmetric. Bibliometric measures consisted of citation numbers, field weighted citation impact and citation percentile. Altmetric measures consisted of article usage, captures, mentions, readers, altmetric attention score and score percentile. Scores were compared using the Wilcoxon Rank-sum test. RESULTS: We screened a total of 7777 articles and identified 42 qualitative articles. Each qualitative article was matched to 3 quantitative articles published during the same year (126 quantitative articles). Citation numbers were not statistically different between the two research types; the median number of citations (google scholar) per quantitative article was 62 (IQR 38-111) versus 58 (IQR 36-85) per qualitative article (p=0.47). Using Plum Analytics, qualitative articles were found to have a significantly higher usage, with a median of 984 (IQR 581-1351) versus 379 (IQR 177-763) for quantitative (p<0.001). The Altmetric Attention Score was higher for quantitative articles at 16 (IQR 7-37) versus qualitative articles at 9 (IQR 5-23, p=0.05), as was the Altmetric Score percentile 93 (IQR 87-96) versus 88 (IQR 76-95; p=0.02). CONCLUSION: Qualitative and quantitative articles published in the BMJ between 2007 and 2017 both have a high impact. No article type was consistently superior in terms of bibliometric or altmetric measures, suggesting that type of article is not the major driver of impact.