Study Comparing Traditional Versus Alternative Metrics to Measure the Impact of the Critical Care Medicine Literature

Viren Kaul; Rohit Bhan; Nancy Stewart; Deanna Behrens; Amy Gutman; Neha Dangayach; Benjamin Geisler; Christopher Carroll

doi:10.1097/CCE.0000000000000028

Study Comparing Traditional Versus Alternative Metrics to Measure the Impact of the Critical Care Medicine Literature

Viren Kaul, Rohit Bhan, Nancy Stewart, Deanna Behrens, Amy Gutman, Neha Dangayach, Benjamin Geisler, Christopher Carroll

Research output: Contribution to journal › Article › peer-review

5 Citations (Scopus)

25 Downloads (Pure)

Abstract

Our objective was to evaluate the association between traditional metrics such as Impact Factor and Eigenfactor with respect to alternative metrics. The Altmetric Attention Score for the top nine pulmonary and critical care journals was compared with Impact Factor, Eigenfactor, and citations over two time periods (2007-2011 and 2012-2016). There was a significant increase in the Altmetric Attention Score (52 from 2007 to 2011 vs 1,061 from 2012 to 2016; p < 0.001) but no significant differences in Total Citations, Impact Factor, or Eigenfactor. There was a strong positive correlation between citations and Altmetric Attention Score, negative correlations between Eigenfactor and Altmetric Attention Score for most journals, and no clear association between Impact Factor and Altmetric Attention Score. Over time, the digital reach of traditional publications has increased significantly, while no significant increase was noted for the traditional metrics. These findings likely reflect discussions of articles online that are not captured by traditional metrics and hence their impact on the community at large.

Original language	English
Article number	e0028
Pages (from-to)	E0028
Number of pages	5
Journal	Critical care explorations
Volume	1
Issue number	8
DOIs	https://doi.org/10.1097/CCE.0000000000000028
Publication status	Published - Aug 2019
Externally published	Yes

Bibliographical note

This is an open-access article distributed under the terms of the Creative Commons Attribution-Non Commercial-No Derivatives License 4.0 (CCBY-NC-ND), where it is permissible to download and share the work provided it is properly cited. The work
cannot be changed in any way or used commercially without permission from
the journal.

Keywords

Eigenfactor
Impact Factor
altmetrics
citations
pulmonary and critical care medicine
traditional metrics

Access to Document

10.1097/CCE.0000000000000028Licence: CC BY-NC-ND

Final published versionFinal published version, 429 KBLicence: CC BY-NC-ND

Cite this

@article{f2ab91bb221c408083f2c629e9c1f4f4,

title = "Study Comparing Traditional Versus Alternative Metrics to Measure the Impact of the Critical Care Medicine Literature",

abstract = "Our objective was to evaluate the association between traditional metrics such as Impact Factor and Eigenfactor with respect to alternative metrics. The Altmetric Attention Score for the top nine pulmonary and critical care journals was compared with Impact Factor, Eigenfactor, and citations over two time periods (2007-2011 and 2012-2016). There was a significant increase in the Altmetric Attention Score (52 from 2007 to 2011 vs 1,061 from 2012 to 2016; p < 0.001) but no significant differences in Total Citations, Impact Factor, or Eigenfactor. There was a strong positive correlation between citations and Altmetric Attention Score, negative correlations between Eigenfactor and Altmetric Attention Score for most journals, and no clear association between Impact Factor and Altmetric Attention Score. Over time, the digital reach of traditional publications has increased significantly, while no significant increase was noted for the traditional metrics. These findings likely reflect discussions of articles online that are not captured by traditional metrics and hence their impact on the community at large.",

keywords = "Eigenfactor, Impact Factor, altmetrics, citations, pulmonary and critical care medicine, traditional metrics",

author = "Viren Kaul and Rohit Bhan and Nancy Stewart and Deanna Behrens and Amy Gutman and Neha Dangayach and Benjamin Geisler and Christopher Carroll",

note = "This is an open-access article distributed under the terms of the Creative Commons Attribution-Non Commercial-No Derivatives License 4.0 (CCBY-NC-ND), where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in any way or used commercially without permission from the journal.",

year = "2019",

month = aug,

doi = "10.1097/CCE.0000000000000028",

language = "English",

volume = "1",

pages = "E0028",

journal = "Critical care explorations",

issn = "2639-8028",

publisher = "Lippincott Williams & Wilkins",

number = "8",

}

TY - JOUR

T1 - Study Comparing Traditional Versus Alternative Metrics to Measure the Impact of the Critical Care Medicine Literature

AU - Kaul, Viren

AU - Bhan, Rohit

AU - Stewart, Nancy

AU - Behrens, Deanna

AU - Gutman, Amy

AU - Dangayach, Neha

AU - Geisler, Benjamin

AU - Carroll, Christopher

N1 - This is an open-access article distributed under the terms of the Creative Commons Attribution-Non Commercial-No Derivatives License 4.0 (CCBY-NC-ND), where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in any way or used commercially without permission from the journal.

PY - 2019/8

Y1 - 2019/8

N2 - Our objective was to evaluate the association between traditional metrics such as Impact Factor and Eigenfactor with respect to alternative metrics. The Altmetric Attention Score for the top nine pulmonary and critical care journals was compared with Impact Factor, Eigenfactor, and citations over two time periods (2007-2011 and 2012-2016). There was a significant increase in the Altmetric Attention Score (52 from 2007 to 2011 vs 1,061 from 2012 to 2016; p < 0.001) but no significant differences in Total Citations, Impact Factor, or Eigenfactor. There was a strong positive correlation between citations and Altmetric Attention Score, negative correlations between Eigenfactor and Altmetric Attention Score for most journals, and no clear association between Impact Factor and Altmetric Attention Score. Over time, the digital reach of traditional publications has increased significantly, while no significant increase was noted for the traditional metrics. These findings likely reflect discussions of articles online that are not captured by traditional metrics and hence their impact on the community at large.

AB - Our objective was to evaluate the association between traditional metrics such as Impact Factor and Eigenfactor with respect to alternative metrics. The Altmetric Attention Score for the top nine pulmonary and critical care journals was compared with Impact Factor, Eigenfactor, and citations over two time periods (2007-2011 and 2012-2016). There was a significant increase in the Altmetric Attention Score (52 from 2007 to 2011 vs 1,061 from 2012 to 2016; p < 0.001) but no significant differences in Total Citations, Impact Factor, or Eigenfactor. There was a strong positive correlation between citations and Altmetric Attention Score, negative correlations between Eigenfactor and Altmetric Attention Score for most journals, and no clear association between Impact Factor and Altmetric Attention Score. Over time, the digital reach of traditional publications has increased significantly, while no significant increase was noted for the traditional metrics. These findings likely reflect discussions of articles online that are not captured by traditional metrics and hence their impact on the community at large.

KW - Eigenfactor

KW - Impact Factor

KW - altmetrics

KW - citations

KW - pulmonary and critical care medicine

KW - traditional metrics

UR - http://www.scopus.com/inward/record.url?scp=85101760354&partnerID=8YFLogxK

U2 - 10.1097/CCE.0000000000000028

DO - 10.1097/CCE.0000000000000028

M3 - Article

SN - 2639-8028

VL - 1

SP - E0028

JO - Critical care explorations

JF - Critical care explorations

IS - 8

M1 - e0028

ER -

Study Comparing Traditional Versus Alternative Metrics to Measure the Impact of the Critical Care Medicine Literature

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this