Study Comparing Traditional Versus Alternative Metrics to Measure the Impact of the Critical Care Medicine Literature

Viren Kaul, Rohit Bhan, Nancy Stewart, Deanna Behrens, Amy Gutman, Neha Dangayach, Benjamin Geisler, Christopher Carroll

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)
18 Downloads (Pure)


Our objective was to evaluate the association between traditional metrics such as Impact Factor and Eigenfactor with respect to alternative metrics. The Altmetric Attention Score for the top nine pulmonary and critical care journals was compared with Impact Factor, Eigenfactor, and citations over two time periods (2007-2011 and 2012-2016). There was a significant increase in the Altmetric Attention Score (52 from 2007 to 2011 vs 1,061 from 2012 to 2016; p < 0.001) but no significant differences in Total Citations, Impact Factor, or Eigenfactor. There was a strong positive correlation between citations and Altmetric Attention Score, negative correlations between Eigenfactor and Altmetric Attention Score for most journals, and no clear association between Impact Factor and Altmetric Attention Score. Over time, the digital reach of traditional publications has increased significantly, while no significant increase was noted for the traditional metrics. These findings likely reflect discussions of articles online that are not captured by traditional metrics and hence their impact on the community at large.
Original languageEnglish
Article numbere0028
Pages (from-to)E0028
Number of pages5
JournalCritical care explorations
Issue number8
Publication statusPublished - Aug 2019
Externally publishedYes

Bibliographical note

This is an open-access article distributed under the terms of the Creative Commons Attribution-Non Commercial-No Derivatives License 4.0 (CCBY-NC-ND), where it is permissible to download and share the work provided it is properly cited. The work
cannot be changed in any way or used commercially without permission from
the journal.


  • Eigenfactor
  • Impact Factor
  • altmetrics
  • citations
  • pulmonary and critical care medicine
  • traditional metrics


Dive into the research topics of 'Study Comparing Traditional Versus Alternative Metrics to Measure the Impact of the Critical Care Medicine Literature'. Together they form a unique fingerprint.

Cite this