Traditional bibliometrics include qualitative assessment (peer review, grants received, awards granted, patents issued) and quantitative measures (publications count, citations count, h-index, journal impact factor). Citation analysis is the examination of an individual publication (or a group of publications) based on counting how often it has been cited by subsequent publications. It is assumed that a high citation count demonstrates a significant quality and impact of an article. The citation analysis is used to:
The h-index measures the author's impact based on the set of the most cited papers and the number of citations that they have received in other publications, e.g. an h-index of 45 means that an author has written 45 papers which have each received at least 45 citations. First introduced by by Jorge E. Hirsch in 2005, the h-index is included in Web of Science and Google Scholar.
The journal impact factor measures the influence of a journal based on how often its articles are cited by authors. It can be found in Journal Citation Reports. There are other emerging journal ranking tools: Eigenfactor, Google Scholar Metrics, SCImago and Journal Metrics (both used by Scopus).
Definition
The impact factor is a citation measure produced by Thompson Scientific's ISI Web of Knowledge database. Impact factors are published annually in ISI's Journal Citation Reports Database. Impact factors are only available for journals that are indexed in ISI databases.
One journal's impact factor on its own doesn't mean much. Instead, it's important to look at impact factors of multiple journals in the same subject area. This way, one can determine if the impact factor of the journal of interest is high or low compared to other journals in a subject area.
Impact Factor Debate
Impact factors have been much debated in the literature in terms of their value for evaluating research quality. The general consensus is that impact factors have been misunderstood and abused by many institutions that place too much value on something that is not entirely scientific or reliable. Please refer to the 'Factors that Influence Impact Factors' and 'Additional Readings' sections to find out more.
How Impact Factors are Calculated
A journal's impact factor for 2012 would be calculated by taking the number of citations in 2012 from articles that were published in 2011 and 2010 and dividing that number by the total number of articles published in that same journal in 2011 and 2010. Please see the example below.
Example:
The specific calculations for Nursing Research's 2011 impact factor are displayed below.
Articles published in 2010 that were cited in 2011: 63
Articles published in 2009 that were cited in 2011: 94
63+94=157
Total Number of articles published in 2010: 61
Total number of articles published in 2009: 51
61+51=112
157 (articles published in 2010 and 2009 that were cited in 2011)
112 (total number of articles published in 2010 and 2009)
= 1.402
The 2011 Impact Factor for the journal Nursing Research means that, on average, articles published in this journal from one or two years ago have been cited around 1.4 times.
Factors that Influence Impact Factors
Date of Publication
The impact factor is based solely on citation data and only looks at the citation frequency of articles from a journal in their first couple years of publication. Journals with articles that are steadily cited for a long period of time (say, 10 years) rather than only immediately lose out with this calculation.
Large vs. Small Journals
Large and small journals are compared equally. Large journals tend to have higher impact factors--nothing to do with their quality.
Average Citation
It’s important to remember that the impact factor only looks at an average citation and that a journal may have a few highly cited papers that greatly increase its impact factor, while other papers in that same journal may not be cited at all. Therefore, there is no direct correlation between an individual article’s citation frequency or quality and the journal impact factor.
Review Articles
Impact factors are calculated using citations not only from research articles but also review articles (which tend to receive more citations), editorials, letters, meeting abstracts, and notes. The inclusion of these publications provides the opportunity for editors and publishers to manipulate the ratio used to calculate impact factor and falsely try to increase their number.
Changing / Growing Fields
Rapidly changing and growing fields (e.g. biochemistry and molecular biology) have much higher immediate citation rates, so those journals will always have higher impact factors than nursing, for instance.
ISI's Indexing / Citation Focus
There is unequal depth of coverage in different disciplines. In the health sciences, the Institute for Scientific Information (ISI), the company which publishes impact factors, has focused much of their attention on indexing and citation data from journals in clinical medicine and biomedical research and has not focused on nursing as much. Very few nursing journals are included in their calculations (around 45). This does not mean that nursing journals they do not include are of lesser quality, and, in fact, they do not give any explanation for why some journals are included and others are not. In general, ISI focuses more heavily on journal dependent disciplines in the sciences and provides less coverage for areas of the social sciences and humanities, where books and other publishing formats are still common.
Research vs. Clinical Journals
In some disciplines such as some areas of clinical medicine where there is not a distinct separation between clinical/practitioner versus research journals, research journals tend to have higher citation rates. This may also apply to nursing.
Thank you to Heidi Schroeder from MSU for sharing this content.