- Impact factor
The Impact factor was devised by
Eugene Garfield, the founder of the Institute for Scientific Information, now part of Thomson, a large worldwide US-based publisher. Impact factors are calculated each year by Thomson Scientific for those journals which it indexes, and the factors and indices are published in " Journal Citation Reports". Some related values, also calculated and published by the same organization, are:
immediacy index: the number of citations the articles in a journal receive in a given year divided by the number of articles published.
* the cited half-life: the median age of the articles that were cited in "Journal Citation Reports" each year. For example, if a journal's half-life in 2005 is 5, that means the citations from 2001-2005 are half of all the citations from that journal in 2005, and the other half of the citations precede 2001. [ [http://www.bib.slu.se/kurser/sss/skriva/impactfactor/eimpactfactor.html Impact Factor, Immediacy Index, Cited Half-life] ]
* the aggregate impact factor for a subject category: it is calculated taking into account the number of citations to all journals in the subject category and the number of articles from all the journals in the subject category.
These measures apply only to journals, not individual articles or individual scientists (unlike, say, the
H-index). The relative number of citations an individual article receives is better viewed as citation impact.
It is, however, possible to measure the Impact factor of the journals in which a particular person has published articles. This use is widespread, but controversial. Eugene Garfield warns about the "misuse in evaluating individuals" because there is "a wide variation from article to article within a single journal". [cite journal
author = Eugen Garfield
year = 1998
month = June
title = Der Impact Faktor und seine richtige Anwendung
journal = Der Unfallchirurg
volume = 101
issue = 6
pages = 413–414
url = http://www.garfield.library.upenn.edu/papers/derunfallchirurg_v101(6)p413y1998english.html] Impact factors have a huge, but controversial, influence on the way published scientific research is perceived and evaluated.
The impact factor of a journal is calculated based on a two-year period. It can be viewed as the average number of citations in a year given to those papers in a journal that were published during the two preceding years. [Citation
title = Journal Citation Reports
year = 2007
url = http://isiwebofknowledge.com
accessdate = 2008-08-12] For example, the 2003 impact factor of a journal would be calculated as follows:
: "A" = the number of times articles published in 2001-2 were cited in indexed journals during 2003: "B" = the number of "citable items" (usually articles, reviews, proceedings or notes; not editorials and letters-to-the-Editor) published in 2001-2
: 2003 impact factor = "A"/"B" :: (note that the 2003 impact factor was actually published in 2004, because it could not be calculated until all of the 2003 publications had been received.)
A convenient way of thinking about it is that a journal that is cited once, on average, for each article published has an IF of 1 in the expression above.
There are some nuances to this: ISI excludes certain article types (so-called 'front-matter' such as news items, correspondence, and errata) from the denominator. Thomson Scientific does not have a fixed rule for which types of articles are considered "citable" and which front-matter.
New journals, that are indexed from their first published issue, will receive an Impact Factor after the completion of two years' indexing; in this case, the citations to the year prior to Volume 1, and the number of articles published in the year prior to Volume 1 are known zero values. Journals that are indexed starting with a volume other than the first volume will not have an Impact Factor published until three complete data-years are known; annuals and other irregular publications, will sometimes publish no items in a particular year, affecting the count. The impact factor is for a specific time period; it is possible to calculate the impact factor for any desired period, for which the web site gives instructions. "Journal Citation Reports" includes a table of the relative rank of journals by Impact factor, in each specific science discipline, such as
organic chemistryor psychiatry.
It is sometimes useful to be able to compare different journals and research groups. For example, a sponsor of scientific research might wish to compare the results to assess the productivity of its projects. An objective measure of the importance of different publications is then required. The number of publications and citation statistics are two obvious candidates for such an objective measure. However, the use of such measures in general and the impact factor in particular is still a matter of debate.
* Thomsons Scientific's wide international coverage. Web of Knowledge indexes 9000 science and social science journals from 60 countries. This is perhaps only partially correct: see below.
* Results are widely (though not freely) available.
* It is an objective measure.
* In practice, the alternative measure of quality is "prestige." This is rating by reputation, which is very slow to change, and cannot be quantified or objectively used. It merely demonstrates popularity.
In the continuing controversy, numerous criticisms have been made of the use of an impact factor. Besides the more general debate on the usefulness of citation metrics, criticisms mainly concern the validity of the impact factor, how easily manipulated it is and its misuse.
* The denominator of the impact factor is negotiable and therefore does not reflect actual citation counts.cite article | url = http://dx.doi.org/10.1371/journal.pmed.0030291 | title = The Impact Factor Game | publisher = PLoS Medicine | author = PLoS Medicine Editors | date = June 6, 2006]
* The impact factor could not be reproduced in an independent audit. [cite article | url = http://www.jcb.org/cgi/content/full/179/6/1091 | title = Show me the data | publisher = Journal of Cell Biology | author = Mike Rossner, Heather Van Epps, and Emma Hill | date = December 17, 2007] (See [http://forums.thomsonscientific.com/ts/blog/article?message.uid=717 Thomson Scientific's reply] .)
* The impact factor refers to the average number of citations per paper, and this is not a gaussian distribution. It is rather a Bradford distribution, as predicted by theory. The impact factor is therefore not a valid measure for citation evaluation. [cite article | url = http://www.mathunion.org/fileadmin/IMU/Report/CitationStatistics.pdf | title = Citation Statistics | publisher = International Mathematical Union | author = Joint Committee on Quantitative Assessment of Research | date = June 12, 2008]
* The temporal window for citation is too short. Classic articles are cited frequently even after several decades, but this should not affect specific journals. [cite journal |author= Bruynooghe M |url=http://www.cs.kuleuven.ac.be/~dtai/projects/ALP/newsletter/nov05/nav/articles/maurice/article.html |title= Theory and practice of logic programming and the ISI Web of Knowledge |journal= Association for Logic Programming Newsletter |year=2005 |volume=18 |issue=4 |accessdate=2008-07-20]
* In the short term - especially in the case of low-impact-factor journals - many of the citations to a certain article are made in papers written by the author(s) of the original article.S.A. Marashi. On the identity of “citers”: are papers promptly recognized by other investigators? (2005) Med. Hypotheses 65, 822. PubMed|15990244.] This means that counting citations may be independent of the real “impact” of the work among investigators.
* Failure to include more international journals or other types of publications. Although Web of Knowledge indexes journals from 60 countries, the coverage is very uneven. Very few publications from languages other than English are included, and very few journals from the less-developed countries. Even the ones that are included are undercounted, because most of the citations to such journals will come from other journals in the same language or from the same country, most of which are not included. Many high quality journals in the applied aspects of some subjects are not included, such as
marketing communications, public relationsand promotionmanagement and many important but not peer-reviewed technical magazines.Fact|date=July 2008 Book publications are not indexed, including textbooks, handbooks and reference books. Conference proceedings publications are not indexed, including conferences, workshops and symposia.
A journal can adopt editorial policies that increase its impact factor. [cite news | url = http://chronicle.com/free/v52/i08/08a01201.htm | title = The Number That's Devouring Science | publisher = The Chronicle of Higher Education | author = Richard Monastersky | date = October 14 2005] These editorial policies may not solely involve improving the quality of published scientific work.
* Journals sometimes may publish a larger percentage of review articles. While many research articles remain uncited after 3 years, nearly all review articles receive at least one citation within three years of publication, therefore review articles can raise the impact factor of the journal. [http://thomsonscientific.com/knowtrend/essays/journalcitationreports/impactfactor/ The Thomson Scientific website] gives directions for removing these journals from the calculation. For researchers or students having even a slight familiarity with the field, the review journals will be obvious.
* Journals may change the fraction of "citable items" compared to front-matter in the denominator of the IF equation. Which types of articles are considered "citable" is largely a matter of negotiation between journals and Thomson Scientific. As a result of such negotiations, impact factor variations of more than 300% have been observed. For instance, editorials in a journal do not count as publications. However when they cite published articles, often articles from the same journal, those citations increase the citation count for the article. This effect is hard to evaluate, for the distinction between editorial comment and short original articles is not obvious. "Letters to the editor" might refer to either class.
* Several methods, not necessarily with nefarious intent, exist for a journal to cite articles in the same journal which will increase the journal's impact factor.cite journal |author=Fassoulaki A, Papilas K, Paraskeva A, Patris K |title=Impact factor bias and proposed adjustments for its determination |journal=Acta anaesthesiologica Scandinavica |volume=46 |issue=7 |pages=902–5 |year=2002 |pmid=12139549 |doi=10.1034/j.1399-6576.2002.460723.x]
* An editor of a journal may encourage authors to cite articles from that journal in the papers they submit. The degree to which this practice affects the citation count and impact factor included in the Journal Citation Reports cited journal data must therefore be examined. Most of these effects are thoroughly discussed on the site's help pages, along with ways for correcting the figures for these effects if desired. However, it is almost universal for articles in a journal to cite primarily its own articles, for those are the ones of the same merit in the same special field. If done artificially, the effect will become especially visible when (i) journals have a low impact factor (in absolute terms) and (ii) publish only few papers per year.
In 2007 a specialist journal with an impact factor of 0.66 published an editorial that cited all its articles from 2005 to 2006 in a protest against the absurd use of the impact factor. [Cite journal
author = Harm K. Schuttea, Jan G. Svec
title = Reaction of "Folia Phoniatrica et Logopaedica" on the Current Trend of Impact Factor Measures
Folia Phoniatrica et Logopaedica
volume = 59
issue = 6
year = 2007
doi = 10.1159/000108334
pages = 281–285] The large number of citations meant that the impact factor for that journal increased to 1.44.
* The impact factor is often misused to predict the importance of an individual publication based on where it was published.cite journal |journal=BMJ |year=1997 |volume=314 |issue=7079 |pages=498–502 |title= Why the impact factor of journals should not be used for evaluating research |author= Seglen PO |pmid=9056804 |pmc=2126010 |url=http://www.bmj.com/cgi/content/full/314/7079/497] This does not work well since a small number of publications are cited much more than the majority - for example, about 90% of Nature's 2004 impact factor was based on only a fourth of its publications, and thus the importance of any one publication will be different and on the average less than the overall number. [cite journal |author= |title=Not-so-deep impact |journal=Nature |volume=435 |issue=7045 |pages=1003–4 |year=2005 |pmid=15973362 |doi=10.1038/4351003a] The impact factor, however, averages over all articles and thus underestimates the citations of the top cited while exaggerating the number of citations of the average publication.
* Academic reviewers involved in programmatic evaluations, particularly those for doctoral degree granting institutions, often turn to ISI's proprietary IF listing of journals in determining scholarly output. This builds in a bias which automatically undervalues some types of research and distorts the total contribution each faculty member makes.
* The absolute value of an impact factor is meaningless. A journal with an IF of 2 would not be very impressive in
Microbiology, while it would in Oceanography. Such values are nonetheless sometimes advertised by scientific publishers.
* The comparison of impact factors between different fields is invalid. Yet such comparisons have been widely used for the evaluation of not merely journals, but of scientists and of university departments. It is not possible to say, for example, that a department whose publications have an average IF below 2 is low-level. This would not make sense for
Mechanical Engineering, where only two review journals attain such a value.
* Outside the sciences, impact factors are relevant for fields that have a similar publication pattern to the sciences (such as economics), where research publications are almost always journal articles, that cite other journal articles. They are not relevant for literature, where the most important publications are books citing other books. Therefore, Thomson Scientific does not publish a JCR for the humanities.
* Even though in practice they are applied this way, impact factors cannot correctly be the only thing to be considered by libraries in selecting journals. The local usefulness of the journal is at least equally important, as is whether or not an institution's faculty member is editor of the journal or on its editorial review board.
* Though the impact factor was originally intended as an objective measure of the reputability of a journal (Garfield), it is now being increasingly applied to measure the productivity of scientists. The way it is customarily used is to examine the impact factors of the journals in which the scientist's articles have been published. This has obvious appeal for an academic administrator who knows neither the subject nor the journals.
* The absolute number of researchers, the average number of authors on each paper, and the nature of results in different research areas, as well as variations in citation habits between different disciplines, particularly the number of citations in each paper, all combine to make impact factors between different groups of scientists incommensurable. Generally, for example, medical journals have higher impact factors than mathematical journals and engineering journals. This limitation is accepted by the publishers; it has never been claimed that they are useful between fields--such a use is an indication of misunderstanding.
HEFCEwas urged by the Parliament of the United KingdomCommittee on Science and Technology to remind Research Assessment Exercise(RAE) panels that they are obliged to assess the quality of the content of individual articles, not the reputation of the journal in which they are published. [cite web |url=http://www.publications.parliament.uk/pa/cm200304/cmselect/cmsctech/399/39912.htm |title=House of Commons - Science and Technology - Tenth Report |format= |work= |accessdate=2008-07-28 |date=2004-07-07]
* The number of citations to papers in a particular journal does not really directly measure the true quality of a journal, much less the scientific merit of the papers within it. It also reflects, at least in part, the intensity of publication or citation in that area, and the current popularity of that particular topic, along with the availability of particular journals. Journals with low circulation, regardless of the scientific merit of their contents, will never obtain high impact factors in an absolute sense, but if all the journals in a specific subject are of low circulation, as in some areas of
botanyand zoology, the relative standing is meaningful. Since defining the quality of an academic publication is problematic, involving non-quantifiable factors, such as the influence on the next generation of scientists, assigning this value a specific numeric measure cannot tell the whole story.
* By merely counting the frequency of citations per article and disregarding the prestige of the citing journals, the impact factor becomes merely a metric of popularity, not of prestige.
Gabriel Pinskiand Francis Narinsuggested a recursive impact factor, to give citations from journals that have high impact greater weight than citations from low-impact journals. [Cite journal
Gabriel Pinskiand Francis Narin
title = Citation influence for journal aggregates of scientific publications: Theory with application to literature of physics
Information Processing & Management
year = 1976
volume = 12
pages = 297–312
doi = 10.1016/0306-4573(76)90048-0] Such a recursive impact factor resembles the
PageRankalgorithm of the
author = S. J. Liebowitz and J. P. Palmer.
year = 1984
title = Assessing the relative impacts of economics journals
journal = Journal of Economic Literature
volume = 22
pages = 77–88
url = http://www.jstor.org/pss/2725228] [cite journal
author = I. Palacios-Huerta and O. Volij
year = 2004
title = The measurement of intellectual influence
journal = Econometrica
volume = 72
pages = 963–977
doi = 10.1111/j.1468-0262.2004.00519.x] [cite journal
author = Y. K. Kodrzycki and P. D. Yu
year = 2006
title = New approaches to ranking economics journals
journal = B. E. Journal of Economics Analysis and Policy
volume = 5
doi = 10.2202/1538-0645.1520] In 2006, Johan Bollen, Marko A. Rodriguez, and Herbert Van de Sompel also proposed using the
PageRankalgorithm. [cite journal
author = Johan Bollen, Marko A. Rodriguez, and Herbert Van de Sompel.
year = 2006
month = December
title = Journal Status
journal = Scientometrics
volume = 69
issue = 3
url = http://www.arxiv.org/abs/cs.GL/0601030] From their paper:
The table shows the top 10 journals by ISI Impact Factor, PageRank, and a modified system that combines the two (based on 2003 data). "Nature" and "Science" are generally regarded as the most prestigious journals, and in the combined system they come out on top. That the "
New England Journal of Medicine" is cited even more than "Nature" or "Science" might reflect the mix of review articles and original articles that it publishes. It is necessary to analyze the data for a journal in the light of a detailed knowledge of the journal literature.
Eigenfactoris another PageRank-type measure of journal influence, [cite journal
author = C. T. Bergstrom.
year = 2007
month = May
title = Eigenfactor: Measuring the value and prestige of scholarly journals
journal = C&RL News
volume = 68
issue = 5
url = http://www.ala.org/ala/acrl/acrlpubs/crlnews/backissues2007/may07/Eigenfactor.htm] with rankings freely available at [http://www.eigenfactor.org eigenfactor.org] .
H-index, for the impact factor of individual scientists, rather than journals.
PageRank, the Algorithm used by
* Official [http://admin-apps.isiknowledge.com/JCR/JCR Journal Citation Report] from the [http://www.isinet.com ISI website]
* [http://www.epidemiologic.org/2007/07/2007-journal-impact-factors-for-leading.html Epidemiology Inquiry] 2007 Impact Factor listings for medical and science journals.
* [http://www.sciencegateway.org/rank/index.html List of ranking and impact factor by Sci-Bytes]
* [http://www.harzing.com/pop.htm Publish or Perish] calculates various statistics, including the h-index and the
g-indexusing Google Scholardata.
Wikimedia Foundation. 2010.
Look at other dictionaries:
Impact Factor — Der Impact Factor bzw. Einflussfaktor oder genauer Journal Impact Factor (JIF) einer Fachzeitschrift soll messen, wie oft andere Zeitschriften Artikel aus ihr in Relation zur Gesamtzahl der dort veröffentlichten Artikel zitieren. Je höher der… … Deutsch Wikipedia
Impact factor — Facteur d impact Pour les articles homonymes, voir FI et IF. Un facteur d impact, également abrégé par les sigles FI ou IF (pour l anglais impact factor) est une mesure de l importance d une revue scientifique. Il est calculé chaque année par l… … Wikipédia en Français
Web Impact Factor — Der Web Impact Factor (WIF) ist eine Übertragung des bibliometrischen Prinzips des Impact Factors für Fachzeitschriften auf Webseiten oder Domänen im World Wide Web. Er wird in der Webometrie eingesetzt, um den Einfluss von Webseiten zu… … Deutsch Wikipedia
IMPACT — (engl. „Stoß“, „Einschlag“, „Wirkung“) steht für: den Einschlag eines Himmelskörpers, siehe Impakt die wahrgenommene Differenz an Informationsgehalt vor und nach der Übermittlung einer Information, siehe Impact (Kommunikationswissenschaft) eine… … Deutsch Wikipedia
Impact (Film) — Impact (engl. „Stoß“, „Einschlag“, „Wirkung“) steht für: den Einschlag eines Himmelskörpers, siehe Impakt die wahrgenommene Differenz an Informationsgehalt vor und nach der Übermittlung einer Information, siehe Impact (Kommunikationswissenschaft) … Deutsch Wikipedia
Factor de impacto — (también conocido como índice de impacto), más común en idioma inglés Impact Factor, es una medida de la importancia de una publicación científica. Cada año es calculado por el Instituto para la Información Científica (ISI o Institute for… … Wikipedia Español
Impact — (engl. „Stoß“, „Einschlag“, „Wirkung“ bzw. lat. impactus, PPP von impingere = einschlagen) steht für: den Einschlag eines Himmelskörpers, siehe Impakt die wahrgenommene Differenz an Informationsgehalt vor und nach der Übermittlung einer… … Deutsch Wikipedia
Factor de impacto — Factor de Impacto, más común en idioma inglés Impact Factor, es una medida de la importancia de una publicación científica. Cada año es calculada por el Instituto de Información Científica (ISI o Institute for Scientific Information) para… … Enciclopedia Universal
Impact-Faktor — Der Impact Factor oder genauer Journal Impact Factor (JIF) einer Fachzeitschrift soll messen, wie oft andere Zeitschriften einen Artikel aus ihr in Relation zur Gesamtzahl der dort veröffentlichten Artikel zitieren. Je höher der Impact Factor,… … Deutsch Wikipedia
Impact Faktor — Der Impact Factor oder genauer Journal Impact Factor (JIF) einer Fachzeitschrift soll messen, wie oft andere Zeitschriften einen Artikel aus ihr in Relation zur Gesamtzahl der dort veröffentlichten Artikel zitieren. Je höher der Impact Factor,… … Deutsch Wikipedia