Sep 14, 2011

Estimation of Impact Factors

Scientific excellence is often burned down to some numbers. For academics, it is publish or perish and bibliographic analysis is an important factor for academic careers. A bibliographic analysis includes how many papers somebody published, where they published, and how many citations their publications received. One of the numbers that sums up the quality of publications is the impact factor, which classifies journals and is often taken as the quality of individual publications published in those journal. There are services that calculate these impact factors, most prominently isiweb of knowledge, however they provide limited access (they are subscription based) and they only publish impact factors for journals that exist already for at least four years. Here I discuss shortly a method based on google scholar to estimate impact factors and I use it to estimate an impact factor for the journal frontiers in systems neuroscience.

What is the impact factor?

I am only paraphrasing slightly from the wikipedia article on the impact factor:

In a given year, the impact factor of a journal is the average number of citations received per paper published in that journal during the two preceding years. [...] Papers published includes citable items, which are usually articles, reviews, proceedings, or notes; not editorials or Letters-to-the-Editor.


There are alternative strategies to evaluating journal impact, such as eigenfactors, which are probably a better indicator of importance than the impact factor, however the impact factor is commonly used and cited.

Average citations

I am trying to estimate impact factor from google scholar, using the publish or perish software as search front-end.

Search for journal Frontiers in systems neuroscience between 2009 and 2010. Results from publish or perish below.

Papers: 110 Cites/paper: 4.82 h-index: 13 AWCR: 239.50
Citations: 530 Cites/author: 182.54 g-index: 16 AW-index: 15.48
Years: 3 Papers/author: 41.93 hc-index: 17 AWCRpA: 81.49
Cites/year: 176.67 Authors/paper: 3.25 hI-index: 4.02 e-index: 7.55
hI,norm: 6 hm-index: 7.98

The number we are looking for are the cites/paper: 4.82.

Discounting

The impact factor counts only citations received during the year after the publication period. Therefore, we should discount for citations during that time. This is not easily possible in google scholar. Therefore, because citation patterns over time should be similar over journals within a scientific domain, I suggest to discount by a factor suggested by other journals for which the impact factor is known. Probably the citations follow a log-curve over time, however a scalar discount factor could suffice for our purpose.

I will now calculate a discount factor based on impact and citation data for two journals, Neuron and PLOS Biology.

According to google scholar, papers in neuron published during 2009-2010 received an average of 20.25 citations since publication. Neuron's impact factor according to Isiweb is 14.027. Therefore, the discount factor should be 14.027/20.25 is roughly 0.69.

For PLOS Biology (impact factor 12.472) the average citations since publication for papers during the period 2009-2010 is 23.755. The discount factor should therefore be 12.472/23.755, roughly 0.52.

The higher discount factor for Neuron could mean that articles in PLOS Biology have a shorter half-life (i.e. Neuron articles get cited for longer periods of time).

Estimated impact factors

For the journal Frontiers in Systems Neuroscience, discounted according to the model by PLOS Biology, the estimated impact factor would be 4.82*0.52, roughly 2.51. According to the Neuron discount factor, the estimated impact factor would be 3.33.

I tried this out with other journals. For the journal of neuroscience, publish and perish's limit of 1000 papers was reached, so the estimate (11.04) is skewed by publications with higher impact that come first in search results. Maybe introduction of some arbitrary search queries could help, but I am moving on to other journals. For Plos Genetics I got "Cites/paper: 12.15" which would be 6.44 and 8.38 discounted, respectively, while the impact factor of 2010 is 9.543.

The the journal of computational neuroscience reports an impact factor of 2.325 on its web page, while I get 4.43 cites/paper, which would be discounted to 2.35. Frontiers in computational neuroscience has an impact factor (as of 2010) of 2.586 and I find 3.13 cites/paper from google scholar; discounted this would amount to 1.66 and 2.16, respectively.

So the estimate from google scholar is sometimes very crude, but maybe indicative for similar journals.

Conclusions

As indicated before, this estimation has to be taken with a grain of salt. Google scholar results are ordered by pagerank, so you have to take care not to loose the less-cited paper in the analysis. Important in this context is that frontiers in very well-indexed (DOAJ, CrossRef, PubMed Central and PubMed, Google Scholar, SCOPUS) which means that no papers get lost, otherwise we might loose papers that are not indexed or not cited. This could mean that estimates for frontiers journals from google scholar are better than for other journals that are not as well-indexed.

Google scholar takes into account a very broad spectrum of journals and many conferences. Isiweb impact factor includes only citations from journals. It also excludes self-citations, however self-citations (as I found in some study) do not co-vary (at least not significantly) with the number of citations of a paper (which means self-citations do not distort results if you compare different results at least).

Please leave a comment below for questions and suggestions.

25 comments:

  1. Thank you for this helpful stuff I got at your site. The stuff here is really good and keep up sharing.Thanks for giving such valuable information..

    ReplyDelete
    Replies
    1. Price Education and learning may be the considerably debated in addition to talked about issue inside the variety associated with education and learning within India. Needless to say it truly is legitimate that the primary purpose of virtually any education and learning is going along with Price positioning.

      Delete
  2. I keep on reading this attractive blog.I learn something more challenging on different blogs everyday. It will always be stimulating to read content from other writers and practice a little something from their store.

    ReplyDelete
  3. I have been using the Google Scholar as it provides a simple way to broadly search for scholarly literature. I think it is one of the amazing products of Google X labs!

    ReplyDelete
  4. Very happy to see your article, I very much to like and agree
    with your point of view. Thank you for sharing. You made some good
    points here.
    I have been using the Google Scholar as it provides a simple way
    to broadly search for scholarly literature. I think it is one of the
    amazing products of Google X labs!

    ReplyDelete
  5.  Yes your post is really nice some great info we gain from your post thanks
    for sharing this interesting Article with us!!!

    Verifone Ruby

    ReplyDelete
  6. Hello friend!!
    This is extremely helpful.We were in need of this stuff and even here I think it is.We are pulling off a undertaking and this also stats are useful to do. Thanks for writing this! 

    ReplyDelete
  7. I think it is one of the amazing products of Google X labs!

     
    Search Engine Optimization  

    ReplyDelete
  8. very glad to attach the document in site to carefully.

    Webdesign Bristol

    ReplyDelete
  9. I love science, but i think neurons is a very complex subject to try to explain to a person. 

    ReplyDelete
  10. In that case, this kind of question should not be taken from any show telecasted in
    specific country. Popular prizes include sports tickets,
    cash and vouchers for drinks, food - and dollars off of tabs.
    28.

    Here is my web site brainstormer pub Quiz answers

    ReplyDelete
  11. Rosemary is pregnant and they plan the delivery of their
    first child. There are plenty of websites offering the option to watch online videos.

    Nonetheless, Walt Disney shows it in an exceedingly engaging manner.


    Feel free to visit my blog; movie4k to

    ReplyDelete
  12. I've learn several just right stuff here.

    Definitely worth bookmarking for revisiting. I wonder how much attempt
    you put to make one of these excellent informative site.


    My homepage amazon.com inc.

    ReplyDelete
  13. Hi there, I enjoy reading through your article post.

    I like to write a little comment to support you.

    Feel free to visit my website; http://stage.meclub.com/content/best-champions-carry-ranked-games-league-legends-0

    ReplyDelete
  14. Write more, thats all I have to say. Literally, it seems as though
    you relied on the video to make your point. You obviously know what youre
    talking about, why throw away your intelligence on just posting videos to your site when you could be giving us something informative
    to read?

    Visit my homepage :: calorie burning calculator

    ReplyDelete
  15. Link exchange is nothing else but it is only
    placing the other person's weblog link on your page at appropriate
    place and other person will also do similar in support of you.


    Feel free to visit my weblog :: Argent Bourse

    ReplyDelete
  16. It's a pity you don't have a donate button! I'd
    definitely donate to this brilliant blog! I suppose for now i'll settle for book-marking and adding your RSS
    feed to my Google account. I look forward to new updates and will share this blog with
    my Facebook group. Talk soon!

    my blog; brooklyn real estate inspector ()

    ReplyDelete
  17. Heyy there! I juust wanted to ask iff you ever have any probnlems with
    hackers? My last blog (wordpress) was hacked and
    I ended up losing many months of hard work due to no data backup.
    Do youu have any solutions to protect against hackers?

    My web sitge - iron force hack download

    ReplyDelete
  18. Hello mates, its wonderful paragraph regarding educationand fully explained, keep
    it up all the time.

    Also visit my web site: best web hosting best credit card processing company for small business

    ReplyDelete
  19. some new details surrounding the case and thought I would update you on what has
    happened as a result of this sad situation. The post-war
    era saw the couple relocating their National Book Store to 'Avenida', which
    worked out well because business started
    picking up in no time at all. One of them was 17 and the younger one was 13 and they
    died a year apart.

    Also visit my web-site portsmouth high school calendar 2014

    ReplyDelete
  20. I think this is among the such a lot vital information for me.
    And i'm satisfied reading your article. However
    should commentary on some common things, The web site style is great, the articles is
    actually nice : D. Excellent job, cheers

    Also visit my webpage ขายดัมเบล

    ReplyDelete


  21. Also visit my weblog - website ()

    ReplyDelete
  22. payments for your business to the rely salutation.ne'er give your kids decide, too!
    virtually masses don't cognise what materials and products to
    take true that any apparel you get an item,
    we a great deal be up online anytime. You don't truly
    hit love what you bang a set of Michael Kors Outlet Online Michael Kors Outlet Stores Michael Kors Outlet Online Michael Kors Canada Michael Kors Watches Michael Kors Outlet Online Michael Kors Outlet Online Michael Kors Handbags Michael Kors Outlet Michael Kors Shoes Michael Kors Outlet Michael Kors Outlet Michael Kors Outlet Stores Michael Kors Canada Michael Kors Handbags Michael Kors Handbags Michael Kors Outlet Michael Kors Outlet Michael Kors Outlet Michael Kors Outlet Michael Kors Wallet
    michael kors outlet Online come to fees joint with
    personalizing your salutation and fix hurt purchases.
    If you need to pay cargo ships, clean up true that it greeting any betimes case,
    smarten up up your small indefinite quantity so it may appear coiled, the secrecy logical argument.
    These explicate to TV audience primeval on what is and you by all odds

    ReplyDelete
  23. I'm really enjoying the theme/design of your site. Do you ever run into any browser compatibility problems?
    A couple of my blog readers have complained about my blog not working correctly in Explorer
    but looks great in Opera. Do you have any advice to help fix this issue?


    Here is my web blog; WiesenburgWahl in Wiesenburg 2014

    ReplyDelete
  24. Mo care, uggs outlet uk I am not a grass, how Liu girl feel his heart at this time as being a big hand suddenly caught. Chuxian Shi unruly cheap ugg boots for men wayward, uggs outlet uk elegant and aloof after metamorphosis, on behalf of their intoxication, save cheap kids ugg boots yourself between cheap uggs ap uggs sale next cheap ugg boots sale day.

    Lost to cherish cheap kids ugg boots the moment fully appreciate. An cheap ugg boots uk anxious and slightly familiar voice from the incoming of the ears. This kind of sad mood from slow over.

    First rays of morning cheap ugg boots for men sunlight shone through Zhichuang everywhere on that sad face. A tear slid ugg bailey button sale uk down from his eyes, which is three years since the death of their parents for the first time in tears.

    ReplyDelete