Myth: Impact Factor Measures Real Impact
One of the most interesting game being played in the universities is that of impact factor research. There is a whole industry that is now specializing in how to increase the impact factor. There are researchers who are publishing at the rate of one publication every month (or even every other week) in the prestigious ISI index. There are several researchers in Pakistan who have published over 30 ISI papers in three years. Where is this impact coming from? How can one do a unique original research that can produce a paper every few weeks, unless it is just a rehash of some existing work?
One of my friends who did his PhD from a prestigious US university told me about a course that he took in USA that he later dropped. The professor told him to write a paper that is so dense and complicated that it should not be understandable by any one. This should be done by including some complicated equations and matehmatical models and should revolve around terminology related to a particular field. The only restriction was to include a few references to the work of some professors in Europe. When those professors’ papers were analyzed, it was found that the papers were equally dense, incomprehensible and even non-sensical. These works are all published in reputable journals.
There is an interesting analysis of computer generated non-sensical but completely grammatical and correct English papers that appear to be scholarly but totally gibberish which were sent for publication to various journals/conferences and which got accepted and were published. There is even a website that helps you generate scholarly research papers complete with tables, facts and figures that get accepted in various conferences. Even major publishers of online journals had published computer generated research papers.
I know of some scientists who have over 800 publications in a career spanning over 40 years. If you do the maths i.e. number of days in 40 years divided by the number of publications, the average number of days in which a publication was produced comes out to be around 18 days (= 40 x 365 / 800). What originality can there be in such creative work? Mind you majority of these publications would be in worthy impact factor journals.
I think there is a fundamental problem in this kind of measurement. You are measuring the instrument with itself. Fever can not be measured with fever of other people, it needs a device called thermometer that measures expansion of (say) Mercury. Speed of a car can not be measured by using speed of other cars, it needs a device called speedometer. Height of a plane in air can not be determined by comparing them with other planes in the air, it needs an instrument called altimeter that uses another quantity. The issue in impact factor measurment is measuring a quantity with itself. Hence, the number of publications have increased tremendously. There are now services available that would publish your journal and articles and would get your journal and articles a high impact factor if you pay some thousands of dollars.
Can this impact factor quantify the negative contributions of the dictators, bigots and war-mongers or exploiters of environment and plunderers of the financial industry in Pakistan. The impact factor is hopelessly out of sync with society and industry.
– Impact on the industry; new ventures, new products, new opportunities, new jobs, ..
– Social change, economic change, change movements
Instead of plagiarizing impact factor research and whole scale implementing it in Pakistan without thinking about its societal impact, we should have been prepared to do original research and should have researched to enhance the impact factor so that it can measure concrete changes brought about in our society. This should have been the role of higher education commission.
West is at a stage where the relevance of research to society has already been worked out and they can play this game. Pakistan is at a stage which has to ensure this societal impact as it spends its precious resources in research. Development of such an impact factor that quantifies contribution to our society is our need. It is not the need of West that has already transited from the stage, where we find ourselves at present.
What we need to do now is to develop indices that measure industry growth, job growth, poverty alleviation, health improvement and other such goals. Then we need to link the output of the university such as the contribution of the alumni to society, industry, and entrepreneurship. We should subtract from such positive contributions, all the negative contributions made by the alumni. There should be Hall of Fame for each university and then there should be a Hall of Shame. Let’s measure the true impact. The impact on character of the graduates as reflected in their contributions to the society and industry.
People may argue that it is difficult, it may not be objective, it may not be measurable, what would be instrument, who would calibrate. But these are the challenges not the problems. Solving such challenges is the real impact factor research. If proponents of higher education would not do this, then who would!
- Motivation: Why PhD?
What is PhD?
- What does it Mean to Have a PhD: Myths of Specialization and Departmental Expertise
- What is the Difference between MS/MPhil Research and PhD Research
- Why PhD is Difficult to Complete and Why there are so many ABDs and PhD Dropouts
- How Progress of Research is related to the Mood and Psychology of a PhD Student
Starting with your PhD
- How to Read a Research Paper and Extract Problem Statement and Thesis Statement
- How Literature Review of a PhD Dissertation Presents the State of the Art: Synthesis vs Listing
- What is a Problem Statement and its role in MS-PhD Research
- What is a Thesis Statement and its Role in PhD-MS Research
- What is meant by Rigor of PhD Research
- Conclusion vs Assumption in Research Writing- Flipping the Thread of Argument in your PhD Thesis
- PhD is about Pursuit of Excellence. Pursuit of Excellence vs Guzara: How to teach excellence through everyday examples
- Myth: Impact Factor Measures Real Impact
- Pursuit of Excellence vs Guzara: How to teach excellence through everyday examples
- Discerning the Forest from the Trees – The Insights from my PhD Supervisor JC Browne
- A Formula is Worth a Thousand Pictures: Dijkstra vs Buzan’s Mind-Maps
- Fairness in Grading: A Lesson by the Great Dijkstra
- Lesser known dimensions of US Universities – Archives of history and literature
- Myth: We are backward because we Lag Behind in Science and Technology
- Myth: Mushrooming of HEIs in Pakistan
- Myth: Impact factor measures impact
- Myth: Increase in PhDs Increase Teaching Quality
- What is a PhD and What is its Definition
- Best Visualization of Bachelors vs Masters vs PhD that I have seen
- What is a Thesis Statement!
- 101 Tips for Completing your PhD Quickly
- Myths of Schooling and Education: Resources
- 5 Myths of Higher Education in Pakistan