Page 268 - Becoming Metric Wise

260 Becoming Metric-Wise

innovation and web presence into account and provides rankings per
sector: University Research Rankings, University Innovation Rankings;
University Web Visibility Rankings; Government Research Rankings;
Government Innovation Rankings; Government Web Visibility
Rankings; Hospital Research Rankings; Hospital Innovation Rankings;
Hospital Web Visibility Rankings; Company Research Rankings;
Company Innovation Rankings; Company Web Visibility Rankings.

8.4.3 Criteria Used to Draw These Rankings

Using different criteria leads to different rankings. For this reason we give
an overview of the criteria used by the main actors. Most university rank-
ings use a composite indicator: different indicators are weighted and
joined into one final ranking. Moed (2017) provides a recent critical
overview and comparison of 5 rankings: ARWU, THE, QS, Leiden rank-
ing, and U-Multirank. The U-Multirank is not discussed in this book; its
results, however, can be found at: www.umultirank.org.
The Shanghai Jiao Tong University ranking (ARWU) was originally
conceived as a way to assess the global performance of top universities. It
takes into account all universities with top researchers (Nobel laureates,
Fields medalists, or highly cited researchers according to the Web of
Science (WoS) databases) or papers in Nature or Science. It is based on the
following indicators (their weights in the total score are shown between
brackets):
• Quality of education, measured by the number of alumni that received
a Nobel Prize or a Fields Medal (10%).
• Quality of faculty, measured by the number of university members
that have been granted a Nobel Prize or Fields medal (20%) and the
number of highly cited researchers in 21 large fields (20%).
• Research output, measured by the number of articles published in the
journals Science and Nature over the last 5 years, accounting for author
order, (20%) and the total number of publications (article type)
included in the Web of Science (SCI and Social Science Citation
Index (SSCI)) (20%).
• A weighted sum of the abovementioned scores divided by the full-time
person equivalent (FTE) number of academic staff (10%).
For institutions specializing in social sciences or humanities, articles in
Science and Nature are not taken into account and the weight of this indi-
cator is spread over the other ones. For each indicator the institution that