Page 269 - Becoming Metric Wise

261
Research Evaluation

obtained the highest value receives a score of 100 and other institutions’
scores are a percentage thereof. Adding these scores a new normalization
is applied in such a way that the university with the highest score receives
a final normalized score of 100. Again other scores are assigned
proportionally.
The World University Rankings (THE) (edition 2016 2017) use a
set of 13 indicators, grouped into the following five categories:
• Teaching (30%). This category includes five indicators, including a rep-
utation survey, staff-to-student ratio, and the ratio of doctorates
awarded to academic staff.
• Research (30%). This category focuses on reputation based on a sur-
vey, income (scaled against number of academic staff), and produc-
tivity. The latter is measured by the number of papers in Scopus
(prior to 2015: Web of Science), normalized for university size and
subject.
• Citations (30%). Citations are collected from Scopus and based on a
5-year publication and 6-year citation window. The data are normal-
ized to account for subject differences. Since papers with a very large
number (over 1000) of authors distorted the citation counts of smaller
institutions, these papers were excluded in the 2015 2016 edition. In
2016 2017 these papers are incorporated again but their scores have
been fractionalized. Each participating university gets at least 5% of
the paper’s citation credit; universities that contribute more authors
get a proportionately larger share.
• International outlook (7.5%). This category looks at a university’s inter-
national orientation via share of international students, share of inter-
national staff, and international research collaboration.
• Industry income (2.5%). The income from industry is scaled against the
number of academic staff of the university.

The QS World University Rankings are based on 6 indicators:
• Academic reputation, measured by a global survey of academics
(40%).
• Employer reputation, measured by a global survey of employers (10%).
• Student-to-faculty ratio (20%).
• Citations per faculty (20%). Data are obtained from Scopus and since
2015 2016 normalized for subject, such that five broad disciplines of
research each contribute 20% to the final indicator.
• International faculty ratio (5%).
• International student ratio (5%).