Page 83 - The Importance of Common Metrics for Advacing Social Science Theory and Research

The Importance of Common Metrics for Advancing Social Science Theory and Research: A Workshop Summary
http://www.nap.edu/catalog/13034.html

5

Final Comments

In the final session, Miron Straf (National Research Council) made a
list of some of the themes articulated by participants during the workshop:

• Good measurement begins with the end in mind. If common met-
rics are the goal, it is important to consider both their purpose and
criteria.
• One size does not fit all. In this regard, the goal may not be com-
mon metrics per se, but rather a few metrics widely used.
• Common metrics require common concepts—which are facilitated
by agreement on theory.
• The issue may not be so much what is measured as how it is per-
ceived and classified. Ontology is very important.
• Useful standardization is balanced with construct validity.
• Just as perception can trump reality, politics trumps science. And
public and political demands can trump scientific review.
• Some measures defy standardization—such as self-regulation and
social class.
• Measures will need to change over time because concepts do, and
in particular what is considered important changes over time.
• Raw data—whether collected, compiled, or pooled—may be grist
for the measurement mill, but they do not become refined in that
mill. Data in their disaggregated form are often more useful than
a metric.
• Meta-analysis is no substitute for primary analysis.
• Useful social science needs measures that are widely accepted.

71

Copyright © National Academy of Sciences. All rights reserved.