Page 203 -

200 N. David et al.

For readers more interested in single aspects of V&V, with regard to ABMs with
applicability in social simulation, the following papers provide highly accessible
starting points:
– Edmonds and Hales (2003) demonstrate the importance of model replication (or
model alignment) by means of a clear example.
– Boero and Squazzoni (2005) examine the use of empirical data for model
calibration and validation and argue that “the characteristics of the empirical
target” influence the choice of validation strategies.
– Moss and Edmonds (2005) discuss an approach for cross-validation that com-
bines the involvement of stakeholders to validate the model qualitatively on the
micro level with the application of statistical measures to numerical outputs to
validate the model quantitatively on the macro level.
– Müller et al. (2014) address the question of whether an ideal standard for
describing and documenting models exists, defining different types of model
reporting and proposing a minimum description standard for good modelling
practice.
– Lee et al. (2015) provide an overview of the state-of-the-art approaches in
analysing and reporting ABM outputs, highlighting challenges and issues related
to variance stability, sensitivity analysis, spatio-temporal analysis, visualisation,
and effective communication of these to non-technical audiences, such as various
stakeholders.
– Fachada et al. (2017) Present a structured approach to designing and per-
forming complete model comparison experiments, using statistical tests to
determine if two or more computational models generate distributionally equiv-
alent behaviour.
– Finally, more comprehensive epistemological perspectives on verification and
validation are provided in a number of papers published or derived from the
Epistemological Perspectives on Simulation (EPOS) workshops, namely Frank
and Troitzsch (2005), David (2009), Squazzoni (2009) and David et al. (2010).

Acknowledgements This work was partially funded by the Fundação para a Ciência e a
Tecnologia project UID/EEA/50009/2013.

References

Alberts, S., Keenan, M. K., D’Souza, R. M., & An, G. (2012). Data-parallel techniques for
simulating a mega-scale agent-based model of systemic inflammatory response syndrome on
graphics processing units. Simulation, 88(8), 895–907. doi:10.1177/0037549711425180, http://
journals.sagepub.com/doi/abs/10.1177/0037549711425180
Altman, M., Borgman, C., Crosas, M., & Matone, M. (2015). An introduction to the joint principles
for data citation. Bulletin of the Association for Information Science and Technology, 41(3), 43–
45. doi:10.1002/bult.2015.1720410313, http://onlinelibrary.wiley.com/doi/10.1002/bult.2015.
1720410313/abstract