Computer Simulation Validation, 1st ed. 2019
Fundamental Concepts, Methodological Frameworks, and Philosophical Perspectives
Simulation Foundations, Methods and Applications Series

This unique volume introduces and discusses the methods of validating computer simulations in scientific research. The core concepts, strategies, and techniques of validation are explained by an international team of pre-eminent authorities, drawing on expertise from various fields ranging from engineering and the physical sciences to the social sciences and history. The work also offers new and original philosophical perspectives on the validation of simulations.

This truly interdisciplinary handbook will appeal to a broad audience, from professional scientists spanning all natural and social sciences, to young scholars new to research with computer simulations. Philosophers of science, and methodologists seeking to increase their understanding of simulation validation, will also find much to benefit from in the text.

Introduction

Part I:  Foundations – Basic Conceptions in Simulation Model Validation

What Is Validation of Computer Simulations? Towards a Clarification of the Concept of Validation and Related Notions
Claus Beisbart

Simulation Accuracy, Uncertainty, and Predictive Capability: A Physical Sciences Perspective
William Oberkampf

Verification and Validation Principles from a Systems Perspective
David J. Murray-Smith

Errors and Uncertainties: Their Sources and Treatment
Christopher J. Roy

Part II: Foundations – Validation as a Scientific Method: Philosophical Frameworks for Thinking about Validation

Invalidation of Models and Fitness-for-purpose: A Rejectionist Approach
Keith Beven & Stuart Lane

Simulation Validation from a Bayesian Perspective
Claus Beisbart

Validation of Computer Simulations from a Kuhnian Perspective
Eckhart Arnold

Understanding Simulation Validation – The Hermeneutic Perspective
Nicole J. Saam

Part III: Methodology – Preparatory Steps

Assessing the Credibility of Conceptual Models
Axel Gelfert

The Method of Manufactured Solutions for Code Verification
Patrick J. Roache

Validation Metrics: A Case for Pattern-based Methods
Robert E. Marks

Analyzing Output from Stochastic Computer Simulations: An Overview
Christine Currie

Part IV: Methodology – Points of Reference and Related Techniques

The Use of Experimental Data in Simulation Model Validation
David J. Murray-Smith

How to Use and Derive Stylized Facts for Validating Simulation Models
Matthias Meyer

The Users’ Judgements – The Stakeholder Approach to Simulation Validation
Nicole J. Saam

Validation Benchmarks and Related Metrics
Nicole J. Saam

Part V: Methodology – Mathematical Frameworks and Related Techniques

Testing Simulation Models Using Frequentist Statistics
Andrew P. Robinson

Validation Using Bayesian Methods
Xiaomo Jiang, Xueyu Cheng & Yong Yuan

Imprecise Probabilities
Seamus Bradley

Objective Uncertainty Quantification
Ed Dougherty, Lori Dalton & Roozbeh Dehghannasiri

Part VI: Methodology – The Organization and Management of Simulation Validation 

Standards for Evaluation of Atmospheric Models in Environmental Meteorology
K. Heinke Schluenzen

The Management of Simulation Validation
Fei Liu &Ming Yang

Valid and Reproducible Simulation Studies - Making It Explicit
Oliver Reinhardt, Tom Warnke, Andreas Ruscheinski & Adelinde M. Uhrmacher

Part VII: Validation at Work – Best Practice-Examples

Validation of Particle Physics Simulation
Peter Mättig

Astrophysical Validation
Alan C. Calder & Dean M. Townsley

Validation in Weather Forecasting
Susanne Theis & Michael Baldauf

Validation of Climate Models: An Essential Practice
Richard B. Rood

Validation of Agent-based Models in Economics and Finance
Giorgio Fagiolo, Mattia Guerini, Francesco Lamperti, Alessio Moneta & Andrea Roventini

Part VIII: Challenges in Simulation Model Validation

Validation and Equifinality
Keith Beven

Validation and Overparameterization – Experiences from Hydrological Modeling
Jan Seibert, Maria Staudinger & Ilja van Meerveld

Uncertainty Quantification Using Multiple Models – Prospects and Challenges
Reto Knutti, Christoph Baumberger & Gertrude Hirsch Hadorn

Challenges to Simulation Validation in the Social Sciences – A critical-rationalist perspective
Michael Mäs

Validation and the Uniqueness of Historical Events
Josef Köstlbauer

Part IX: Reflecting on Simulation Validation: Philosophical Perspectives and Discussion Points

How Do the Validations of Simulations and Experiments Compare?
Anouk Barberousse & Julie Jebeile

How Does Holism Challenge the Validation of Computer Simulation?
Johannes Lenhard

What Types of Values Enter Simulation Validation and What are Their Roles?
Gertrude Hirsch Hadorn & Christoph Baumberger

Calibration, Validation, and Confirmation
Mathias Frisch

Should Validation and Verification Be Separated Strictly?
Claus Beisbart

Prof. Dr. Dr. Claus Beisbart is Professor for Philosophy of Science (Extraordinarius) in the Institute for Philosophy at the University of Bern, Switzerland.

Prof. Dr. Nicole J. Saam is Professor for Sociology (Chair) in the Institute of Sociology at Friedrich-Alexander University Erlangen-Nürnberg, Germany.

Introduces the most important ideas, techniques and strategies of validation

Presents an interdisciplinary approach, considering simulations from both natural and social sciences

Includes philosophical reflection on the validation of computer simulation