Close menu

SURE

Sunderland Repository records the research produced by the University of Sunderland including practice-based research and theses.

Automated Multi-Objective Calibration of Biological Agent-Based Simulations

Read, Mark N, Alden, Kieran, Rose, Lois M and Timmis, Jonathan (2016) Automated Multi-Objective Calibration of Biological Agent-Based Simulations. Journal of the Royal Society Interface, 13 (122). ISSN 1742-5689

Item Type: Article

Abstract

Computational agent-based simulation is increasingly used to complement laboratory techniques in advancing our understanding of biological systems. Calibration, the identification of parameter values that align simulation with biological behaviours, becomes challenging as increasingly complex biological domains are simulated. Complex domains cannot be characterised by single metrics alone, rendering simulation calibration a fundamentally multi-metric optimisation problem that typical calibration techniques cannot handle. Yet calibration is an essential
activity in simulation-based science; the baseline calibration forms a control for subsequent experimentation, and hence is fundamental in the interpretation of results.

Here we develop and showcase a method, built around multi-objective optimisation, for calibrating agent-based simulations against complex target behaviours requiring several metrics (termed objectives) to characterise. Multi-objective calibration delivers those sets of parameter values representing optimal tradeoffs in simulation performance against each metric, in the form of a Pareto front. We use MOC to calibrate a well-understood immunological simulation against both established a priori and previously unestablished target behaviours. Further, we show that simulation-borne conclusions are broadly, but not entirely, robust to adopting baseline parameter values from different extremes of the Pareto front, highlighting the importance of MOC’s identification of numerous calibration solutions. We devise a method for detecting overfitting in a multi-objective context, not previously possible, used to save computational effort by terminating MOC when no improved solutions will be found. MOC can significantly impact biological simulation, adding rigour to and speeding up an otherwise time-consuming calibration process, and highlighting inappropriate biological capture by simulations that cannot be well calibrated. As such, it produces more accurate simulations that generate more
informative biological predictions.

[img] PDF (Administrator use only)
10846.pdf - Published Version
Restricted to Repository staff only

Download (1MB)

More Information

Depositing User: Klaire Purvis-Shepherd

Identifiers

Item ID: 10846
Identification Number: https://doi.org/10.1098/rsif.2016.0543
ISSN: 1742-5689
URI: http://sure.sunderland.ac.uk/id/eprint/10846
Official URL: https://royalsocietypublishing.org/doi/10.1098/rsi...

Users with ORCIDS

Catalogue record

Date Deposited: 07 Jun 2019 13:55
Last Modified: 27 Jan 2021 16:45

Contributors

Author: Mark N Read
Author: Kieran Alden
Author: Lois M Rose
Author: Jonathan Timmis

University Divisions

Services > University Executive

Subjects

Sciences > Biomedical Sciences
Computing

Actions (login required)

View Item (Repository Staff Only) View Item (Repository Staff Only)