年間 6 号発行
ISSN 印刷: 2152-5080
ISSN オンライン: 2152-5099
Indexed in
EFFICIENT CALIBRATION FOR HIGH-DIMENSIONAL COMPUTER MODEL OUTPUT USING BASIS METHODS
要約
Calibration of expensive computer models using emulators for high-dimensional output fields can become increasingly intractable with the size of the field(s) being compared to observational data. In these settings, dimension reduction is attractive, reducing the number of emulators required to mimic the field(s) by orders of magnitude. By comparing to popular independent emulation approaches that fit univariate emulators to each grid cell in the output field, we demonstrate that using a basis structure for emulation, aside from the clear computational benefits, is essential for obtaining coherent draws that can be compared with data or used in prediction. We show that calibrating on the subspace spanned by the basis is not generally equivalent to calibrating on the full field (the latter being generally infeasible owing to the large number of matrix inversions required for calibration and the size of the matrices on the full field). We then present a projection that allows accurate calibration on the field for exactly the cost of calibrating in the subspace, by projecting in the norm induced by our uncertainties in observations and model discrepancy and given a one-off inversion of a large matrix. We illustrate the benefits of our approach and compare with standard univariate approaches for emulating and calibrating the high-dimensional ice sheet model Glimmer.
-
von Salzen, K., Scinocca, J.F., McFarlane, N.A., Li, J., Cole, J.N., Plummer, D., Verseghy, D., Reader, M.C., Ma, X., and Lazare, M., The Canadian Fourth Generation Atmospheric Global Climate Model (CanAM4). Part I: Representation of Physical Processes, Atmos. Ocean, 51(1):104-125, 2013.
-
Sacks, J., Welch, W.J., Mitchell, T.J., and Wynn, H.P., Design and Analysis of Computer Experiments, Stat. Sci., 4:409-423, 1989.
-
Higdon, D., Gattiker, J., Williams, B., and Rightley, M., Computer Model Calibration Using High-Dimensional Output, J. Am. Stat. Assoc., 103(482):570-583, 2008.
-
Kennedy, M.C. and O'Hagan, A., Bayesian Calibration of Computer Models, J. R. Stat. Soc. Ser. B (Stat. Methodol.), 63(3):425-464, 2001.
-
Craig, P.S., Goldstein, M., Seheult, A., and Smith, J., Bayes Linear Strategies for Matching Hydrocarbon Reservoir History, Bayesian Stat., 5:69-95, 1996.
-
Williamson, D., Blaker, A.T., Hampton, C., and Salter, J., Identifying and Removing Structural Biases in Climate Models with History Matching, Climate Dyn., 45(5-6):1299-1324, 2015.
-
Andrianakis, I., McCreesh, N., Vernon, I., McKinley, T.J., Oakley, J.E., Nsubuga, R.N., Goldstein, M., and White, R.G., Efficient History Matching of a High Dimensional Individual-Based HIV Transmission Model, SIAM/ASA J. Uncertainty Quantif., 5(1):694-719, 2017.
-
Tuo, R. and Wu, C.J., Efficient Calibration for Imperfect Computer Models, Ann. Stat., 43(6):2331-2352, 2015.
-
Wong, R.K., Storlie, C.B., and Lee, T.C., A Frequentist Approach to Computer Model Calibration, J. R. Stat. Soc.: Ser. B (Stat. Methodol.), 79(2):635-648, 2017.
-
Plumlee, M., Bayesian Calibration of Inexact Computer Models, J. Am. Stat. Assoc., 112(519):1274-1285, 2017.
-
Gu, M. and Wang, L., Scaled Gaussian Stochastic Process for Computer Model Calibration and Prediction, SIAM/ASA J. Uncertainty Quantif., 6(4):1555-1583, 2018.
-
Liu, F. and West, M., A Dynamic Modelling Strategy for Bayesian Computer Model Emulation, Bayesian Anal., 4(2):393-411, 2009.
-
Williamson, D. and Blaker, A.T., Evolving Bayesian Emulators for Structured Chaotic Time Series, with Application to Large Climate Models, SIAM/ASA J. Uncertainty Quantif., 2(1):1-28, 2014.
-
Chang,W., Haran, M., Applegate, P., and Pollard, D., Calibrating an Ice Sheet Model Using High-Dimensional Binary Spatial Data, J. Am. Stat. Assoc., 111(513):57-72, 2016.
-
Salter, J.M., Williamson, D.B., Scinocca, J., and Kharin, V., Uncertainty Quantification for Computer Models with Spatial Output Using Calibration-Optimal Bases, J. Am. Stat. Assoc., 114(528):1800-1814, 2019.
-
Williamson, D., Goldstein, M., and Blaker, A., Fast Linked Analyses for Scenario-Based Hierarchies, J. R. Stat. Soc.: Ser. C (Appl. Stat.), 61(5):665-691, 2012.
-
Wilkinson, R.D., Bayesian Calibration of Expensive Multivariate Computer Experiments, Large-Scale Inverse Problems and Quantification of Uncertainty, L.T. Biegler et al., Ed., Hoboken, NJ: Wiley, pp. 195-216, 2010.
-
Sexton, D.M., Murphy, J.M., Collins, M., and Webb, M.J., Multivariate Probabilistic Projections Using Imperfect Climate Models. Part I: Outline of Methodology, Climate Dyn., 38(11-12):2513-2542, 2011.
-
Chang, W., Applegate, P.J., Haran, M., and Keller, K., Probabilistic Calibration of a Greenland Ice Sheet Model Using Spatially-Resolved Synthetic Observations: Toward Projections of Ice Mass Loss with Uncertainties, Geosci. Model Dev. Discuss., 7(2):1905-1931, 2014.
-
Coveney, S., Corrado, C., Oakley, J.E., Wilkinson, R.D., Niederer, S.A., and Clayton, R.H., Bayesian Calibration of Electrophysiology Models Using Restitution Curve Emulators, Front. Physiol., 2021. DOI: 10.3389/fphys.2021.693015. DOI: 10.3389/fphys.2021.693015
-
Lee, L., Carslaw, K., Pringle, K., and Mann, G., Mapping the Uncertainty in Global CCN Using Emulation, Atmos. Chem. Phys., 12(20):9739-9751, 2012.
-
Spiller, E.T., Bayarri, M., Berger, J.O., Calder, E.S., Patra, A.K., Pitman, E.B., and Wolpert, R.L., Automating Emulator Construction for Geophysical Hazard Maps, SIAM/ASA J. Uncertainty Quantif., 2(1):126-152, 2014.
-
Gu, M. and Berger, J.O., Parallel Partial Gaussian Process Emulation for Computer Models with Massive Output, Ann. Appl. Stat., 10(3):1317-1347, 2016.
-
Johnson, J.S., Regayre, L.A., Yoshioka, M., Pringle, K.J., Lee, L.A., Sexton, D.M., Rostron, J.W., Booth, B.B., and Carslaw, K.S., The Importance of Comprehensive Parameter Sampling and Multiple Observations for Robust Constraint of Aerosol Radiative Forcing, Atmos. Chem. Phys., 18(17):13031-13053, 2018.
-
Haylock, R. and O'Hagan, A., On Inference for Outputs of Computationally Expensive Algorithms with Uncertainty on the Inputs, Bayesian Stat., 5:629-637, 1996.
-
Salter, J.M. and Williamson, D., A Comparison of Statistical Emulation Methodologies for Multi-Wave Calibration of Environmental Models, Environmetrics, 27(8):507-523, 2016.
-
Lee, L., Pringle, K., Reddington, C., Mann, G., Stier, P., Spracklen, D., Pierce, J., and Carslaw, K., The Magnitude and Causes of Uncertainty in Global Model Simulations of Cloud Condensation Nuclei, Atmos. Chem. Phys., 13(17):8879-8914, 2013.
-
Gu, M. and Shen, W., Generalized Probabilistic Principal Component Analysis of Correlated Data., J. Mach. Learn. Res., 21:13-1, 2020.
-
Williamson, D., Goldstein, M., Allison, L., Blaker, A., Challenor, P., Jackson, L., and Yamazaki, K., History Matching for Exploring and Reducing Climate Model Parameter Space Using Observations and a Large Perturbed Physics Ensemble, Climate Dyn., 41(7-8):1703-1729, 2013.
-
Vernon, I., Liu, J., Goldstein, M., Rowe, J., Topping, J., and Lindsey, K., Bayesian Uncertainty Analysis for Complex Systems Biology Models: Emulation, Global Parameter Searches and Evaluation of Gene Functions, BMC Syst. Biol., 12(1):1, 2018.
-
Vernon, I. and Goldstein, M., Bayes Linear Analysis of Imprecision in Computer Models, with Application to Understanding Galaxy Formation, in Proc. of the 6th International Symp. on Imprecise Probability: Theories and Applications, Durham, UK, pp. 441-450, 2009.
-
Vernon, I., Goldstein, M., and Bower, R.G., Galaxy Formation: A Bayesian Uncertainty Analysis, Bayesian Anal., 5(4):619-669, 2010.
-
Andrianakis, I., Vernon, I.R., McCreesh, N., McKinley, T.J., Oakley, J.E., Nsubuga, R.N., Goldstein, M., and White, R.G., Bayesian History Matching of Complex Infectious Disease Models Using Emulation: A Tutorial and a Case Study on HIV in Uganda, PLoS Comput. Biol., 11(1):e1003968, 2015.
-
Hourdin, F., Williamson, D., Rio, C., Couvreux, F., Roehrig, R., Villefranque, N., Musat, I., Fairhead, L., Diallo, F.B., and Volodina, V., Process-Based Climate Model Development Harnessing Machine Learning: II. Model Calibration from Single Column to Global, J. Adv. Model. Earth Syst., 13(6):e2020MS002225, 2021.
-
Salter, J.M., Williamson, D.B., Gregoire, L.J., and Edwards, T.L., Quantifying Spatio-Temporal Boundary Condition Uncertainty for the North American Deglaciation, SIAM/ASA J. Uncertainty Quantif., Accepted, 2022.
-
Xu, W., Williamson, D.B., and Challenor, P., Local Voronoi Tessellations for Robust Multiwave Calibration of Computer Models, Int. J. Uncertainty Quantif., 11(5):1-17, 2021.
-
Volodina, V. and Williamson, D., Diagnostics-Driven Nonstationary Emulators Using Kernel Mixtures, SIAM/ASA J. Uncertainty Quantif., 8(1):1-26, 2020.
-
Williamson, D. and Vernon, I., Efficient Uniform Designs for Multi-Wave Computer Experiments, Stat. Methodol., arXiv:1309.3520, 2013.
-
Couvreux, F., Hourdin, F., Williamson, D., Roehrig, R., Volodina, V., Villefranque, N., Rio, C., Audouin, O., Salter, J., and Bazile, E., Process-Based Climate Model Development Harnessing Machine Learning: I. A Calibration Tool for Parameterization Improvement, J. Adv. Model. Earth Syst., 13(3):e2020MS002217, 2021.
-
Woodbury, M.A., Inverting Modified Matrices, Memorandum Rep., 42(106):336, 1950.
-
Higham, N.J., Accuracy and Stability of Numerical Algorithms, Philadelphia: SIAM, 2002.
-
Rougier, J., Efficient Emulators for Multivariate Deterministic Functions, J. Comput. Graph. Stat., 17(4):827-843, 2008.
-
Lee, L.A., Reddington, C.L., and Carslaw, K.S., On the Relationship between Aerosol Model Uncertainty and Radiative Forcing Uncertainty, Proc. Nat. Acad. Sci., 113(21):5820-5827, 2016.
-
Rutt, I.C., Hagdorn, M., Hulton, N., and Payne, A., The Glimmer Community Ice Sheet Model, J. Geophys. Res.: Earth Surf., 114(F2):F02004, 2009.
-
Loeppky, J.L., Sacks, J., and Welch, W.J., Choosing the Sample Size of a Computer Experiment: A Practical Guide, Technometrics, 51(4):366-376, 2009.
-
Bamber, J.L., Layberry, R.L., and Gogineni, S., A New Ice Thickness and Bed Data Set for the Greenland Ice Sheet: 1. Measurement, Data Reduction, and Errors, J. Geophys. Res.: Atmos., 106(D24):33773-33780, 2001.
-
Gu, M., Palomo, J., and Berger, J.O., RobustGaSP: Robust Gaussian Stochastic Process Emulation in R, Stat. Comput., arXiv:1801.01874, 2018.