Published 6 issues per year
ISSN Print: 2152-5080
ISSN Online: 2152-5099
Indexed in
MULTILEVEL MONTE CARLO SAMPLING ON HETEROGENEOUS COMPUTER ARCHITECTURES
ABSTRACT
Monte Carlo (MC) sampling is the standard approach for uncertainty propagation in problems with high-dimensional stochastic inputs. Various acceleration techniques have been developed to overcome the slow convergence of MC estimates, such as multilevel Monte Carlo (MLMC). MLMC uses successive approximations computed on levels, models with different levels of accuracy, and computational cost to reduce the estimator variance. MLMC analytically determines the number of samples required on each level to achieve a given accuracy at minimal cost. We propose an extension of the original MLMC theoretical framework for modern, heterogeneous computer architectures in which accelerators (GPUs) are available and, therefore, samples can be distributed on both different levels and different compute units (CPUs and GPUs). We derive the optimal sample allocation for the proposed MLMC extension by solving a convex optimization problem. We apply the MLMC extension to a stochastically heated channel flow to provide insight for a study on the design of concentrated solar energy receivers. We demonstrate for the stochastically heated channel flow that the proposed MLMC extension leads to considerable total cost reduction (up to 86%) compared to MLMC using only GPUs.
-
Peherstorfer, B., Willcox, K., and Gunzburger, M., Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization, SIAMRev, 60(3):550-591,2018.
-
Cliffe, K.A., Giles, M.B., Scheichl, R., and Teckentrup, A.L., Multilevel Monte Carlo Methods and Applications to Elliptic PDEs with Random Coefficients, Comput. Visualization Sci., 14(1):3-15, 2011.
-
Peherstorfer, B., Willcox, K., and Gunzberger, M., Optimal Model Management for Multifidelity Monte Carlo Estimation, SIAMJ. Sci. Comput., 38(5):A3163-A3194, 2016.
-
Gorodetsky, A.A., Geraci, G., Eldred, M.S., and Jakeman, J.D., A Generalized Approximate Control Variate Framework for Multifidelity Uncertainty Quantification, J. Comput. Phys, 408:109257, 2020.
-
Geraci, G., Menhorn, F., Huan, X., Safta, C., Marzouk, Y.M., Najm, H.N., and Eldred, M.S., Progress in Scramjet Design Optimization under Uncertainty Using Simulations of the HIFiRE Direct Connect Rig, AIAA SciTech Forum, 2019.
-
Qian, E., Peherstorfer, B., Malley, D., Vesselinov, V., and Willox, K., Multifidelity Monte Carlo Estimation of Variance and Sensitivity Indices, SIAM/ASA J. Uncertainty Quantif, 6:683-706, 2018.
-
Krumscheid, S., Nobile, F., and Pisaroni, M., Quantifying Uncertain System Outputs via the Multilevel Monte Carlo Method. Part I: Central Moment Estimation, J. Comput. Phys, 414:109466, 2020.
-
Giles, M.B., Nagapetyan, T., and Ritter, K., Multilevel Monte Carlo Approximation of Distribution Functions and Densities, SIAM/ASA J Uncertainty Quantif., 3(1):267-295, 2015.
-
Krumscheid, S. and Nobile, F., Multilevel Monte Carlo Approximation of Functions, SIAM/ASA J. Uncertainty Quantif., 6(3):1256-1293, 2018.
-
Top500, November 2019, accessed December 2, 2019, from http://top500.org/lists/top500/2019/11/.
-
Xu, X.G., Lui, T., Su, L., Du, X., Riblett, M., Ji, W., Gu, D., Carothers, C.D., Shephard, M.S., Brown, F.B., Kalra, M.K., and Liu, B., ARCHER, a New Monte Carlo Software Tool for Emerging Heterogeneous Computing Environments, Ann. Nucl. Energy, 82:2-9,2015.
-
Srinivasan, A., Parallel and Distributed Computing Issues in Pricing Financial Derivatives through Quasi Monte Carlo, in Proc. of 16th International Parallel and Distributed Processing Symposium, pp. 6-11, 2002.
-
Tse, A.H., Thomas, D.B., Tsoi, K., and Luk, W., Dynamic Scheduling Monte-Carlo Framework for Multi-Accelerator Heterogeneous Clusters, in Proc. of Int. Conf. on Field-Programmable Technology, pp. 233-240, 2010.
-
Giles, M.B., Multilevel Monte Carlo Codes for 2015 Acta Numerica Article, accessed December 2, 2019, from http://people.maths.ox.ac.uk/gilesm/acta/.
-
Jofre, L., Papadakis, M., Roy, P.T., Aiken, A., and Iaccarino, G., Multifidelity Modeling of Irradiated Particle-Laden Rurbulence Subject to Uncertainty, Int. J. Uncertainty Quantif., 10(6):499-514,2020.
-
Lawrence Livermore National Laboratory, Lassen, 2019, accessed December 2, 2019, from http://hpc.llnl.gov/ hardware/platforms/lassen.
-
Torres, H., Papadakis, M., Jofre, L., Lee, W., Aiken, A., and Iaccarino, G., Soleil-X: Turbulence, Particles, and Radiation in the Regent Programming Language, in SC'19: Proc. of Int. Conf. on High Performance Computing, Networking, Storage, and Analysis, 2019.
-
Slaughter, E., Lee, W., Treichler, S., Bauer, M., and Aiken, A., Regent: A High-Productivity Programming Language forHPC with Logical Regions, in SC'15: Proc. of Int. Conf. on High Performance Computing, Networking, Storage, and Analysis, 2015.
-
Bauer, M., Treichler, S., and Aiken, A., Legion: Expressing Locality and Independence with Logical Regions, in SC'12: Proc. of Int. Conf. on High Performance Computing, Networking, Storage, and Analysis, 2012.
-
Giles, M.B., Multilevel Monte Carlo Methods, Acta Numer., 24:259-328, 2015.
-
Valero Mario Miguel, Jofre Lluís, Torres Ricardo, Multifidelity prediction in wildfire spread simulation: Modeling, uncertainty quantification and sensitivity analysis, Environmental Modelling & Software, 141, 2021. Crossref