Выходит 6 номеров в год
ISSN Печать: 2152-5080
ISSN Онлайн: 2152-5099
Indexed in
BAYESIAN INFERENCE OF STOCHASTIC REACTION NETWORKS USING MULTIFIDELITY SEQUENTIAL TEMPERED MARKOV CHAIN MONTE CARLO
Краткое описание
Stochastic reaction network models are often used to explain and predict the dynamics of gene regulation in single cells. These models usually involve several parameters, such as the kinetic rates of chemical reactions, that are not directly measurable and must be inferred from experimental data. Bayesian inference provides a rigorous probabilistic framework for identifying these parameters by finding a posterior parameter distribution that captures their uncertainty. Traditional computational methods for solving inference problems such as Markov chain Monte Carlo methods based on the classical Metropolis-Hastings algorithm involve numerous serial evaluations of the likelihood function, which in turn requires expensive forward solutions of the chemical master equation (CME). We propose an alternate approach based on a multifidelity extension of the sequential tempered Markov chain Monte Carlo (ST-MCMC) sampler. This algorithm is built upon sequential Monte Carlo and solves the Bayesian inference problem by decomposing it into a sequence of efficiently solved subproblems that gradually increase both model fidelity and the influence of the observed data. We reformulate the finite state projection (FSP) algorithm, a well-known method for solving the CME, to produce a hierarchy of surrogate master equations to be used in this multifidelity scheme. To determine the appropriate fidelity, we introduce a novel information-theoretic criterion that seeks to extract the most information about the ultimate Bayesian posterior from each model in the hierarchy without inducing significant bias. This novel sampling scheme is tested with high-performance computing resources using biologically relevant problems.
-
Elowitz, M.B. and Leibler, S., A Synthetic Oscillatory Network of Transcriptional Regulators., Nature, 403(6767):335-338, 2000.
-
Munsky, B., Trinh, B., and Khammash, M., Listening to the Noise: Random Fluctuations Reveal Gene Network Parameters, Mol. Syst. Biol., 5(318):318, 2009.
-
Neuert, G., Munsky, B., Tan, R.Z., Teytelman, L., Khammash, M., and Van Oudenaarden, A., Systematic Identification of Signal-Activated Stochastic Gene Regulation, Science, 339(6ii9):584-587,2013.
-
Singh, A. and Dennehy, J.J., Stochastic Holin Expression Can Account for Lysis Time Variation in the Bacteriophage A, J. R. Soc. Interf., 11(95):2oi4oi4o, 2014.
-
Van Boxtel, C., Van Heerden, J.H., Nordholt, N., Schmidt, P., and Bruggeman, F.J., Taking Chances and Making Mistakes: Non-Genetic Phenotypic Heterogeneity and Its Consequences for Surviving in Dynamic Environments, J. R Soc. Interf., 14(i32):20170141,2017.
-
Raj, A., van den Bogaard, P., Rifkin, S.A., van Oudenaarden, A., and Tyagi, S., Imaging Individual MRNA Molecules Using Multiple Singly Labeled Probes, Nat. Methods, 5:877, 20088.
-
Munsky, B., Fox, Z., and Neuert, G., Integrating Single-Molecule Experiments and Discrete Stochastic Models to Understand Heterogeneous Gene Transcription Dynamics, Methods, 85:12-21, 2015.
-
Li, G. and Neuert, G., Multiplex RNA Single Molecule FISH of Inducible MRNAs in Single Yeast Cells, Sci. Data, 6(1):94, 2019.
-
Gillespie, D.T., A Rigorous Derivation of the Chemical Master Equation, Phys. A: Stat. Mech. Appl., 188(1-3):404-425, 1992.
-
Munsky, B. and Khammash, M., The Finite State Projection Algorithm for the Solution of the Chemical Master Equation, J. Chem. Phys, 124(4):44104, 2006.
-
Gomez-Schiavon, M., Chen, L.F., West, A.E., and Buchler, N.E., BayFish: Bayesian Inference of Transcription Dynamics from Population Snapshots of Single-Molecule RNA FISH in Single Cells, Genome Biol, 18(1):164, 2017.
-
Schnoerr, D., Sanguinetti, G., and Grima, R., Approximation and Inference Methods for Stochastic Biochemical Kinetics-A Tutorial Review, J. Phys. A, 50(9):093001, 2017.
-
Tiberi, S., Walsh, M., Cavallaro, M., Hebenstreit, D., and Finkenstadt, B., Bayesian Inference on Stochastic Gene Transcription from Flow Cytometry Data, Bioinformatics, 34:1647-1655, 2018.
-
Weber, L., Raymond, W., and Munsky, B., Identification of Gene Regulation Models from Single-Cell Data, Phys. Biol., 15(5):055001,2018.
-
Lin, Y.T. and Buchler, N.E., Exact and Efficient Hybrid Monte Carlo Algorithm for Accelerated Bayesian Inference of Gene Expression Models from Snapshots of Single-Cell Transcripts, J. Chem. Phys., 151(2):024106, 2019.
-
Catanach, T.A., McCardell, R., Baetica, A.A., and Murray, R.M., Context Dependence of Biological Circuits, bioRxiv, DOI: 10.1101/3600,04, 2018.
-
Lindley, D.V., On a Measure of the Information Provided by an Experiment, Ann. Math. Stat., 27(4):986-1005, 2007.
-
Huan, X. and Marzouk, Y.M., Simulation-Based Optimal Bayesian Experimental Design for Nonlinear Systems, J. Comput. Phys, 232(i):288-317,2013.
-
Ruess, J., Milias-Argeitis, A., and Lygeros, J., Designing Experiments to Understand the Variability in Biochemical Reaction Networks., J. R. Soc. Interf., 10(88):20130588,2013.
-
Fox, Z.R. and Munsky, B., The Finite State Projection based Fisher Information Matrix Approach to Estimate Information and Optimize Single-Cell Experiments, PLoS Comput. Biol., 15(1):e1006365, 2019.
-
Busetto, A.G., Hauser, A., Krummenacher, G., Sunnaker, M., Dimopoulos, S., Ong, C.S., Stelling, J., and Buhmann, J.M., Near-Optimal Experimental Design for Model Selection in Systems Biology, Bioinformatics, 29(20):2625-2632,2013.
-
Vo, H.D., Fox, Z., Baetica, A., and Munsky, B., Bayesian Estimation for Stochastic Gene Expression Using Multifidelity Models, J. Phys. Chem. B, 123(10):2217-2234, 2019.
-
Wu, Q., Smith-Miles, K., and Tian, T., Approximate Bayesian Computation Schemes for Parameter Inference of Discrete Stochastic Models Using Simulated Likelihood Density, BMC Bioinformatics, 15(12):S3, 2014.
-
Prescott, T.P. and Baker, R.E., Multifidelity Approximate Bayesian Computation, SIAM/ASA J. Uncertainty Quantif., 8(i):114-138, 2020.
-
Warne, D.J., Baker, R.E., and Simpson, M.J., Rapid Bayesian Inference for Expensive Stochastic Models, Stat. Comput:., arXiv:1909.06540,2019.
-
Zechner, C., Ruess, J., Krenn, P., Pelet, S., Peter, M., Lygeros, J., and Koeppl, H., Moment-Based Inference Predicts Bimodality in Transient Gene Expression, Proc. Natl. Acad. Sci. U. S. A., 109(21):8340-8345, 2012.
-
Cao, Z. and Grima, R., Accuracy of Parameter Estimation for Auto-Regulatory Transcriptional Feedback Loops from Noisy Data, J. R. Soc. Interf., 16(i53):20180967, 2019.
-
Ocal, K., Grima, R., and Sanguinetti, G., Parameter Estimation for Biochemical Reaction Networks Using Wasserstein Distances, J. Phys. A: Math. Theor., 53(3):034002, 2019.
-
Rosenthal, J.S., Parallel Computing and Monte Carlo Algorithms, Far East J. Theor. Stat., 4(2):207-236, 2000.
-
Liu, J.S., Liang, F., and Wong, W.H., The Multiple-Try Method and Local Optimization in Metropolis Sampling, J. Am. Stat. Assoc, 95(449):121-134, 2000.
-
Ching, J. and Chen, Y.C., Transitional Markov Chain Monte Carlo Method for Bayesian Model Updating, Model Class Selection, and Model Averaging, J. Eng. Mech, 133(7):816-832, 2007.
-
Wu, S., Angelikopoulos, P., Papadimitriou, C., and Koumoutsakos, P., Bayesian Annealed Sequential Importance Sampling: An Unbiased Version of Transitional Markov Chain Monte Carlo, ASCE-ASME J. Risk Uncert. Eng. Syst. PartB: Mech. Eng., 4(1):011008, 2017.
-
Moral, P.D., Doucet, A., and Jasra, A., Sequential Monte Carlo Samplers, J. R. Stat. Soc. B, 68:411-436, 2006.
-
Kantas, N., Beskos, A., and Jasra, A., Sequential Monte Carlo Methods for High-Dimensional Inverse Problems: A Case Study for the Navier-Stokes Equations, SIAM/ASA J. Uncertainty Quantif., 2(1):464-489, 2014.
-
Catanach, T.A. and Beck, J.L., Bayesian Updating and Uncertainty Quantification Using Sequential Tempered MCMC with the Rank-One Modified Metropolis Algorithm, Stat. Comput., arXiv:1804.08738,2018.
-
Andres Christen, J. and Fox, C., Markov Chain Monte Carlo Using an Approximation, J. Comput. Graph. Stat., 14(4):795-810,2005.
-
Efendiev, Y., Hou, T., and Luo, W., Preconditioning Markov Chain Monte Carlo Simulations Using Coarse-Scale Models, SIAMJ. Sci. Comput., 28(2):776-803, 2006.
-
Cui, T., Marzouk, Y.M., and Willcox, K.E., Data-Driven Model Reduction for the Bayesian Solution of Inverse Problems, Int. J. Numer. Methods Eng., 102(5):966-990, 2015.
-
Koutsourelakis, P. S., A Multi-Resolution, Non-Parametric, Bayesian Framework for Identification of Spatially-Varying Model Parameters, J. Comput. Phys, 228(17):6184-6211,2009.
-
Dodwell, T.J., Ketelsen, C., Scheichl, R., and Teckentrup, A.L., A Hierarchical Multilevel Markov Chain Monte Carlo Algorithm with Applications to Uncertainty Quantification in Subsurface Flow, SIAM/ASA J. Uncertainty Quantif., 3(1):1075-1108,2015.
-
Latz, J., Papaioannou, I., and Ullmann, E., Multilevel Sequential2 Monte Carlo for Bayesian Inverse Problems, J. Comput. Phys, 368:154-178,2018.
-
Golightly, A., Henderson, D.A., and Sherlock, C., Delayed Acceptance Particle MCMC for Exact Inference in Stochastic Kinetic Models, Stat. Comput, 25(5):1039-1055, 2015.
-
Sherlock, C., Golightly, A., and Henderson, D.A., Adaptive, Delayed-Acceptance MCMC for Targets with Expensive Likeli-hoods, J. Comput. Graph. Stat, 26(2):434-444,2017.
-
Kalb, D.M., Adikari, S.H., Hong-Geller, E., and Werner, J.H., Single-Cell Correlations of MRNA and Protein Content in a Human Monocytic Cell Line after LPS Stimulation, PLoS One, 14(4):1-16, 2019.
-
Munsky, B. and Khammash, M., Transient Analysis of Stochastic Switches and Trajectories with Applications to Gene Reg-ulatory Networks, IETSyst. Biol, 2(5):323-333, 2008.
-
Gauckler, L. and Yserentant, H., Regularity and Approximability of the Solutions to the Chemical Master Equation, ESAIM. Math. Model. Numer. Anal, 48:1757-1775,2014.
-
Gupta, A., Briat, C., and Khammash, M., A Scalable Computational Framework for Establishing Long-Term Behavior of Stochastic Reaction Networks, PLoS Comput. Biol, 10(6):e1003669,2014.
-
Munsky, B. and Khammash, M., A Multiple Time Interval Finite State Projection Algorithm for the Solution to the Chemical Master Equation, J. Comput. Phys, 226(1):818-835, 2007.
-
Kuntz, J., Thomas, P., Stan, G.B., and Barahona, M., The Exit Time Finite State Projection Scheme: Bounding Exit Distributions and Occupation Measures of Continuous-Time Markov Chains, SIAMJ. Sci. Comput:., 41(2):A748-A769, 2019.
-
Femino, A.M., Fay, F.S., Fogarty, K., and Singer, R.H., Visualization of Single RNA Transcripts in Situ, Science, 280(5363):585-590,1998.
-
Jaynes, E.T., Probability Theory: The Logic of Science, Cambridge: Cambridge University Press, 2003.
-
Duersch, J.A. and Catanach, T.A., Generalizing Information to the Evolution of Rational Belief, Entropy, 22(1):108, 2020.
-
Estimating Bayes Factors via Thermodynamic Integration and Population MCMC, Comput. Stat. Data Anal., 53(12):4028-4045, 2009.
-
Burrage, K., Hegland, M., Macnamara, S., and Sidje, R.B., A Krylov-Based Finite State Projection Algorithm for Solving the Chemical Master Equation Arising in the Discrete Modelling of Biological Systems, in Proc. of the 150th Markov Anniv. Meeting, A. Langeville and W.J. Stewart, Eds., Charleston, SC, pp. 1-18, 2006.
-
Wolf, V., Goel, R., Mateescu, M., and Henzinger, T.A., Solving the Chemical Master Equation Using Sliding Windows, BMC Syst. Biol., 4:42, 2010.
-
Sidje, R.B. and Vo, H.D., Solving the Chemical Master Equation by a Fast Adaptive Finite State Projection based on the Stochastic Simulation Algorithm, Math. Biosci., 269:10-16,2015.
-
Cao, Y., Terebus, A., and Liang, J., State Space Truncation with Quantified Errors for Accurate Solutions to Discrete Chemical Master Equation, Bull. Math. Biol, 78(4):617-661, 2016.
-
Fox, Z., Neuert, G., and Munsky, B., Finite State Projection based Bounds to Compare Chemical Master Equation Models Using Single-Cell Data, J Chem. Phys, 145(7):074101, 2016.
-
Vo, H.D. and Munsky, B., A Parallel Implementation of the Finite State Projection Algorithm for the Solution of the Chemical Master Equation, bioRxv,DOI: 10.1101/2020.06.30.180273,2020.
-
Bader, B.W. and Kolda, T.G., Efficient MATLAB Computations with Sparse and Factored Tensors, SIAM J. Sci. Comput:., 30(1):205-231,2008.
-
Devine, K., Boman, E., Heaphy, R., Hendrickson, B., and Vaughan, C., Zoltan Data Management Services for Parallel Dynamic Applications, Comput. Sci. Eng., 4(2):90-97, 2002.
-
Boman, E.G., Catalyurek, U.V., Chevalier, C., and Devine, K.D., The Zoltan and Isorropia Parallel Toolkits for Combinatorial Scientific Computing: Partitioning, Ordering, and Coloring, Sci. Prog, 20(2):129-150,2012.
-
Balay, S., Gropp, W.D., McInnes, L.C., and Smith, B.F., Efficient Management of Parallelism in Object Oriented Numerical Software Libraries, Modern Software Tools in Scientific Computing, E. Arge, A.M. Bruaset, and H.P. Langtangen, Eds., Birkhauser Press, Basel, Switzerland, pp. 163-202, 1997.
-
Balay, S., Abhyankar, S., Adams, M.F., Brown, J., Brune, P., Buschelman, K., Dalcin, L., Eijkhout, V., Gropp, W.D., Kaushik, D., Knepley, M.G., McInnes, L.C., Rupp, K., Smith, B.F., Zampini, S., and Zhang, H., PETSc Users Manual, Tech. Rep. ANL-95/11, Revision 3.6, Argonne National Laboratory, 2015.
-
Balay, S., Abhyankar, S., Adams, M.F., Brown, J., Brune, P., Buschelman, K., Dalcin, L., Eijkhout, V., Gropp, W.D., Kaushik, D., Knepley, M.G., McInnes, L.C., Rupp, K., Smith, B.F., Zampini, S., and Zhang, H., PETSc Web Page, 2015, accessed from http://www.mcs.anl.gov/petsc.
-
Koskela, A., Approximating the Matrix Exponential of an Advection-Diffusion Operator Using the Incomplete Orthogonalization Method, Lect. Notes Comput. Sci. Eng., 103:345-353, 2015.
-
Vo, H.D. and Sidje, R.B., Approximating the Large Sparse Matrix Exponential Using Incomplete Orthogonalization and Krylov Subspaces of Variable Dimension, Numer. Linear Algebra Appl., 24(3):e2090, 2017.
-
KIOPS: A Fast Adaptive Krylov Subspace Solver for Exponential Integrators, J. Comput. Phys., 372:236-255, 2018.
-
Rang, J. andAngermann,L.,NewRosenbrockW-MethodsofOrder3 for Partial Differential Algebraic Equations of Index 1, BIT Numer. Math., 45(4):761-787, 2005.
-
Abhyankar, S., Brown, J., Constantinescu, E.M., Ghosh, D., Smith, B.F., and Zhang, H., PETSc/TS: A Modern Scalable ODE/DAE Solver Library, Math. Numer. Anal, arXiv:1806.01437, 2018.
-
Munsky, B., Li, G., Fox, Z.R., Shepherd, D.P., and Neuert, G., Distribution Shapes Govern the Discovery of Predictive Models for Gene Regulation, Proc. Natl. Acad. Sci., 115(29):7533-7538, 2018.
-
Kazeev, V., Khammash, M., Nip, M., and Schwab, C., Direct Solution of the Chemical Master Equation Using Quantized Tensor Trains, PLoS Comput. Biol, 10(3):e1003359, 2014.
-
Kazeev, V. and Schwab, C., Tensor Approximation of Stationary Distributions of Chemical Reaction Networks, SIAM J. Matrix Anal. Appl, 36(3):1221-1247, 2015.
-
Dolgov, S.V. and Savostyanov, D., Alternating Minimal Energy Methods for Linear Systems in Higher Dimensions, SIAM J. Sci. Comput., 36(5):A2248-A2271, 2014.
-
Dolgov, S. and Khoromskij, B., Simultaneous State-Time Approximation of the Chemical Master Equation Using Tensor Product Formats, Numer. Linear Algebra Appl., 22(2):197-219, 2015.
-
Vo, H.D. and Sidje, R.B., An Adaptive Solution to the Chemical Master Equation Using Tensors, J. Chem. Phys., 147:044102, 2017.
-
Dolgov, S.V., A Tensor Decomposition Algorithm for Large ODEs with Conservation Laws, Comput. Methods Appl. Math, 19(1):23, 2018.
-
Andreychenko, A., Mikeev, L., Spieler, D., and Wolf, V., Parameter Identification for Markov Models of Biochemical Reactions, Lect. Notes Comput. Sci. (Including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), Berlin, Heidelberg: Springer, Vol. 6806 LNCS, pp. 83-98, 2011.
-
ENCISO GERMAN, ERBAN RADEK, KIM JINSU, Identifiability of stochastically modelled reaction networks, European Journal of Applied Mathematics, 32, 5, 2021. Crossref
-
Kalb Daniel, Vo Huy D., Adikari Samantha, Hong-Geller Elizabeth, Munsky Brian, Werner James, Visualization and modeling of inhibition of IL-1β and TNF-α mRNA transcription at the single-cell level, Scientific Reports, 11, 1, 2021. Crossref
-
Feldmann R., Gehb C. M., Schaeffner M., Melz T., A Methodology for the Efficient Quantification of Parameter and Model Uncertainty, Journal of Verification, Validation and Uncertainty Quantification, 7, 3, 2022. Crossref
-
Dhulipala Somayajulu L.N., Shields Michael D., Spencer Benjamin W., Bolisetti Chandrakanth, Slaughter Andrew E., Labouré Vincent M., Chakroborty Promit, Active learning with multifidelity modeling for efficient rare event simulation, Journal of Computational Physics, 468, 2022. Crossref