Library Subscription: Guest
Journal of Machine Learning for Modeling and Computing

Published 4 issues per year

ISSN Print: 2689-3967

ISSN Online: 2689-3975

Indexed in

MACHINE LEARNING FOR TRAJECTORIES OF PARAMETRIC NONLINEAR DYNAMICAL SYSTEMS

Volume 1, Issue 1, 2020, pp. 75-95
DOI: 10.1615/JMachLearnModelComput.2020034093
Get accessDownload

ABSTRACT

We investigate parameter-dependent nonlinear dynamical systems consisting of ordinary differential equations or differential-algebraic equations. A single quantity of interest is observed, which depends on the solution of a system. Our aim is to determine efficient approximations of the trajectories belonging to the quantity of interest in the time domain. We arrange a set of samples including trajectories of this quantity. A proper orthogonal decomposition of this data yields a reduced basis. Consequently, the mapping from the parameter domain to the basis coefficients is approximated. We apply machine learning with artificial neural networks for this approximation, where the degrees of freedom are fitted to the data of the sample trajectories in a nonlinear optimization. Alternatively, we consider a polynomial approximation, which is identified by regression, for comparison. Furthermore, concepts of sensitivity analysis are examined to characterize the impact of an input parameter on the output of the exact mapping or the approximations from the neural networks. We present results of numerical computations for examples of nonlinear dynamical systems.

REFERENCES
  1. Antoulas, A.C., Approximation of Large-Scale Dynamical Systems, Philadelphia: SIAM, 2005.

  2. Benner, P., Gugercin, S., and Willcox, K., A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems, SIAM Review, vol. 57, no. 4, pp. 483-531,2015.

  3. Du, K. and Swamy, M., Neural Networks and Statistical Learning, Berlin: Springer, 2014.

  4. Genzel, M. and Kutyniok, G., Artificial Neural Networks, GAMMRundbrief, vol. 2, pp. 12-18,2019.

  5. Golub, G. and van Loan, C., Matrix Computations, Baltimore: Johns Hopkins University Press, 1996.

  6. Goodfellow, I., Bengio, Y., and Courville, A., Deep Learning, Cambridge, MA: MIT Press, 2017.

  7. Hairer, E. and Wanner, G., Solving Ordinary Differential Equations. Vol. 2: Stiff and Differential-Algebraic Equations, Berlin: Springer, 1996?.

  8. Hesthaven, J. and Ubbiali, S., Non-Intrusive Reduced Order Modeling of Nonlinear Problems Using Neural Networks, J. Comput. Phys, vol. 363, pp. 55-78, 2018.

  9. Kampowsky, W., Rentrop, P., and Schmidt, W., Classification and Numerical Solution of Electric Circuits, Surv. Math. Ind., vol. 2, pp. 23-65, 1992.

  10. Kunisch, K. and Volkwein, S., Galerkin Proper Orthogonal Decomposition Methods for Parabolic Problems, Numer. Math., vol. 90, pp. 117-148, 2001.

  11. Mifsud, M., MacManus, D., and Shaw, S., A Variable-Fidelity Aerodynamic Model Using Proper Orthogonal Decomposition, J. Numer: Meth. Fluids, vol. 82, pp. 646-663, 2016.

  12. Montavon, G., Samek, W., and Muller, K., Methods for Interpreting and Understanding Deep Neural Net-works, Digital Signal Process, vol. 73, pp. 1-15, 2018.

  13. Pulch, R., Model Order Reduction for Random Nonlinear Dynamical Systems and Low-Dimensional Representations for Their Quantities of Interest, Math. Comput. Simulat., vol. 166, pp. 76-92, 2019.

  14. Pulch, R. and Narayan, A., Sensitivity Analysis of Random Linear Dynamical Systems Using Quadratic Outputs, J. Comput. Appl. Math, 2019. DOI: 10.1016/j.cam.2019.112491.

  15. Pulch, R., ter Maten, J., and Augustin, F., Sensitivity Analysis and Model Order Reduction for Random Linear Dynamical Systems, Math. Comput. Simulat., vol. 111, pp. 80-95, 2015.

  16. Qin, T., Wu, K., and Xiu, D., Data Driven Governing Equations Approximation Using Deep Neural Networks, J. Comput. Phys, vol. 395, pp. 620-635, 2019.

  17. Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., and Tarantola, S., Global Sensitivity Analysis, John Wiley and Sons, Ltd., 2008.

  18. Seber, G. and Lee, A., Linear Regression Analysis, Hoboken, NJ: John Wiley and Sons, Inc., 2003.

  19. Sobol, I., Global Sensitivity Indices for Nonlinear Mathematical Models and Their Monte Carlo Estimates, Math. Comput. Simulat, vol. 55, pp. 271-280, 2001.

  20. Sobol, I. and Kucherenko, S., Derivative based Global Sensitivity Measures and Their Link with Global Sensitivity Indices, Math. Comput. Simulat., vol. 79, pp. 3009-3017, 2009.

  21. Stoer, J. and Bulirsch, R., Introduction to Numerical Analysis, Berlin: Springer, 2002.

  22. Stroud, A., Approximate Calculation of Multiple Integrals, Upper Saddle River, NJ: Prentice-Hall, 1971.

  23. Sudret, B., Global Sensitivity Analysis Using Polynomial Chaos Expansions, Reliability Eng. Syst. Safety, vol. 93, no. 7, pp. 964-979, 2008.

  24. Wang, X., The Effect of Regularization Coefficient on Polynomial Regression, J. Phys.: Conf. Ser., vol. 1213, p. 042054, 2019.

  25. Xiu, D., Numerical Methods for Stochastic Computations: A Spectral Method Approach, Princeton, NJ: Princeton University Press, 2010.

  26. Yu, J. and Hesthaven, J., Flowfield Reconstruction Method Using Artificial Neural Network, AIAA J, vol. 57,2019.

CITED BY
  1. Loreau Tanguy, Champaney Victor, Hascoët Nicolas, Mourgue Philippe, Duval Jean-Louis, Chinesta Francisco, Learning the Parametric Transfer Function of Unitary Operations for Real-Time Evaluation of Manufacturing Processes Involving Operations Sequencing, Applied Sciences, 11, 11, 2021. Crossref

  2. Fresca Stefania, Manzoni Andrea, POD-DL-ROM: Enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decomposition, Computer Methods in Applied Mechanics and Engineering, 388, 2022. Crossref

  3. Pulch Roland, A machine learning approach for identifying an effective dimension in parametric dynamical systems, PAMM, 21, 1, 2021. Crossref

  4. Lazzara Michele, Chevalier Max, Colombo Michele, Garay Garcia Jasone, Lapeyre Corentin, Teste Olivier, Surrogate modelling for an aircraft dynamic landing loads simulation using an LSTM AutoEncoder-based dimensionality reduction approach, Aerospace Science and Technology, 126, 2022. Crossref

  5. Blackburn Landen D., Tuttle Jacob F., Andersson Klas, Hedengren John D., Powell Kody M., Dynamic machine learning-based optimization algorithm to improve boiler efficiency, Journal of Process Control, 120, 2022. Crossref

Begell Digital Portal Begell Digital Library eBooks Journals References & Proceedings Research Collections Prices and Subscription Policies Begell House Contact Us Language English 中文 Русский Português German French Spain