Page 205 - Neural Network Modeling and Identification of Dynamical Systems
P. 205

196           5. SEMIEMPIRICAL NEURAL NETWORK MODELS OF CONTROLLED DYNAMICAL SYSTEMS

                         ing examples are located in a small area of the  research. Studies in computational intelligence, vol. 799.
                         input space has a similar effect as the assign-  Berlin: Springer Nature; 2019. p. 196–201.
                         ment of the weight ¯n to some mean example    [7] Tarkhov DA, Vasilyev AN. New neural network tech-
                                                                          nique to the numerical solution of mathematical physics
                         from this area. Thus, the nonuniform distribu-   problems. I: Simple problems. Opt Memory Neural
                         tion of training examples in U × X might lead    Netw (Inf Opt) 2005;14(1):59–72.
                         to higher model accuracy in some areas of the  [8] Tarkhov DA, Vasilyev AN. New neural network tech-
                         input space at the expense of the lower accu-    nique to the numerical solution of mathematical physics
                                                                          problems. II: Complicated and nonstandard problems.
                         racy in other areas. In order to avoid this effect,
                                                                          Opt Memory Neural Netw (Inf Opt) 2005;14(2):97–122.
                         we need to perform appropriate weighting for  [9] Kainov NU, Tarkhov DA, Shemyakina TA. Application
                         individual training examples. In particular, the  of neural network modeling to identification and pre-
                         weight of a training example might be taken      diction problems in ecology data analysis for metal-
                         inversely proportional to the number of train-   lurgy and welding industry. Nonlinear Phenom Com-
                                                                          plex Syst 2014;17(1):57–63.
                         ing examples in its neighborhood of fixed ra-  [10] Vasilyev AN, Tarkhov DA. Mathematical models
                         dius.                                            of complex systems on the basis of artificial neu-
                            An efficient software implementation of the    ral networks. Nonlinear Phenom Complex Syst
                         algorithms described in this section should take  2014;17(3):327–35.
                         advantage of a special data structure for the  [11] Budkina  EM,  Kuznetsov  EB,  Lazovskaya  TV,
                                                                          Tarkhov DA, Shemyakina TA, Vasilyev AN. Neu-
                         storage of training set points in order to pro-  ral network approach to intricate problems solving for
                         vide fast operations of the nearest neighbor     ordinary differential equations. Opt Memory Neural
                         search as well as the search for all neighbors   Netw (Inf Opt) 2017;26(2):96–109.
                         in a fixed radius. One reasonable candidate   [12] Lazovskaya TN, Tarkhov DA, Vasilyev AN. Paramet-
                                                                          ric neural network modeling in engineering. Recent
                         is a k-d tree structure that allows for approx-
                                                                          Patents Eng 2017;11(1):10–5.
                         imate nearest neighbor searches, such as the  [13] Lazovskaya TN, Tarkhov DA, Vasilyev AN. Multi-
                         one implemented in the FLANN library [56,        layer solution of heat equation. Stud Comput Intell
                         57].                                             2018;736:17–22.
                                                                      [14] Vasilyev AN, Tarkhov DA, Tereshin VA, Berminova MS,
                                                                          Galyautdinova AR. Semi-empirical neural network
                                                                          model of real thread sagging. Stud Comput Intell
                                       REFERENCES                         2018;736:138–46.
                                                                      [15] Antonov V, Tarkhov D, Vasilyev A. Unified approach to
                                                                          constructing the neural network models of real objects.
                          [1] Bohlin T. Practical grey-box process identification: The-  Part 1. Math Models Methods Appl Sci 2018;48(18):1–8.
                             ory and applications. London: Springer-Verlag; 2006.  [16] Sontag ED. Mathematical control theory: Deter-
                          [2] Dreyfus G. Neural networks: Methodology and appli-  ministic finite dimensional systems. 2nd ed. New
                             cations. Berlin ao.: Springer; 2005.         York, NY, USA: Springer-Verlag New York, Inc..
                          [3] Oussar Y, Dreyfus G. How to be a gray box:  ISBN 0-387-98489-5, 1998.
                             Dynamic  semi-physical  modeling.  Neural  Netw  [17] Sontag ED. Neural nets as systems models and con-
                             2001;14(9):1161–72.                          trollers. In: Proc. Seventh Yale Workshop on Adaptive
                          [4] Kozlov DS, Tiumentsev YV. Neural network based  and Learning Systems; 1992. p. 73–9.
                             semi-empirical models for dynamical systems de-  [18] Wang YJ, Lin CT. Runge–Kutta neural network for iden-
                             scribed by differential-algebraic equations. Opt Mem-  tification of dynamical systems in high accuracy. IEEE
                             ory Neural Netw (Inf Opt) 2015;24(4):279–87.  Trans Neural Netw 1998;9(2):294–307.
                          [5] Kozlov DS, Tiumentsev YV. Neural network based  [19] Scott LR. Numerical analysis. Princeton and Oxford:
                             semi-empirical models for dynamical systems repre-  Princeton University Press; 2011.
                             sented by differential-algebraic equations of index 2.  [20] Dreyfus G, Idan Y. The canonical form of nonlinear
                             Proc Comput Sci 2018;123:252–7.              discrete-time models. Neural Comput 1998;10:133–64.
                          [6] Kozlov DS, Tiumentsev YV. Neural network based  [21] Nerrand O, Roussel-Ragot P, Personnaz L, Dreyfus G.
                             semi-empirical models of 3d-motion of hypersonic ve-  Neural networks and non-linear adaptive filtering: Uni-
                             hicle. In: Kryzhanovsky B, et al., editors. Advances in  fying concepts and new algorithms. Neural Comput
                             neural computation, machine learning, and cognitive  1993;5(2):165–97.
   200   201   202   203   204   205   206   207   208   209   210