TY  - GEN
ID  - cogprints547
UR  - http://cogprints.org/547/
A1  - Aussem, A.
Y1  - 1999///
N2  - This paper addresses the use of Dynamical Recurrent Neural Networks (DRNN) for time series prediction and modeling of small dynamical systems. Since the recurrent synapses are represented by Finite Impulse Response (FIR) filters, DRNN are state-based connectionist models in which all hidden units act as state variables of a dynamical system. The model is trained with Temporal Recurrent Backprop (TRBP), an efficient backward recurrent training procedure with minimal computational burden which benefits from the exponential decay of gradient reversely in time. The gradient decay is first illustrated on intensive experiments on the standard sunspot series. The ability of the model to internally encode useful information on the underlying process is then illustrated by several experiments on well known chaotic processes. Parsimonious DRNN models are able to find an appropriate internal representation of various chaotic processes from the observation of a subset of the state variables.
KW  - Recurrent neural networks
KW  -  dynamical systems
KW  -  gradient descent
KW  -  chaotic maps
KW  -  time series prediction
TI  - Dynamical recurrent neural networks towards prediction and modeling of dynamical systems
SP  - 207
AV  - public
EP  - 232
ER  -

<script src='https://archive-bar.soton.ac.uk/archive-bar.js'></script>
<script src='https://archive-bar.soton.ac.uk/google-analytics.js'></script>