Paper title: |
Echo State Networks for predicting financial time series |
DOI: | https://doi.org/10.4316/JACSM.202102006 |
Published in: | Issue 2, (Vol. 15) / 2021 |
Publishing date: | 2021-11-14 |
Pages: | 44-48 |
Author(s): | VLAD Sorin, GORDIN Ionel |
Abstract. | A general problem occurring when training the recurrent neural networks (RNN) is that the solution space is extensive and the chance of choosing a local minimum instead of a global minimum is high. This is due to the fact that the weights among the neurons are variable. ESN networks are solving this issue by training the weights of the connections among the reservoir and the neurons on the output layer. The reservoirs containing fewer neurons are generalizing better with new data that the reservoirs with high number of neurons, indicating the fact that, as for other FNN networks, the overspecialization phenomenon may occur |
Keywords: | Recurrent Neural Networks, Echo State Networks, Liquid State Machine, Time Series Prediction |
References: | 1. Brock, W. A. Hommes, C. H., Heterogeneous beliefs and routes to chaos in a simple asset pricing model, Journal of Economic Dynamics and Control, Elsevier, vol. 22(8-9), (1998). 2. Deihimi A., Showkati H., Application of echo state network in short-term electric load forecasting, Energy 39, 2012. 3. Federici D., Chaos and the exchange rate, Journal of International Trade and Economic Development, Vol. 11, No. 2, pp. 111-142, (2002). 4. Lukoševičius M. (2012) A Practical Guide to Applying Echo State Networks. In: Montavon G., Orr G.B., Müller KR. (eds) Neural Networks: Tricks of the Trade. Lecture Notes in Computer Science, vol 7700. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35289-8_36 5. Jaeger H., A tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the “echo state network” approach, Fraunhofer Institute for Autonomous Intelligent Systems, 2002 6. Pai P. F., Lin C. S., A SVM Regression for Exchange Rate prediction, Information and Management Sciences, Volume 17, Number 2, 2006 7. Talathi T., Anaki V., Improving performance of recurrent neural networks with relu nonlinearity, 2015. 8. Yang, Cuili, et al. “Design of polynomial echo state networks for time series prediction.” Neurocomputing 290 (2018): 148-160. |
Back to the journal content |