Abstract
Selecting proper parameters of RBF networks has been a puzzling problem even for batch learning. The parameter selection is usually carried out by an external supervisor. To exclude the intervention by an external supervisor from the parameter selection, we propose a new learning scheme called Autonomous Learning algorithm for Resource Allocating Network (AL-RAN). AL-RAN is an incremental learning algorithm which consists of the following functions: automated data normalization and automated adjustment of RBF widths. In the experiments, we evaluate AL-RAN using nine benchmark datasets in terms of the decision accuracy of data normalization and the final classification accuracy. The experimental results demonstrate that the above two functions in AL-RAN work well and the final classification accuracy of AL-RAN is almost the same as that of a non-autonomous model whose parameters are manually tuned by an external supervisor.
The authors would like to thank Professor Shigeo Abe for his helpful comments and discussions. This research was partially supported by the Ministry of Education, Science, Sports and Culture, Grant-in-Aid for Scientific Research (C) 205002205.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Carpenter, G.A., Grossberg, S.: The ART of Adaptive Pattern Recognition by a Self-Organizing Neural Network. IEEE Computer 21(3), 77–88 (1988)
Haykin, S.: Neural Networks: A Comprehensive Foundation. Prentice-Hall, Englewood Cliffs (1999)
Kasabov, N.: Evolving Connectionist Systems: Methods and Applications in Bioinformatics, Brain Study and Intelligent Machines. Springer, Heidelberg (2002)
Okamoto, K., Ozawa, S., Abe, S.: A Fast Incremental Learning Algorithm of RBF Networks with Long-Term Memory. In: Proc. Int. Joint Conf. on Neural Networks, pp. 102–107 (2003)
Ozawa, S., Toh, S.-L., Abe, S., Pang, S., Kasabov, N.: Incremental Learning of Feature Space and Classifier for Face Recognition. Neural Networks 18(5-6), 575–584 (2005)
Platt, J.: A Resource-allocating Network for Function Interpolation. Neural Computation 3, 213–225 (1991)
Peng, J.-X., Li, K., Irwin, G.W.: A Novel Continuous Forward Algorithm for RBF Neural Modelling. IEEE Trans. Automatic Control 52, 117–122 (2007)
Roy, A., Govil, S., Miranda, R.: An Algorithm to Generate Radial Basis Function (RBF)-like Nets for Classification Problems. Neural Networks 8(2), 179–202 (1995)
Roy, A.: Connectionism, Controllers and a Brain Theory. IEEE Trans. on Sys., Man and Cybern., Part A 38(6), 1434–1441 (2008)
Asuncion, A., Newman, D.J.: UCI Machine Learning Repository. UC, Irvine, School of Info. and Comp. Sci. (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tabuchi, T., Ozawa, S., Roy, A. (2009). An Autonomous Learning Algorithm of Resource Allocating Network. In: Corchado, E., Yin, H. (eds) Intelligent Data Engineering and Automated Learning - IDEAL 2009. IDEAL 2009. Lecture Notes in Computer Science, vol 5788. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04394-9_17
Download citation
DOI: https://doi.org/10.1007/978-3-642-04394-9_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04393-2
Online ISBN: 978-3-642-04394-9
eBook Packages: Computer ScienceComputer Science (R0)