International Journal of Control, Automation, and Systems

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지

Genetically Optimized Hybrid Fuzzy Neural Networks Based on Linear Fuzzy Inference Rules

  • Oh Sung-Kwun (Department of Electrical Engineering, The University of Suwon) ;
  • Park Byoung-Jun (Department of Electrical Electronic & Information Engineering, Wonkwang University) ;
  • Kim Hyun-Ki (Department of Electrical Engineering, The University of Suwon)
  • Published : 2005.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this study, we introduce an advanced architecture of genetically optimized Hybrid Fuzzy Neural Networks (gHFNN) and develop a comprehensive design methodology supporting their construction. A series of numeric experiments is included to illustrate the performance of the networks. The construction of gHFNN exploits fundamental technologies of Computational Intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithms (GAs). The architecture of the gHFNNs results from a synergistic usage of the genetic optimization-driven hybrid system generated by combining Fuzzy Neural Networks (FNN) with Polynomial Neural Networks (PNN). In this tandem, a FNN supports the formation of the premise part of the rule-based structure of the gHFNN. The consequence part of the gHFNN is designed using PNNs. We distinguish between two types of the linear fuzzy inference rule-based FNN structures showing how this taxonomy depends upon the type of a fuzzy partition of input variables. As to the consequence part of the gHFNN, the development of the PNN dwells on two general optimization mechanisms: the structural optimization is realized via GAs whereas in case of the parametric optimization we proceed with a standard least square method-based learning. To evaluate the performance of the gHFNN, the models are experimented with a representative numerical example. A comparative analysis demonstrates that the proposed gHFNN come with higher accuracy as well as superb predictive capabilities when comparing with other neurofuzzy models.

Keywords

References

  1. S.-K. Oh and W. Pedrycz, 'Fuzzy identification by means of auto-tuning algorithm and its application to nonlinear systems,' Fuzzy Sets and Systems, vol. 115, no. 2, pp. 205-230, 2000 https://doi.org/10.1016/S0165-0114(98)00174-2
  2. B.-J. Park, W. Pedrycz, and S.-K. Oh, 'Identification of fuzzy models with the aid of evolutionary data granulation,' IEE Proceedings -Control Theory and Application, vol. 148, no. 5, pp. 406-418, 2001
  3. S.-K. Oh, W. Pedrycz, and B.-J. Park, 'Hybrid identification of fuzzy rule-based models,' International Journal of Intelligent Systems, vol. 17, no. 1, pp. 77-103, 2002 https://doi.org/10.1002/int.1004
  4. B.-J. Park, S.-K. Oh, T.-C. Ahn, and H.-K. Kim, 'Optimization of fuzzy systems by means of GA and weighting factor,' The Transactions of the Korean Institute of Electrical Engineers (in Korean), vol. 48A, no. 6, pp. 789-799, June 1999
  5. S.-K. Oh, C.-S. Park, and B.-J. Park, 'On-line modeling of nonlinear process systems using the adaptive fuzzy-neural networks,' The Transactions of the Korean Institute of Electrical Engineers (in Korean), vol. 48A, no. 10, pp. 1293-1302, 1999
  6. K. S. Narendra and K. Parthasarathy, 'Gradient methods for the optimization of dynamical systems containing neural networks,' IEEE Trans. on Neural Networks, vol. 2, no. 2, pp. 252-262, March 1991 https://doi.org/10.1109/72.80336
  7. D. E. Goldberg, Genetic Algorithms in Search, Optimization & Machine Learning, Addison- Wesley, 1989
  8. Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, Springer- Verlag, Berlin Heidelberg, 1996
  9. J. H. Holland, Adaptation in Natural and Artificial Systems, The University of Michigan Press, Ann Arbour, 1975
  10. W. Pedrycz and J. F. Peters, Computational Intelligence and Software Engineering, World Scientific, Singapore, 1998
  11. S.-K. Oh, Computational Intelligence by Programming focused on Fuzzy, Neural Networks, and Genetic Algorithms (in Korean), Naeha, 2002
  12. S.-K. Oh and W. Pedrycz, 'The design of selforganizing polynomial neural networks,' Information Sciences, vol. 141, no. 3-4, pp. 237- 258, 2002 https://doi.org/10.1016/S0020-0255(02)00175-5
  13. S.-K. Oh, W. Pedrycz, and B.-J. Park, 'Polynomial neural networks architecture: analysis and design,' Computers and Electrical Engineering, vol. 29, no. 6, pp. 653-725, 2003 https://doi.org/10.1016/S0045-7906(02)00056-3
  14. T. Ohtani, H. Ichihashi, T. Miyoshi, and K. Nagasaka, 'Orthogonal and successive projection methods for the learning of neurofuzzy GMDH,' Information Sciences, vol. 110, pp. 5-24, 1998 https://doi.org/10.1016/S0020-0255(97)10082-2
  15. T. Ohtani, H. Ichihashi, T. Miyoshi, and K. Nagasaka, 'Structural learning with M-apoptosis in neurofuzzy GMHD,' Proc. of the 7th IEEE Iinternational Conference on Fuzzy Systems, pp. 1265-1270, 1998
  16. H. Ichihashi and K. Nagasaka, 'Differential minimum bias criterion for neuro-fuzzy GMDH,' Proc. of 3rd International Conference on Fuzzy Logic, Neural Nets and Soft Computing IIZUKA'94, pp. 171-172, 1994
  17. S.-K. Oh, W. Pedrycz, and B.-J. Park, 'Selforganizing neurofuzzy networks based on evolutionary fuzzy granulation,' IEEE Trans. on Systems, Man and Cybernetics-A, vol. 33, no. 2, pp. 271-277, 2003
  18. L. Magdalena, O. Cordon, F. Gomide, F. Herrera, and F. Hoffmann, 'Ten years of genetic fuzzy systems: current framework and new trends,' Fuzzy Sets and Systems, vol. 141, no. 1, pp. 5-31, 2004 https://doi.org/10.1016/S0165-0114(03)00111-8
  19. A. G. Ivahnenko, 'The group method of data handling: a rival of method of stochastic approximation,' Soviet Automatic Control, vol. 13, no. 3, pp. 43-55, 1968
  20. T. Yamakawa, 'A new effective learning algorithm for a neo fuzzy neuron model,' Proc. of 5th IFSA World Conference, pp. 1017-1020, 1993
  21. S.-K. Oh, K.-C. Yoon, and H.-K. Kim, 'The design of optimal fuzzy-neural networks structure by means of GA and an aggregate weighted performance index,' Journal of Control, Automation and Systems Engineering(in Korean), vol. 6, no. 3, pp. 273-283, 2000
  22. G. E. P. Box and G. M. Jenkins, Time Series Analysis, Forecasting, and Control, 2nd edition Holden-Day, SanFransisco, 1976
  23. E. Kim, H. Lee, M. Park, and M. Park, 'A simply identified Sugeno-type fuzzy model via double clustering,' Information Sciences, vol. 110, pp. 25-39. 1998 https://doi.org/10.1016/S0020-0255(97)10083-4
  24. Y. Lin and G. A. Cunningham III, 'A new approach to fuzzy-neural modeling,' IEEE Trans. on Fuzzy Systems, vol. 3, no. 2, pp. 190-197, 1997 https://doi.org/10.1109/91.388173
  25. S.-K. Oh, W. Pedrycz, and H.-S. Park, 'Hybrid identification in fuzzy-neural networks,' Fuzzy Sets and Systems, vol. 138, no. 2, pp. 399-426, 2003 https://doi.org/10.1016/S0165-0114(02)00441-4
  26. H.-S. Park and S.-K Oh, 'Multi-FNN identification by means of HCM clustering and its optimization using genetic algorithms,' Journal of Fuzzy Logic and Intelligent Systems(in Korean), vol. 10, no. 5, pp. 487-496, 2000
  27. B.-J. Park, S.-K. Oh, and S.-W. Jang, 'The design of adaptive fuzzy polynomial neural networks architectures based on fuzzy neural networks and self-organizing networks,' Journal of Control, Automation and Systems Engineering(in Korean), vol. 8, no. 2, pp.126-135, 2002
  28. B.-J. Park and S.-K. Oh, 'The analysis and design of advanced neurofuzzy polynomial networks,' Journal of the Institute of Electronics Engineers of Korea (in Korean), vol. 39-CI, no. 3, pp. 18-31, 2002