Neuro-Optimizer: A New Artificial Intelligent Optimization Tool and Its Application for Robot Optimal Controller Design
Subject Areas : journal of Artificial Intelligence in Electrical Engineering
Keywords: Neural Networks, numerical optimization, Objective function, weight updating, five bar linkage manipulator robot,
Abstract :
The main objective of this paper is to introduce a new intelligent optimization technique that uses a predictioncorrectionstrategy supported by a recurrent neural network for finding a near optimal solution of a givenobjective function. Recently there have been attempts for using artificial neural networks (ANNs) in optimizationproblems and some types of ANNs such as Hopfield network and Boltzmann machine have been applied incombinatorial optimization problems. However, ANNs cannot optimize continuous functions and discreteproblems should be mapped into the neural networks architecture. To overcome these shortages, we introduce anew procedure for stochastic optimization by a recurrent artificial neural network. The introduced neurooptimizer(NO) starts with an initial solution and adjusts its weights by a new heuristic and unsupervised rule tocompute the best solution. Therefore, in each iteration, NO generates a new solution to reach the optimal ornear optimal solutions. For comparison and detailed description, the introduced NO is compared to geneticalgorithm and particle swarm optimization methods. Then, the proposed method is used to design the optimalcontroller parameters for a five bar linkage manipulator robot. The important characteristics of NO are:convergence to optimal or near optimal solutions, escaping from local minima, less function evaluation, highconvergence rate and easy to implement.
[1] J. Hopfield, and D. Tank, Neural computation
of decisions in optimization problems,
Biological Cybernetics, Vol. 52, 1985, pp. 141-
152.
[2] G.E. Hinton, and T.J. Sejnowsky, Optimal
perceptual inference, Proceedings of the IEEE
Conference on Computer Vision and Pattern
Recognition, Washigton, 1983, pp. 448-453.
[3] D. Amit, H. Gutfreund, and H. Sompolinsky,
Spin-Glass models of neural networks,
Physical Review Letters A 32, 1985, pp. 1007-
1018.
[4] Y. Akiyama, A. Yamashita, M. Kajiura, and H.
Aiso, Combinatorial optimization with
gaussian machines, Proceedings IEEE
International Joint Conference on Neural
Networks 1, 1989, pp. 533–540.
[5] T. Kohonen, Self-Organized formation of
topologically correct feature maps, Biological
Cybernetics 43, 1982, pp. 59–69.
[6] A.H. Gee, and R. W. Prager, Limitations of
neural networks for solving traveling salesman
problems, IEEE Trans. Neural Networks, vol.
6, 1995, pp. 280–282.
[7] M. Goldstein, Self-Organizing feature maps for
the multiple traveling salesman problem
(MTSP), Proceedings IEEE International
Conference on Neural Networks, Paris, 1990,
pp. 258–261.
[8] Y. P. S. Foo, and Y. Takefuji, Stochastic neural
networks for job-shop scheduling: parts 1 and
2, Proceedings of the IEEE International
Conference on Neural Networks 2, 1988, pp.
275–290.
[9] Y.P. S. Foo, and Y. Takefuji, Integer Linear
programming neural networks for job shop
scheduling, Proceedings of the IEEE
International Conference on Neural Networks
2, 1988, pp. 341–348.
[10] J.S. Lai, S.Y. Kuo, and I.Y. Chen, Neural
networks for optimization problems in graph
theory, Proceedings IEEE International
Symposium on Circuits and Systems 6, 1994,
pp. 269–272.
[11] D.E. Van Den Bout, and T.K. Miller, Graph
partitioning using annealed neural networks,
IEEE Transactions on Neural Networks 1,
1990, pp. 192–203.
[12] S. Vaithyanathan, H. Ogmen, and J. IGNIZIO,
Generalized boltzmann machines for
multidimensional knapsack problems,
Intelligent Engineering Systems Through
Artificial Neural Networks 4, ASME Press,
New York, 1994, pp. 1079–1084.
[13] A. Yamamoto, M. Ohta, H. Ueda, A. Ogihara,
and K. Fukunaga, Asymmetric neural network
and its application to knapsack problem, IEICE
Transactions Fundamentals E78-A, 1995, pp.
300–305.
[14] K. Urahama, and H. Nishiyuki, Neural
algorithms for placement problems,
Proceedings International Joint Conference on
Neural Networks 3, Nagoya, 1993, pp. 2421–
2424.
[15] K.E. Nygard, P. Jueli, and N. Kadaba, Neural
networks for selecting vehicle routing
heuristics, ORSA Journal of Computing 2,
1990, pp. 353–364.
[16] A.I. Vakhutinsky, and B. L. Golden, Solving
vehicle routing problems using elastic nets,
Proceedings IEEE International Conference on
Neural Networks 7, 1994, pp. 4535–4540.
[17] L. Fang, W. H. Wilson, and T. Li, Mean-Field
annealing neural net for quadratic assignment,
Proceedings International Conference on
Neural Networks, Paris, 1990, pp. 282–286.
[18] G.A. Tagliarini, and E. W. Page, Solving
constraint satisfaction problems with neural
networks, Proceedings IEEE International
Conference on Neural Networks 3, 1987, pp.
741–747.
[19] M. Kajiura, Y. Akiyama, and Y. Anzai, Solving
large scale puzzles with neural networks,
Proceedings Tools for AI Conference, Fairfax,
1990, pp. 562–569.
[20] N. Funabiki and Y. Takefuji, A neural network
parallel algorithm for channel assignment
problems in cellular radio networks, IEEE
Trans. Veh. Technol., vol. 41, Nov. 1992, pp.
430–437.
[21] K. Smith, and M. Palaniswami, Static and
dynamic channel assignment using neural
networks, IEEE Journal on Selected Areas in
Communications 15, 1997, pp. 238–249.
[22] T. Bultan and C. Aykanat, Circuit partitioning
using parallel mean field annealing algorithms,
Proceedings 3rd IEEE Symposium on Parallel
and Distributed Processing, 1991, pp. 534–541.
[23] U. Halici, Artificial neural networks, EE 543
Lecture Notes, Middle East Technical
University, Ankara, Turkey, 2004.
[24] J.H. Holland, Adaptation in natural and
artificial systems, University of Michigan
Press, Ann Arbor, MI, Internal Report, 1975.
[25] Y. Shi, and R. Eberhart, A modified particle
swarm optimizer, Proceedings of the IEEE
international conference on evolutionary
computation, Piscataway, NJ: IEEE Press;
1998, pp. 69–73.
[26] J.G. Ziegler and N.B. Nichols, “Optimum
settlings for automatic controllers,” Trans. On
ASME., vol. 64, pp. 759-768, 1942.
[27] Z.L. Gaing, “A Particle Swarm Optimization
Approach for Optimum Design of PID
controller in AVR system,” IEEE Transactions
on Energy Conversion, vol. 9, no. 2, pp. 384-
391, 2003.
[28] Z.Y. Zhao, M. Tomizuka, and S. Isaka, “Fuzzy
gain scheduling of PID controllers,” IEEE
Trans. System, Man, and Cybernetics, vol. 23,
no. 5, pp. 1392-1398, 1993.
[29] S.Y. Chu, C.C. Teng, “Tuning of PID
controllers based on gain and phase margin
specifications using fuzzy neural network,”
Fuzzy Sets and Systems, vol. 101, no. 1, pp.
21-30, 1999.
[30] G. Zhou and J.D. Birdwell, “Fuzzy logic-based
PID autotuner design using simulated
annealing,” Proceedings of the IEEE/IFAC
Joint Symposium on Computer-Aided Control
System Design, pp. 67 – 72, 1994.
[31] R.A. Krohling and J.P. Rey, “Design of optimal
disturbance rejection PID controllers using
genetic algorithm,” IEEE Trans. Evol.
Comput., vol. 5, pp. 78–82, 2001.
[32] D.H. Kim, “Tuning of a PID controller using a
artificial immune network model and local
fuzzy set,” Proceedings of the Joint 9th IFSA
World Congress and 20th NAFIPS
International Conference, vol. 5, pp. 2698 –
2703, 2001.
[33] Y.T. Hsiao, C.L. Chuang, and C.C. Chien, “Ant
colony optimization for designing of PID
controllers,” Proceedings of the 2004 IEEE
Conference on Control Applications/
International Symposium on Intelligent
Control/International Symposium on Computer
Aided Control Systems Design, Taipei, Taiwan,
2004.
[34] D. Wang and M. Vidyasagar, “Modeling of a
five-bar-Linkage Manipulator with One
Flexible Link,” in Proc. IEEE Int. Symp,
subject, Turkey, pp. 21–26, 1988.
[35] D. Wang, J.P. Huissoon and K. Luscott, “A
teaching robot for demonstrating robot control
strategies,” manufacturing research corporation
of Ontario, 1993.