Improving multilayer back propagation neural networks by using variable learning rate and automata theory and determining optimum learning rate

Subject Areas : Analysis of Structure and Earthquake

mohammadreza jafariyan ¹ , Alireza Abaszadeh ²

1 -
2 -

Received: 2008-07-30 Accepted : 2008-12-29 Published : 2009-01-20

Keywords:

Abstract :

Multilayer Bach propagation neural networks have been considered by researchers. Despite their outstanding success in managing contact between input and output, they have had several drawbacks. For example the time needed for the training of these neural networks is long, and some times not to be teachable. The reason For this long time of teaching is due to the selection unsuitable network parameters. The method For Obtaining the network parameters Of bias and weight is using is using gradient network energy function. As we Know, network error Function is of a not flat level, So the network is stopped at some optimum local points and we have no instruction at this points. To compensate for returned algorithm drawbacks, we use adaptive variable learning rate to enhance learning rate and in order to avoiding our network trapping in local points we used automata algorithm. By using this method it is possible to obtain improved learning rate For different net works.