An Approach to Reducing Overfitting in FCM with Evolutionary Optimization

Subject Areas : Journal of Computer & Robotics

Seyed Mahmood  Hashemi ¹ (School of Computer Engineering, Darolfonoon High Educational Institute, Qazvin, Iran)

Received: 2011-07-05 Accepted : 2011-09-08 Published : 2012-02-01

Keywords: Overfitting, fuzzy system modeling, FCM, multi-objective optimization,

Abstract :

Fuzzy clustering methods are conveniently employed in constructing a fuzzy model of a system, but they need to tune some parameters. In this research, FCM is chosen for fuzzy clustering. Parameters such as the number of clusters and the value of fuzzifier significantly influence the extent of generalization of the fuzzy model. These two parameters require tuning to reduce the overfitting in the fuzzy model. Two new cost functions are developed to set the parameters of FCM algorithm properly and the two evolutionary optimization algorithms, i.e. the multi-objective simulated annealing and the multi-objective imperialist competitive algorithm, are employed to optimize the parameters of FCM according to the proposed cost functions. The multi-objective imperialist competitive algorithm is the proposed algorithm.