Content-Based Medical Image Retrieval Based on Image Feature Projection in Relevance Feedback Level

Subject Areas : Image and video processing

Mohammad Behnam ¹ , Hossein Pourghasem ²

1 - Department of Electrical Engineering, Islamic Azad University, Najafabad Branch
2 - Department of Electrical Engineering, Islamic Azad University, Najafabad Branch

Received: 2013-10-29 Accepted : 2014-04-27 Published : 2014-06-01

Keywords: Support vector machine, principal component analysis, Content-based image retrieval, Linear Discriminant Analysis, relevance feedback, Semantic gap,

Abstract :

The purpose of this study is to design a content-based medical image retrieval system and provide a new method to reduce semantic gap between visual features and semantic concepts. Generally performance of the retrieval systems based on only visual contents decrease because these features often fail to describe the high level semantic concepts in user’s mind. In this paper this problem is solved using a new approach based on projection of relevant and irrelevant images in to a new space with low dimensionality and less overlapping in relevance feedback level. For this purpose, first we change the feature space using Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA) techniques and then classify the feedback images applying Support Vector Machine (SVM) classifier. The proposed framework has been evaluated on a database consisting of 10,000 medical X-ray images of 57 semantic classes. The obtained results show that the proposed approach significantly improves the accuracy of retrieval system.

References:

[1] F. Long, H. Zhang, D.D. Feng, "Fundamentals of content-based image retrieval, in multimedia information retrieval and management - technological fundamentals and applications", Springer Verlag, pp. 1-26, 2003.

[2] S.K. Chang, A. Hsu, "Image information systems: where do we go from here?", IEEE Trans. on Knowledge and Data Engineering, Vol.5, No.5, pp. 431-442, Oct.1992.

[3] X. Li, S.C. Chen, M.L. Shyu, B. Furht, "Image retrieval by color, texture, and spatial information", In 8th Inter. Con. on Dis. Multi. Sys. (DMS'2002), San Francisco Bay, California, USA, pp. 1-8, .2002.

[4] K. Zagoris, S.A. Chatzichristofis, N. Papamarkos, Y.S. Boutalis, "Img (Anaktisi): A web content based image retrieval system", IEEE Second Int. Workshop on Similarity Search and Applications, pp. 154-155, .2009.

[5] R.C. Veltkamp M. Tanase, "Content-based image retrieval systems: A survey", Dept. of Computing Science, Utrecht University, Technical Report .2000.

[6] P. Ghosh, S. Antani, L.R. Long, G.R. Thoma, "Review of medical image retrieval systems and future directions", IEEE, Computer-Based Medical Systems (CBMS), 24th International Symposium, pp. 1-6, June 2011.

[7] J.G. Dy, C.E. Brodley, A. Kak, L.S. Broderick, A.M. Aisen, "Unsupervised feature selection applied to content-based retrieval of lung images", IEEE Trans. Pattern Anal. Mach. Intell., Vol. 25, No. 3, pp. 373–378, 2003.

[8] P. Korn, N. Sidiropoulos, C. Faloutsos, E. Siegel, Z. Protopapas, "Fast and effective retrieval of medical tumor shapes", IEEE Trans. Knowl. Data Eng. Vol. 10, No. 6, pp. 889-904, 1998.

[9] S.N. Yu, C.T. Chianga, C.C. Hsieh, "A three-object model for the similarity searches of chest CT images", Computerized Medical Imaging and Graphics, Vol. 29, pp. 617-630, 2005.

[10] L.L.G. Oliveira, S.A. Silva, L.H.V. Ribeiro, R.M. Oliveira, C. Coelho, A.S.S. Andrade, "Computer-aided diagnosis in chest radiography for detection of childhood pneumonia", Int. J. Med. Inform., Vol. 77, No. 8, pp. 555-564, 2007.

[11] X. Xu, D.J. Lee, S. Antani, L.R. Long, "A spine X-ray image retrieval system using partial shape matching", IEEE Trans. on Inf. Tech. in Bio., Vol. 12, No. 1, pp. 100-108, 2008.

[12] O. Nomira, M. Abdel-Mottalebb, "Hierarchical contour matching for dental X-ray radiographs", Pattern Recognition, Vol. 41, pp. 130-138, 2008.

[13] Y. Liu, D. Zhanga, G. Lua, W.Y. Ma, "A survey of content-based image retrieval with high-level semantics", Pattern Recognition, Vol. 40, No. 1, pp. 262–282, 2007.

[14] Y. Rui, T.S. Huang, M. Ortega, S. Mehrotra, "Relevance feedback: A power tool for interactive content-based image retrieval", IEEE Trans. Circuits and Systems for Video Technology, Vol. 8, No. 5, pp. 644-655, Sep. 1998.

[15] A. Marakakis, G. Siolas, N. Galatsanos, A. Likas, A. Stafylopatis, "Relevance feedback approach for image retrieval combining support vector machines and adapted Gaussian mixture models", IET Image Process., Vol. 5, No. 6, pp. 531–540, Sept. 2011.

[16] T. Hastie, R. Tibshirani, J. Friedman, "The elements of statistical learning", Second edition, Springer, New York, 2008.

[17] M.M. Rahman, S.K. Antani, G.R. Thoma, "A learning-based similarity fusion and filtering approach for biomedical image retrieval using SVM classification and relevance feedback", IEEE Trans. on Info. Tech. in Bio., Vol. 15, No. 4, July 2011.

[18] H. Pourghassem, S. Daneshvar, "A framework for medical image retrieval using merging-based classification with dependency probability-based relevance feedback", Turkish J. of Elec. Engi. & Com. Sci., Vol. 21, No. 3, pp. 882-896, 2013.

[19] L. Yang, R. Jin, L. Mummert, R. Sukthankar, A. Goode, B. Zheng, S.C.H. Hoi, M. Satyanarayanan, "A boosting framework for visuality-preserving distance metric learning and its application to medical image retrieval", IEEE Trans. Pat. Anal. Mach. Intell., Vol. 32, No. 1, pp. 30–44, Jan. 2010.

[20] R.M. Haralick, K. Shanmugan, I. Dinstein, ''Textural features for image classification", IEEE Trans. on Sys., Man, and Cybernetics, Vol. 3, No. 6, pp. 610–621, Nov. 1973.

[21] H. Tamura, S. Mori, T. Yamawaki, "Texture features corresponding to visual perception", IEEE Trans. on Sys., Man, and Cybernetics, Vol. Smc-8, No. 6, pp. 460–473, June 1978.

[22] B.S. Manjunathi, W.Y. Ma, "Texture features for browsing and retrieval of image data", IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 18, No. 8, pp. 837-842, August 1996.

[23] E. Persoon, K. Fu, "Shape discrimination using Fourier descriptors", IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 8, No. 3, pp. 388-397, 1977.

[24] D.S. Zhang, G. Lu, "Generic fourier descriptor for shape-based image retrieval", IEEE International Conference on Multimedia and Expo. Vol.1, pp. 425-428, 2002.

[25] S.H. Cha, "Comprehensive survey on distance/similarity measures between probability density functions", International journal of mathematical models and methods in applied sciences, Vol. 1, No. 4, pp. 300-307 , 2007.

[26] R.O. Duda, P.E. Hart, D.G. Stork, Pattern Classification, 2nd ed. John Wiley & Sons, New York, NY, 2001.

[27] A.M. Martinez, A.C. Kak, "PCA versus LDA," IEEE Trans. on Pattern Analysis and Machine Intelligence", Vol. 23, No. 2, pp. 228-233, February 2001.

[28] P. Clough, H. Muller, T. Deselaers, M. Grubinger, T.M. Lehmann, J. Jensen, W. Hersh, "The CLEF 2005 cross–language image retrieval track", Springer Berlin Heidelberg, 6th Workshop of the Cross-Language Evalution Forum, CLEF 2005, Vienna, Austria, 21-23 September, 2005, pp. 535-557, 2006.

[29] J.R. Smith, S. Chang, "Tools and Techniques for Color Image Retrieval", In SPIE, pp. 1-12, 1996.

[30] T. Deselaers, D. Keysers, H. Ney, "Classification error rate for quantitative evaluation of content-based image retrieval systems", IEEE, Proceedings of the 17th Int. Con. on Patt. Reco., Vol. 2, pp. 505–508, 2004.