Interactive image retrieval using self-organizing maps
No Thumbnail Available
Journal Title
Journal ISSN
Volume Title
Doctoral thesis (article-based)
Checking the digitized thesis and permission for publishing
Instructions for the author
Instructions for the author
Unless otherwise stated, all rights belong to the author. You may download, display and print this publication for Your own personal use. Commercial use is prohibited.
Author
Date
2003-11-14
Major/Subject
Mcode
Degree programme
Language
en
Pages
107
Series
Dissertations in computer and information science. Report D, 1
Abstract
Digital image libraries are becoming more common and widely used as visual information is produced at a rapidly growing rate. Creating and storing digital images is nowadays easy and getting more affordable all the time as the needed technologies are maturing and becoming eligible for general use. As a result, the amount of data in visual form is increasing and there is a strong need for effective ways to manage and process it. In many settings, the existing and widely adopted methods for text-based indexing and information retrieval are inadequate for these new purposes. Content-based image retrieval addresses the problem of finding images relevant to the users' information needs from image databases, based principally on low-level visual features for which automatic extraction methods are available. Due to the inherently weak connection between the high-level semantic concepts that humans naturally associate with images and the low-level visual features that the computer is relying upon, the task of developing this kind of systems is very challenging. A popular method to improve retrieval performance is to shift from single-round queries to navigational queries where a single retrieval instance consists of multiple rounds of user-system interaction and query reformulation. This kind of operation is commonly referred to as relevance feedback and can be considered as supervised learning to adjust the subsequent retrieval process by using information gathered from the user's feedback. In this thesis, an image retrieval system named PicSOM is presented, including detailed descriptions of using multiple parallel Self-Organizing Maps (SOMs) for image indexing and a novel relevance feedback technique. The proposed relevance feedback technique is based on spreading the user responses to local SOM neighborhoods by a convolution with a kernel function. A broad set of evaluations with different image features, retrieval tasks, and parameter settings demonstrating the validity of the retrieval method is described. In particular, the results establish that relevance feedback with the proposed method is able to adapt to different retrieval tasks and scenarios. Furthermore, a method for using the relevance assessments of previous retrieval sessions or potentially available keyword annotations as sources of semantic information is presented. With performed experiments, it is confirmed that the efficiency of semantic image retrieval can be substantially increased by using these features in parallel with the standard low-level visual features.Description
Keywords
content-based image retrieval (CBIR), Self-Organizing Map (SOM), relevance feedback, MPEG-7
Other note
Parts
- Laaksonen J., Koskela M., Laakso S. and Oja E., 2000. Pic-SOM – content-based image retrieval with self-organizing maps. Pattern Recognition Letters 21, No. 13-14, pages 1199-1207. [article1.pdf] © 2000 Elsevier Science. By permission.
- Laaksonen J., Oja E., Koskela M. and Brandt S., 2000. Analyzing low-level visual features using content-based image retrieval. Proceedings of the 7th International Conference on Neural Information Processing (ICONIP 2000) (invited paper). Taejon, Korea, Vol. 2, pages 1333-1338.
- Laaksonen J., Koskela M., Laakso S. and Oja E., 2001. Self-Organising Maps as a relevance feedback technique in content-based image retrieval. Pattern Analysis & Applications 4, No. 2-3, pages 140-152. [article3.pdf] © 2001 Springer-Verlag. By permission.
- Koskela M., Laaksonen J. and Oja E., 2001. Comparison of techniques for content-based image retrieval. Proceedings of the 12th Scandinavian Conference on Image Analysis (SCIA 2001). Bergen, Norway, pages 579-586. [article4.pdf] © 2001 Norsk forening for bildebehandling og mønstergjenkjenning (NOBIM). By permission.
- Laaksonen J., Koskela M. and Oja E., 2002. PicSOM – self-organizing image retrieval with MPEG-7 content descriptors. IEEE Transactions on Neural Networks: Special Issue on Intelligent Multimedia Processing 13, No. 4, pages 841-853. [article5.pdf] © 2002 IEEE. By permission.
- Koskela M., Laaksonen J. and Oja E., 2002. Implementing relevance feedback as convolutions of local neighborhoods on Self-Organizing Maps. Proceedings of the International Conference on Artificial Neural Networks (ICANN 2002). Madrid, Spain, pages 981-986. [article6.pdf] © 2002 Springer-Verlag. By permission.
- Koskela M. and Laaksonen J., 2003. Using long-term learning to improve efficiency of content-based image retrieval. Proceedings of the Third International Workshop on Pattern Recognition in Information Systems (PRIS 2003). Angers, France, pages 72-79. [article7.pdf] © 2003 ICEIS Press. By permission.
