Adaptive methods for on-line recognition of isolated handwritten characters
No Thumbnail Available
Journal Title
Journal ISSN
Volume Title
Doctoral thesis (article-based)
Checking the digitized thesis and permission for publishing
Instructions for the author
Instructions for the author
Unless otherwise stated, all rights belong to the author. You may download, display and print this publication for Your own personal use. Commercial use is prohibited.
Author
Date
2002-12-14
Major/Subject
Mcode
Degree programme
Language
en
Pages
93, [74]
Series
Acta polytechnica Scandinavica. Ma, Mathematics and computing series, 119
Abstract
The main goal of the work presented in this thesis has been the development of an on-line handwriting recognition system which is able to recognize handwritten characters of several different writing styles and is able to improve its performance by adapting itself to new writing styles. The recognition method should be applicable to hand-held devices of limited memory and computational resources. The adaptation process should take place during normal use of the device, not in some specific training mode. For the usability aspect of the recognition system, the recognition and adaptation processes should be easily understandable to the users. The first part of this thesis gives an introduction to the handwriting recognition. The topics considered include: the variations present in personal handwriting styles; automatic grouping of similar handwriting styles; the differences between writer-independent and writer-dependent as well as on-line and off-line handwriting recognition problems; the different approaches to on-line handwriting recognition; the previous adaptive recognition systems and the experiments performed with them; the recognition performance requirements and other usability issues related to on-line handwriting recognition; the current trends in on-line handwriting recognition research; the recognition results obtained with the most recent recognition systems; and the commercial applications. The second part of the thesis describes an adaptive on-line character recognition system and the experiments performed with it. The recognition system is based on prototype matching. The comparisons between the character samples and prototypes are based on the Dynamical Time Warping (DTW) algorithm and the input characters are classified according to the k Nearest Neighbors (k-NN) rule. The initial prototype set is formed by clustering character samples collected from a large number of subjects. Thus, the recognition system can handle various writing styles. This thesis work introduces four DTW-based clustering algorithms which can be used for the prototype selection. The recognition system adapts to new writing styles by modifying its prototype set. This work introduces several adaptation strategies which add new writer-dependent prototypes into the initial writer-independent prototype set, reshape the existing prototypes with a Learning Vector Quantization (LVQ)-based algorithm, and inactivate poorly performing prototypes. The adaptations are carried out on-line in a supervised or self-supervised fashion. In the former case, the user explicitly labels the input characters which are used as training samples in the adaptation process. In the latter case, the system deduces the labels from the recognition results and the user's actions. The latter approach is prone to erroneously labeled learning samples. The different adaptation strategies were experimented with and compared with each other by performing off-line simulations and genuine on-line user experiments. In the simulations, special attention has been paid to the various erroneous learning situations likely to be encountered in real world handwriting recognition tasks. The recognition system is able to improve its recognition accuracy significantly on the basis of only a few additional character samples per class. Recognition accuracies acceptable in real world applications can be attained for most of the test subjects. This work also introduces a Self-Organizing Map (SOM)-based method for analyzing personal writing styles. Personal writing styles are represented by high-dimensional vectors, the components of which indicate the subjects' tendencies to use certain prototypical writing styles for isolated characters. These writing style vectors are then visualized by a SOM which enables the detection and analysis of clusters of similar writing styles.Description
Keywords
handwriting recognition, isolated Latin characters, on-line, adaptation, clustering, allographs, Dynamical Time Warping (DTW), Learning Vector Quantization (LVQ), Self-Organizing Map (SOM), the k nearest neighbors (k-NN) rule
Other note
Parts
- Vuori, V., J. Laaksonen, E. Oja, and J. Kangas (2001a). Experiments with adaptation strategies for a prototype-based recognition system for isolated handwritten characters. International Journal on Document Analysis and Recognition 3 (3), 150-159. [article1.pdf] © 2001 Springer-Verlag. By permission.
- Vuori, V., J. Laaksonen, and J. Kangas (2002). Influence of erroneous learning samples on adaptation in on-line handwriting recognition. Pattern Recognition 35 (4), 915-925.
- Vuori, V., J. Laaksonen, E. Oja, and J. Kangas (2000b). Controlling on-line adaptation of a prototype-based classifier for handwritten characters. In Proceedings of the 15th International Conference on Pattern Recognition, Volume 2, pp. 331-334. [article3.pdf] © 2000 IEEE. By permission.
- Vuori, V., M. Aksela, J. Laaksonen, E. Oja, and J. Kangas (2000a). Adaptive character recognizer for a hand-held device: implementation and evaluation setup. In Proceedings of the 7th International Workshop on Frontiers in Handwriting Recognition, pp. 13-22. [article4.pdf] © 2000 Unipen Foundation. By permission.
- Vuori, V., J. Laaksonen, E. Oja, and J. Kangas (2001b). Speeding up on-line recognition of handwritten characters by pruning the prototype set. In Proceedings of 6th International Conference on Document Analysis and Recognition, pp. 501-505. [article5.pdf] © 2001 IEEE. By permission.
- Vuori, V. and J. Laaksonen (2002). A comparison of techniques for automatic clustering of handwritten characters. In Proceedings of the 16th International Conference on Pattern Recognition, Volume 3, pp. 168-171. [article6.pdf] © 2002 IEEE. By permission.
- Vuori, V. and E. Oja (2000). Analysis of different writing styles with the self-organizing map. In Proceedings of the 7th International Conference on Neural Information Processing, Volume 2, pp. 1243-1247. [article7.pdf] © 2000 IEEE. By permission.
- Vuori, V. (2002). Clustering writing styles with a self-organizing map. In Proceedings of the 8th International Workshop on Frontiers in Handwriting Recognition, pp. 345-350. [article8.pdf] © 2002 IEEE. By permission.
