Real time handwriting recognition system using CNN algorithms
DOI:
https://doi.org/10.31185/wjcms.157Keywords:
Artificial intelligence; handwriting processing; deep learning; CNN models.Abstract
Abstract— The growing use of digital technologies across various sectors and daily activities has made handwriting recognition a popular research topic. Despite the continued relevance of handwriting, people still require the conversion of handwritten copies into digital versions that can be stored and shared digitally. Handwriting recognition involves the computer's strength to identify and understand legible handwriting input data from various sources, including document, photo-graphs and others. Handwriting recognition pose a complexity challenge due to the diversity in handwriting styles among different individuals especially in real time applications. In this paper, an automatic system was designed to handwriting recognition using the recent artificial intelligent algorithms, the conventional neural network (CNN).
Different CNN models were tested and modified to produce a system has two important features high performance accuracy and less testing time. These features are the most important factors for real time applications. The experimental results were conducted on a dataset includes over 400,000 handwritten names; the best performance accuracy results were 99.8% for SqueezeNet model.
References
L. Chen, S. Wang, W. Fan, J. Sun, and S. Naoi, “Beyond human recognition: A CNN-based framework for handwritten character recognition,” 3rd IAPR Asian Conference on Pattern Recognition (ACPR), pp. 695–699, 2015.
A. K. A. Hassan, B. S. Mahdi, and A. A. Mohammed, “Arabic handwriting word recognition based on scale invariant feature transform and support vector machine,” Iraqi Journal of Science, vol. 60, no. 2, pp. 381–387, 2019.
W. N. Hussein and H. N. Hussain, “A design of a hybrid algorithm for optical character recognition of online hand-written Arabic alphabets,” Iraqi Journal of Science, vol. 60, no. 9, pp. 2067–2079, 2019.
X. Wang, J. Gao, and Y. Wang, “A comprehensive review of the extreme learning machine algorithm,” Neurocomputing, vol. 338, pp. 48–58, 2019.
T. S. Gunawan, A. F. R. M. Noor, and M. Kartiwi, “Development of English handwritten recognition using deep neural network,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 10, no. 2, pp. 562–568, 2018.
A. A. Chandio, M. Leghari, D. Hakro, S. Awan, and A. H. Jalbani, “A Novel Approach for Online Sindhi Handwritten Word Recognition using Neural Network,” Sindh University Research Journal SURJ (Science Series), vol. 48, no. 1, pp. 213–216, 2016.
T. Wilkinson and A. Brun, “Semantic and verbatim word spotting using deep neural networks,” 15th International Conference on Frontiers in Handwriting Recognition (ICFHR), pp. 307–312, 2016.
S. Ding, H. Zhao, Y. Zhang, X. Xu, and R. Nie, “Extreme learning machine: algorithm, theory and applications,” Artificial Intelligence Review, vol. 44, no. 1, pp. 103–115, 2015.
N. A. Hamid and N. N. A. Sjarif, “Handwritten recognition using SVM, KNN and neural network,” Procedia Computer Science, vol. 105, pp. 61– 68, 2017.
A. A. A. Ali and M. Suresha, “A novel features and classifiers fusion technique for recognition of Arabic handwritten character script,” SN Applied Sciences, vol. 1, no. 10, pp. 1286–1286, 2019.
M. Jaderberg, K. Simonyan, A. Vedaldi, and A. Zisserman, “Synthetic data and artificial neural networks for natural scene text recognition,” Computer Vision and Pattern Recognition, 2014.
A. Poznanski and L. Wolf, “CNN-n-gram for handwriting word recognition,” CVPR, pp. 2305–2314, 2016.
T. Wilkinson, J. Lindstrom, and A. Brun Neural ctrl-f: segmentation-free query-by-string word spotting in handwritten manuscript collections, pp. 4443–4452, 2017.
X. Hou, J. Zhang, Q. Gao, and Y. Guo, “Handwriting recognition using convolutional recurrent neural networks and connectionist temporal classification,” Journal of Intelligent & Fuzzy Systems, vol. 39, no. 4, pp. 5681–5691, 2020.
B. Shi, X. Bai, and C. Yao, “An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 11, pp. 2298–2304, 2017.
P. Voigtlaender, P. Doetsch, and H. Ney, “Handwriting recognition with large multidimensional long short-term memory recurrent neural networks,” ICFHR, pp. 228–233, 2016.
P. Krishnan, K. Dutta, and C. V. Jawahar, “Word spotting and recognition using deep embedding,” 2018 13th IAPR International Workshop on Document Analysis Systems (DAS), pp. 1–6, 2018.
P. Krishnan, K. Dutta, and C. V. Jawahar, “Deep feature embedding for accurate recognition and retrieval of handwritten text,” ICFHR, pp. 289– 294, 2016.
X. Wang, A. Shrivastava, and A. Gupta A-fast-rcnn: Hard positive generation via adversary for object detection, pp. 1325–1334, 2017.
. Dataset and Landlord, Handwriting Recognition Dataset.
M. A. Al-Omari, “Handwritten Arabic character recognition using deep learning techniques without feature extraction,” Journal of Intelligent & Fuzzy Systems, vol. 37, no. 3, pp. 4243–4253, 2019
D. H. Kadhim and N. H. Salman, “A Review on Face Detection Based on Convolution Neural Network Techniques,” Iraqi Journal of Science, vol. 63, no. 4, pp. 1823–1835, 2022.
S. Samir, E. Emary, K. El-Sayed, and H. Onsi Optimization of a Pre-Trained AlexNet Model for Detecting and Localizing Image Forgeries, vol. 11, pp. 275–275, 2020.
S. G. Lee, Y. Sung, Y. G. Kim, and E. Y. Cha, “Variations of AlexNet and GoogLeNet to Improve Korean Character Recognition Performance,” Journal of Information Processing Systems, vol. 14, no. 1, pp. 205–217, 2018.
A. Wang, M. Wang, K. Jiang, M. Cao, and Y. Iwahori, “A Dual Neural Architecture Combined SqueezeNet with OctConv for LiDAR Data Classification,” Sensors, vol. 19, no. 22, pp. 4927–4927, 2019.
V. K. Sonthi, “An Intelligent Telugu Handwritten Character Recognition Using Multi-Objective Mayfly Optimization with Deep Learning-Based DenseNet Model,” ACM Trans. Asian Low-Resour. Lang. Inf. Process, vol. 22, no. 3, pp. 1–16, 2023.
M. S. Akter, H. Shahriar, A. Cuzzocrea, N. Ahmed, and C. Leung, “Handwritten word recognition using deep learning approach: A novel way of generating handwritten words,” in Proc. IEEE Int. Conf. Big Data (Big Data), pp. 1–6, 2022.
M. Kamal, F. Shaiara, C. M. Abdullah, S. Ahmed, T. Ahmed, and M. H. Kabir, “Huruf: An Application for Arabic Handwritten Character Recognition Using Deep Learning,” International Conference on Computer and Information Technology (ICCIT), 2022.
Downloads
Published
Issue
Section
License
Copyright (c) 2023 Maryam Yaseen Abdullah
This work is licensed under a Creative Commons Attribution 4.0 International License.
