ENHANCING HANDWRITTEN DIGIT RECOGNITION ACCURACY ON THE MNIST DATASET USING A HYBRID CNN-BILSTM MODEL WITH DATA AUGMENTATION

Muhtyas Yugi, Ahmad Latif, Fandy Setyo Utomo, Azhari Shouni Barkah

Abstract


Handwritten digit recognition is a classic challenge in the field of computer vision and machine learning, and continues to be developed to achieve higher accuracy. This study proposes a hybrid method that combines Convolutional Neural Networks (CNN) and Bidirectional Long Short-Term Memory (BiLSTM) to enhance performance in handwritten digit classification using the MNIST dataset. CNNs are em-ployed to extract spatial features from digit images, while BiLSTMs are used to capture the temporal patterns and sequential context from the extracted features. To address limitations in data variation and improve the model’s generalization capabilities, the study also applies data augmentation techniques based on image transformations such as rota-tion, translation, scaling, and flipping. Experimental results demonstrate that the hybrid CNN-BiLSTM model with data augmentation signifi-cantly improves classification accuracy compared to baseline ap-proaches without augmentation or without BiLSTM. The model achieved the following accuracy on the MNIST test data: CNN Model Accuracy: Before Augmentation: 98.0%. After Augmentation: 98.5%; CNN-BiLSTM Model Accuracy: Before Augmentation: 98.0%. After Augmentation: 98.7%. These results highlight the effectiveness of the hybrid approach in enhancing handwritten digit recognition perfor-mance. This research contributes to the development of more accurate and robust deep learning models for handwritten image processing

Keywords


Handwritten digit recognition, Convolutional Neural Network (CNN), Bidirectional Long Short-Term Memory (BiLSTM), handwritten image processing

Full Text:

PDF

References


M. J. Hasan, M. F. Wahid, and M. S. Alom, “Bangla Compound Character Recognition by Combining Deep Convolutional Neural Network with Bidirectional Long Short-Term Memory,” 2019 4th Int. Conf. Electr. Inf. Commun. Technol. EICT 2019, no. May 2021, 2019, doi: 10.1109/EICT48899.2019.9068817.

M. Eltay, A. Zidouri, I. Ahmad, and Y. Elarian, “Generative adversarial network based adaptive data augmentation for handwritten Arabic text recognition,” PeerJ Comput. Sci., vol. 8, pp. 1–22, 2022, doi: 10.7717/PEERJ-CS.861.

M. Rabi and M. Amrouche, “Enhancing Arabic Handwritten Recognition System-Based CNN-BLSTM Using Generative Adversarial Networks,” Eur. J. Artif. Intell. Mach. Learn., vol. 3, no. 1, pp. 10–17, 2024, doi: 10.24018/ejai.2024.3.1.36.

T. Watanabe, M. Maniruzzaman, M. A. M. Hasan, H. S. Lee, S. W. Jang, and J. Shin, “2D Camera-Based Air-Writing Recognition Using Hand Pose Estimation and Hybrid Deep Learning Model,” Electron., vol. 12, no. 4, pp. 1–14, 2023, doi: 10.3390/electronics12040995.

N. Jyothi, J. Simha, K. K.-2024 S. International, and undefined 2024, “Word Prediction from Medical Prescription via Transfer Learning with Pre-trained CNN, GAN and BiLSTM Integration,” ieeexplore.ieee.orgNM Jyothi, JB Simha, KVK Kumar2024 Second Int. Conf. Networks, Multimed. and, 2024•ieeexplore.ieee.org, Accessed: May 02, 2025. [Online]. Available: https://ieeexplore.ieee.org/abstract/document/10698946/

M. A. Rahim et al., “An Enhanced Hybrid Model Based on CNN and BiLSTM for Identifying Individuals via Handwriting Analysis,” C. - Comput. Model. Eng. Sci., vol. 140, no. 2, pp. 1689–1710, 2024, doi: 10.32604/cmes.2024.048714.

M. Kowsher et al., “LSTM-ANN & BiLSTM-ANN: Hybrid deep learning models for enhanced classification accuracy,” Procedia Comput. Sci., vol. 193, pp. 131–140, 2021, doi: 10.1016/j.procs.2021.10.013.

F. Kizilirmak and B. Yanikoglu, “CNN-BiLSTM model for English Handwriting Recognition: Comprehensive Evaluation on the IAM Dataset,” pp. 1–20, 2023, [Online]. Available: http://arxiv.org/abs/2307.00664

L. Jiao, H. Wu, H. Wang, and R. Bie, “Text recovery via deep CNN-BiLSTM recognition and Bayesian inference,” IEEE Access, vol. 6, pp. 76416–76428, 2018, doi: 10.1109/ACCESS.2018.2882592.

G. S. Nugraha, M. I. Darmawan, and R. Dwiyansaputra, “Comparison of CNN’s Architecture GoogleNet, AlexNet, VGG-16, Lenet -5, Resnet-50 in Arabic Handwriting Pattern Recognition,” Kinet. Game Technol. Inf. Syst. Comput. Network, Comput. Electron. Control, vol. 4, no. 2, 2023, doi: 10.22219/kinetik.v8i2.1667.

A. Bwatiramba and S. Venkataraman, “Handwritten Character Recognition Using Deep Learning (Convolutional Neural Network),” Comput. Eng. Intell. Syst., no. February, 2023, doi: 10.7176/ceis/14-1-05.

F. Mahardika, N. Alfiah, and R. B. B. Sumantri, “Penerapan Metode FP Tree dan Frequent Pattern Growth pada Penerimaan Mahasiswa Baru STMIK,” Blend Sains J. Tek., vol. 1, no. 3, pp. 226–234, Jan. 2023, doi: 10.56211/BLENDSAINS.V1I3.176.

F. Alwajih, E. Badr, and S. Abdou, “Writer adaptation for E2E Arabic online handwriting recognition via adversarial multi task learning,” Egypt. Informatics J., vol. 23, no. 3, pp. 373–382, 2022, doi: 10.1016/j.eij.2022.02.007.

Y. Yang, L. Chen, and S. Wu, “Enhancing Fetal Electrocardiogram Signal Extraction Accuracy through a CycleGAN Utilizing Combined CNN–BiLSTM Architecture,” Sensors, vol. 24, no. 9, 2024, doi: 10.3390/s24092948.

T. Tundo and F. Mahardika, “Fuzzy Inference System Tsukamoto–Decision Tree C 4.5 in Predicting the Amount of Roof Tile Production in Kebumen,” JTAM (Jurnal Teor. dan Apl. Mat., vol. 7, no. 2, p. 533, 2023, doi: 10.31764/jtam.v7i2.13034.

Q. D. E. J. Ren, L. Wang, Z. Ma, and S. Barintag, “Offline Mongolian Handwriting Recognition Based on Data Augmentation and Improved ECA-Net,” Electron., vol. 13, no. 5, 2024, doi: 10.3390/electronics13050835.

V. Carbune et al., “Fast multi-language LSTM-based online handwriting recognition,” Int. J. Doc. Anal. Recognit., vol. 23, no. 2, pp. 89–102, 2020, doi: 10.1007/s10032-020-00350-4.

J. Bhaskar and A. Patel, “Image Classification using Convolutional Neural Network,” SSRG Int. J. Comput. Sci. Eng., pp. 197–202, 2016.

C. Medel-Vera, P. Vidal-Estévez, and T. Mädler, “A convolutional neural network approach to classifying urban spaces using generative tools for data augmentation,” Int. J. Archit. Comput., vol. 22, no. 3, pp. 392–411, 2024, doi: 10.1177/14780771231225697.

F. Mahardika and H. Marcos, “PENERAPAN ALGORITMA GRAF WELCH POWEL PADA PENJADWALAN MATA KULIAH DAN JADWAL ASISTEN Study Kasus Forum Asisten STMIK Amikom Purwokerto,” Simetris J. Tek. Mesin, Elektro dan Ilmu Komput., vol. 8, no. 2, pp. 825–832, Nov. 2017, doi: 10.24176/SIMET.V8I2.1208.

L. Zhang, C. Peng Lim, and C. Liu, “Enhanced bare-bones particle swarm optimization based evolving deep neural networks,” Expert Syst. Appl., vol. 230, no. June, p. 120642, 2023, doi: 10.1016/j.eswa.2023.120642




DOI: https://doi.org/10.29100/jipi.v11i1.7758

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika)
ISSN 2540-8984
Published by
Prodi Pendidikan Teknologi Informasi
Universitas Bhinneka PGRI

Website :https://jurnal.stkippgritulungagung.ac.id/index.php/jipi/index
Email: jipistkippti@gmail.com


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.