Implementation of an Automatic System for Vehicle License Plate Character Recognition in Indonesia Using YOLOv8 and Tesseract OCR

Alief Dewana Iriawan, Andi Sunyoto, Dhani Ariatmanto

Abstract


This study develops an automatic system for vehicle license plate identification in Indonesia by combining the YOLOv8 object detection algorithm with character recognition using Tesseract OCR. The system is designed to recognize two commonly used license plate colors in Indonesia: white and black. The process begins with training the YOLOv8 model using an annotated dataset consisting of 602 images of Indonesian vehicle license plates. Once the license plate area is accurately detected, the image is cropped based on the bounding box coordinates for the character recognition stage. Before being recognized by Tesseract OCR, the cropped image undergoes a series of preprocessing steps to enhance recognition accuracy. These steps include grayscale conversion, local contrast enhancement using the CLAHE method, segmentation with Otsu thresholding, and color inversion using the bitwise NOT operation. The system is evaluated using metrics such as accuracy, precision, recall, and F1-score. Test results show that the system is capable of detecting and recognizing license plates with high accuracy achieving 96% for white plates and 92% for black plates. Overall, the system achieved a combined accuracy of 94%. These findings indicate that the integration of YOLOv8 and Tesseract OCR, supported by effective image preprocessing, can significantly enhance license plate recognition performance. Nonetheless, challenges remain in recognizing characters on black plates with low contrast, which could be the focus of future improvements.

Keywords


Character Recognition; OCR; Object Detection; Plate Number; YOLO

Full Text:

PDF

References


D. Iskandar Mulyana and M. A. Rofik, “Implementasi Deteksi Real Time Klasifikasi Jenis Kendaraan Di Indonesia Menggunakan Metode YOLOV5,” Jurnal Pendidikan Tambusai, vol. 6, no. 3, pp. 13971–13982, Jul. 2022, doi: 10.31004/jptam.v6i3.4825.

H. Moussaoui et al., “Enhancing automated vehicle identification by integrating YOLO v8 and OCR techniques for high-precision license plate detec-tion and recognition,” Sci Rep, vol. 14, no. 1, pp. 1–17, Dec. 2024, doi: 10.1038/s41598-024-65272-1.

V. Fanditama Wijaya and B. Soewito, “Efficient License Plate Detection and Recognition with YOLOv7 and OCR,” International Journal of Intelli-gent Systems and Applications in Engineering IJISAE, vol. 12, no. 3, pp. 1598–1605, 2024, [Online]. Available: www.ijisae.org

A. Sarhan et al., “Egyptian car plate recognition based on YOLOv8, Easy-OCR, and CNN,” Journal of Electrical Systems and Information Technolo-gy, vol. 11, no. 1, pp. 1–27, Aug. 2024, doi: 10.1186/s43067-024-00156-y.

M. C. Wijaya, “Research of Indonesian license plates recognition on moving vehicles,” EUREKA: Physics and Engineering, no. 6, pp. 185–198, Nov. 2022, doi: 10.21303/2461-4262.2022.002424.

D. Islam, T. Mahmud, and T. Chowdhury, “An efficient automated vehicle license plate recognition system under image processing,” Indonesian Jour-nal of Electrical Engineering and Computer Science, vol. 29, no. 2, pp. 1055–1062, Feb. 2023, doi: 10.11591/ijeecs.v29.i2.pp1055-1062.

A. R. Hanif, E. Nasrullah, and F. X. A. Setyawan, “DETEKSI KARAKTER PLAT NOMOR KENDARAAN DENGAN MENGGUNAKAN METODE OPTICAL CHARACTER RECOGNITION (OCR),” Jurnal Informatika dan Teknik Elektro Terapan, vol. 11, no. 1, Jan. 2023, doi: 10.23960/jitet.v11i1.2897.

N. O’Mahony et al., “Deep Learning vs. Traditional Computer Vision,” in Advances in Intelligent Systems and Computing, Springer Verlag, 2020, pp. 128–144. doi: 10.1007/978-3-030-17795-9_10.

A. R. Youssef, A. A. Ali, and F. R. Sayed, “Real-time Egyptian License Plate Detection and Recognition using YOLO,” International Journal of Advanced Computer Science and Applications, vol. 13, no. 7, 2022, doi: 10.14569/IJACSA.2022.0130799.

A. Naureen, K. C. Krishna, N. S. Teja, L. Mahesh, and K. Vamshi, “College Bus Number Plate Registration Detection Using YOLO-V8,” in 2023 International Conference on Evolutionary Algorithms and Soft Computing Techniques, EASCT 2023, Institute of Electrical and Electronics Engineers Inc., 2023. doi: 10.1109/EASCT59475.2023.10392472.

I. Nurhaida, I. Nududdin, and D. Ramayanti, “Indonesian license plate recognition with improved horizontal-vertical edge projection,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 21, no. 2, p. 811, Feb. 2021, doi: 10.11591/ijeecs.v21.i2.pp811-821.

F. Al-Islama, A. Putra, A. Rizki Jatmiko, D. M. Putri, and A. H. Al-Fath, “Vehicle Licence Number Plate Recognition Using Convolution Neural Network for Traffic Violators in Indonesia,” Inform : Jurnal Ilmiah Bidang Teknologi Informasi dan Komunikasi, vol. 9, no. 2, 2024, doi: 10.25139/inform.v9i2.8449.

I. M. Nadif and K. Kusrini, “License Plate Localization and Character Recognition using YOLOv8 and Convolutional Neural Network,” in 2023 Eighth International Conference on Informatics and Computing (ICIC), IEEE, Dec. 2023, pp. 1–6. doi: 10.1109/ICIC60109.2023.10382046.

A. Meirza and N. R. Puteri, “Implementasi Metode YOLOV5 dan Tesseract OCR untuk Deteksi Plat Nomor Kendaraan,” Jurnal Ilmu Komputer dan Desain Komunikasi Visual, vol. 9, no. 1, pp. 424–435, 2024.

T. Gorak and Dr. C. K. Kumar Reddy, “HELMET AND NUMBER PLATE DETECTION USING YOLOV5 AND YOLOV8,” International Jour-nal of Interpreting Enigma Engineers, vol. 01, no. 04, pp. 14–22, 2024, doi: 10.62674/ijiee.2024.v1i04.003.

R. Rai, S. Shitole, P. Sutar, S. Kaldhone, and J. D. Jadhav, “Automatic License Plate Recognition Using YOLOv4 and Tesseract OCR,” Article in International Journal of Innovative Research in Computer and Communication Engineering, vol. 10, no. 3, pp. 1656–1661, 2022, doi: 10.15680/IJIRCCE.2022.1003089.

H. Fakhrurroja, D. Pramesti, A. R. Hidayatullah, A. A. Fashihullisan, H. Bangkit, and N. Ismail, “Automated License Plate Detection and Recognition using YOLOv8 and OCR With Tello Drone Camera,” in 2023 International Conference on Computer, Control, Informatics and its Applications (IC3INA), IEEE, Oct. 2023, pp. 206–211. doi: 10.1109/IC3INA60834.2023.10285750.

O. G. Ajayi, P. O. Ibrahim, and O. S. Adegboyega, “Effect of Hyperparameter Tuning on the Performance of YOLOv8 for Multi Crop Classification on UAV Images,” Applied Sciences (Switzerland), vol. 14, no. 13, pp. 1–19, Jul. 2024, doi: 10.3390/app14135708.

M. Yaseen, “What is YOLOv8: An In-Depth Exploration of the Internal Features of the Next-Generation Object Detector,” pp. 1–10, Aug. 2024.

P. Hidayatullah, N. Syakrani, M. R. Sholahuddin, T. Gelar, and R. Tubagus, “YOLOv8 to YOLO11: A Comprehensive Architecture In-depth Com-parative Review,” pp. 1–22, Jan. 2025.

R. Alfinnur Charisma, “Modified YOLOv5-based License Plate Detection: an Efficient Approach for Automatic Vehicle Identification,” International Journal of Computing and Digital Systems, vol. 20, pp. 2210–142, 2024, doi: 10.12785/ijcds/XXXXXX.

O. O. Patience, E. M. Amaechi, O. George, and O. N. Isaac, “Enhanced Text Recognition in Images Using Tesseract OCR within the Laravel Frame-work,” Asian Journal of Research in Computer Science, vol. 17, no. 9, pp. 58–69, Sep. 2024, doi: 10.9734/ajrcos/2024/v17i9499.

D. Angelika Mulia, S. Safitri, and I. Gede Putra Kusuma Negara, “YOLOv8 and Faster R-CNN Performance Evaluation with Super-resolution in License Plate Recognition,” International Journal of Computing and Digital Systems, vol. 15, no. 1, pp. 365–375, Jul. 2024, doi: 10.12785/ijcds/160129.

Y. O. L. Rema, “Deteksi Plat Nomor Kendaraan Bermotor dengan Segmentasi Gambar,” Jurnal Saintek Lahan Kering, vol. 2, no. 1, pp. 20–23, Jun. 2019, doi: 10.32938/slk.v2i1.794.

H. Kurniawan and E. I. Sela, “Indonesian Vehicle License Plate Identification Using YoloV5 and OCR,” Jurnal Info Sains : Informatika dan Sains, vol. 13, no. 3, pp. 913–920, 2023, [Online]. Available: http://ejournal.seaninstitute.or.id/index.php/InfoSains

G. H. Yun, S. J. Oh, and S. C. Shin, “Image preprocessing method in radiographic inspection for automatic detection of ship welding defects,” Ap-plied Sciences (Switzerland), vol. 12, no. 1, pp. 1–17, Jan. 2022, doi: 10.3390/app12010123.

Yovi Apridiansyah, Rozali Toyib, and Ardi Wijaya, “Metode Otsu dan Mathematical Morphology Dalam Segmentasi Region Karakter Plat Nomor Kendaraan,” Journal of Applied Computer Science and Technology, vol. 3, no. 1, pp. 134–143, Jun. 2022, doi: 10.52158/jacost.v3i1.277.

M. H. Rezaei, “Ultra-Fast Detection of Loosened Bolts Based on Binary Image Processing,” Research in Medical & Engineering Sciences, vol. 9, no. 3, pp. 1010–1014, Jul. 2021, doi: 10.31031/rmes.2021.09.000713.

N. Plavac, S. A. Amirshahi, M. Pedersen, and S. Triantaphillidou, “Performance of Automatic License Plate Recognition Systems on Distorted Imag-es,” Journal of Imaging Science and Technology, vol. 68, no. 6, pp. 1–16, Nov. 2024, doi: 10.2352/J.ImagingSci.Technol.2024.68.6.060401.

R. A. Tavares, “Comparison of Image Preprocessing Techniques for Vehicle License Plate Recognition Using OCR: Performance and Accuracy Evalu-ation,” Oct. 2024, [Online]. Available: http://arxiv.org/abs/2410.13622




DOI: https://doi.org/10.29100/jipi.v11i2.7930

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika)
ISSN 2540-8984
Published by
Prodi Pendidikan Teknologi Informasi
Universitas Bhinneka PGRI

Website :https://jurnal.stkippgritulungagung.ac.id/index.php/jipi/index
Email: jipistkippti@gmail.com

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.