Real-Time Packaging Quality Inspection and Sorting Using YOLOv8 and ESP32-Based IoT Integration

DOI: https://doi.org/10.33650/jeecom.v8i2.17208
Authors

(1)  Muhammad Arya Saputra   (Universitas Negeri Surabaya)  
        Indonesia
(2) * As'ad Shidqy Aziz   (Universitas Negeri Surabaya)  
        Indonesia
(*) Corresponding Author

Abstract


Manual product inspection and sorting in small and medium-sized enterprises (SMEs) are often slow and error-prone, whereas conventional computer vision systems require expensive infrastructure. This study proposes a low-cost, real-time packaging inspection and sorting system utilizing YOLOv8 integrated with an ESP32 microcontroller. The proposed closed-loop architecture combines object detection, servo-based actuation, and dual data logging via LCD, Blynk IoT, and Google Sheets, alongside end-to-end latency characterization. The dataset used consists of 1,510 packaging images annotated into two classes: Good Product and Damaged Product. Five dataset-splitting scenarios were evaluated using the early stopping method, with performance assessed based on precision, recall, mAP50, and mAP50-95 metrics. The optimal configuration achieved 99.32% accuracy and an mAP50 of 97.6%, with zero false negatives across 292 test samples. The measured response time was approximately 0.51 seconds, providing a real-time margin of 1.40 seconds at a conveyor speed of 30 RPM. Physical sorting achieved success rates of 86% for Damaged Products and 96% for Good Products, while data logging achieved 100% transmission success. These findings demonstrate that the YOLOv8–ESP32–IoT integration is a viable solution for low-cost, real-time packaging inspection and sorting, although mechanical factors remain crucial and further validation at an industrial scale is required.

Keywords

YOLOv8;ESP32;Internet of Things;Product Inspection;Real-Time System



Full Text: PDF



References


C. M. Badgujar, A. Poulose, and H. Gan, "Agricultural object detection with You Only Look Once (YOLO) Algorithm: A bibliometric and systematic literature review," Comput. Electron. Agric., vol. 223, no. May, 2024, doi: 10.1016/j.compag.2024.109090.

D. Saha, M. Padhiary, and N. Chandrakar, "AI vision and machine learning for enhanced automation in food industry: A systematic review," Food Humanit., vol. 4, p. 100587, May 2025, doi: 10.1016/j.foohum.2025.100587.

W. Xie et al., "Towards high-accuracy digital detection in meter images: The ASS-YOLO algorithm and Dig21000 dataset," Neurocomputing, vol. 647, no. May, p. 130606, 2025, doi: 10.1016/j.neucom.2025.130606.

H. Li, J. Huang, Z. Gu, D. He, J. Huang, and C. Wang, "Positioning of mango picking point using an improved YOLOv8 architecture with object detection and instance segmentation," Biosyst. Eng., vol. 247, no. April, pp. 202–220, 2024, doi: 10.1016/j.biosystemseng.2024.09.015.

X. Li, M. Hu, B. Li, and R. Tong, "OAM-YOLO: A real-time small object detection framework for PPE compliance monitoring in industrial environments," Process Saf. Approximately. Prot., vol. 204, no. May, p. 108058, 2025, doi: 10.1016/j.psep.2025.108058.

V. U. Chandra Bodempudi et al., "Salmonella risk prediction in poultry farms via deep learning image classification Models, Cross-Region Validation, and edge computing," Comput. Electron. Agric., vol. 252, no. June, p. 112116, 2026, doi: 10.1016/j.compag.2026.112116.

Sandhya and A. Kashyap, "A novel method for real-time object-based copy-move tampering localization in videos using fine-tuned YOLO V8," Forensic Sci. Int. Digit. Do your research., vol. 48, no. December 2023, p. 301663, Mar. 2024, doi: 10.1016/j.fsidi.2023.301663.

R. E. Wibisono et al., "Motorcycle Parking Availability Monitoring Using YOLOv5 and Mobile-Based Systems," Bull. Ilm. Serj. Tek. Electrical, vol. 8, no. 3, pp. 638–653, 2026, doi: 10.12928/biste.v8i3.16087.

B. Ma et al., "Using an improved lightweight YOLOv8 model for real-time detection of multi-stage apple fruit in complex orchard environments," Artif. Intell. Agric., vol. 11, pp. 70–82, 2024, doi: 10.1016/j.aiia.2024.02.001.

S. Kumari et al., "YOLO-DwSimAM: An improved YOLOv11 network for insect-pest detection in rice crop," Neurocomputing, vol. 698, no. June, p. 134315, 2026, doi: 10.1016/j.neucom.2026.134315.

C. C. Kuo et al., "SE-ATT-YOLO- A deep learning driven ultrasound based respiratory motion compensation system for precision radiotherapy," Comput. Biol. Med., vol. 195, no. June, p. 110638, 2025, doi: 10.1016/j.compbiomed.2025.110638.

Y. Zhou and Z. Zhao, "MPA-YOLO: Steel surface defect detection based on improved YOLOv8 framework," Pattern Recognit., vol. 168, no. April, p. 111897, 2025, doi: 10.1016/j.patcog.2025.111897.

H. Wang and H. Qian, "SDG-YOLOv8: Single-domain generalized object detection based on domain diversity in traffic road scenes," Displays, vol. 87, no. January, p. 102948, 2025, doi: 10.1016/j.displa.2024.102948.

Y. Chen et al., "Guided feature learning network focusing on spatial and frequency domains for real-time small object detection," Eng. Appl. Art. Intell., vol. 181, no. P4, p. 115386, 2026, doi: 10.1016/j.engappai.2026.115386.

P. P. Das, T. Ganguly, R. Chaudhuri, and S. Deb, "YOLO-D: A Domain Adaptive approach towards low light object detection," Computational procedure. Sci., vol. 258, pp. 3042–3051, 2025, doi: 10.1016/j.procs.2025.04.562.

L. J. Liu, S. Q. Sun, and H. R. Karimi, "A real-time surface defect detection model based on adaptive feature information selection and fusion," Inf. Fusion, vol. 129, no. June 2025, p. 104041, 2026, doi: 10.1016/j.inffus.2025.104041.

R. Ranjan, "YOLO in precision aquaculture: A decadal bibliometric and systematic review of applications, architectural adaptations, and deployment challenges," J. Agric. Food Res., vol. 28, p. 102982, 2026, doi: 10.1016/j.jafr.2026.102982.

Y. M. Abdal, A. H. Ali, and O. N. M. Salim, "IoT-enabled monitoring, fuzzy control, and LSTM-based temperature forecasting for smart hydroponic greenhouses," Smart Agric. Technol., vol. 15, no. May, p. 102432, 2026, doi: 10.1016/j.atech.2026.102432.

A. Martikkala, J. David, A. Lobov, M. Lanz, and I. F. Ituarte, "Trends for low-cost and open-source IoT solutions development for industry 4.0," Manuf Procedia., vol. 55, no. C, pp. 298–305, 2021, doi: 10.1016/j.promfg.2021.10.042.

V. Moya, M. Guerra, K. Pazmiño, F. Abedrabbo, F. A. Chicaiza, and D. Pozo-Espín, "Tomato classification with YOLOv8: Enhancing automated sorting and quality assessment," Smart Agric. Technol., vol. 12, no. August, p. 101221, 2025, doi: 10.1016/j.atech.2025.101221.

Belinda Ayuningtyas, Riesa Syariful Akbar, Syaeful Ilman, R. Rustandi, and N. Nurudin, "Prototype of an IoT-Based Height Sorting Conveyor using ESP32, HC-SR04, and IR Sensors," J. Ilm. Tek., vol. 5, no. 1, pp. 223–237, 2026, doi: 10.56127/juit.v5i1.2532.

V. Lakshmi Chetana, V. Srilakshmi, and S. Arukonda, "YOLOv8-Based Real-Time Traffic Sign Detection for Intelligent Transportation Systems," Computational procedure. Sci., vol. 283, pp. 1876–1886, 2026, doi: 10.1016/j.procs.2026.06.262.

P. Dong, Y. Wang, Q. Yu, W. Feng, and G. Zong, "AMC-YOLO: Improved YOLOv8-based defect detection for cigarette packs," IET Image Process., vol. 18, no. 14, pp. 4873–4886, 2024, doi: 10.1049/ipr2.13272.

F. Pan, J. Li, Y. Yan, S. Guan, B. Biswal, and Y. Zhao, "Enhanced surface defect detection of cylinder liners using Swin Transformer and YOLOv8," J. Autom. Intell., vol. 4, no. 3, pp. 227–235, 2025, doi: 10.1016/j.jai.2025.01.004.

C. Agnew, E. M. Grua, P. Van de Ven, P. Denny, C. Eising, and A. Scanlan, "Pretraining instance segmentation models with bounding box annotations," Intell. Syst. with Appl., vol. 24, no. September, p. 200454, 2024, doi: 10.1016/j.iswa.2024.200454.

M. Chaman, A. El Maliki, H. Dahou, and A. Hadjoudja, "Benchmarking YOLO-based deep learning models for real-time object detection in hybrid ADAS and intelligent transportation systems," Results Eng., vol. 29, no. December 2025, p. 108942, 2026, doi: 10.1016/j.rineng.2025.108942.

Y. Zhou, X. Xu, W. Fan, and Z. H. Jiang, "YOLO-DFW: An improved detection method for printed circuit board surface defects based on YOLOv8," Displays, vol. 91, no. April 2025, p. 103201, 2026, doi: 10.1016/j.displa.2025.103201.

M. Ashourpour and G. Azizpour, "Edge-Deployed Deep Learning for Automated Quality Control in Industrial Assembly: A Case Study in Real-Time Defect Detection," CIRP Procedure, vol. 134, pp. 735–740, 2025, doi: 10.1016/j.procir.2025.02.180.

A. A. Murat and M. S. Kiran, "A comprehensive review on YOLO versions for object detection," Eng. Sci. Technol. an Int. J., vol. 70, no. January, 2025, doi: 10.1016/j.jestch.2025.102161.

W. Luo and S. Yuan, "Enhanced YOLOv8 for small-object detection in multiscale UAV imagery: Innovations in detection accuracy and efficiency," Digit. Signal Process. A Rev. J., vol. 158, no. December 2024, p. 104964, 2025, doi: 10.1016/j.dsp.2024.104964.

P. Vasanthi and L. Mohan, "Efficient YOLOv8 algorithm for extreme small-scale object detection," Digit. Signal Process. A Rev. J., vol. 154, no. July, p. 104682, 2024, doi: 10.1016/j.dsp.2024.104682.

T. T. H. Vu, D. L. Pham, and T. W. Chang, "A YOLO-based Real-time Packaging Defect Detection System," Computational procedure. Sci., vol. 217, no. 2022, pp. 886–894, 2022, doi: 10.1016/j.procs.2022.12.285.

G. Liu, S. Zhang, L. Wang, X. Li, and G. Li, "Research on mechanical automatic food packaging defect detection model based on improved YOLOv5 algorithm," PLoS One, vol. 20, no. 4 April, pp. 1–28, 2025, doi: 10.1371/journal.pone.0321971.

L. Malburg, M. P. Rieder, R. Seiger, P. Klein, and R. Bergmann, "Object detection for smart factory processes by machine learning," Computational procedure. Sci., vol. 184, no. 2019, pp. 581–588, 2021, doi: 10.1016/j.procs.2021.04.009.

B. I. Oladapo et al., "Model design and simulation of automatic sorting machine using proximity sensor," Eng. Sci. Technol. an Int. J., vol. 19, no. 3, pp. 1452–1456, 2016, doi: 10.1016/j.jestch.2016.04.007.

W. Tan, Q. Duan, L. Yao, and J. Li, "A sensor combination based automatic sorting system for waste washing machine parts," Resour. Conserved. Recycling., vol. 181, no. November 2021, p. 106270, 2022, doi: 10.1016/j.resconrec.2022.106270.

P. Dera, T. Talaśka, and R. Długosz, "A new, cost-efficient modular sensor platform for IoT and predictive maintenance in industrial applications," J. Comput. Appl. Math., vol. 473, no. December 2024, p. 116777, 2026, doi: 10.1016/j.cam.2025.116777.

A. Mumuni and F. Mumuni, "Data augmentation: A comprehensive survey of modern approaches," Array, vol. 16, no. November, p. 100258, 2022, doi: 10.1016/j.array.2022.100258.

M. F. A. Sayeedi, A. M. I. M. Osmani, T. Rahman, J. F. Deepti, R. Rahman, and S. Islam, "ElectroCom61: A multiclass dataset for detection of electronic components," Data Br., vol. 59, p. 111331, 2025, doi: 10.1016/j.dib.2025.111331.

M. J. A. Rafi, M. Rony, and N. Majadi, "NSTU-BDTAKA: An open dataset for Bangladeshi paper currency detection and recognition," Data Br., vol. 55, p. 110701, 2024, doi: 10.1016/j.dib.2024.110701.

H. Assemlali, S. Bouhsissin, and N. Sael, "Deep learning-driven CNN model for detection and classification of dynamic obstacles," Green Energy Intell. Transp., vol. 5, no. 3, p. 100334, 2026, doi: 10.1016/j.geits.2025.100334.

C. Newman, J. Petzing, Y. M. Goh, and L. Justham, "Investigating the optimisation of real-world and synthetic object detection training datasets through the consideration of environmental and simulation factors," Intell. Syst. with Appl., vol. 14, 2022, doi: 10.1016/j.iswa.2022.200079.

S. Or et al., "How improper dataset split hinders model generalizability: a systematic comparison in Human activity recognition and exercise evaluation tasks," Int. J. Med. Inform., vol. 216, no. April, p. 106464, 2026, doi: 10.1016/j.ijmedinf.2026.106464.

M. Vilares Ferro, Y. Doval Mosquera, F. J. Ribadas Pena, and V. M. Darriba Bilbao, "Early stopping by correlating online indicators in neural networks," Neural Networks, vol. 159, pp. 109–124, 2023, doi: 10.1016/j.neunet.2022.11.035.

R. Sapkota, D. Ahmed, and M. Karkee, "Comparing YOLOv8 and Mask R-CNN for instance segmentation in complex orchard environments," Artif. Intell. Agric., vol. 13, pp. 84–99, 2024, doi: 10.1016/j.aiia.2024.07.001.

Y. Gui, X. Xiao, Y. Fu, and M. Yao, "A local training paradigm for YOLO models to enhance tiny object detection," Results Eng., vol. 29, no. October 2025, p. 109835, 2026, doi: 10.1016/j.rineng.2026.109835.

M. Shaloo, G. Princz, R. Hörbe, and S. Erol, "Flexible automation of quality inspection in parts assembly using CNN-based machine learning," Computational procedure. Sci., vol. 232, pp. 2921–2932, 2024, doi: 10.1016/j.procs.2024.02.108.

X. Zhu, M. Björkman, A. Maki, L. Hanson, and P. Mårtensson, "Surface Defect Detection with Limited Training Data: A Case Study on Crown Wheel Surface Inspection," CIRP Procedure, vol. 120, pp. 1333–1338, 2023, doi: 10.1016/j.procir.2023.09.172.

J. Tie et al., "LSKA-YOLOv8: A lightweight steel surface defect detection algorithm based on YOLOv8 improvement," Alexandria Eng. J., vol. 109, no. September, pp. 201–212, 2024, doi: 10.1016/j.aej.2024.08.087.

Mr. Caballero-Ramírez et al., "Deep learning-based detection of wine bottle capsules for contamination prevention," Results Eng., vol. 27, no. March, 2025, doi: 10.1016/j.rineng.2025.106388.


Dimensions, PlumX, and Google Scholar Metrics

10.33650/jeecom.v8i2.17208


Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Muhammad Arya Saputra, As'ad Shidqy Aziz

 
This work is licensed under a Creative Commons Attribution License (CC BY-SA 4.0)

Journal of Electrical Engineering and Computer (JEECOM)
Published by LP3M Nurul Jadid University, Indonesia, Probolinggo, East Java, Indonesia.