Penerapan SMOTE pada Algoritma LightGBM dan XGBoost untuk Klasifikasi Penyakit Diabetes
DOI:
https://doi.org/10.47065/jieee.v5i4.2593Keywords:
Diabetes Mellitus; Classification; LightGBM; XGBoost; SMOTE; Mutual InformationAbstract
Diabetes mellitus is a chronic metabolic disease whose prevalence continues to increase worldwide and is often diagnosed late owing to insufficient recognition of its early symptoms. One of the major challenges in diabetes classification using machine learning is class imbalance in the dataset, which may cause the model to disproportionately favor the majority class and consequently compromise its capacity to accurately identify diabetic patients. Accordingly, this research seeks to compare the classification effectiveness of Light Gradient Boosting Machine (LightGBM) and Extreme Gradient Boosting (XGBoost) algorithms combined with the Artificial Minority Oversampling Approach (SMOTE) applied to diabetes classification task. The study utilized the Pima Indians Diabetes Dataset consisting of 768 instances and 8 attributes and followed the Machine Learning Life Cycle (MLLC), including exploratory data analysis, MinMax Scaler normalization, feature selection using Mutual Information, class imbalance handling with SMOTE, model training, and evaluation using accuracy, precision, recall, F1-score, and ROC-AUC as quantitative measures. Analysis of the results demonstrates that the application of SMOTE significantly improved the performance of both models. LightGBM with SMOTE achieved the best performance, with an accuracy of 85.33%, precision of 81.55%, recall of 91.33%, F1-score of 86.16%, and ROC-AUC of 90.49%, while XGBoost with SMOTE achieved an accuracy of 83.00%, precision of 79.64%, recall of 88.67%, F1-score of 83.91%, and ROC-AUC of 90.04%. These findings demonstrate that the combination of LightGBM and SMOTE is more effective than XGBoost in detecting diabetes cases and holds considerable promise for deployment as a clinical decision-making tool in early diabetes screening.
Downloads
References
H. Guo, H. Wu, and Z. Li, “The Pathogenesis of Diabetes,” Int. J. Mol. Sci., vol. 24, no. 8, pp. 0–23, 2023, doi: 10.3390/ijms24086978.
J. Harreiter and M. Roden, “Diabetes mellitus: definition, classification, diagnosis, screening and prevention (Update 2023),” Wien. Klin. Wochenschr., vol. 135, pp. 7–17, 2023, doi: 10.1007/s00508-022-02122-y.
International Diabetes Federation, “IDF Diabetes Atlas,” Brussels, 2025. [Online]. Available: https://diabetesatlas.org/resources/idf-diabetes-atlas-2025/
H. Guan et al., “Advances in secondary prevention mechanisms of macrovascular complications in type 2 diabetes mellitus patients: a comprehensive review,” Eur. J. Med. Res., vol. 29, no. 1, pp. 1–34, 2024, doi: 10.1186/s40001-024-01739-1.
X. An et al., “Early effective intervention can significantly reduce all-cause mortality in prediabetic patients: a systematic review and meta-analysis based on high-quality clinical studies,” Front. Endocrinol. (Lausanne)., vol. 15, no. March, 2024, doi: 10.3389/fendo.2024.1294819.
K. S?kowski, J. Grudzi??-S?kowska, J. Pinkas, and M. Jankowski, “Public knowledge and awareness of diabetes mellitus, its risk factors, complications, and prevention methods among adults in Poland—A 2022 nationwide cross-sectional survey,” Frontiers in Public Health, vol. 10, 2022, Art. no. 1029358, doi: 10.3389/fpubh.2022.1029358
K. Dulyapach, P. Ngamchaliew, P. Vichitkunakorn, P. Sornsenee, and K. Choomalee, “Prevalence and Associated Factors of Delayed Diagnosis of Type 2 Diabetes Mellitus in a Tertiary Hospital: A Retrospective Cohort Study,” Int. J. Public Health, vol. 67, no. November, pp. 1–9, 2022, doi: 10.3389/ijph.2022.1605039.
A. Mulyani, S. Khoerunisa, and D. Kurniadi, “Comparison of KNN and SVM Algorithms Performance Using SMOTE to Classify Diabetes,” Jurnal Nasional Teknik Elektro dan Teknologi Informasi, vol. 14, no. 1, pp. 25–34, 2025, doi: 10.22146/jnteti.v14i1.15198.
W. H. G. Cheng et al., “Non-Laboratory-Based Risk Prediction Tools for Undiagnosed Pre-Diabetes: A Systematic Review,” Diagnostics, vol. 13, no. 7, 2023, doi: 10.3390/diagnostics13071294.
F. Mohsen, H. R. H. Al-Absi, N. A. Yousri, N. El Hajj, and Z. Shah, “A scoping review of artificial intelligence-based methods for diabetes risk prediction,” npj Digit. Med., vol. 6, no. 1, pp. 1–15, 2023, doi: 10.1038/s41746-023-00933-5.
S. G. Choi et al., “Comparisons of the prediction models for undiagnosed diabetes between machine learning versus traditional statistical methods,” Sci. Rep., vol. 13, no. 1, pp. 1–11, 2023, doi: 10.1038/s41598-023-40170-0.
Z. Rozikin and J. J. Hidayat, “Perbandingan Metode Oversampling SMOTE dan ADASYN pada Klasifikasi Diabetes Menggunakan Algoritma CatBoost,” J. Manaj. Inform. Teknol., vol. 6, no. 1, pp. 151–164, 2026, doi: 10.51903/mifortekh.v6i1.1157.
I. Abousaber, H. F. Abdallah, and H. El-Ghaish, “Robust predictive framework for diabetes classification using optimized machine learning on imbalanced datasets,” Front. Artif. Intell., vol. 7, 2024, doi: 10.3389/frai.2024.1499530.
H. Hairani, T. Widiyaningtyas, and D. D. Prasetya, “Addressing Class Imbalance of Health Data: a Systematic Literature Review on Modified Synthetic Minority Oversampling Technique (SMOTE) Strategies,” Int. J. Informatics Vis., vol. 8, no. 3, pp. 1310–1318, 2024, doi: 10.62527/joiv.8.3.2283.
D. Elreedy, A. F. Atiya, and F. Kamalov, “A theoretical distribution analysis of synthetic minority oversampling technique ( SMOTE ) for imbalanced learning,” Mach. Learn., vol. 113, no. 7, pp. 4903–4923, 2024, doi: https://doi.org/10.1007/s10994-022-06296-4.
Y. Xie and S. P. Tummala, “Machine Learning for Sensor Analytics: A Comprehensive Review and Benchmark of Boosting Algorithms in Healthcare, Environmental, and Energy Applications,” Sensors, vol. 25, no. 23, 2025, doi: 10.3390/s25237294.
S. M. Ganie, P. K. D. Pramanik, M. Bashir Malik, S. Mallik, and H. Qin, “An ensemble learning approach for diabetes prediction using boosting techniques,” Front. Genet., vol. 14, no. October, pp. 1–15, 2023, doi: 10.3389/fgene.2023.1252159.
S. Masood, M. A. Al-Bashrawi, M. A. Khan, and Y. K. Dwivedi, “From data to diagnosis: a systematic review on AI-driven approaches to diabetes prediction,” Artif. Intell. Rev., vol. 59, no. 3, 2026, doi: 10.1007/s10462-025-11485-3.
H. M. Jumasa, “Model Predictive Analytics Terhadap Pasien Diabetes Menggunakan Exploratory Data Analysis dan Algoritma Random Forest,” INTEK: J. Inform. dan Teknol. Inform., vol. 6, no. 2, pp. 44–50, Nov. 2023, doi: 10.37729/intek.v6i2.3867.
K. Li and N. Fard, “A Novel Nonparametric Feature Selection Approach Based on Mutual Information Transfer Network,” Entropy, vol. 24, no. 9, 2022, doi: 10.3390/e24091255.
A. K. Tiwari, R. Saini, A. Nath, P. Singh, and M. A. Shah, “Hybrid similarity relation based mutual information for feature selection in intuitionistic fuzzy rough framework and its applications,” Sci. Rep., pp. 1–21, 2024, doi: 10.1038/s41598-024-55902-z.
Y. Chen, J. Zou, L. Liu, and C. Hu, “Improved Oversampling Algorithm for Imbalanced Data Based on K-Nearest Neighbor and Interpolation Process Optimization,” Symmetry, vol. 16, no. 3, Art. no. 273, 2024, doi: 10.3390/sym16030273..
N. Altwaijry, “Probability-Based Synthetic Minority Oversampling Technique,” IEEE Access, vol. 11, pp. 28831–28839, 2023, doi: 10.1109/ACCESS.2023.3260723.
SAS Institute Inc., SAS Data Surveyor for User ’ s Guide. 2026.
N. Gunasekara, B. Pfahringer, H. Gomes, and A. Bifet, “Gradient boosted trees for evolving data streams,” Mach. Learn., vol. 113, no. 5, pp. 3325–3352, 2024, doi: 10.1007/s10994-024-06517-y.
D. Boldini, F. Grisoni, D. Kuhn, L. Friedrich, and S. A. Sieber, “Practical guidelines for the use of gradient boosting for molecular property prediction,” J. Cheminform., pp. 1–13, 2023, doi: 10.1186/s13321-023-00743-7.
F. E. P. Nadya, M. F. I. Ferdiansyah, V. R. S. Nastiti, and C. S. K. Aditya, “Implementation of Feature Selection Strategies to Enhance Classification Using XGBoost and Decision Tree,” Scientific Journal of Informatics, vol. 11, no. 1, pp. 187–194, 2024, doi: 10.15294/sji.v11i1.48145.
P. B. Khokhar, C. Gravino, and F. Palomba, “Advances in artificial intelligence for diabetes prediction: insights from a systematic literature review,” Artif. Intell. Med., vol. 164, no. September 2024, p. 103132, 2025, doi: 10.1016/j.artmed.2025.103132.
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Penerapan SMOTE pada Algoritma LightGBM dan XGBoost untuk Klasifikasi Penyakit Diabetes
ARTICLE HISTORY
Issue
Section
Copyright (c) 2026 Regita Audyna Siregar, Solikhun Solikhun, Timbo Faritcan P. Siallagan
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
