Publication Type

Journal Article

Journal Name

Heliyon

Publication Date

2-15-2025

Abstract

The study focusses on handling of multiclass imbalanced data on classification of stingless bee samples by employing data balancing techniques, namely Synthetic Minority Oversampling Technique (SMOTE) and Adaptive Synthetic (ADASYN) approach. These techniques are applied in combination with machine learning (ML) algorithms; specifically Random Forest (RF), and Support Vector Machine (SVM), to assess the models’ predictive performance to infer stingless bee samples identities. We studied ML classifier models: RF, RF + SMOTE, RF + ADASYN, SVM, SVM + SMOTE and SVM + ADASYN on the six-class imbalanced dataset of stingless bees morphometrics. Multi-class area under curve (AUC), F1-score, G-mean, balanced accuracy, sensitivity and “No information rate” were used to assess model performance. SMOTE and ADASYN marginally improved the performance of RF and SVM classifiers. SVM outperformed RF, with SVM using SMOTE performing better than with ADASYN. SVM with ADASYN had a lower multi-class AUC (0.9898) and sensitivity (0.956) but a higher F1-score (0.939) compared to SVM with SMOTE (AUC = 0.9918, sensitivity = 0.959, F1-score = 0.934). Overall, SVM with SMOTE was superior to RF with SMOTE. All models except SVM with ADASYN, correctly classified four of the six species, M. (Meliponula) bocandei, M. (Meliplebeia) lendliana, D. schmidti and P. armata but not the two morphs, Meliponula (Axestotrigona) togoensis and Meliponula (Axestotrigona) ferruginea. This study therefore confirms that the impact of imbalanced learning is minimal when classes are separable. Random forest recursive feature elimination technique was used to assess variable importance, guiding future studies on key morphometric measurements to save time and cost while maintaining high classification performance. Our results pave the way for the development of smart and automated machine learning applications to complement the existing methods for the identification of stingless bee species.

Keywords

ADASYN, Imbalanced data, Random forest, SMOTE, Stingless bees, SVM

Share

COinS
 
 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.