Algorithms | Imbalanced class technique | SMOTE | ADASYN | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Dataset | Training | Testing | Training | Testing | |||||||||||||||
Performance measures | Mean accuracy | SD | Range | Accuracy | Sensitivity | Precision | F1-score | SP | NPV | Mean accuracy | SD | Range | Accuracy | Sensitivity | Precision | F1-score | SP | NPV | |
Logistic regression | 0.89 | 0.033 | 0.84–0.96 | 0.84 | 0.67 | 0.30 | 0.41 | 0.85 | 0.97 | 0.88 | 0.047 | 0.82–0.97 | 0.91 | 0.67 | 0.47 | 0.55 | 0.93 | 0.97 | |
Linear SVM | 0.89 | 0.036 | 0.85–0.96 | 0.82 | 0.83 | 0.29 | 0.44 | 0.82 | 0.98 | 0.88 | 0.04 | 0.81–0.95 | 0.94 | 0.67 | 0.62 | 0.64 | 0.96 | 0.97 | |
RBF-Kernel SVM | 0.91 | 0.039 | 0.83–0.97 | 0.87 | 0.50 | 0.33 | 0.40 | 0.91 | 0.95 | 0.91 | 0.025 | 0.87–0.95 | 0.90 | 0.42 | 0.42 | 0.42 | 0.95 | 0.95 | |
Random forest | 0.83 | 0.034 | 0.77–0.88 | 0.96 | 0.58 | 0.88 | 0.70 | 0.99 | 0.96 | 0.81 | 0.055 | 0.75–0.91 | 0.88 | 0.67 | 0.38 | 0.49 | 0.90 | 0.97 | |
Decision tree | 0.91 | 0.045 | 0.83–0.98 | 0.91 | 0.50 | 0.46 | 0.48 | 0.95 | 0.95 | 0.92 | 0.032 | 0.87–0.97 | 0.90 | 0.67 | 0.42 | 0.52 | 0.92 | 0.97 | |
Gradient boosting | 0.90 | 0.040 | 0.85–0.97 | 0.86 | 0.83 | 0.36 | 0.50 | 0.86 | 0.98 | 0.87 | 0.035 | 0.82–0.94 | 0.94 | 0.75 | 0.64 | 0.69 | 0.96 | 0.98 | |
kNN | 0.90 | 0.035 | 0.82–0.96 | 0.87 | 0.42 | 0.29 | 0.35 | 0.91 | 0.94 | 0.92 | 0.032 | 0.85–0.98 | 0.89 | 0.33 | 0.33 | 0.33 | 0.94 | 0.94 | |
MLP-BP | 0.86 | 0.038 | 0.80–0.91 | 0.90 | 0.75 | 0.43 | 0.55 | 0.91 | 0.98 | 0.83 | 0.067 | 0.68–0.89 | 0.90 | 0.75 | 0.42 | 0.55 | 0.91 | 0.98 | |
LDA | 0.85 | 0.036 | 0.80–0.91 | 0.83 | 0.67 | 0.28 | 0.39 | 0.84 | 0.96 | 0.87 | 0.066 | 0.75–0.96 | 0.89 | 0.58 | 0.39 | 0.47 | 0.92 | 0.96 |