Table 2 Performance comparison of different feature selection methods on eight datasets
Dataset | Method | Evaluation criteria | ||
|---|---|---|---|---|
SVM | NB | DT | ||
SPECTF | LS | 75.87(1.78) | 76.79(1.84) | 76.88(1.19) |
GCNC | 77.32(0.35) | 78.18(1.05) | 77.07(1.92) | |
FGUFS | 78.68(0.83) | 78.19(2.15) | 76.23(2.08) | |
FS | 77.83(2.32) | 73.83(0.92) | 69.25(1.78) | |
FAST | 78.91(1.24) | 76.78(0.25) | 73.18(1.60) | |
FJMI | 79.08(2.18) | 78.29(1.45) | 74.22(2.43) | |
PCA | 75.56(1.98) | 75.72(1.83) | 77.81(1.71) | |
PCFS | 79.41(0.92) | 78.10(0.31) | 78.94(1.04) | |
SpamBase | LS | 85.69(0.17) | 75.63(0.12) | 75.71(1.15) |
GCNC | 88.27(1.19) | 88.11(0.75) | 88.96(1.09) | |
FGUFS | 88.63(1.16) | 87.71(2.37) | 86.71(1.35) | |
FS | 86.23(0.08) | 86.42(3.89) | 86.49(2.81) | |
FAST | 87.47(1.87) | 80.50(4.14) | 88.88(1.93) | |
FJMI | 86.89(3.21) | 86.97(3.44) | 87.35(2.36) | |
PCA | 87.17(1.13) | 84.12(0.75) | 83.66(1.11) | |
PCFS | 90.06(1.28) | 90.76(2.34) | 88.46(1.63) | |
Sonar | LS | 79.21(1.38) | 69.42(0.94) | 79.09(1.94) |
GCNC | 82.33(2.52) | 74.36(2.48) | 78.72(1.65) | |
FGUFS | 80.34(1.34) | 75.73(1.84) | 79.96(1.42) | |
FS | 73.81(1.89) | 73.31(3.06) | 73.76(0.54) | |
FAST | 75.95(0.98) | 72.52(1.51) | 73.24(2.73) | |
FJMI | 77.31(0.66) | 75.96(1.16) | 78.68(1.83) | |
PCA | 77.20(1.38) | 68.42(2.31) | 79.35(1.84) | |
PCFS | 81.81(2.09) | 77.28(1.88) | 80.89(2.42) | |
Arrhythmia | LS | 56.78(2.34) | 56.36(3.24) | 57.49(3.24) |
GCNC | 58.18(1.28) | 59.04(2.30) | 58.99(2.43) | |
FGUFS | 59.37(1.26) | 59.37(1.67) | 57.81(2.12) | |
FS | 52.89(0.25) | 59.34(4.81) | 54.15(2.68) | |
FAST | 57.74(3.56) | 52.72(4.33) | 57.33(1.24) | |
FJMI | 59.09(1.84) | 58.74(3.22) | 59.56(3.16) | |
PCA | 56.72(2.67) | 55.31(3.54) | 57.40(3.92) | |
PCFS | 61.61(2.34) | 58.28(0.25) | 59.34(2.76) | |
Madelon | LS | 65.76(1.27) | 61.88(2.80) | 64.48(2.28) |
GCNC | 66.56(1.38) | 62.68(2.32) | 63.68(2.48) | |
FGUFS | 67.78(2.15) | 63.55(1.76) | 65.79(2.13) | |
mRMR | 76.82(1.81) | 73.15(2.14) | 71.38(2.14) | |
FAST | 71.43(1.24) | 73.35(2.48) | 70.91(1.94) | |
FJMI | 77.12(3.02) | 72.28(1.12) | 71.44(2.54) | |
PCA | 66.72(1.47) | 62.58(2.66) | 67.18(2.32) | |
PCFS | 78.76(1.67) | 76.24(3.08) | 64.82(1.92) | |
Isolet | LS | 83.78(1.08) | 83.61(1.22) | 82.72(2.42) |
GCNC | 88.58(2.29) | 82.78(2.42) | 81.29(3.39) | |
FGUFS | 91.74(3.08) | 86.66(1.82) | 84.44(2.56) | |
FS | 87.95(2.21) | 75.41(0.27) | 75.58(1.31) | |
FAST | 84.28(2.48) | 81.25(0.78) | 80.49(3.16) | |
FJMI | 91.16(1.48) | 88.92(1.92) | 81.08(2.88) | |
PCA | 64.71(1.83) | 61.81(2.89) | 63.48(2.21) | |
PCFS | 93.55(2.75) | 87.06(1.39) | 87.55(1.80) | |
Multiple features | LS | 91.36(0.13) | 91.43(0.12) | 90.62(0.12) |
GCNC | 91.81(2.26) | 88.78(1.02) | 92.55(0.54) | |
FGUFS | 92.21(1.24) | 89.93(1.35) | 92.79(2.38) | |
FS | 94.78(0.11) | 92.32(1.42) | 92.15(1.20) | |
FAST | 94.91(1.91) | 92.48(1.95) | 92.59(2.67) | |
FJMI | 95.82(0.64) | 93.28(3.14) | 93.04(2.05) | |
PCA | 92.29(1.64) | 89.82(1.98) | 91.78(2.42) | |
PCFS | 94.87(0.25) | 94.90(2.68) | 93.14(2.45) | |
Colon | LS | 74.10(1.18) | 73.82(1.67) | 76.03(2.48) |
GCNC | 75.17(1.76) | 76.53(1.21) | 76.47(3.38) | |
FGUFS | 78.23(2.23) | 75.91(2.34) | 77.96(1.22) | |
FS | 72.31(3.92) | 69.15(2.26) | 72.61(2.21) | |
FAST | 74.11(1.71) | 73.26(3.52) | 71.83(1.65) | |
FJMI | 82.37(4.04) | 76.58(2.09) | 81.48(1.72) | |
PCA | 76.12(1.54) | 76.43(1.51) | 76.42(2.12) | |
PCFS | 83.19(2.32) | 79.24(3.01) | 81.92 (1.33) | |