Examining characteristics of predictive models with imbalanced big data

Hasanin, Tawfiq; Khoshgoftaar, Taghi M.; Leevy, Joffrey L.; Seliya, Naeem

doi:10.1186/s40537-019-0231-2

Journal of Big Data

Table 6 Tukey HSD test—POST dataset

From: Examining characteristics of predictive models with imbalanced big data

Factor	Level	\(\text {TPR}\times \text {TNR}\)	std	r	g	Min	Max	Q25	Q50	Q75
(a) GBT
Features	5	0.8221	0.0290	60	a	0.7704	0.8832	0.8012	0.8216	0.8465
	10	0.7962	0.2166	60	a	0.0007	0.8770	0.8515	0.8649	0.8695
	36	0.6233	0.3508	60	b	0.0007	0.8775	0.4310	0.8123	0.8609
	20	0.6156	0.3175	60	b	0.0007	0.8747	0.4633	0.8113	0.8631
	ALL	0.6106	0.3169	60	b	0.0007	0.8767	0.4643	0.8051	0.8229
Ratio	(40:60)	0.8279	0.1223	50	a	0.0007	0.8702	0.8297	0.8580	0.8621
	(45:55)	0.8097	0.1392	50	ab	0.1436	0.8832	0.8052	0.8599	0.8642
	(50:50)	0.7888	0.1904	50	ab	0.0009	0.8730	0.8063	0.8427	0.8652
	(65:35)	0.6885	0.2965	50	bc	0.0007	0.8775	0.7819	0.8130	0.8696
	(75:25)	0.5719	0.3179	50	cd	0.0009	0.8770	0.4638	0.7714	0.8535
	(90:10)	0.4746	0.3716	50	d	0.0007	0.8232	0.0007	0.6310	0.8223
(b) RF
Features	10	0.7333	0.3314	60	a	0	0.9062	0.8410	0.8789	0.8820
	20	0.5812	0.3864	60	b	0	0.9073	0.0866	0.8195	0.8787
	36	0.5708	0.3953	60	b	0	0.8808	0.0009	0.8195	0.8787
	ALL	0.4589	0.4047	60	c	0	0.8808	0.0007	0.8144	0.8225
	5	0.3107	0.4161	60	d	0	0.8969	0	0	0.8711
Ratio	(75:25)	0.8542	0.0314	50	a	0.8085	0.9073	0.8193	0.8714	0.8788
	(40:60)	0.6997	0.3375	50	b	0	0.8796	0.8221	0.8789	0.8791
	(90:10)	0.6720	0.3623	50	b	0	0.9062	0.8193	0.8195	0.8967
	(45:55)	0.6618	0.3559	50	b	0	0.8793	0.8220	0.8224	0.8789
	(50:50)	0.2034	0.3628	50	c	0	0.8820	0.0007	0.0009	0.1291
	(65:35)	0.0947	0.2122	50	d	0	0.8232	0	0	0.0422
(c) LR
Features	5	0.8569	0.1071	60	a	0.0537	0.8793	0.8771	0.8774	0.8788
	10	0.4892	0.3586	60	b	0.0007	0.8225	0.1767	0.7910	0.8213
	20	0.4750	0.3690	60	b	0.0007	0.8798	0.1748	0.3254	0.8675
	ALL	0.4241	0.3607	60	b	0.0007	0.8796	0.1749	0.1767	0.8333
	36	0.4188	0.3579	60	b	0.0007	0.9521	0.1679	0.1823	0.8333
Ratio	(45:55)	0.6420	0.3207	50	a	0.1747	0.8796	0.1754	0.8442	0.8749
	(40:60)	0.6218	0.3240	50	a	0.1455	0.8785	0.1771	0.8440	0.8745
	(65:35)	0.6122	0.3345	50	a	0.0007	0.8792	0.1768	0.8215	0.8771
	(50:50)	0.5740	0.3375	50	a	0.1458	0.9521	0.1751	0.8209	0.8754
	(75:25)	0.4818	0.3684	50	a	0.0007	0.8793	0.1459	0.5450	0.8221
	(90:10)	0.2649	0.3677	50	b	0.0007	0.8769	0.0007	0.0007	0.8086

Back to article page