Survey on deep learning with class imbalance

Journal of Big Data

Table 16 CRL with CelebA Data (Balanced Accuracy) [118]

	Attractive	Mouth open	Smiling	Wear lipstick	High cheekbones	Male	Heavy makeup	Wavy hair	Oval face	Pointy nose	Arched eyebrows	Black hair	Big lips	Big nose	Young	Straight hair	Brown hair	Bags under eyes	Wear earings	No beard	Bangs
Imbalance (1:x)	1	1	1	1	1	1	2	2	3	3	3	3	3	3	4	4	4	4	4	5	6
Triplet-kNN	83	92	92	91	86	91	88	77	61	61	73	82	55	68	75	63	76	63	69	82	81
PANDA	85	93	98	97	89	99	95	78	66	67	77	84	56	72	78	66	85	67	77	87	92
ANet	87	96	97	95	89	99	96	81	67	69	76	90	57	78	84	69	83	70	83	93	90
DeepID2	78	89	89	92	84	94	88	73	63	66	77	83	62	73	76	65	79	74	75	88	91
Over-sampling	77	89	90	92	84	95	87	70	63	67	79	84	61	73	75	66	82	73	76	88	90
Down-sampling	78	87	90	91	80	90	89	70	58	63	70	80	61	76	80	61	76	71	70	88	88
Cost-sensitive	78	89	90	91	85	93	89	75	64	65	78	85	61	74	75	67	84	74	76	88	90
Threshold-Adj	69	89	88	89	83	95	89	77	72	72	76	86	66	76	24	73	81	76	76	15	93
LMLE-kNN	88	96	99	99	92	99	98	83	68	72	79	92	60	80	87	73	87	73	83	96	98
CRL	81	94	92	95	87	98	90	79	66	71	80	88	67	77	83	72	84	79	84	93	95

	Blond hair	Bushy eyebrows	Wear necklace	Narrow eyes	5 o’clock shadow	Receding hairline	Wear necktie	Eyeglasses	Rosy cheeks	Goatee	Chubby	Sideburns	Blurry	Wear hat	Double chin	Pale skin	Gray hair	Mustache	Bald	Mean
Imbalance (1:x)	6	6	7	8	8	11	13	14	14	15	16	17	18	19	20	22	23	24	43
Triplet-kNN	81	68	50	47	66	60	73	82	64	73	64	71	43	84	60	63	72	57	75	72
PANDA	91	74	51	51	76	67	85	88	68	84	65	81	50	90	64	69	79	63	74	77
ANet	90	82	59	57	81	70	79	95	76	86	70	79	56	90	68	77	85	61	73	80
DeepID2	90	78	70	64	85	81	83	92	86	90	81	89	74	90	83	81	90	88	93	81
Over-sampling	90	80	71	65	85	82	79	91	90	89	83	90	76	89	84	82	90	90	92	82
Down-sampling	85	75	66	61	82	79	80	85	82	85	78	80	68	90	80	78	88	60	79	78
Cost-sensitive	89	79	71	65	84	81	82	91	92	86	82	90	76	90	84	80	90	88	93	82
Threshold-Adj	92	84	62	71	82	83	76	95	82	89	81	89	78	95	83	85	91	86	93	79
LMLE-kNN	99	82	59	59	82	76	90	98	78	95	79	88	59	99	74	80	91	73	90	84
CRL	95	84	73	73	89	88	87	99	90	95	87	95	86	99	89	92	96	93	99	87

Bold-italic and italic scores indicate best and second best class scores, respectively