A new feature popularity framework for detecting cyberattacks using popular features

Zuech, Richard; Hancock, John; Khoshgoftaar, Taghi M.

doi:10.1186/s40537-022-00661-9

Journal of Big Data

Table 13 Classification performance for 4 feature popularity lists (plus all features), 3 web attacks, and 5 classifiers

From: A new feature popularity framework for detecting cyberattacks using popular features

	Brute force (web)		SQL injection (web)		XSS (web)
CatBoost
FST	AUC	SD AUC	AUC	SD AUC	AUC	SD AUC
All Features	0.93277	0.00920	0.90008	0.02382	0.93743	0.01432
2/3 & 4/7 Agree	0.91121	0.01242	0.87876	0.03297	0.92574	0.01290
2/3 & 5/7 Agree	0.91121	0.01322	0.86604	0.02766	0.92791	0.01226
3/3 & 4/7 Agree	0.88749	0.01398	0.87531	0.03579	0.92627	0.01420
3/3 & 5/7 Agree	0.88858	0.01770	0.87057	0.03077	0.92167	0.01696
Decision Tree
FST	AUC	SD AUC	AUC	SD AUC	AUC	SD AUC
All Features	0.92252	0.01355	0.90876	0.03032	0.93830	0.01244
2/3 & 4/7 Agree	0.90346	0.01235	0.91000	0.02972	0.93417	0.01456
2/3 & 5/7 Agree	0.91178	0.01391	0.91206	0.03209	0.94020	0.01389
3/3 & 4/7 Agree	0.87643	0.01820	0.91527	0.03260	0.93716	0.01701
3/3 & 5/7 Agree	0.87384	0.01813	0.91334	0.03429	0.93335	0.01301
LightGBM
FST	AUC	SD AUC	AUC	SD AUC	AUC	SD AUC
All Features	0.93863	0.00975	0.93499	0.03401	0.94622	0.01416
2/3 & 4/7 Agree	0.93511	0.01052	0.91610	0.03595	0.94354	0.01320
2/3 & 5/7 Agree	0.93536	0.01078	0.90934	0.03810	0.94191	0.01491
3/3 & 4/7 Agree	0.93379	0.01159	0.90404	0.04282	0.94170	0.01360
3/3 & 5/7 Agree	0.93652	0.01084	0.91161	0.04016	0.94166	0.01347
Random Forest
FST	AUC	SD AUC	AUC	SD AUC	AUC	SD AUC
All Features	0.93945	0.00910	0.91773	0.02602	0.94216	0.01316
2/3 & 4/7 Agree	0.93799	0.00944	0.91105	0.03448	0.94455	0.01214
2/3 & 5/7 Agree	0.93441	0.01089	0.90349	0.03102	0.94036	0.01592
3/3 & 4/7 Agree	0.92851	0.01070	0.89572	0.03404	0.94274	0.01418
3/3 & 5/7 Agree	0.92106	0.01235	0.90950	0.02971	0.93966	0.01546
XGBoost
FST	AUC	SD AUC	AUC	SD AUC	AUC	SD AUC
All Features	0.93668	0.00891	0.89892	0.04456	0.93581	0.01363
2/3 & 4/7 Agree	0.92197	0.01063	0.89720	0.03518	0.92918	0.01379
2/3 & 5/7 Agree	0.92613	0.01357	0.90861	0.03699	0.94058	0.01425
3/3 & 4/7 Agree	0.91230	0.01552	0.90421	0.03625	0.93121	0.01521
3/3 & 5/7 Agree	0.91188	0.01677	0.90233	0.03867	0.92933	0.01460

Bold values indicate the best AUC score for each web attack and FST.

Back to article page