Journal of Big Data

Table 8 Personality prediction result using Twitter dataset

From: Text based personality prediction from multiple social media data sources using pre-trained language model and model averaging

Traits	Metric	System Baseline
Traits	Metric	BERT	RoBERTa	XLnet	BERT + NLP Features	RoBERTa + NLP Features	XLNet + NLP Features	Proposed Model
Openness	Accuracy	67.41%	66.38%	66.94%	69.28%	68.88%	69.85%	70.85%
Openness	F1 Measure	0.702	0.691	0.697	0.723	0.718	0.729	0.740
Conscientiousness	Accuracy	81.76%	81.44%	81.24%	85.64%	85.86%	85.77%	88.49%
Conscientiousness	F1 Measure	0.613	0.612	0.608	0.675	0.677	0.679	0.736
Extraversion	Accuracy	78.31%	77.80%	78.26%	78.99%	79.51%	79.50%	81.17%
Extraversion	F1 Measure	0.863	0.860	0.862	0.867	0.871	0.871	0.882
Agreeableness	Accuracy	65.30%	65.14%	65.40%	70.39%	69.01%	68.44%	69.33%
Agreeableness	F1 Measure	0.694	0.695	0.694	0.744	0.731	0.723	0.734
Neuroticism	Accuracy	70.74%	70.47%	71.51%	73.57%	73.76%	73.99%	75.08%
Neuroticism	F1 Measure	0.631	0.632	0.643	0.673	0.677	0.679	0.694
Average	Accuracy	72.70%	72.25%	72.67%	75.57%	75.40%	75.51%	77.34%
Average	F1 Measure	0.701	0.698	0.701	0.736	0.735	0.736	0.760

The highest performance value resulting from each of the personalities listed in bold

Back to article page