Skip to main content
Journal of Big Data

Table 7 Personality prediction result using Facebook dataset

From: Text based personality prediction from multiple social media data sources using pre-trained language model and model averaging

Traits Metric System baseline
BERT RoBERTa XLnet BERT + NLP features RoBERTa + NLP features XLNet + NLP features Proposed model
Openness Accuracy 83.87% 81.11% 81.51% 84.68% 84.01% 84.35% 86.17%
F1 Measure 0.897 0.878 0.879 0.902 0.898 0.899 0.912
Conscientiousness Accuracy 68.96% 69.43% 69.64% 70.04% 69.70% 70.04% 70.85%
F1 Measure 0.545 0.561 0.566 0.613 0.615 0.615 0.652
Extraversion Accuracy 73.14% 72.33% 72.27% 74.76% 75.44% 75.51% 76.92%
F1 Measure 0.742 0.705 0.707 0.736 0.739 0.735 0.748
Agreeableness Accuracy 64.71% 65.32% 67.00% 70.11% 70.51% 72.33% 71.59%
F1 Measure 0.617 0.620 0.641 0.680 0.676 0.701 0.690
Neuroticism Accuracy 71.79% 71.05% 70.24% 73.08% 74.29% 73.75% 78.21%
F1 Measure 0.637 0.621 0.621 0.658 0.675 0.667 0.709
Average Accuracy 72.50% 71.85% 72.13% 74.53% 74.79% 75.20% 77.34%
F1 Measure 0.688 0.677 0.683 0.718 0.720 0.723 0.749
  1. The highest performance value resulting from each of the personalities listed in bold
Back to article page