Skip to main content

Table 7 Personality prediction result using Facebook dataset

From: Text based personality prediction from multiple social media data sources using pre-trained language model and model averaging

Traits

Metric

System baseline

BERT

RoBERTa

XLnet

BERT + NLP features

RoBERTa + NLP features

XLNet + NLP features

Proposed model

Openness

Accuracy

83.87%

81.11%

81.51%

84.68%

84.01%

84.35%

86.17%

F1 Measure

0.897

0.878

0.879

0.902

0.898

0.899

0.912

Conscientiousness

Accuracy

68.96%

69.43%

69.64%

70.04%

69.70%

70.04%

70.85%

F1 Measure

0.545

0.561

0.566

0.613

0.615

0.615

0.652

Extraversion

Accuracy

73.14%

72.33%

72.27%

74.76%

75.44%

75.51%

76.92%

F1 Measure

0.742

0.705

0.707

0.736

0.739

0.735

0.748

Agreeableness

Accuracy

64.71%

65.32%

67.00%

70.11%

70.51%

72.33%

71.59%

F1 Measure

0.617

0.620

0.641

0.680

0.676

0.701

0.690

Neuroticism

Accuracy

71.79%

71.05%

70.24%

73.08%

74.29%

73.75%

78.21%

F1 Measure

0.637

0.621

0.621

0.658

0.675

0.667

0.709

Average

Accuracy

72.50%

71.85%

72.13%

74.53%

74.79%

75.20%

77.34%

F1 Measure

0.688

0.677

0.683

0.718

0.720

0.723

0.749

  1. The highest performance value resulting from each of the personalities listed in bold