Traits | Metric | System baseline | ||||||
---|---|---|---|---|---|---|---|---|
BERT | RoBERTa | XLnet | BERT + NLP features | RoBERTa + NLP features | XLNet + NLP features | Proposed model | ||
Openness | Accuracy | 83.87% | 81.11% | 81.51% | 84.68% | 84.01% | 84.35% | 86.17% |
F1 Measure | 0.897 | 0.878 | 0.879 | 0.902 | 0.898 | 0.899 | 0.912 | |
Conscientiousness | Accuracy | 68.96% | 69.43% | 69.64% | 70.04% | 69.70% | 70.04% | 70.85% |
F1 Measure | 0.545 | 0.561 | 0.566 | 0.613 | 0.615 | 0.615 | 0.652 | |
Extraversion | Accuracy | 73.14% | 72.33% | 72.27% | 74.76% | 75.44% | 75.51% | 76.92% |
F1 Measure | 0.742 | 0.705 | 0.707 | 0.736 | 0.739 | 0.735 | 0.748 | |
Agreeableness | Accuracy | 64.71% | 65.32% | 67.00% | 70.11% | 70.51% | 72.33% | 71.59% |
F1 Measure | 0.617 | 0.620 | 0.641 | 0.680 | 0.676 | 0.701 | 0.690 | |
Neuroticism | Accuracy | 71.79% | 71.05% | 70.24% | 73.08% | 74.29% | 73.75% | 78.21% |
F1 Measure | 0.637 | 0.621 | 0.621 | 0.658 | 0.675 | 0.667 | 0.709 | |
Average | Accuracy | 72.50% | 71.85% | 72.13% | 74.53% | 74.79% | 75.20% | 77.34% |
F1 Measure | 0.688 | 0.677 | 0.683 | 0.718 | 0.720 | 0.723 | 0.749 |