From: Survey of transformers and towards ensemble learning using transformers for natural language processing
Model
BERT
XLNet
GPT2
RoBERTa
ALBERT
Accuracy
0.19635
0.15068
0.36986
0.17351
0.36073