Journal of Big Data

Table 13 Transformer Models

From: Adapting transformer-based language models for heart disease detection and risk factors extraction

Model/risk factor	BERT	BioBERT	BioClinical Bert	RoBERTa	XLNET
Diabetes	0.82	0.83	0.80	0.75	0.75
Hypertension	0.90	0.91	0.92	0.92	0.91
CAD	0.77	0.78	0.79	0.71	0.77
Medication	0.77	0.80	0.80	0.80	0.81
Smoker	0.88	0.90	0.94	0.90	0.90
Obese	0.81	0.81	0.71	0.70	0.74
Hyperlipidemia	0.78	0.80	0.83	0.75	0.77
FamilyHist	0.88	0.88	0.88	0.88	0.88
F-score (micro)	0.9373	0.9399	0.9403	0.9427	0.9397

Back to article page