Table 2 Raw annotation results per observer
From: Understanding big data themes from scientific biomedical literature through topic modeling
Topic | Theme assignment grouped by observer | ||||||
|---|---|---|---|---|---|---|---|
A | B | C | D | E | F | G | |
1 | Imp, value | Value | App, imp, value | Vera, value | imp, app, vera | Imp, value | |
2 | Vera, app | Imp, app | Info, app | Vera, velo | App | Tech, variety, vera | |
3 | Imp, app | App | App | ||||
4 | Met | Met | Vol, met | Met | Tech, met | Tech, velo | Met |
5 | Vol, velo, beyond | Tech | Vol, tech, beyond | Beyond, vol, velo | Tech, complex, beyond | Vol | Vol |
6 | Tech | Tech | Tech, velo | Tech, beyond | Tech, beyond | Tech | Tech, variety, vera |
7 | Met | Met | Vera, met | Met | Tech, met, info, app | Met | Met |
8 | App | App | Info, app | App, info | App | App | Variety, app |
9 | App | Imp | Imp | Imp | Value, imp, app | ||
10 | App | Met, tech | Variety, info, met | App, met | App | App, variety, info | Vol, beyond |
11 | App | App | App | App, Imp | App | App | Imp, value |
12 | Tech, vol, velo | Vol | Vol, velo | Vol, velo, beyond | Tech, vol, velo | Vol, velo | Met, vol |
13 | Variability, vera | Met | Met | Met | App, info | Met | Met |
14 | Info | Info | Tech, app | App, info | Imp | Info | Value, imp, app |
15 | Imp | App | Imp | App | Info, app | App, imp | Value, vera |
16 | App | Met | App | Info, app | Info, app | App | Beyond, vol |
17 | Value | Info | Tech, beyond | Info | Continuity, variability | Tech | Value, tech |
18 | App | Met | Info | App, info | Met, app, tech, info | App | Vol, vera |
19 | Value | App | Met, app | Info | Continuity, app | Variety | Tech, imp |
20 | Met | Met | Met | Met | Met, info | Met | Met |
21 | App | App | App | App, imp | Info, app | App | Variety, app, vera |
22 | Info, velo | Info | Info, app | Info, vera | Velo, continuity, app | App, info | Info |
23 | Info, app | App | Info, app | Info | Info | App, info | Beyond, vol, vera, info |
24 | Value | App | Info, app | Info, app | Continuity, info, imp | App | Vol, variety |
25 | Met | Met | Info | Info, met, tech | Vol, velo | Velo | |
Total | 33 | 22 | 39 | 40 | 53 | 35 | 49 |