Table 2 Results of the VQA usability evaluation
From: The LRA Workbench: an IDE for efficient REST API composition through linked metadata
Criterion | Question | VQA | YASGUI | p-value |
|---|---|---|---|---|
Time (s) | 1 | 156 | 729 | 0.0017 |
2 | 204 | 1077 | 0.0162 | |
3 | 334 | 842 | 0.0250 | |
4 | 193 | 518 | 0.0282 | |
5 | 119 | 534 | 0.0083 | |
Average | 201 | 740 | 0.0048 | |
F-measure | 1 | 1.000 | 0.857 | 0.3559 |
2 | 1.000 | 0.833 | 0.1723 | |
3 | 0.750 | 0.555 | 0.2274 | |
4 | 0.888 | 0.422 | 0.2033 | |
5 | 1.000 | 0.666 | 0.0781 | |
Average | 0.927 | 0.695 | 0.0978 | |
Num. Attempts | 1 | 1.000 | 4.571 | 0.0323 |
2 | 1.000 | 11.857 | 0.0111 | |
3 | 1.125 | 9.285 | 0.0151 | |
4 | 1.625 | 3.857 | 0.2033 | |
5 | 1.125 | 8.000 | 0.0690 | |
Average | 1.175 | 7.257 | 0.0048 | |
SUS | Average | 79.062 | 55.357 | 0.0015 |