Skip to main content

Table 7 Wilcoxon signed-rank test results for the Hypert and BERT models with 10 iterations

From: Hypert: hypernymy-aware BERT with Hearst pattern exploitation for hypernym discovery

 

Subtask

Evaluation

measures

BERT model

Hypert model

versus

(p-value)

1A

MRR

Win

(2.73e–2)

MAP

Win

(6.40e–2)

P@1

Win

(5.85e–3)

P@3

Win

(8.39e–2)

P@5

Win

(1.30e–1)

P@15

Win

(4.88e–2)

2A

MRR

Win

(1.93e–1)

MAP

Win

(1.93e–1)

P@1

Win

(1.38e–1)

P@3

Win

(4.92e–1)

P@5

Win

(4.92e–1)

P@15

Win

(4.88e–2)

2B

MRR

Win

(4.88e–2)

MAP

Win

(9.76e–3)

P@1

Win

(6.44e–2)

P@3

Win

(3.90e–3)

P@5

Win

(1.36e–2)

P@15

Win

(3.90e–3)

  1. At the significance level of \(\alpha =0.05\) (\(\textit{p}\)-values in parentheses)