Skip to main content

Table 3 Comparison of ClusTop algorithm against various baselines, in terms of Precision (Pre), Recall (Rec) and F-score (FS) for the top 5 keywords/unigrams of each topic

From: A clustering-based topic model using word networks and word embeddings

Algorithm

Precision

Recall

F-score

Precision

Recall

F-score

Precision

Recall

F-score

Rank@5

ClusTop-Word-NA

.754 ± .002 (22)

.031 ± .000 (6)

.059 ± .000 (6)

.866 ± .003 (21)

.043 ± .000 (5)

.082 ± .001 (5)

.840 ± .009 (18)

.027 ± .001 (7)

.052 ± .001 (7)

(10.8)

ClusTop-BiG-NA

.786 ± .002 (18)

.034 ± .000 (2)

.064 ± .000 (2)

.857 ± .003 (22)

.046 ± .000 (2)

.086 ± .001 (2)

.833 ± .010 (20)

.029 ± .001 (4)

.056 ± .001 (3)

(8.3)

ClusTop-TriG-NA

.791 ± .002 (17)

.034 ± .000 (2)

.064 ± .000 (2)

.871 ± .003 (20)

.046 ± .000 (2)

.087 ± .001 (1)

.822 ± .009 (21)

.031 ± .001 (2)

.058 ± .001 (2)

(7.7)

ClusTop-BiHa-NA

.784 ± .002 (19)

.032 ± .000 (4)

.060 ± .000 (4)

.886 ± .003 (18)

.045 ± .000 (4)

.084 ± .001 (4)

.820 ± .009 (22)

.029 ± .001 (4)

.055 ± .001 (5)

(9.3)

ClusTop-Hash-NA

.898 ± .004 (10)

.023 ± .000 (21)

.044 ± .000 (18)

.916 ± .007 (13)

.032 ± .001 (17)

.062 ± .001 (17)

.936 ± .011 (8)

.022 ± .000 (17)

.042 ± .001 (18)

(15.4)

ClusTop-Noun-NA

.761 ± .002 (21)

.028 ± .000 (8)

.054 ± .000 (8)

.836 ± .003 (24)

.043 ± .000 (5)

.081 ± .001 (6)

.888 ± .008 (14)

.032 ± .001 (1)

.062 ± .001 (1)

(9.8)

ClusTop-H2VG-NA

.924 ± .003 (3)

.023 ± .000 (21)

.045 ± .000 (17)

.978 ± .004 (2)

.032 ± .001 (17)

.062 ± .001 (17)

.976 ± .007 (4)

.023 ± .001 (14)

.044 ± .001 (14)

(12.1)

ClusTop-H2VW-NA

.906 ± .001 (9)

.023 ± .001 (21)

.023 ± .001 (22)

.963 ± .001 (6)

.028 ± .001 (20)

.028 ± .001 (20)

.986 ± .001 (1)

.019 ± .001 (23)

.019 ± .001 (23)

(16.1)

ClusTop-H2VF-NA

.910 ± .001 (7)

.025 ± .001 (15)

.025 ± .001 (19)

.960 ± .001 (7)

.029 ± .001 (19)

.029 ± .001 (19)

.955 ± .001 (6)

.019 ± .001 (23)

.019 ± .001 (23)

(15.3)

ClusTop-Word-AH

.741 ± .003 (24)

.025 ± .000 (15)

.049 ± .000 (13)

.845 ± .005 (23)

.040 ± .000 (9)

.075 ± .001 (9)

.844 ± .010 (17)

.027 ± .001 (7)

.052 ± .001 (7)

(13.8)

ClusTop-Hash-AH

.847 ± .002 (12)

.026 ± .000 (12)

.051 ± .000 (12)

.912 ± .004 (15)

.046 ± .001 (2)

.086 ± .001 (2)

.896 ± .008 (12)

.024 ± .000 (12)

.046 ± .001 (13)

(10.2)

ClusTop-Noun-AH

.802 ± .002 (16)

.024 ± .000 (18)

.046 ± .000 (16)

.873 ± .004 (19)

.037 ± .000 (13)

.071 ± .001 (13)

.872 ± .008 (15)

.029 ± .001 (4)

.056 ± .001 (3)

(13.0)

ClusTop-H2VG-AH

.919 ± .002 (5)

.025 ± .000 (15)

.049 ± .000 (13)

.902 ± .003 (16)

.042 ± .000 (7)

.080 ± .001 (7)

.891 ± .008 (13)

.025 ± .001 (10)

.048 ± .001 (11)

(10.8)

ClusTop-H2VW-AH

.927 ± .001 (1)

.023 ± .001 (21)

.023 ± .001 (22)

.972 ± .001 (4)

.028 ± .001 (20)

.028 ± .001 (20)

.979 ± .001 (3)

.020 ± .001 (21)

.020 ± .001 (21)

(14.8)

ClusTop-H2VF-AH

.918 ± .001 (6)

.025 ± .001 (15)

.025 ± .001 (19)

.965 ± .001 (5)

.027 ± .001 (23)

.027 ± .001 (23)

.948 ± .001 (7)

.021 ± .001 (19)

.021 ± .001 (19)

(15.1)

ClusTop-Word-AM

.748 ± .001 (23)

.034 ± .000 (2)

.065 ± .000 (1)

.929 ± .003 (11)

.036 ± .000 (15)

.069 ± .001 (15)

.758 ± .016 (24)

.022 ± .000 (17)

.043 ± .001 (16)

(13.8)

ClusTop-Hash-AM

.763 ± .002 (20)

.027 ± .000 (10)

.052 ± .000 (10)

.917 ± .003 (12)

.037 ± .000 (13)

.072 ± .001 (12)

.869 ± .011 (16)

.024 ± .000 (12)

.047 ± .001 (12)

(13.0)

ClusTop-Noun-AM

.842 ± .002 (13)

.025 ± .000 (15)

.048 ± .000 (15)

.950 ± .003 (9)

.039 ± .000 (10)

.074 ± .001 (10)

.923 ± .009 (9)

.022 ± .000 (17)

.043 ± .001 (16)

(12.7)

ClusTop-H2VG-AM

.864 ± .002 (11)

.028 ± .000 (8)

.054 ± .000 (8)

.930 ± .003 (10)

.041 ± .000 (8)

.078 ± .001 (8)

.900 ± .008 (10)

.025 ± .000 (10)

.049 ± .001 (9)

(9.1)

ClusTop-H2VW-AM

.924 ± .001 (3)

.023 ± .001 (21)

.023 ± .001 (22)

.976 ± .001 (3)

.027 ± .001 (23)

.027 ± .001 (23)

.981 ± .001 (2)

.020 ± .001 (21)

.020 ± .001 (21)

(15.4)

ClusTop-H2VF-AM

.910 ± .001 (7)

.022 ± .001 (24)

.022 ± .001 (24)

.985 ± .001 (1)

.027 ± .001 (23)

.027 ± .001 (23)

.971 ± .001 (5)

.020 ± .001 (21)

.020 ± .001 (21)

(16.6)

LDA-Orig

.925 ± .001 (2)

.027 ± .000 (10)

.052 ± .000 (10)

.956 ± .002 (8)

.037 ± .000 (13)

.070 ± .001 (14)

.898 ± .010 (11)

.025 ± .000 (10)

.049 ± .001 (9)

(9.7)

LDA-Hash

.821 ± .002 (15)

.031 ± .000 (6)

.059 ± .000 (6)

.916 ± .003 (13)

.036 ± .000 (15)

.069 ± .001 (15)

.837 ± .010 (19)

.028 ± .001 (6)

.054 ± .001 (6)

(11.2)

LDA-Ment

.830 ± .002 (14)

.031 ± .000 (6)

.060 ± .000 (4)

.900 ± .003 (17)

.039 ± .000 (10)

.074 ± .001 (10)

.814 ± .018 (23)

.023 ± .000 (14)

.044 ± .001 (14)

(12.4)

Algorithm

Precision

Recall

F-score

Precision

Recall

F-score

Precision

Recall

F-score

Rank@10

ClusTop-Word-NA

.690 ± .002 (24)

.033 ± .000 (7)

.062 ± .000 (7)

.804 ± .003 (20)

.051 ± .000 (3)

.095 ± .001 (3)

.764 ± .010 (22)

.033 ± .001 (6)

.062 ± .001 (6)

(10.9)

ClusTop-BiG-NA

.707 ± .002 (22)

.035 ± .000 (2)

.065 ± .000 (2)

.789 ± .004 (22)

.052 ± .000 (2)

.096 ± .001 (2)

.765 ± .010 (20)

.035 ± .001 (3)

.067 ± .002 (2)

(8.6)

ClusTop-TriG-NA

.717 ± .002 (21)

.034 ± .000 (4)

.064 ± .000 (4)

.811 ± .003 (19)

.053 ± .000 (1)

.098 ± .001 (1)

.746 ± .010 (23)

.036 ± .001 (1)

.068 ± .001 (1)

(8.3)

ClusTop-BiHa-NA

.719 ± .002 (20)

.034 ± .000 (4)

.064 ± .000 (4)

.782 ± .004 (24)

.051 ± .000 (3)

.095 ± .001 (3)

.765 ± .010 (20)

.035 ± .001 (3)

.065 ± .001 (3)

(9.3)

ClusTop-Hash-NA

.860 ± .004 (8)

.023 ± .000 (24)

.045 ± .000 (17)

.896 ± .008 (9)

.032 ± .001 (17)

.061 ± .001 (17)

.925 ± .012 (8)

.022 ± .000 (18)

.043 ± .001 (18)

(15.1)

ClusTop-Noun-NA

.736 ± .002 (16)

.033 ± .000 (7)

.062 ± .000 (7)

.803 ± .003 (21)

.049 ± .000 (5)

.091 ± .001 (5)

.802 ± .009 (16)

.035 ± .001 (3)

.065 ± .001 (3)

(9.2)

ClusTop-H2VG-NA

.904 ± .004 (3)

.024 ± .000 (21)

.046 ± .000 (16)

.973 ± .004 (1)

.032 ± .001 (17)

.061 ± .001 (17)

.964 ± .008 (3)

.023 ± .001 (16)

.044 ± .001 (16)

(12.2)

ClusTop-H2VW-NA

.894 ± .001 (5)

.026 ± .001 (17)

.026 ± .001 (22)

.944 ± .001 (4)

.029 ± .001 (20)

.029 ± .001 (20)

.983 ± .001 (1)

.020 ± .001 (23)

.020 ± .001 (23)

(15.0)

ClusTop-H2VF-NA

.892 ± .001 (6)

.026 ± .001 (17)

.026 ± .001 (22)

.931 ± .001 (8)

.029 ± .001 (20)

.029 ± .001 (20)

.943 ± .001 (7)

.021 ± .001 (20)

.021 ± .001 (20)

(15.6)

ClusTop-Word-AH

.692 ± .003 (23)

.025 ± .000 (19)

.049 ± .000 (14)

.784 ± .004 (23)

.043 ± .000 (8)

.080 ± .001 (8)

.778 ± .010 (18)

.030 ± .001 (8)

.057 ± .001 (8)

(14.3)

ClusTop-Hash-AH

.833 ± .002 (11)

.027 ± .000 (12)

.051 ± .000 (13)

.842 ± .004 (15)

.041 ± .000 (11)

.078 ± .001 (11)

.857 ± .009 (12)

.025 ± .000 (13)

.048 ± .001 (13)

(12.3)

ClusTop-Noun-AH

.735 ± .002 (17)

.024 ± .000 (21)

.045 ± .000 (17)

.827 ± .004 (17)

.041 ± .000 (11)

.076 ± .001 (14)

.828 ± .009 (13)

.031 ± .001 (7)

.059 ± .001 (7)

(13.8)

ClusTop-H2VG-AH

.824 ± .002 (12)

.027 ± .000 (12)

.053 ± .000 (12)

.850 ± .003 (12)

.043 ± .000 (8)

.080 ± .001 (8)

.869 ± .009 (11)

.028 ± .001 (9)

.053 ± .001 (9)

(10.3)

ClusTop-H2VW-AH

.908 ± .001 (1)

.024 ± .001 (21)

.024 ± .001 (24)

.944 ± .001 (4)

.027 ± .001 (23)

.027 ± .001 (23)

.964 ± .001 (4)

.020 ± .001 (23)

.020 ± .001 (23)

(16.2)

ClusTop-H2VF-AH

.905 ± .001 (2)

.027 ± .001 (15)

.027 ± .001 (20)

.934 ± .001 (6)

.029 ± .001 (20)

.029 ± .001 (20)

.949 ± .001 (5)

.021 ± .001 (20)

.021 ± .001 (20)

(14.2)

ClusTop-Word-AM

.734 ± .001 (18)

.036 ± .000 (1)

.068 ± .000 (1)

.828 ± .004 (16)

.039 ± .000 (16)

.073 ± .001 (16)

.709 ± .013 (24)

.023 ± .000 (16)

.044 ± .001 (16)

(13.8)

ClusTop-Hash-AM

.731 ± .002 (19)

.030 ± .000 (10)

.058 ± .000 (10)

.845 ± .004 (14)

.043 ± .000 (8)

.081 ± .001 (7)

.823 ± .011 (14)

.028 ± .001 (9)

.053 ± .001 (9)

(11.1)

ClusTop-Noun-AM

.860 ± .001 (8)

.024 ± .000 (21)

.047 ± .000 (15)

.932 ± .003 (7)

.040 ± .000 (14)

.076 ± .001 (14)

.908 ± .008 (9)

.024 ± .000 (14)

.047 ± .001 (14)

(12.9)

ClusTop-H2VG-AM

.800 ± .002 (13)

.031 ± .000 (9)

.060 ± .000 (9)

.875 ± .003 (11)

.041 ± .000 (11)

.078 ± .001 (11)

.882 ± .008 (10)

.027 ± .000 (11)

.051 ± .001 (11)

(10.7)

ClusTop-H2VW-AM

.904 ± .001 (3)

.027 ± .001 (15)

.027 ± .001 (20)

.964 ± .001 (2)

.028 ± .001 (22)

.028 ± .001 (22)

.972 ± .001 (2)

.021 ± .001 (20)

.021 ± .001 (20)

(14.0)

ClusTop-H2VF-AM

.891 ± .001 (7)

.027 ± .001 (15)

.027 ± .001 (20)

.951 ± .001 (3)

.027 ± .001 (23)

.027 ± .001 (23)

.944 ± .001 (6)

.020 ± .001 (23)

.020 ± .001 (23)

(15.9)

LDA-Orig

.848 ± .002 (10)

.029 ± .000 (11)

.056 ± .000 (11)

.885 ± .003 (10)

.040 ± .000 (14)

.076 ± .001 (14)

.808 ± .011 (15)

.026 ± .001 (12)

.051 ± .001 (11)

(12.0)

LDA-Hash

.759 ± .002 (14)

.034 ± .000 (4)

.064 ± .000 (4)

.847 ± .003 (13)

.041 ± .000 (11)

.078 ± .001 (11)

.778 ± .010 (18)

.034 ± .001 (5)

.064 ± .001 (5)

(9.4)

LDA-Ment

.752 ± .002 (15)

.033 ± .000 (7)

.063 ± .000 (6)

.820 ± .004 (18)

.044 ± .000 (6)

.082 ± .001 (6)

.787 ± .013 (17)

.024 ± .000 (14)

.047 ± .001 (14)

(11.4)

Algorithm

Precision

Recall

F-score

Precision

Recall

F-score

Precision

Recall

F-score

Rank@15

ClusTop-Word-NA

.648 ± .002 (24)

.034 ± .000 (5)

.063 ± .000 (7)

.743 ± .004 (23)

.053 ± .000 (3)

.098 ± .001 (3)

.717 ± .010 (22)

.038 ± .001 (4)

.070 ± .002 (4)

(10.6)

ClusTop-BiG-NA

.671 ± .002 (21)

.035 ± .000 (2)

.065 ± .000 (2)

.747 ± .004 (21)

.055 ± .001 (1)

.100 ± .001 (1)

.719 ± .010 (21)

.040 ± .001 (2)

.073 ± .002 (2)

(8.1)

ClusTop-TriG-NA

.667 ± .002 (22)

.035 ± .000 (2)

.065 ± .000 (2)

.757 ± .004 (20)

.055 ± .000 (1)

.100 ± .001 (1)

.677 ± .010 (24)

.041 ± .001 (1)

.075 ± .002 (1)

(8.2)

ClusTop-BiHa-NA

.667 ± .002 (22)

.034 ± .000 (5)

.064 ± .000 (5)

.729 ± .004 (24)

.052 ± .000 (4)

.096 ± .001 (4)

.722 ± .009 (20)

.040 ± .001 (2)

.073 ± .002 (2)

(9.8)

ClusTop-Hash-NA

.848 ± .004 (9)

.023 ± .000 (24)

.045 ± .000 (18)

.880 ± .008 (9)

.031 ± .001 (17)

.060 ± .001 (17)

.914 ± .012 (8)

.023 ± .001 (17)

.044 ± .001 (17)

(15.1)

ClusTop-Noun-NA

.698 ± .002 (18)

.033 ± .000 (8)

.061 ± .000 (9)

.773 ± .003 (19)

.051 ± .000 (5)

.093 ± .001 (5)

.753 ± .010 (15)

.036 ± .001 (6)

.067 ± .001 (6)

(10.1)

ClusTop-H2VG-NA

.895 ± .004 (2)

.024 ± .000 (23)

.046 ± .000 (17)

.961 ± .005 (1)

.031 ± .001 (17)

.060 ± .001 (17)

.962 ± .008 (3)

.023 ± .001 (17)

.044 ± .001 (17)

(12.7)

ClusTop-H2VW-NA

.889 ± .001 (5)

.026 ± .001 (21)

.026 ± .001 (24)

.935 ± .001 (3)

.030 ± .001 (20)

.030 ± .001 (20)

.983 ± .001 (1)

.020 ± .001 (23)

.020 ± .001 (23)

(15.6)

ClusTop-H2VF-NA

.862 ± .001 (7)

.028 ± .001 (14)

.028 ± .001 (19)

.903 ± .001 (8)

.030 ± .001 (20)

.030 ± .001 (20)

.942 ± .001 (6)

.021 ± .001 (20)

.021 ± .001 (20)

(14.9)

ClusTop-Word-AH

.677 ± .002 (20)

.025 ± .000 (22)

.048 ± .000 (16)

.744 ± .004 (22)

.043 ± .000 (12)

.079 ± .001 (14)

.731 ± .010 (19)

.033 ± .001 (7)

.061 ± .001 (8)

(15.6)

ClusTop-Hash-AH

.802 ± .002 (10)

.030 ± .000 (12)

.058 ± .000 (12)

.831 ± .004 (13)

.044 ± .000 (10)

.083 ± .001 (10)

.847 ± .009 (12)

.026 ± .001 (15)

.050 ± .001 (15)

(12.1)

ClusTop-Noun-AH

.699 ± .002 (17)

.027 ± .000 (16)

.051 ± .000 (14)

.791 ± .004 (16)

.042 ± .000 (14)

.078 ± .001 (15)

.781 ± .010 (13)

.033 ± .001 (7)

.062 ± .001 (7)

(13.2)

ClusTop-H2VG-AH

.762 ± .002 (12)

.029 ± .000 (13)

.055 ± .000 (13)

.832 ± .003 (12)

.043 ± .000 (12)

.080 ± .001 (12)

.859 ± .009 (11)

.028 ± .001 (10)

.053 ± .001 (11)

(11.8)

ClusTop-H2VW-AH

.902 ± .001 (1)

.027 ± .001 (18)

.027 ± .001 (22)

.913 ± .001 (5)

.029 ± .001 (22)

.029 ± .001 (22)

.964 ± .001 (2)

.020 ± .001 (23)

.020 ± .001 (23)

(15.3)

ClusTop-H2VF-AH

.893 ± .001 (3)

.028 ± .001 (14)

.028 ± .001 (19)

.913 ± .001 (5)

.030 ± .001 (20)

.030 ± .001 (20)

.945 ± .001 (5)

.021 ± .001 (20)

.021 ± .001 (20)

(14.0)

ClusTop-Word-AM

.687 ± .001 (19)

.036 ± .000 (1)

.067 ± .000 (1)

.790 ± .004 (17)

.046 ± .000 (7)

.085 ± .001 (7)

.689 ± .012 (23)

.027 ± .001 (13)

.052 ± .001 (13)

(11.2)

ClusTop-Hash-AM

.713 ± .002 (15)

.033 ± .000 (8)

.063 ± .000 (7)

.816 ± .004 (14)

.045 ± .000 (9)

.083 ± .001 (10)

.770 ± .011 (14)

.030 ± .001 (9)

.058 ± .001 (9)

(10.6)

ClusTop-Noun-AM

.860 ± .001 (8)

.026 ± .000 (20)

.050 ± .000 (15)

.905 ± .003 (7)

.041 ± .000 (16)

.077 ± .001 (16)

.892 ± .008 (9)

.026 ± .000 (15)

.049 ± .001 (16)

(13.6)

ClusTop-H2VG-AM

.758 ± .002 (13)

.031 ± .000 (11)

.060 ± .000 (10)

.863 ± .003 (10)

.044 ± .000 (10)

.083 ± .001 (10)

.876 ± .008 (10)

.027 ± .000 (13)

.052 ± .001 (13)

(11.1)

ClusTop-H2VW-AM

.892 ± .001 (4)

.027 ± .001 (18)

.027 ± .001 (22)

.942 ± .001 (2)

.028 ± .001 (23)

.028 ± .001 (23)

.960 ± .001 (4)

.021 ± .001 (20)

.021 ± .001 (20)

(15.1)

ClusTop-H2VF-AM

.877 ± .001 (6)

.027 ± .001 (18)

.027 ± .001 (22)

.935 ± .001 (3)

.027 ± .001 (24)

.027 ± .001 (24)

.931 ± .001 (7)

.021 ± .001 (20)

.021 ± .001 (20)

(16.0)

LDA-Orig

.799 ± .002 (11)

.032 ± .000 (10)

.060 ± .000 (10)

.840 ± .003 (11)

.042 ± .000 (14)

.080 ± .001 (12)

.753 ± .010 (15)

.028 ± .001 (10)

.054 ± .001 (10)

(11.4)

LDA-Hash

.720 ± .002 (14)

.034 ± .000 (5)

.064 ± .000 (5)

.795 ± .003 (15)

.046 ± .000 (7)

.085 ± .001 (7)

.733 ± .010 (18)

.038 ± .001 (4)

.070 ± .001 (4)

(8.8)

LDA-Ment

.703 ± .002 (16)

.034 ± .000 (5)

.064 ± .000 (5)

.774 ± .004 (18)

.048 ± .000 (6)

.088 ± .001 (6)

.743 ± .012 (17)

.027 ± .001 (13)

.052 ± .001 (13)

(11.0)

Algorithm

Precision

Recall

F-score

Precision

Recall

F-score

Precision

Recall

F-score

Rank@20

ClusTop-Word-NA

.617 ± .002 (24)

.034 ± .000 (6)

.064 ± .000 (6)

.709 ± .003 (23)

.055 ± .000 (2)

.100 ± .001 (3)

.669 ± .009 (22)

.038 ± .001 (4)

.070 ± .002 (4)

(10.4)

ClusTop-BiG-NA

.646 ± .002 (21)

.035 ± .000 (3)

.065 ± .000 (3)

.722 ± .004 (22)

.056 ± .001 (1)

.102 ± .001 (1)

.679 ± .010 (20)

.040 ± .001 (2)

.073 ± .002 (2)

(8.3)

ClusTop-TriG-NA

.636 ± .002 (22)

.035 ± .000 (3)

.065 ± .000 (3)

.726 ± .004 (20)

.055 ± .001 (2)

.101 ± .001 (2)

.662 ± .009 (24)

.041 ± .001 (1)

.075 ± .002 (1)

(8.7)

ClusTop-BiHa-NA

.635 ± .002 (23)

.035 ± .000 (3)

.065 ± .000 (3)

.702 ± .004 (24)

.054 ± .000 (4)

.099 ± .001 (4)

.679 ± .009 (20)

.040 ± .001 (2)

.073 ± .002 (2)

(9.4)

ClusTop-Hash-NA

.831 ± .004 (9)

.024 ± .000 (23)

.045 ± .000 (18)

.873 ± .008 (9)

.031 ± .001 (17)

.060 ± .001 (17)

.911 ± .012 (8)

.023 ± .001 (17)

.044 ± .001 (17)

(15.0)

ClusTop-Noun-NA

.666 ± .002 (17)

.033 ± .000 (9)

.061 ± .000 (11)

.748 ± .003 (18)

.051 ± .000 (5)

.094 ± .001 (5)

.719 ± .010 (15)

.036 ± .001 (6)

.067 ± .001 (6)

(10.2)

ClusTop-H2VG-NA

.891 ± .004 (2)

.024 ± .000 (23)

.046 ± .000 (17)

.952 ± .005 (1)

.031 ± .001 (17)

.060 ± .001 (17)

.962 ± .008 (2)

.023 ± .001 (17)

.044 ± .001 (17)

(12.6)

ClusTop-H2VW-NA

.869 ± .001 (5)

.027 ± .001 (20)

.027 ± .001 (22)

.927 ± .001 (4)

.030 ± .001 (20)

.030 ± .001 (20)

.983 ± .001 (1)

.020 ± .001 (23)

.020 ± .001 (23)

(15.3)

ClusTop-H2VF-NA

.856 ± .001 (7)

.028 ± .001 (16)

.028 ± .001 (19)

.894 ± .001 (7)

.030 ± .001 (20)

.030 ± .001 (20)

.942 ± .001 (5)

.021 ± .001 (20)

.021 ± .001 (20)

(14.9)

ClusTop-Word-AH

.660 ± .002 (19)

.029 ± .000 (14)

.055 ± .000 (14)

.724 ± .004 (21)

.044 ± .001 (12)

.080 ± .001 (13)

.703 ± .010 (17)

.033 ± .001 (7)

.061 ± .001 (8)

(13.9)

ClusTop-Hash-AH

.757 ± .002 (10)

.033 ± .000 (9)

.063 ± .000 (8)

.801 ± .004 (13)

.044 ± .000 (12)

.082 ± .001 (11)

.836 ± .009 (12)

.026 ± .001 (15)

.050 ± .001 (15)

(11.7)

ClusTop-Noun-AH

.700 ± .002 (14)

.029 ± .000 (14)

.054 ± .000 (15)

.774 ± .004 (16)

.042 ± .000 (15)

.079 ± .001 (15)

.743 ± .010 (14)

.033 ± .001 (7)

.062 ± .001 (7)

(13.0)

ClusTop-H2VG-AH

.743 ± .002 (12)

.030 ± .000 (13)

.058 ± .000 (13)

.809 ± .003 (11)

.043 ± .000 (14)

.080 ± .001 (13)

.858 ± .009 (11)

.028 ± .001 (10)

.053 ± .001 (11)

(12.0)

ClusTop-H2VW-AH

.894 ± .001 (1)

.027 ± .001 (20)

.027 ± .001 (22)

.902 ± .001 (6)

.029 ± .001 (22)

.029 ± .001 (22)

.962 ± .001 (3)

.020 ± .001 (23)

.020 ± .001 (23)

(15.8)

ClusTop-H2VF-AH

.879 ± .001 (3)

.028 ± .001 (16)

.028 ± .001 (19)

.905 ± .001 (5)

.030 ± .001 (20)

.030 ± .001 (20)

.939 ± .001 (6)

.021 ± .001 (20)

.021 ± .001 (20)

(14.3)

ClusTop-Word-AM

.660 ± .001 (19)

.036 ± .000 (1)

.067 ± .000 (1)

.778 ± .004 (15)

.050 ± .000 (6)

.091 ± .001 (6)

.664 ± .012 (23)

.027 ± .001 (13)

.052 ± .001 (13)

(10.8)

ClusTop-Hash-AM

.691 ± .002 (15)

.033 ± .000 (9)

.062 ± .000 (9)

.796 ± .004 (14)

.047 ± .000 (9)

.087 ± .001 (9)

.745 ± .011 (13)

.030 ± .001 (9)

.058 ± .001 (9)

(10.7)

ClusTop-Noun-AM

.841 ± .001 (8)

.027 ± .000 (18)

.051 ± .000 (16)

.883 ± .003 (8)

.041 ± .000 (16)

.078 ± .001 (16)

.859 ± .009 (10)

.026 ± .000 (15)

.049 ± .001 (16)

(13.7)

ClusTop-H2VG-AM

.736 ± .002 (13)

.032 ± .000 (11)

.061 ± .000 (11)

.856 ± .003 (10)

.045 ± .000 (10)

.084 ± .001 (10)

.875 ± .008 (9)

.027 ± .000 (13)

.052 ± .001 (13)

(11.1)

ClusTop-H2VW-AM

.876 ± .001 (4)

.027 ± .001 (20)

.027 ± .001 (22)

.936 ± .001 (2)

.029 ± .001 (22)

.029 ± .001 (22)

.955 ± .001 (4)

.021 ± .001 (20)

.021 ± .001 (20)

(15.1)

ClusTop-H2VF-AM

.859 ± .001 (6)

.027 ± .001 (20)

.027 ± .001 (22)

.930 ± .001 (3)

.028 ± .001 (24)

.028 ± .001 (24)

.928 ± .001 (7)

.021 ± .001 (20)

.021 ± .001 (20)

(16.2)

LDA-Orig

.752 ± .002 (11)

.032 ± .000 (11)

.061 ± .000 (11)

.802 ± .003 (12)

.044 ± .000 (12)

.082 ± .001 (11)

.706 ± .010 (16)

.028 ± .001 (10)

.054 ± .001 (10)

(11.6)

LDA-Hash

.689 ± .002 (16)

.035 ± .000 (3)

.065 ± .000 (3)

.751 ± .003 (17)

.048 ± .000 (8)

.088 ± .001 (8)

.702 ± .010 (18)

.038 ± .001 (4)

.070 ± .001 (4)

(9.0)

LDA-Ment

.666 ± .002 (17)

.034 ± .000 (6)

.064 ± .000 (6)

.730 ± .004 (19)

.049 ± .000 (7)

.090 ± .001 (7)

.698 ± .012 (19)

.027 ± .001 (13)

.052 ± .001 (13)

(11.9)

  1. The rank of an algorithm’s performance for each metric are provided in brackets