Results - Decision 2019¶
UWaterMDS_BM25¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.3764
bpref all 0.4104
recip_rank all 0.7517
P_10 all 0.5920
P_100 all 0.3656
P_1000 all 0.0729
recall_10 all 0.1051
recall_100 all 0.5309
recall_1000 all 0.9060
ndcg all 0.6798
ndcg_cut_10 all 0.4986
ndcg_cut_100 all 0.5181
ndcg_cut_1000 all 0.6798
UWatMDSBM25_HC1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.4027
bpref all 0.4608
recip_rank all 0.7601
P_10 all 0.5820
P_100 all 0.3988
P_1000 all 0.0668
recall_10 all 0.0922
recall_100 all 0.5555
recall_1000 all 0.8104
ndcg all 0.6413
ndcg_cut_10 all 0.4504
ndcg_cut_100 all 0.5379
ndcg_cut_1000 all 0.6413
UWatMDSBM25_HC2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.3911
bpref all 0.4630
recip_rank all 0.7601
P_10 all 0.5820
P_100 all 0.3854
P_1000 all 0.0668
recall_10 all 0.0922
recall_100 all 0.5406
recall_1000 all 0.8104
ndcg all 0.6380
ndcg_cut_10 all 0.4504
ndcg_cut_100 all 0.5282
ndcg_cut_1000 all 0.6380
UWatMDSBM25_HC3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.4108
bpref all 0.4793
recip_rank all 0.7601
P_10 all 0.5820
P_100 all 0.4082
P_1000 all 0.0668
recall_10 all 0.0922
recall_100 all 0.5650
recall_1000 all 0.8104
ndcg all 0.6437
ndcg_cut_10 all 0.4504
ndcg_cut_100 all 0.5462
ndcg_cut_1000 all 0.6437
UWatMDS_BM25_ZS¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.3105
bpref all 0.3593
recip_rank all 0.7271
P_10 all 0.5060
P_100 all 0.3364
P_1000 all 0.0650
recall_10 all 0.0848
recall_100 all 0.4694
recall_1000 all 0.7907
ndcg all 0.5972
ndcg_cut_10 all 0.4302
ndcg_cut_100 all 0.4602
ndcg_cut_1000 all 0.5972
UWatMDS_BM25_Z¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.3448
bpref all 0.3706
recip_rank all 0.7293
P_10 all 0.5200
P_100 all 0.3518
P_1000 all 0.0719
recall_10 all 0.0848
recall_100 all 0.4970
recall_1000 all 0.8925
ndcg all 0.6517
ndcg_cut_10 all 0.4430
ndcg_cut_100 all 0.4809
ndcg_cut_1000 all 0.6517
UWatMDS_BMZBS10¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.2827
bpref all 0.3405
recip_rank all 0.7029
P_10 all 0.4560
P_100 all 0.3064
P_1000 all 0.0634
recall_10 all 0.0723
recall_100 all 0.4319
recall_1000 all 0.7774
ndcg all 0.5736
ndcg_cut_10 all 0.3921
ndcg_cut_100 all 0.4226
ndcg_cut_1000 all 0.5736
UWatMDS_BMF_C90¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.1562
bpref all 0.2070
recip_rank all 0.7844
P_10 all 0.4820
P_100 all 0.1904
P_1000 all 0.0251
recall_10 all 0.0788
recall_100 all 0.2640
recall_1000 all 0.3291
ndcg all 0.3261
ndcg_cut_10 all 0.4249
ndcg_cut_100 all 0.3116
ndcg_cut_1000 all 0.3261
UWatMDS_BMF_C95¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.1699
bpref all 0.2229
recip_rank all 0.7891
P_10 all 0.5100
P_100 all 0.2162
P_1000 all 0.0280
recall_10 all 0.0829
recall_100 all 0.2919
recall_1000 all 0.3624
ndcg all 0.3513
ndcg_cut_10 all 0.4450
ndcg_cut_100 all 0.3378
ndcg_cut_1000 all 0.3513
UWatMDS_BMF_S30¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.2855
bpref all 0.3576
recip_rank all 0.7847
P_10 all 0.5900
P_100 all 0.3102
P_1000 all 0.0535
recall_10 all 0.1039
recall_100 all 0.4279
recall_1000 all 0.6466
ndcg all 0.5400
ndcg_cut_10 all 0.5000
ndcg_cut_100 all 0.4574
ndcg_cut_1000 all 0.5400
webisMSame1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.1402
bpref all 0.1737
recip_rank all 0.3665
P_10 all 0.2280
P_100 all 0.2020
P_1000 all 0.0550
recall_10 all 0.0270
recall_100 all 0.2313
recall_1000 all 0.6750
ndcg all 0.4192
ndcg_cut_10 all 0.1641
ndcg_cut_100 all 0.2231
ndcg_cut_1000 all 0.4192
webisMSame2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.1382
bpref all 0.1726
recip_rank all 0.3542
P_10 all 0.2120
P_100 all 0.2020
P_1000 all 0.0550
recall_10 all 0.0224
recall_100 all 0.2313
recall_1000 all 0.6750
ndcg all 0.4148
ndcg_cut_10 all 0.1510
ndcg_cut_100 all 0.2180
ndcg_cut_1000 all 0.4148
webisMSame3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.1417
bpref all 0.1772
recip_rank all 0.4275
P_10 all 0.1960
P_100 all 0.2020
P_1000 all 0.0550
recall_10 all 0.0237
recall_100 all 0.2313
recall_1000 all 0.6750
ndcg all 0.4227
ndcg_cut_10 all 0.1481
ndcg_cut_100 all 0.2265
ndcg_cut_1000 all 0.4227
webisMSame4¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.1354
bpref all 0.1722
recip_rank all 0.3347
P_10 all 0.1640
P_100 all 0.2020
P_1000 all 0.0550
recall_10 all 0.0204
recall_100 all 0.2313
recall_1000 all 0.6750
ndcg all 0.4121
ndcg_cut_10 all 0.1149
ndcg_cut_100 all 0.2153
ndcg_cut_1000 all 0.4121
webisMSame5¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.1349
bpref all 0.1778
recip_rank all 0.2961
P_10 all 0.1620
P_100 all 0.2020
P_1000 all 0.0550
recall_10 all 0.0230
recall_100 all 0.2313
recall_1000 all 0.6750
ndcg all 0.4137
ndcg_cut_10 all 0.1162
ndcg_cut_100 all 0.2166
ndcg_cut_1000 all 0.4137
webisTSame1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.1373
bpref all 0.1743
recip_rank all 0.3338
P_10 all 0.1940
P_100 all 0.2020
P_1000 all 0.0550
recall_10 all 0.0234
recall_100 all 0.2313
recall_1000 all 0.6750
ndcg all 0.4161
ndcg_cut_10 all 0.1447
ndcg_cut_100 all 0.2191
ndcg_cut_1000 all 0.4161
IELAB01_ori_q¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.3334
bpref all 0.3849
recip_rank all 0.8079
P_10 all 0.5740
P_100 all 0.3322
P_1000 all 0.0707
recall_10 all 0.0910
recall_100 all 0.4663
recall_1000 all 0.8543
ndcg all 0.6451
ndcg_cut_10 all 0.4828
ndcg_cut_100 all 0.4768
ndcg_cut_1000 all 0.6451
IELAB02_ori_d¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.2082
bpref all 0.2801
recip_rank all 0.6273
P_10 all 0.4300
P_100 all 0.2414
P_1000 all 0.0561
recall_10 all 0.0599
recall_100 all 0.3163
recall_1000 all 0.6703
ndcg all 0.4774
ndcg_cut_10 all 0.3525
ndcg_cut_100 all 0.3237
ndcg_cut_1000 all 0.4774
IELAB03_umls_d¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.2723
bpref all 0.3235
recip_rank all 0.6479
P_10 all 0.4900
P_100 all 0.2942
P_1000 all 0.0642
recall_10 all 0.0754
recall_100 all 0.3973
recall_1000 all 0.7728
ndcg all 0.5590
ndcg_cut_10 all 0.3948
ndcg_cut_100 all 0.3994
ndcg_cut_1000 all 0.5590
IELAB04_umls_n¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.2387
bpref all 0.3024
recip_rank all 0.6125
P_10 all 0.4640
P_100 all 0.2730
P_1000 all 0.0610
recall_10 all 0.0668
recall_100 all 0.3588
recall_1000 all 0.7172
ndcg all 0.5166
ndcg_cut_10 all 0.3565
ndcg_cut_100 all 0.3659
ndcg_cut_1000 all 0.5166
IELAB05_xChv_q¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.2642
bpref all 0.3399
recip_rank all 0.7028
P_10 all 0.5040
P_100 all 0.2786
P_1000 all 0.0643
recall_10 all 0.0879
recall_100 all 0.4004
recall_1000 all 0.7824
ndcg all 0.5748
ndcg_cut_10 all 0.4125
ndcg_cut_100 all 0.4034
ndcg_cut_1000 all 0.5748
IELAB06_xChv_d¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.2613
bpref all 0.3300
recip_rank all 0.6639
P_10 all 0.4840
P_100 all 0.2832
P_1000 all 0.0628
recall_10 all 0.0781
recall_100 all 0.3995
recall_1000 all 0.7664
ndcg all 0.5541
ndcg_cut_10 all 0.3906
ndcg_cut_100 all 0.3930
ndcg_cut_1000 all 0.5541
IELAB07_xWiki_q¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.3129
bpref all 0.3679
recip_rank all 0.7652
P_10 all 0.5560
P_100 all 0.3138
P_1000 all 0.0693
recall_10 all 0.0888
recall_100 all 0.4443
recall_1000 all 0.8401
ndcg all 0.6263
ndcg_cut_10 all 0.4651
ndcg_cut_100 all 0.4568
ndcg_cut_1000 all 0.6263
IELAB08_xWiki_d¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.2718
bpref all 0.3239
recip_rank all 0.6617
P_10 all 0.4860
P_100 all 0.2954
P_1000 all 0.0642
recall_10 all 0.0742
recall_100 all 0.3987
recall_1000 all 0.7710
ndcg all 0.5585
ndcg_cut_10 all 0.3936
ndcg_cut_100 all 0.4008
ndcg_cut_1000 all 0.5585
IELAB09_xCW_q¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.2568
bpref all 0.3338
recip_rank all 0.7067
P_10 all 0.4940
P_100 all 0.2736
P_1000 all 0.0640
recall_10 all 0.0866
recall_100 all 0.3932
recall_1000 all 0.7778
ndcg all 0.5686
ndcg_cut_10 all 0.4065
ndcg_cut_100 all 0.3973
ndcg_cut_1000 all 0.5686
IELAB10_xCW_d¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.2611
bpref all 0.3306
recip_rank all 0.6667
P_10 all 0.4820
P_100 all 0.2842
P_1000 all 0.0629
recall_10 all 0.0782
recall_100 all 0.4002
recall_1000 all 0.7657
ndcg all 0.5540
ndcg_cut_10 all 0.3898
ndcg_cut_100 all 0.3941
ndcg_cut_1000 all 0.5540
ICTNETv1BM25¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.0000
bpref all 0.0003
recip_rank all 0.0029
P_10 all 0.0020
P_100 all 0.0002
P_1000 all 0.0000
recall_10 all 0.0003
recall_100 all 0.0003
recall_1000 all 0.0003
ndcg all 0.0003
ndcg_cut_10 all 0.0007
ndcg_cut_100 all 0.0003
ndcg_cut_1000 all 0.0003
webisMMajority1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.1475
bpref all 0.1789
recip_rank all 0.5534
P_10 all 0.2880
P_100 all 0.2020
P_1000 all 0.0550
recall_10 all 0.0375
recall_100 all 0.2313
recall_1000 all 0.6750
ndcg all 0.4384
ndcg_cut_10 all 0.2395
ndcg_cut_100 all 0.2425
ndcg_cut_1000 all 0.4384
webisTMajority1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.1491
bpref all 0.1808
recip_rank all 0.6006
P_10 all 0.2840
P_100 all 0.2020
P_1000 all 0.0550
recall_10 all 0.0368
recall_100 all 0.2313
recall_1000 all 0.6750
ndcg all 0.4419
ndcg_cut_10 all 0.2498
ndcg_cut_100 all 0.2462
ndcg_cut_1000 all 0.4419
webisMAll1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.1504
bpref all 0.1800
recip_rank all 0.6466
P_10 all 0.2880
P_100 all 0.2020
P_1000 all 0.0550
recall_10 all 0.0373
recall_100 all 0.2313
recall_1000 all 0.6750
ndcg all 0.4434
ndcg_cut_10 all 0.2562
ndcg_cut_100 all 0.2477
ndcg_cut_1000 all 0.4434
webisTAll1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.1495
bpref all 0.1797
recip_rank all 0.6262
P_10 all 0.2860
P_100 all 0.2020
P_1000 all 0.0550
recall_10 all 0.0370
recall_100 all 0.2313
recall_1000 all 0.6750
ndcg all 0.4418
ndcg_cut_10 all 0.2512
ndcg_cut_100 all 0.2461
ndcg_cut_1000 all 0.4418
ICTNETv2BM25¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (extended)| Appendix
summary (trec_eval)
map all 0.0037
bpref all 0.0068
recip_rank all 0.1586
P_10 all 0.0460
P_100 all 0.0058
P_1000 all 0.0006
recall_10 all 0.0066
recall_100 all 0.0081
recall_1000 all 0.0081
ndcg all 0.0128
ndcg_cut_10 all 0.0339
ndcg_cut_100 all 0.0145
ndcg_cut_1000 all 0.0128