Results - Common Core 2017¶
MRGrankrel¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3609
bpref all 0.4595
recip_rank all 0.8307
P_10 all 0.6500
P_100 all 0.4660
P_1000 all 0.1206
recall_10 all 0.0681
recall_100 all 0.3590
recall_1000 all 0.7250
ndcg all 0.6041
ndcg_cut_10 all 0.4961
ndcg_cut_100 all 0.4867
ndcg_cut_1000 all 0.6041
MRGrandrel¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3190
bpref all 0.4289
recip_rank all 0.7327
P_10 all 0.5660
P_100 all 0.4350
P_1000 all 0.1200
recall_10 all 0.0588
recall_100 all 0.3364
recall_1000 all 0.7235
ndcg all 0.5780
ndcg_cut_10 all 0.4157
ndcg_cut_100 all 0.4413
ndcg_cut_1000 all 0.5780
MRGrankall¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3538
bpref all 0.4514
recip_rank all 0.8190
P_10 all 0.6420
P_100 all 0.4602
P_1000 all 0.1202
recall_10 all 0.0621
recall_100 all 0.3543
recall_1000 all 0.7238
ndcg all 0.5994
ndcg_cut_10 all 0.4899
ndcg_cut_100 all 0.4792
ndcg_cut_1000 all 0.5994
WCrobust04¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3711
bpref all 0.4644
recip_rank all 0.8081
P_10 all 0.6460
P_100 all 0.4770
P_1000 all 0.1279
recall_10 all 0.0651
recall_100 all 0.3567
recall_1000 all 0.7647
ndcg all 0.6371
ndcg_cut_10 all 0.5153
ndcg_cut_100 all 0.5015
ndcg_cut_1000 all 0.6371
WCrobust0405¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4278
bpref all 0.5116
recip_rank all 0.8995
P_10 all 0.7500
P_100 all 0.5448
P_1000 all 0.1357
recall_10 all 0.0728
recall_100 all 0.3990
recall_1000 all 0.8060
ndcg all 0.6956
ndcg_cut_10 all 0.6162
ndcg_cut_100 all 0.5868
ndcg_cut_1000 all 0.6956
WCrobust04W¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3656
bpref all 0.4579
recip_rank all 0.8131
P_10 all 0.6580
P_100 all 0.4752
P_1000 all 0.1259
recall_10 all 0.0661
recall_100 all 0.3516
recall_1000 all 0.7524
ndcg all 0.6297
ndcg_cut_10 all 0.5182
ndcg_cut_100 all 0.5004
ndcg_cut_1000 all 0.6297
tgncorpBASE¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2552
bpref all 0.3657
recip_rank all 0.7444
P_10 all 0.5260
P_100 all 0.3544
P_1000 all 0.1016
recall_10 all 0.0519
recall_100 all 0.2803
recall_1000 all 0.6406
ndcg all 0.5102
ndcg_cut_10 all 0.3859
ndcg_cut_100 all 0.3852
ndcg_cut_1000 all 0.5102
tgncorpBOOST¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2757
bpref all 0.3853
recip_rank all 0.7835
P_10 all 0.5940
P_100 all 0.3780
P_1000 all 0.1019
recall_10 all 0.0599
recall_100 all 0.3052
recall_1000 all 0.6482
ndcg all 0.5354
ndcg_cut_10 all 0.4550
ndcg_cut_100 all 0.4258
ndcg_cut_1000 all 0.5354
IlpsUvAQlmNvsm¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1715
bpref all 0.2555
recip_rank all 0.6450
P_10 all 0.4180
P_100 all 0.2708
P_1000 all 0.0766
recall_10 all 0.0422
recall_100 all 0.2196
recall_1000 all 0.5217
ndcg all 0.4122
ndcg_cut_10 all 0.3492
ndcg_cut_100 all 0.3083
ndcg_cut_1000 all 0.4122
IlpsUvANvsm¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1260
bpref all 0.2233
recip_rank all 0.5227
P_10 all 0.3220
P_100 all 0.2156
P_1000 all 0.0641
recall_10 all 0.0351
recall_100 all 0.1656
recall_1000 all 0.4147
ndcg all 0.3325
ndcg_cut_10 all 0.2614
ndcg_cut_100 all 0.2449
ndcg_cut_1000 all 0.3325
IlpsUvABoir¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2861
bpref all 0.3445
recip_rank all 0.6794
P_10 all 0.5700
P_100 all 0.3568
P_1000 all 0.0929
recall_10 all 0.0639
recall_100 all 0.2930
recall_1000 all 0.6333
ndcg all 0.5151
ndcg_cut_10 all 0.4497
ndcg_cut_100 all 0.4004
ndcg_cut_1000 all 0.5151
umass_direlmnvs¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2303
bpref all 0.3078
recip_rank all 0.5874
P_10 all 0.4660
P_100 all 0.3234
P_1000 all 0.0937
recall_10 all 0.0455
recall_100 all 0.2653
recall_1000 all 0.6097
ndcg all 0.4734
ndcg_cut_10 all 0.3504
ndcg_cut_100 all 0.3510
ndcg_cut_1000 all 0.4734
umass_direlm¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2452
bpref all 0.3153
recip_rank all 0.6411
P_10 all 0.4560
P_100 all 0.3414
P_1000 all 0.0936
recall_10 all 0.0471
recall_100 all 0.2705
recall_1000 all 0.6055
ndcg all 0.4807
ndcg_cut_10 all 0.3405
ndcg_cut_100 all 0.3632
ndcg_cut_1000 all 0.4807
umass_diremart¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2515
bpref all 0.3192
recip_rank all 0.5828
P_10 all 0.4620
P_100 all 0.3538
P_1000 all 0.1028
recall_10 all 0.0426
recall_100 all 0.2830
recall_1000 all 0.6450
ndcg all 0.4976
ndcg_cut_10 all 0.3273
ndcg_cut_100 all 0.3644
ndcg_cut_1000 all 0.4976
umass_baselnrm¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2752
bpref all 0.3310
recip_rank all 0.7012
P_10 all 0.5720
P_100 all 0.3456
P_1000 all 0.0933
recall_10 all 0.0640
recall_100 all 0.2789
recall_1000 all 0.6016
ndcg all 0.4992
ndcg_cut_10 all 0.4484
ndcg_cut_100 all 0.3923
ndcg_cut_1000 all 0.4992
umass_baselnsdm¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2281
bpref all 0.2922
recip_rank all 0.6855
P_10 all 0.5280
P_100 all 0.3108
P_1000 all 0.0822
recall_10 all 0.0566
recall_100 all 0.2536
recall_1000 all 0.5472
ndcg all 0.4506
ndcg_cut_10 all 0.4186
ndcg_cut_100 all 0.3551
ndcg_cut_1000 all 0.4506
ICT17ZCJL01¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1801
bpref all 0.2577
recip_rank all 0.6444
P_10 all 0.4420
P_100 all 0.2704
P_1000 all 0.0736
recall_10 all 0.0495
recall_100 all 0.2227
recall_1000 all 0.5054
ndcg all 0.4036
ndcg_cut_10 all 0.3408
ndcg_cut_100 all 0.3055
ndcg_cut_1000 all 0.4036
ICT17ZCJL02¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1878
bpref all 0.2689
recip_rank all 0.6131
P_10 all 0.4480
P_100 all 0.2720
P_1000 all 0.0740
recall_10 all 0.0526
recall_100 all 0.2280
recall_1000 all 0.5138
ndcg all 0.4133
ndcg_cut_10 all 0.3466
ndcg_cut_100 all 0.3128
ndcg_cut_1000 all 0.4133
ICT17ZCJL03¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1483
bpref all 0.2429
recip_rank all 0.5417
P_10 all 0.4000
P_100 all 0.2216
P_1000 all 0.0714
recall_10 all 0.0427
recall_100 all 0.1894
recall_1000 all 0.4702
ndcg all 0.3711
ndcg_cut_10 all 0.3099
ndcg_cut_100 all 0.2547
ndcg_cut_1000 all 0.3711
ims_bm25_td¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2433
bpref all 0.3179
recip_rank all 0.7803
P_10 all 0.5700
P_100 all 0.3304
P_1000 all 0.0880
recall_10 all 0.0645
recall_100 all 0.2696
recall_1000 all 0.5784
ndcg all 0.4872
ndcg_cut_10 all 0.4519
ndcg_cut_100 all 0.3872
ndcg_cut_1000 all 0.4872
ims_dfrinl2_td¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2425
bpref all 0.3182
recip_rank all 0.7664
P_10 all 0.5740
P_100 all 0.3322
P_1000 all 0.0872
recall_10 all 0.0680
recall_100 all 0.2705
recall_1000 all 0.5757
ndcg all 0.4849
ndcg_cut_10 all 0.4534
ndcg_cut_100 all 0.3874
ndcg_cut_1000 all 0.4849
ims_wcmbsum_ap¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2684
bpref all 0.3375
recip_rank all 0.7922
P_10 all 0.5900
P_100 all 0.3498
P_1000 all 0.0930
recall_10 all 0.0705
recall_100 all 0.2938
recall_1000 all 0.6078
ndcg all 0.5151
ndcg_cut_10 all 0.4752
ndcg_cut_100 all 0.4126
ndcg_cut_1000 all 0.5151
UWatMDS_TARSv1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4624
bpref all 0.5418
recip_rank all 0.8963
P_10 all 0.8340
P_100 all 0.5648
P_1000 all 0.1304
recall_10 all 0.0941
recall_100 all 0.4178
recall_1000 all 0.7741
ndcg all 0.6988
ndcg_cut_10 all 0.6680
ndcg_cut_100 all 0.6225
ndcg_cut_1000 all 0.6988
UWatMDS_HT10¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4075
bpref all 0.5104
recip_rank all 0.8809
P_10 all 0.4620
P_100 all 0.5534
P_1000 all 0.1305
recall_10 all 0.0388
recall_100 all 0.4121
recall_1000 all 0.7742
ndcg all 0.6658
ndcg_cut_10 all 0.4395
ndcg_cut_100 all 0.5769
ndcg_cut_1000 all 0.6658
ims_cmbsum¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2515
bpref all 0.3244
recip_rank all 0.7682
P_10 all 0.5720
P_100 all 0.3364
P_1000 all 0.0914
recall_10 all 0.0637
recall_100 all 0.2766
recall_1000 all 0.6022
ndcg all 0.5031
ndcg_cut_10 all 0.4636
ndcg_cut_100 all 0.3944
ndcg_cut_1000 all 0.5031
ims_wcs_ap_uf¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0188
bpref all 0.1117
recip_rank all 0.0123
P_10 all 0.0160
P_100 all 0.0108
P_1000 all 0.0391
recall_10 all 0.0004
recall_100 all 0.0030
recall_1000 all 0.2319
ndcg all 0.1248
ndcg_cut_10 all 0.0064
ndcg_cut_100 all 0.0084
ndcg_cut_1000 all 0.1248
UWatMDS_TARSv2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4383
bpref all 0.5234
recip_rank all 0.9120
P_10 all 0.8100
P_100 all 0.5406
P_1000 all 0.1262
recall_10 all 0.0916
recall_100 all 0.4048
recall_1000 all 0.7541
ndcg all 0.6780
ndcg_cut_10 all 0.6462
ndcg_cut_100 all 0.5979
ndcg_cut_1000 all 0.6780
UDelInfoLOGext¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2516
bpref all 0.3251
recip_rank all 0.6356
P_10 all 0.5300
P_100 all 0.3156
P_1000 all 0.0916
recall_10 all 0.0634
recall_100 all 0.2647
recall_1000 all 0.6026
ndcg all 0.4923
ndcg_cut_10 all 0.4222
ndcg_cut_100 all 0.3692
ndcg_cut_1000 all 0.4923
UDelInfoLOGint¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2984
bpref all 0.3595
recip_rank all 0.7070
P_10 all 0.5500
P_100 all 0.3650
P_1000 all 0.1037
recall_10 all 0.0588
recall_100 all 0.2891
recall_1000 all 0.6551
ndcg all 0.5391
ndcg_cut_10 all 0.4468
ndcg_cut_100 all 0.4138
ndcg_cut_1000 all 0.5391
UDelInfoEXPint¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2844
bpref all 0.3544
recip_rank all 0.6809
P_10 all 0.5240
P_100 all 0.3522
P_1000 all 0.1027
recall_10 all 0.0552
recall_100 all 0.2851
recall_1000 all 0.6498
ndcg all 0.5249
ndcg_cut_10 all 0.4236
ndcg_cut_100 all 0.3963
ndcg_cut_1000 all 0.5249
RMITRBCUQVT5M1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3410
bpref all 0.4118
recip_rank all 0.8774
P_10 all 0.7120
P_100 all 0.4370
P_1000 all 0.1109
recall_10 all 0.0733
recall_100 all 0.3415
recall_1000 all 0.6978
ndcg all 0.6001
ndcg_cut_10 all 0.5737
ndcg_cut_100 all 0.4970
ndcg_cut_1000 all 0.6001
RMITUQVBestM2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2679
bpref all 0.3490
recip_rank all 0.8404
P_10 all 0.6200
P_100 all 0.3766
P_1000 all 0.0935
recall_10 all 0.0648
recall_100 all 0.2936
recall_1000 all 0.6181
ndcg all 0.5227
ndcg_cut_10 all 0.5053
ndcg_cut_100 all 0.4297
ndcg_cut_1000 all 0.5227
RMITFDMQEA1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2117
bpref all 0.2823
recip_rank all 0.6828
P_10 all 0.5160
P_100 all 0.2900
P_1000 all 0.0784
recall_10 all 0.0578
recall_100 all 0.2476
recall_1000 all 0.5413
ndcg all 0.4413
ndcg_cut_10 all 0.4015
ndcg_cut_100 all 0.3394
ndcg_cut_1000 all 0.4413
udelIndri¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2324
bpref all 0.3044
recip_rank all 0.7199
P_10 all 0.5260
P_100 all 0.3166
P_1000 all 0.0892
recall_10 all 0.0585
recall_100 all 0.2601
recall_1000 all 0.5852
ndcg all 0.4829
ndcg_cut_10 all 0.4281
ndcg_cut_100 all 0.3695
ndcg_cut_1000 all 0.4829
udelIndriB¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2324
bpref all 0.3044
recip_rank all 0.7199
P_10 all 0.5260
P_100 all 0.3166
P_1000 all 0.0892
recall_10 all 0.0585
recall_100 all 0.2601
recall_1000 all 0.5852
ndcg all 0.4829
ndcg_cut_10 all 0.4281
ndcg_cut_100 all 0.3695
ndcg_cut_1000 all 0.4829
sab17coreA¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2719
bpref all 0.3552
recip_rank all 0.7830
P_10 all 0.6140
P_100 all 0.3504
P_1000 all 0.0981
recall_10 all 0.0682
recall_100 all 0.2844
recall_1000 all 0.6270
ndcg all 0.5300
ndcg_cut_10 all 0.5028
ndcg_cut_100 all 0.4131
ndcg_cut_1000 all 0.5300
sab17coreE1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2763
bpref all 0.3542
recip_rank all 0.8393
P_10 all 0.6460
P_100 all 0.4076
P_1000 all 0.0947
recall_10 all 0.0635
recall_100 all 0.2810
recall_1000 all 0.5867
ndcg all 0.5151
ndcg_cut_10 all 0.5153
ndcg_cut_100 all 0.4460
ndcg_cut_1000 all 0.5151
mpiik10e105akDT¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1656
bpref all 0.2178
recip_rank all 0.7258
P_10 all 0.5500
P_100 all 0.3044
P_1000 all 0.0378
recall_10 all 0.0581
recall_100 all 0.2448
recall_1000 all 0.2979
ndcg all 0.3143
ndcg_cut_10 all 0.4308
ndcg_cut_100 all 0.3599
ndcg_cut_1000 all 0.3143
mpiik15e74akDT¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1643
bpref all 0.2154
recip_rank all 0.6775
P_10 all 0.5440
P_100 all 0.2998
P_1000 all 0.0378
recall_10 all 0.0566
recall_100 all 0.2399
recall_1000 all 0.2979
ndcg all 0.3124
ndcg_cut_10 all 0.4243
ndcg_cut_100 all 0.3539
ndcg_cut_1000 all 0.3124
sab17coreO1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2984
bpref all 0.4017
recip_rank all 0.7870
P_10 all 0.6140
P_100 all 0.4372
P_1000 all 0.1095
recall_10 all 0.0593
recall_100 all 0.2864
recall_1000 all 0.6078
ndcg all 0.5366
ndcg_cut_10 all 0.4868
ndcg_cut_100 all 0.4584
ndcg_cut_1000 all 0.5366
mpiik10e111akDT¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1562
bpref all 0.2127
recip_rank all 0.7058
P_10 all 0.5180
P_100 all 0.2950
P_1000 all 0.0378
recall_10 all 0.0538
recall_100 all 0.2372
recall_1000 all 0.2979
ndcg all 0.3070
ndcg_cut_10 all 0.4038
ndcg_cut_100 all 0.3446
ndcg_cut_1000 all 0.3070
ims_wcs_p10¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2670
bpref all 0.3376
recip_rank all 0.7984
P_10 all 0.5980
P_100 all 0.3494
P_1000 all 0.0921
recall_10 all 0.0721
recall_100 all 0.2939
recall_1000 all 0.6030
ndcg all 0.5127
ndcg_cut_10 all 0.4786
ndcg_cut_100 all 0.4128
ndcg_cut_1000 all 0.5127
ims_wcs_ndcg¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2608
bpref all 0.3301
recip_rank all 0.7787
P_10 all 0.5840
P_100 all 0.3458
P_1000 all 0.0926
recall_10 all 0.0677
recall_100 all 0.2839
recall_1000 all 0.6082
ndcg all 0.5100
ndcg_cut_10 all 0.4690
ndcg_cut_100 all 0.4033
ndcg_cut_1000 all 0.5100
ims_wcs_twist¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2653
bpref all 0.3356
recip_rank all 0.7875
P_10 all 0.5920
P_100 all 0.3496
P_1000 all 0.0925
recall_10 all 0.0712
recall_100 all 0.2922
recall_1000 all 0.6055
ndcg all 0.5123
ndcg_cut_10 all 0.4735
ndcg_cut_100 all 0.4101
ndcg_cut_1000 all 0.5123
ims_wcs_rbp¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2684
bpref all 0.3397
recip_rank all 0.7980
P_10 all 0.6040
P_100 all 0.3510
P_1000 all 0.0922
recall_10 all 0.0745
recall_100 all 0.2944
recall_1000 all 0.6034
ndcg all 0.5134
ndcg_cut_10 all 0.4826
ndcg_cut_100 all 0.4145
ndcg_cut_1000 all 0.5134
ims_wcs_err¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2667
bpref all 0.3371
recip_rank all 0.7971
P_10 all 0.6000
P_100 all 0.3488
P_1000 all 0.0924
recall_10 all 0.0740
recall_100 all 0.2943
recall_1000 all 0.6048
ndcg all 0.5137
ndcg_cut_10 all 0.4830
ndcg_cut_100 all 0.4130
ndcg_cut_1000 all 0.5137
ims_wcs_recall¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2592
bpref all 0.3290
recip_rank all 0.7700
P_10 all 0.5860
P_100 all 0.3452
P_1000 all 0.0925
recall_10 all 0.0680
recall_100 all 0.2842
recall_1000 all 0.6072
ndcg all 0.5089
ndcg_cut_10 all 0.4692
ndcg_cut_100 all 0.4025
ndcg_cut_1000 all 0.5089
ims_wcs_rprec¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2649
bpref all 0.3344
recip_rank all 0.7850
P_10 all 0.5880
P_100 all 0.3486
P_1000 all 0.0927
recall_10 all 0.0679
recall_100 all 0.2921
recall_1000 all 0.6060
ndcg all 0.5121
ndcg_cut_10 all 0.4719
ndcg_cut_100 all 0.4089
ndcg_cut_1000 all 0.5121
ICT17ZCJL05¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1406
bpref all 0.2286
recip_rank all 0.5640
P_10 all 0.3720
P_100 all 0.2194
P_1000 all 0.0664
recall_10 all 0.0423
recall_100 all 0.1808
recall_1000 all 0.4584
ndcg all 0.3537
ndcg_cut_10 all 0.2946
ndcg_cut_100 all 0.2481
ndcg_cut_1000 all 0.3537
ICT17ZCJL06¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1588
bpref all 0.2439
recip_rank all 0.5550
P_10 all 0.4200
P_100 all 0.2506
P_1000 all 0.0713
recall_10 all 0.0458
recall_100 all 0.2041
recall_1000 all 0.4799
ndcg all 0.3746
ndcg_cut_10 all 0.3167
ndcg_cut_100 all 0.2748
ndcg_cut_1000 all 0.3746
ICT17ZCJL07¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1780
bpref all 0.2564
recip_rank all 0.5973
P_10 all 0.4580
P_100 all 0.2704
P_1000 all 0.0748
recall_10 all 0.0495
recall_100 all 0.2189
recall_1000 all 0.5066
ndcg all 0.4023
ndcg_cut_10 all 0.3444
ndcg_cut_100 all 0.3006
ndcg_cut_1000 all 0.4023
UWatMDS_ustudy¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3203
bpref all 0.4152
recip_rank all 0.7662
P_10 all 0.6540
P_100 all 0.4134
P_1000 all 0.1111
recall_10 all 0.0665
recall_100 all 0.3244
recall_1000 all 0.6848
ndcg all 0.5663
ndcg_cut_10 all 0.5004
ndcg_cut_100 all 0.4526
ndcg_cut_1000 all 0.5663
UWatMDS_BUnion¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3843
bpref all 0.4746
recip_rank all 0.8416
P_10 all 0.6380
P_100 all 0.4796
P_1000 all 0.1274
recall_10 all 0.0680
recall_100 all 0.3813
recall_1000 all 0.7721
ndcg all 0.6399
ndcg_cut_10 all 0.4960
ndcg_cut_100 all 0.5051
ndcg_cut_1000 all 0.6399
UWatMDS_BFuse¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4414
bpref all 0.5160
recip_rank all 0.8342
P_10 all 0.7300
P_100 all 0.5166
P_1000 all 0.1391
recall_10 all 0.0753
recall_100 all 0.4011
recall_1000 all 0.8232
ndcg all 0.6936
ndcg_cut_10 all 0.5607
ndcg_cut_100 all 0.5515
ndcg_cut_1000 all 0.6936
UWatMDS_AUnion¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3969
bpref all 0.4935
recip_rank all 0.8982
P_10 all 0.6540
P_100 all 0.4958
P_1000 all 0.1277
recall_10 all 0.0685
recall_100 all 0.3895
recall_1000 all 0.7728
ndcg all 0.6533
ndcg_cut_10 all 0.5216
ndcg_cut_100 all 0.5279
ndcg_cut_1000 all 0.6533
UWatMDS_AFuse¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4344
bpref all 0.5173
recip_rank all 0.8759
P_10 all 0.7060
P_100 all 0.5244
P_1000 all 0.1356
recall_10 all 0.0757
recall_100 all 0.4086
recall_1000 all 0.8099
ndcg all 0.6849
ndcg_cut_10 all 0.5567
ndcg_cut_100 all 0.5570
ndcg_cut_1000 all 0.6849
umass_maxpas50¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1898
bpref all 0.2729
recip_rank all 0.6234
P_10 all 0.4260
P_100 all 0.2728
P_1000 all 0.0772
recall_10 all 0.0437
recall_100 all 0.2250
recall_1000 all 0.5135
ndcg all 0.4113
ndcg_cut_10 all 0.3304
ndcg_cut_100 all 0.3045
ndcg_cut_1000 all 0.4113
umass_maxpas150¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2127
bpref all 0.2867
recip_rank all 0.6634
P_10 all 0.4840
P_100 all 0.2872
P_1000 all 0.0795
recall_10 all 0.0556
recall_100 all 0.2333
recall_1000 all 0.5389
ndcg all 0.4381
ndcg_cut_10 all 0.3725
ndcg_cut_100 all 0.3283
ndcg_cut_1000 all 0.4381
umass_letor_lm¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2589
bpref all 0.3207
recip_rank all 0.6603
P_10 all 0.5380
P_100 all 0.3442
P_1000 all 0.0935
recall_10 all 0.0544
recall_100 all 0.2747
recall_1000 all 0.6044
ndcg all 0.4929
ndcg_cut_10 all 0.4218
ndcg_cut_100 all 0.3808
ndcg_cut_1000 all 0.4929
umass_letor_m¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2741
bpref all 0.3406
recip_rank all 0.6117
P_10 all 0.5120
P_100 all 0.3552
P_1000 all 0.1028
recall_10 all 0.0534
recall_100 all 0.2859
recall_1000 all 0.6455
ndcg all 0.5143
ndcg_cut_10 all 0.3929
ndcg_cut_100 all 0.3856
ndcg_cut_1000 all 0.5143
umass_emb1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2353
bpref all 0.2994
recip_rank all 0.6931
P_10 all 0.5300
P_100 all 0.3154
P_1000 all 0.0886
recall_10 all 0.0580
recall_100 all 0.2515
recall_1000 all 0.5744
ndcg all 0.4760
ndcg_cut_10 all 0.4310
ndcg_cut_100 all 0.3657
ndcg_cut_1000 all 0.4760
umass_erm¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2891
bpref all 0.3437
recip_rank all 0.6939
P_10 all 0.5700
P_100 all 0.3628
P_1000 all 0.0978
recall_10 all 0.0629
recall_100 all 0.2926
recall_1000 all 0.6273
ndcg all 0.5175
ndcg_cut_10 all 0.4511
ndcg_cut_100 all 0.4061
ndcg_cut_1000 all 0.5175
umass_letor_lmn¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2443
bpref all 0.3179
recip_rank all 0.6406
P_10 all 0.4920
P_100 all 0.3232
P_1000 all 0.0937
recall_10 all 0.0489
recall_100 all 0.2651
recall_1000 all 0.6097
ndcg all 0.4854
ndcg_cut_10 all 0.3898
ndcg_cut_100 all 0.3645
ndcg_cut_1000 all 0.4854
UWatMDS_AWgtd¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3985
bpref all 0.4941
recip_rank all 0.8836
P_10 all 0.6760
P_100 all 0.4924
P_1000 all 0.1301
recall_10 all 0.0712
recall_100 all 0.3870
recall_1000 all 0.7850
ndcg all 0.6579
ndcg_cut_10 all 0.5211
ndcg_cut_100 all 0.5212
ndcg_cut_1000 all 0.6579
UWatMDS_BWgtd¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4161
bpref all 0.5044
recip_rank all 0.8454
P_10 all 0.7380
P_100 all 0.5042
P_1000 all 0.1315
recall_10 all 0.0805
recall_100 all 0.3911
recall_1000 all 0.7793
ndcg all 0.6626
ndcg_cut_10 all 0.5585
ndcg_cut_100 all 0.5383
ndcg_cut_1000 all 0.6626
sabchoicev45¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3946
bpref all 0.4884
recip_rank all 0.8953
P_10 all 0.7400
P_100 all 0.5010
P_1000 all 0.1295
recall_10 all 0.0759
recall_100 all 0.3685
recall_1000 all 0.7577
ndcg all 0.6614
ndcg_cut_10 all 0.5992
ndcg_cut_100 all 0.5513
ndcg_cut_1000 all 0.6614
sabopt50v45¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3762
bpref all 0.4816
recip_rank all 0.8694
P_10 all 0.6960
P_100 all 0.4820
P_1000 all 0.1288
recall_10 all 0.0699
recall_100 all 0.3513
recall_1000 all 0.7491
ndcg all 0.6449
ndcg_cut_10 all 0.5637
ndcg_cut_100 all 0.5230
ndcg_cut_1000 all 0.6449
sabopt50av45¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3514
bpref all 0.4439
recip_rank all 0.9019
P_10 all 0.7240
P_100 all 0.4674
P_1000 all 0.1203
recall_10 all 0.0703
recall_100 all 0.3316
recall_1000 all 0.6997
ndcg all 0.6185
ndcg_cut_10 all 0.6010
ndcg_cut_100 all 0.5220
ndcg_cut_1000 all 0.6185
sabmerge50aqv45¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.4157
bpref all 0.4755
recip_rank all 0.9056
P_10 all 0.7620
P_100 all 0.5114
P_1000 all 0.1279
recall_10 all 0.0778
recall_100 all 0.3837
recall_1000 all 0.7759
ndcg all 0.6762
ndcg_cut_10 all 0.6243
ndcg_cut_100 all 0.5724
ndcg_cut_1000 all 0.6762
sabchmergeav45¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.4051
bpref all 0.4621
recip_rank all 0.9016
P_10 all 0.7480
P_100 all 0.4996
P_1000 all 0.1273
recall_10 all 0.0763
recall_100 all 0.3756
recall_1000 all 0.7765
ndcg all 0.6727
ndcg_cut_10 all 0.6141
ndcg_cut_100 all 0.5634
ndcg_cut_1000 all 0.6727
sabchoiceaqv45¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3426
bpref all 0.4265
recip_rank all 0.9048
P_10 all 0.7180
P_100 all 0.4686
P_1000 all 0.1171
recall_10 all 0.0685
recall_100 all 0.3284
recall_1000 all 0.6876
ndcg all 0.6072
ndcg_cut_10 all 0.6031
ndcg_cut_100 all 0.5203
ndcg_cut_1000 all 0.6072
webis_baseline¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0659
bpref all 0.0978
recip_rank all 0.5815
P_10 all 0.3660
P_100 all 0.1324
P_1000 all 0.0132
recall_10 all 0.0388
recall_100 all 0.1116
recall_1000 all 0.1116
ndcg all 0.1483
ndcg_cut_10 all 0.2845
ndcg_cut_100 all 0.1840
ndcg_cut_1000 all 0.1483
webis_baseline2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0659
bpref all 0.0978
recip_rank all 0.5815
P_10 all 0.3660
P_100 all 0.1324
P_1000 all 0.0132
recall_10 all 0.0388
recall_100 all 0.1116
recall_1000 all 0.1116
ndcg all 0.1483
ndcg_cut_10 all 0.2845
ndcg_cut_100 all 0.1840
ndcg_cut_1000 all 0.1483
webis_reranked¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0530
bpref all 0.0880
recip_rank all 0.4929
P_10 all 0.2800
P_100 all 0.1324
P_1000 all 0.0132
recall_10 all 0.0269
recall_100 all 0.1116
recall_1000 all 0.1116
ndcg all 0.1347
ndcg_cut_10 all 0.2094
ndcg_cut_100 all 0.1672
ndcg_cut_1000 all 0.1347
webis_reranked2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0530
bpref all 0.0880
recip_rank all 0.4929
P_10 all 0.2800
P_100 all 0.1324
P_1000 all 0.0132
recall_10 all 0.0269
recall_100 all 0.1116
recall_1000 all 0.1116
ndcg all 0.1347
ndcg_cut_10 all 0.2094
ndcg_cut_100 all 0.1672
ndcg_cut_1000 all 0.1347