Results - Deep Learning 2022¶
srchvrs_d_bm25¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1048
bpref all 0.1692
recip_rank all 0.7101
P_10 all 0.4500
P_100 all 0.2184
P_1000 all 0.0218
recall_10 all 0.0454
recall_100 all 0.2130
recall_1000 all 0.2130
ndcg all 0.2353
ndcg_cut_10 all 0.3388
ndcg_cut_100 all 0.2763
ndcg_cut_1000 all 0.2375
srchvrs_d_bm25_mf¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1116
bpref all 0.1763
recip_rank all 0.7592
P_10 all 0.4908
P_100 all 0.2317
P_1000 all 0.0232
recall_10 all 0.0514
recall_100 all 0.2184
recall_1000 all 0.2184
ndcg all 0.2485
ndcg_cut_10 all 0.3841
ndcg_cut_100 all 0.2943
ndcg_cut_1000 all 0.2509
srchvrs_d_bm25_mdl1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1157
bpref all 0.1816
recip_rank all 0.7494
P_10 all 0.4803
P_100 all 0.2375
P_1000 all 0.0237
recall_10 all 0.0508
recall_100 all 0.2274
recall_1000 all 0.2274
ndcg all 0.2552
ndcg_cut_10 all 0.3817
ndcg_cut_100 all 0.3019
ndcg_cut_1000 all 0.2577
srchvrs_d_bm25_pass_mf¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1340
bpref all 0.1906
recip_rank all 0.8309
P_10 all 0.5539
P_100 all 0.2617
P_1000 all 0.0262
recall_10 all 0.0575
recall_100 all 0.2416
recall_1000 all 0.2416
ndcg all 0.2775
ndcg_cut_10 all 0.4318
ndcg_cut_100 all 0.3316
ndcg_cut_1000 all 0.2802
srchvrs_d_bm25_p_mf_mdl1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1286
bpref all 0.1842
recip_rank all 0.7969
P_10 all 0.5421
P_100 all 0.2517
P_1000 all 0.0252
recall_10 all 0.0573
recall_100 all 0.2338
recall_1000 all 0.2338
ndcg all 0.2692
ndcg_cut_10 all 0.4243
ndcg_cut_100 all 0.3224
ndcg_cut_1000 all 0.2720
srchvrs_d_bm25_pass_mdl1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1336
bpref all 0.1958
recip_rank all 0.8090
P_10 all 0.5526
P_100 all 0.2639
P_1000 all 0.0264
recall_10 all 0.0580
recall_100 all 0.2453
recall_1000 all 0.2453
ndcg all 0.2757
ndcg_cut_10 all 0.4269
ndcg_cut_100 all 0.3311
ndcg_cut_1000 all 0.2787
srchvrs_d_bm25_mf_mdl1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1082
bpref all 0.1722
recip_rank all 0.7732
P_10 all 0.4842
P_100 all 0.2258
P_1000 all 0.0226
recall_10 all 0.0532
recall_100 all 0.2135
recall_1000 all 0.2135
ndcg all 0.2454
ndcg_cut_10 all 0.3883
ndcg_cut_100 all 0.2937
ndcg_cut_1000 all 0.2480
srchvrs_d_prd3¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1742
bpref all 0.2319
recip_rank all 0.8982
P_10 all 0.6882
P_100 all 0.2804
P_1000 all 0.0280
recall_10 all 0.0851
recall_100 all 0.2723
recall_1000 all 0.2723
ndcg all 0.3349
ndcg_cut_10 all 0.5620
ndcg_cut_100 all 0.3909
ndcg_cut_1000 all 0.3367
srchvrs_d_lb2¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1777
bpref all 0.2328
recip_rank all 0.8943
P_10 all 0.7079
P_100 all 0.2804
P_1000 all 0.0280
recall_10 all 0.0873
recall_100 all 0.2723
recall_1000 all 0.2723
ndcg all 0.3377
ndcg_cut_10 all 0.5760
ndcg_cut_100 all 0.3940
ndcg_cut_1000 all 0.3396
srchvrs_d_lb1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1782
bpref all 0.2328
recip_rank all 0.9016
P_10 all 0.7026
P_100 all 0.2804
P_1000 all 0.0280
recall_10 all 0.0865
recall_100 all 0.2723
recall_1000 all 0.2723
ndcg all 0.3387
ndcg_cut_10 all 0.5754
ndcg_cut_100 all 0.3949
ndcg_cut_1000 all 0.3405
srchvrs_d_lb3¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1407
bpref all 0.1867
recip_rank all 0.8523
P_10 all 0.6342
P_100 all 0.2188
P_1000 all 0.0219
recall_10 all 0.0743
recall_100 all 0.2108
recall_1000 all 0.2108
ndcg all 0.2785
ndcg_cut_10 all 0.5302
ndcg_cut_100 all 0.3281
ndcg_cut_1000 all 0.2812
srchvrs_d_prd1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1705
bpref all 0.2314
recip_rank all 0.8800
P_10 all 0.6789
P_100 all 0.2804
P_1000 all 0.0280
recall_10 all 0.0842
recall_100 all 0.2723
recall_1000 all 0.2723
ndcg all 0.3321
ndcg_cut_10 all 0.5546
ndcg_cut_100 all 0.3877
ndcg_cut_1000 all 0.3340
srchvrs_p_bm25¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.2911
ndcg_cut_100 all 0.2206
ndcg_cut_1000 all 0.1648
summary (trec_eval)
map all 0.0340
bpref all 0.0706
recip_rank all 0.3232
P_10 all 0.1605
P_100 all 0.0788
P_1000 all 0.0079
recall_10 all 0.0286
recall_100 all 0.1383
recall_1000 all 0.1383
ndcg all 0.1253
ndcg_cut_10 all 0.1466
ndcg_cut_100 all 0.1366
ndcg_cut_1000 all 0.1261
srchvrs_p_bm25f¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.3153
ndcg_cut_100 all 0.2428
ndcg_cut_1000 all 0.1812
summary (trec_eval)
map all 0.0405
bpref all 0.0774
recip_rank all 0.3675
P_10 all 0.1855
P_100 all 0.0878
P_1000 all 0.0088
recall_10 all 0.0326
recall_100 all 0.1603
recall_1000 all 0.1603
ndcg all 0.1435
ndcg_cut_10 all 0.1722
ndcg_cut_100 all 0.1549
ndcg_cut_1000 all 0.1443
srchvrs_p_bm25_mdl1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.3194
ndcg_cut_100 all 0.2442
ndcg_cut_1000 all 0.1819
summary (trec_eval)
map all 0.0414
bpref all 0.0790
recip_rank all 0.3746
P_10 all 0.1842
P_100 all 0.0883
P_1000 all 0.0088
recall_10 all 0.0331
recall_100 all 0.1664
recall_1000 all 0.1664
ndcg all 0.1454
ndcg_cut_10 all 0.1734
ndcg_cut_100 all 0.1574
ndcg_cut_1000 all 0.1462
srchvrs_p_bm25f_mdl1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.3161
ndcg_cut_100 all 0.2462
ndcg_cut_1000 all 0.1837
summary (trec_eval)
map all 0.0415
bpref all 0.0789
recip_rank all 0.3802
P_10 all 0.1803
P_100 all 0.0893
P_1000 all 0.0089
recall_10 all 0.0332
recall_100 all 0.1684
recall_1000 all 0.1684
ndcg all 0.1464
ndcg_cut_10 all 0.1708
ndcg_cut_100 all 0.1581
ndcg_cut_1000 all 0.1472
srchvrs_dtn1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1816
bpref all 0.2321
recip_rank all 0.9379
P_10 all 0.7276
P_100 all 0.2804
P_1000 all 0.0280
recall_10 all 0.0878
recall_100 all 0.2723
recall_1000 all 0.2723
ndcg all 0.3413
ndcg_cut_10 all 0.5970
ndcg_cut_100 all 0.3990
ndcg_cut_1000 all 0.3434
srchvrs_dtn2¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1798
bpref all 0.2319
recip_rank all 0.9127
P_10 all 0.7184
P_100 all 0.2804
P_1000 all 0.0280
recall_10 all 0.0855
recall_100 all 0.2723
recall_1000 all 0.2723
ndcg all 0.3390
ndcg_cut_10 all 0.5888
ndcg_cut_100 all 0.3965
ndcg_cut_1000 all 0.3411
fused_3runs¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5094
ndcg_cut_100 all 0.2768
ndcg_cut_1000 all 0.2094
summary (trec_eval)
map all 0.0901
bpref all 0.1169
recip_rank all 0.7502
P_10 all 0.3908
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0903
recall_100 all 0.1382
recall_1000 all 0.1382
ndcg all 0.1990
ndcg_cut_10 all 0.3989
ndcg_cut_100 all 0.2126
ndcg_cut_1000 all 0.1997
fused_2runs¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5060
ndcg_cut_100 all 0.2776
ndcg_cut_1000 all 0.2103
summary (trec_eval)
map all 0.0895
bpref all 0.1166
recip_rank all 0.7576
P_10 all 0.3737
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0882
recall_100 all 0.1382
recall_1000 all 0.1382
ndcg all 0.1986
ndcg_cut_10 all 0.3907
ndcg_cut_100 all 0.2123
ndcg_cut_1000 all 0.1994
hierarchical_2runs¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5001
ndcg_cut_100 all 0.2764
ndcg_cut_1000 all 0.2097
summary (trec_eval)
map all 0.0885
bpref all 0.1171
recip_rank all 0.7304
P_10 all 0.3684
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0890
recall_100 all 0.1382
recall_1000 all 0.1382
ndcg all 0.1972
ndcg_cut_10 all 0.3840
ndcg_cut_100 all 0.2107
ndcg_cut_1000 all 0.1980
rm3_term_filter_rerank¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1049
bpref all 0.1646
recip_rank all 0.7601
P_10 all 0.4829
P_100 all 0.2072
P_1000 all 0.0207
recall_10 all 0.0497
recall_100 all 0.1894
recall_1000 all 0.1894
ndcg all 0.2207
ndcg_cut_10 all 0.3611
ndcg_cut_100 all 0.2601
ndcg_cut_1000 all 0.2225
graph_colbert¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5482
ndcg_cut_100 all 0.4227
ndcg_cut_1000 all 0.3258
summary (trec_eval)
map all 0.1656
bpref all 0.2121
recip_rank all 0.7201
P_10 all 0.4684
P_100 all 0.1791
P_1000 all 0.0179
recall_10 all 0.1078
recall_100 all 0.3285
recall_1000 all 0.3285
ndcg all 0.3375
ndcg_cut_10 all 0.4556
ndcg_cut_100 all 0.3550
ndcg_cut_1000 all 0.3383
hierarchcal_combination¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5696
ndcg_cut_100 all 0.4278
ndcg_cut_1000 all 0.3301
summary (trec_eval)
map all 0.1655
bpref all 0.2106
recip_rank all 0.7326
P_10 all 0.4921
P_100 all 0.1799
P_1000 all 0.0180
recall_10 all 0.1151
recall_100 all 0.3268
recall_1000 all 0.3268
ndcg all 0.3401
ndcg_cut_10 all 0.4731
ndcg_cut_100 all 0.3578
ndcg_cut_1000 all 0.3409
6systems¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5783
ndcg_cut_100 all 0.4041
ndcg_cut_1000 all 0.3124
summary (trec_eval)
map all 0.1604
bpref all 0.2023
recip_rank all 0.7219
P_10 all 0.4987
P_100 all 0.1655
P_1000 all 0.0166
recall_10 all 0.1173
recall_100 all 0.3028
recall_1000 all 0.3028
ndcg all 0.3282
ndcg_cut_10 all 0.4804
ndcg_cut_100 all 0.3450
ndcg_cut_1000 all 0.3290
2systems¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5991
ndcg_cut_100 all 0.3890
ndcg_cut_1000 all 0.3015
summary (trec_eval)
map all 0.1622
bpref all 0.2025
recip_rank all 0.7707
P_10 all 0.5145
P_100 all 0.1500
P_1000 all 0.0150
recall_10 all 0.1225
recall_100 all 0.2728
recall_1000 all 0.2728
ndcg all 0.3192
ndcg_cut_10 all 0.5038
ndcg_cut_100 all 0.3356
ndcg_cut_1000 all 0.3201
unicoil_reranked¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5910
ndcg_cut_100 all 0.3880
ndcg_cut_1000 all 0.3006
summary (trec_eval)
map all 0.1605
bpref all 0.2010
recip_rank all 0.7711
P_10 all 0.5013
P_100 all 0.1500
P_1000 all 0.0150
recall_10 all 0.1213
recall_100 all 0.2728
recall_1000 all 0.2728
ndcg all 0.3177
ndcg_cut_10 all 0.4945
ndcg_cut_100 all 0.3341
ndcg_cut_1000 all 0.3185
4systems¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5761
ndcg_cut_100 all 0.3825
ndcg_cut_1000 all 0.2954
summary (trec_eval)
map all 0.1530
bpref all 0.1912
recip_rank all 0.7300
P_10 all 0.4974
P_100 all 0.1500
P_1000 all 0.0150
recall_10 all 0.1133
recall_100 all 0.2728
recall_1000 all 0.2728
ndcg all 0.3090
ndcg_cut_10 all 0.4783
ndcg_cut_100 all 0.3252
ndcg_cut_1000 all 0.3098
c47¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5701
ndcg_cut_100 all 0.3816
ndcg_cut_1000 all 0.2950
summary (trec_eval)
map all 0.1493
bpref all 0.1875
recip_rank all 0.7217
P_10 all 0.4789
P_100 all 0.1500
P_1000 all 0.0150
recall_10 all 0.1098
recall_100 all 0.2728
recall_1000 all 0.2728
ndcg all 0.3083
ndcg_cut_10 all 0.4692
ndcg_cut_100 all 0.3244
ndcg_cut_1000 all 0.3091
srchvrs_ptn1_colb2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6562
ndcg_cut_100 all 0.4653
ndcg_cut_1000 all 0.3673
summary (trec_eval)
map all 0.2066
bpref all 0.2569
recip_rank all 0.8275
P_10 all 0.5842
P_100 all 0.1945
P_1000 all 0.0194
recall_10 all 0.1376
recall_100 all 0.3636
recall_1000 all 0.3636
ndcg all 0.3940
ndcg_cut_10 all 0.5686
ndcg_cut_100 all 0.4129
ndcg_cut_1000 all 0.3948
srchvrs_ptn2_colb2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6448
ndcg_cut_100 all 0.4618
ndcg_cut_1000 all 0.3644
summary (trec_eval)
map all 0.2002
bpref all 0.2514
recip_rank all 0.8050
P_10 all 0.5684
P_100 all 0.1945
P_1000 all 0.0194
recall_10 all 0.1298
recall_100 all 0.3636
recall_1000 all 0.3636
ndcg all 0.3894
ndcg_cut_10 all 0.5557
ndcg_cut_100 all 0.4081
ndcg_cut_1000 all 0.3901
srchvrs_pz2_colb2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6630
ndcg_cut_100 all 0.4673
ndcg_cut_1000 all 0.3678
summary (trec_eval)
map all 0.2160
bpref all 0.2623
recip_rank all 0.8237
P_10 all 0.6053
P_100 all 0.1945
P_1000 all 0.0194
recall_10 all 0.1453
recall_100 all 0.3636
recall_1000 all 0.3636
ndcg all 0.4010
ndcg_cut_10 all 0.5882
ndcg_cut_100 all 0.4198
ndcg_cut_1000 all 0.4018
srchvrs_ptn3_colb2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5800
ndcg_cut_100 all 0.4380
ndcg_cut_1000 all 0.3423
summary (trec_eval)
map all 0.1687
bpref all 0.2299
recip_rank all 0.7604
P_10 all 0.5026
P_100 all 0.1945
P_1000 all 0.0194
recall_10 all 0.1152
recall_100 all 0.3636
recall_1000 all 0.3636
ndcg all 0.3611
ndcg_cut_10 all 0.4859
ndcg_cut_100 all 0.3790
ndcg_cut_1000 all 0.3619
srchvrs_p2_colb2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6010
ndcg_cut_100 all 0.4375
ndcg_cut_1000 all 0.3442
summary (trec_eval)
map all 0.1745
bpref all 0.2238
recip_rank all 0.7955
P_10 all 0.5092
P_100 all 0.1846
P_1000 all 0.0185
recall_10 all 0.1211
recall_100 all 0.3470
recall_1000 all 0.3470
ndcg all 0.3624
ndcg_cut_10 all 0.5028
ndcg_cut_100 all 0.3791
ndcg_cut_1000 all 0.3630
srchvrs_p1_colb2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5818
ndcg_cut_100 all 0.4225
ndcg_cut_1000 all 0.3289
summary (trec_eval)
map all 0.1723
bpref all 0.2206
recip_rank all 0.7488
P_10 all 0.5053
P_100 all 0.1816
P_1000 all 0.0182
recall_10 all 0.1218
recall_100 all 0.3354
recall_1000 all 0.3354
ndcg all 0.3475
ndcg_cut_10 all 0.4853
ndcg_cut_100 all 0.3647
ndcg_cut_1000 all 0.3483
srchvrs_ptn1_lcn_colb2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6367
ndcg_cut_100 all 0.4470
ndcg_cut_1000 all 0.3519
summary (trec_eval)
map all 0.1996
bpref all 0.2476
recip_rank all 0.8050
P_10 all 0.5671
P_100 all 0.1857
P_1000 all 0.0186
recall_10 all 0.1306
recall_100 all 0.3468
recall_1000 all 0.3468
ndcg all 0.3757
ndcg_cut_10 all 0.5459
ndcg_cut_100 all 0.3934
ndcg_cut_1000 all 0.3765
srchvrs_pz1_colb2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6414
ndcg_cut_100 all 0.4486
ndcg_cut_1000 all 0.3517
summary (trec_eval)
map all 0.2096
bpref all 0.2531
recip_rank all 0.7924
P_10 all 0.5855
P_100 all 0.1857
P_1000 all 0.0186
recall_10 all 0.1385
recall_100 all 0.3468
recall_1000 all 0.3468
ndcg all 0.3812
ndcg_cut_10 all 0.5640
ndcg_cut_100 all 0.3987
ndcg_cut_1000 all 0.3820
ceqe_custom_rerank¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1090
bpref all 0.1703
recip_rank all 0.7382
P_10 all 0.4842
P_100 all 0.2083
P_1000 all 0.0208
recall_10 all 0.0513
recall_100 all 0.2035
recall_1000 all 0.2035
ndcg all 0.2358
ndcg_cut_10 all 0.3811
ndcg_cut_100 all 0.2763
ndcg_cut_1000 all 0.2380
tuvienna¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1294
bpref all 0.1943
recip_rank all 0.8799
P_10 all 0.6053
P_100 all 0.2414
P_1000 all 0.0241
recall_10 all 0.0688
recall_100 all 0.2322
recall_1000 all 0.2322
ndcg all 0.2845
ndcg_cut_10 all 0.4868
ndcg_cut_100 all 0.3360
ndcg_cut_1000 all 0.2868
tuvienna-unicol¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1232
bpref all 0.1851
recip_rank all 0.8959
P_10 all 0.5947
P_100 all 0.2343
P_1000 all 0.0234
recall_10 all 0.0640
recall_100 all 0.2296
recall_1000 all 0.2296
ndcg all 0.2761
ndcg_cut_10 all 0.4830
ndcg_cut_100 all 0.3268
ndcg_cut_1000 all 0.2784
tuvienna-pas-unicol¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5231
ndcg_cut_100 all 0.3954
ndcg_cut_1000 all 0.3124
summary (trec_eval)
map all 0.1518
bpref all 0.2111
recip_rank all 0.7143
P_10 all 0.4171
P_100 all 0.1724
P_1000 all 0.0172
recall_10 all 0.0989
recall_100 all 0.3408
recall_1000 all 0.3408
ndcg all 0.3316
ndcg_cut_10 all 0.4153
ndcg_cut_100 all 0.3462
ndcg_cut_1000 all 0.3322
tuvienna-pas-col¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5386
ndcg_cut_100 all 0.4105
ndcg_cut_1000 all 0.3268
summary (trec_eval)
map all 0.1677
bpref all 0.2290
recip_rank all 0.7174
P_10 all 0.4408
P_100 all 0.1795
P_1000 all 0.0179
recall_10 all 0.1118
recall_100 all 0.3613
recall_1000 all 0.3613
ndcg all 0.3519
ndcg_cut_10 all 0.4293
ndcg_cut_100 all 0.3669
ndcg_cut_1000 all 0.3525
yorku22b¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5076
ndcg_cut_100 all 0.3408
ndcg_cut_1000 all 0.2689
summary (trec_eval)
map all 0.1130
bpref all 0.1650
recip_rank all 0.6597
P_10 all 0.3947
P_100 all 0.1407
P_1000 all 0.0141
recall_10 all 0.0874
recall_100 all 0.2747
recall_1000 all 0.2747
ndcg all 0.2762
ndcg_cut_10 all 0.3914
ndcg_cut_100 all 0.2887
ndcg_cut_1000 all 0.2769
yorku22a¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6089
ndcg_cut_100 all 0.4610
ndcg_cut_1000 all 0.3612
summary (trec_eval)
map all 0.2003
bpref all 0.2554
recip_rank all 0.7821
P_10 all 0.5316
P_100 all 0.2095
P_1000 all 0.0209
recall_10 all 0.1265
recall_100 all 0.3807
recall_1000 all 0.3807
ndcg all 0.3907
ndcg_cut_10 all 0.5195
ndcg_cut_100 all 0.4096
ndcg_cut_1000 all 0.3914
IELab-3MP-DT5¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.3620
ndcg_cut_100 all 0.2814
ndcg_cut_1000 all 0.2182
summary (trec_eval)
map all 0.0713
bpref all 0.1176
recip_rank all 0.4502
P_10 all 0.2513
P_100 all 0.1124
P_1000 all 0.0112
recall_10 all 0.0568
recall_100 all 0.2270
recall_1000 all 0.2270
ndcg all 0.2003
ndcg_cut_10 all 0.2374
ndcg_cut_100 all 0.2115
ndcg_cut_1000 all 0.2011
IELab-3MP-DI¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4148
ndcg_cut_100 all 0.3073
ndcg_cut_1000 all 0.2335
summary (trec_eval)
map all 0.0832
bpref all 0.1355
recip_rank all 0.5128
P_10 all 0.3197
P_100 all 0.1291
P_1000 all 0.0129
recall_10 all 0.0661
recall_100 all 0.2414
recall_1000 all 0.2414
ndcg all 0.2290
ndcg_cut_10 all 0.3032
ndcg_cut_100 all 0.2425
ndcg_cut_1000 all 0.2298
IELab-3MP-UT¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4658
ndcg_cut_100 all 0.3485
ndcg_cut_1000 all 0.2675
summary (trec_eval)
map all 0.1101
bpref all 0.1585
recip_rank all 0.5918
P_10 all 0.3592
P_100 all 0.1484
P_1000 all 0.0148
recall_10 all 0.0802
recall_100 all 0.2775
recall_1000 all 0.2775
ndcg all 0.2678
ndcg_cut_10 all 0.3522
ndcg_cut_100 all 0.2825
ndcg_cut_1000 all 0.2686
IELab-3MP-RBC¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4368
ndcg_cut_100 all 0.3620
ndcg_cut_1000 all 0.2757
summary (trec_eval)
map all 0.1013
bpref all 0.1432
recip_rank all 0.5482
P_10 all 0.3237
P_100 all 0.1509
P_1000 all 0.0151
recall_10 all 0.0710
recall_100 all 0.2886
recall_1000 all 0.2886
ndcg all 0.2594
ndcg_cut_10 all 0.3068
ndcg_cut_100 all 0.2743
ndcg_cut_1000 all 0.2602
cip_f1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5121
ndcg_cut_100 all 0.3991
ndcg_cut_1000 all 0.3117
summary (trec_eval)
map all 0.1469
bpref all 0.1923
recip_rank all 0.7025
P_10 all 0.4263
P_100 all 0.1679
P_1000 all 0.0168
recall_10 all 0.1054
recall_100 all 0.3318
recall_1000 all 0.3318
ndcg all 0.3213
ndcg_cut_10 all 0.4108
ndcg_cut_100 all 0.3362
ndcg_cut_1000 all 0.3220
cip_f2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4997
ndcg_cut_100 all 0.4065
ndcg_cut_1000 all 0.3187
summary (trec_eval)
map all 0.1429
bpref all 0.1935
recip_rank all 0.6797
P_10 all 0.4158
P_100 all 0.1734
P_1000 all 0.0173
recall_10 all 0.0998
recall_100 all 0.3493
recall_1000 all 0.3493
ndcg all 0.3245
ndcg_cut_10 all 0.3976
ndcg_cut_100 all 0.3392
ndcg_cut_1000 all 0.3253
cip_f3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4840
ndcg_cut_100 all 0.3820
ndcg_cut_1000 all 0.2981
summary (trec_eval)
map all 0.1357
bpref all 0.1812
recip_rank all 0.6393
P_10 all 0.3842
P_100 all 0.1597
P_1000 all 0.0160
recall_10 all 0.0910
recall_100 all 0.3116
recall_1000 all 0.3116
ndcg all 0.3006
ndcg_cut_10 all 0.3771
ndcg_cut_100 all 0.3151
ndcg_cut_1000 all 0.3014
cip_r1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4320
ndcg_cut_100 all 0.2591
ndcg_cut_1000 all 0.1956
summary (trec_eval)
map all 0.0719
bpref all 0.1037
recip_rank all 0.6544
P_10 all 0.3000
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0700
recall_100 all 0.1382
recall_1000 all 0.1382
ndcg all 0.1776
ndcg_cut_10 all 0.3107
ndcg_cut_100 all 0.1906
ndcg_cut_1000 all 0.1784
cip_r2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4975
ndcg_cut_100 all 0.2746
ndcg_cut_1000 all 0.2081
summary (trec_eval)
map all 0.0891
bpref all 0.1170
recip_rank all 0.7176
P_10 all 0.3842
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0900
recall_100 all 0.1382
recall_1000 all 0.1382
ndcg all 0.1966
ndcg_cut_10 all 0.3870
ndcg_cut_100 all 0.2100
ndcg_cut_1000 all 0.1973
cip_r3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4669
ndcg_cut_100 all 0.2658
ndcg_cut_1000 all 0.2004
summary (trec_eval)
map all 0.0795
bpref all 0.1104
recip_rank all 0.6456
P_10 all 0.3500
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0836
recall_100 all 0.1382
recall_1000 all 0.1382
ndcg all 0.1849
ndcg_cut_10 all 0.3451
ndcg_cut_100 all 0.1978
ndcg_cut_1000 all 0.1856
cip_f1_r¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5072
ndcg_cut_100 all 0.4131
ndcg_cut_1000 all 0.3260
summary (trec_eval)
map all 0.1622
bpref all 0.2176
recip_rank all 0.6419
P_10 all 0.4579
P_100 all 0.1734
P_1000 all 0.0173
recall_10 all 0.1076
recall_100 all 0.3493
recall_1000 all 0.3493
ndcg all 0.3350
ndcg_cut_10 all 0.4118
ndcg_cut_100 all 0.3483
ndcg_cut_1000 all 0.3354
cip_f2_r¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5860
ndcg_cut_100 all 0.4220
ndcg_cut_1000 all 0.3316
summary (trec_eval)
map all 0.1761
bpref all 0.2166
recip_rank all 0.7797
P_10 all 0.5039
P_100 all 0.1679
P_1000 all 0.0168
recall_10 all 0.1234
recall_100 all 0.3318
recall_1000 all 0.3318
ndcg all 0.3501
ndcg_cut_10 all 0.4877
ndcg_cut_100 all 0.3656
ndcg_cut_1000 all 0.3508
cip_f3_r¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5852
ndcg_cut_100 all 0.4106
ndcg_cut_1000 all 0.3226
summary (trec_eval)
map all 0.1708
bpref all 0.2122
recip_rank all 0.7804
P_10 all 0.5013
P_100 all 0.1597
P_1000 all 0.0160
recall_10 all 0.1235
recall_100 all 0.3116
recall_1000 all 0.3116
ndcg all 0.3389
ndcg_cut_10 all 0.4869
ndcg_cut_100 all 0.3543
ndcg_cut_1000 all 0.3397
pass1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.7050
ndcg_cut_100 all 0.5050
ndcg_cut_1000 all 0.4003
summary (trec_eval)
map all 0.2442
bpref all 0.2831
recip_rank all 0.8487
P_10 all 0.6618
P_100 all 0.2161
P_1000 all 0.0216
recall_10 all 0.1596
recall_100 all 0.4079
recall_1000 all 0.4079
ndcg all 0.4372
ndcg_cut_10 all 0.6363
ndcg_cut_100 all 0.4565
ndcg_cut_1000 all 0.4380
doc1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2154
bpref all 0.2845
recip_rank all 0.8287
P_10 all 0.6395
P_100 all 0.3761
P_1000 all 0.0376
recall_10 all 0.0688
recall_100 all 0.3632
recall_1000 all 0.3632
ndcg all 0.3925
ndcg_cut_10 all 0.4936
ndcg_cut_100 all 0.4587
ndcg_cut_1000 all 0.3951
webis-dl-duot5¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4972
ndcg_cut_100 all 0.2435
ndcg_cut_1000 all 0.1847
summary (trec_eval)
map all 0.0800
bpref all 0.1068
recip_rank all 0.7114
P_10 all 0.3855
P_100 all 0.0684
P_1000 all 0.0068
recall_10 all 0.0870
recall_100 all 0.1265
recall_1000 all 0.1265
ndcg all 0.1803
ndcg_cut_10 all 0.3775
ndcg_cut_100 all 0.1933
ndcg_cut_1000 all 0.1811
pass2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.7105
ndcg_cut_100 all 0.5103
ndcg_cut_1000 all 0.4050
summary (trec_eval)
map all 0.2577
bpref all 0.2983
recip_rank all 0.8459
P_10 all 0.6711
P_100 all 0.2161
P_1000 all 0.0216
recall_10 all 0.1606
recall_100 all 0.4079
recall_1000 all 0.4079
ndcg all 0.4440
ndcg_cut_10 all 0.6428
ndcg_cut_100 all 0.4635
ndcg_cut_1000 all 0.4448
webis-dl-duot5-g¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5314
ndcg_cut_100 all 0.2526
ndcg_cut_1000 all 0.1926
summary (trec_eval)
map all 0.0887
bpref all 0.1093
recip_rank all 0.8228
P_10 all 0.4026
P_100 all 0.0684
P_1000 all 0.0068
recall_10 all 0.0891
recall_100 all 0.1265
recall_1000 all 0.1265
ndcg all 0.1948
ndcg_cut_10 all 0.4207
ndcg_cut_100 all 0.2079
ndcg_cut_1000 all 0.1956
pass3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.7184
ndcg_cut_100 all 0.5313
ndcg_cut_1000 all 0.4231
summary (trec_eval)
map all 0.2818
bpref all 0.3372
recip_rank all 0.8453
P_10 all 0.6803
P_100 all 0.2518
P_1000 all 0.0252
recall_10 all 0.1655
recall_100 all 0.4645
recall_1000 all 0.4645
ndcg all 0.4815
ndcg_cut_10 all 0.6503
ndcg_cut_100 all 0.5023
ndcg_cut_1000 all 0.4822
doc3¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2997
bpref all 0.3427
recip_rank all 0.9846
P_10 all 0.8645
P_100 all 0.4222
P_1000 all 0.0422
recall_10 all 0.1086
recall_100 all 0.4076
recall_1000 all 0.4076
ndcg all 0.4826
ndcg_cut_10 all 0.7488
ndcg_cut_100 all 0.5636
ndcg_cut_1000 all 0.4861
doc2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2030
bpref all 0.2766
recip_rank all 0.8078
P_10 all 0.5908
P_100 all 0.3761
P_1000 all 0.0376
recall_10 all 0.0625
recall_100 all 0.3632
recall_1000 all 0.3632
ndcg all 0.3818
ndcg_cut_10 all 0.4589
ndcg_cut_100 all 0.4468
ndcg_cut_1000 all 0.3845
webis-dl-duot5-aug-1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4925
ndcg_cut_100 all 0.2176
ndcg_cut_1000 all 0.1675
summary (trec_eval)
map all 0.0781
bpref all 0.0989
recip_rank all 0.7133
P_10 all 0.3658
P_100 all 0.0611
P_1000 all 0.0061
recall_10 all 0.0798
recall_100 all 0.1185
recall_1000 all 0.1185
ndcg all 0.1772
ndcg_cut_10 all 0.3747
ndcg_cut_100 all 0.1887
ndcg_cut_1000 all 0.1779
webis-dl-duot5-aug-2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4885
ndcg_cut_100 all 0.2137
ndcg_cut_1000 all 0.1638
summary (trec_eval)
map all 0.0759
bpref all 0.0987
recip_rank all 0.6479
P_10 all 0.3724
P_100 all 0.0611
P_1000 all 0.0061
recall_10 all 0.0822
recall_100 all 0.1185
recall_1000 all 0.1185
ndcg all 0.1707
ndcg_cut_10 all 0.3635
ndcg_cut_100 all 0.1823
ndcg_cut_1000 all 0.1715
NLE_T0pp¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5102
ndcg_cut_100 all 0.2764
ndcg_cut_1000 all 0.2097
summary (trec_eval)
map all 0.0881
bpref all 0.1163
recip_rank all 0.6830
P_10 all 0.3947
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0904
recall_100 all 0.1382
recall_1000 all 0.1382
ndcg all 0.1964
ndcg_cut_10 all 0.3913
ndcg_cut_100 all 0.2099
ndcg_cut_1000 all 0.1971
NLE_T0pp_doc¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1587
bpref all 0.1852
recip_rank all 0.9276
P_10 all 0.7539
P_100 all 0.2404
P_1000 all 0.0240
recall_10 all 0.0822
recall_100 all 0.2010
recall_1000 all 0.2010
ndcg all 0.2839
ndcg_cut_10 all 0.5843
ndcg_cut_100 all 0.3394
ndcg_cut_1000 all 0.2867
NLE_ENSEMBLE_SUM_doc¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1619
bpref all 0.1844
recip_rank all 0.9386
P_10 all 0.7461
P_100 all 0.2404
P_1000 all 0.0240
recall_10 all 0.0801
recall_100 all 0.2010
recall_1000 all 0.2010
ndcg all 0.2862
ndcg_cut_10 all 0.5918
ndcg_cut_100 all 0.3426
ndcg_cut_1000 all 0.2891
NLE_ENSEMBLE_CONDORCE_doc¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1609
bpref all 0.1842
recip_rank all 0.9518
P_10 all 0.7487
P_100 all 0.2404
P_1000 all 0.0240
recall_10 all 0.0799
recall_100 all 0.2010
recall_1000 all 0.2010
ndcg all 0.2853
ndcg_cut_10 all 0.5882
ndcg_cut_100 all 0.3417
ndcg_cut_1000 all 0.2882
NLE_ENSEMBLE_CONDORCET¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5284
ndcg_cut_100 all 0.2816
ndcg_cut_1000 all 0.2131
summary (trec_eval)
map all 0.0943
bpref all 0.1185
recip_rank all 0.7507
P_10 all 0.4039
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0921
recall_100 all 0.1382
recall_1000 all 0.1382
ndcg all 0.2035
ndcg_cut_10 all 0.4144
ndcg_cut_100 all 0.2177
ndcg_cut_1000 all 0.2043
NLE_ENSEMBLE_SUM¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5286
ndcg_cut_100 all 0.2819
ndcg_cut_1000 all 0.2135
summary (trec_eval)
map all 0.0948
bpref all 0.1190
recip_rank all 0.7470
P_10 all 0.4053
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0922
recall_100 all 0.1382
recall_1000 all 0.1382
ndcg all 0.2038
ndcg_cut_10 all 0.4165
ndcg_cut_100 all 0.2181
ndcg_cut_1000 all 0.2046
uogtr_dph¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.2905
ndcg_cut_100 all 0.2137
ndcg_cut_1000 all 0.1585
summary (trec_eval)
map all 0.0410
bpref all 0.0761
recip_rank all 0.3065
P_10 all 0.1789
P_100 all 0.0782
P_1000 all 0.0078
recall_10 all 0.0356
recall_100 all 0.1460
recall_1000 all 0.1460
ndcg all 0.1303
ndcg_cut_10 all 0.1589
ndcg_cut_100 all 0.1416
ndcg_cut_1000 all 0.1311
uogtr_dph_bo1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.3050
ndcg_cut_100 all 0.2227
ndcg_cut_1000 all 0.1657
summary (trec_eval)
map all 0.0433
bpref all 0.0779
recip_rank all 0.3207
P_10 all 0.1789
P_100 all 0.0847
P_1000 all 0.0085
recall_10 all 0.0310
recall_100 all 0.1485
recall_1000 all 0.1485
ndcg all 0.1343
ndcg_cut_10 all 0.1659
ndcg_cut_100 all 0.1460
ndcg_cut_1000 all 0.1351
uogtr_s¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5697
ndcg_cut_100 all 0.4456
ndcg_cut_1000 all 0.3497
summary (trec_eval)
map all 0.1831
bpref all 0.2404
recip_rank all 0.7015
P_10 all 0.4947
P_100 all 0.2012
P_1000 all 0.0201
recall_10 all 0.1227
recall_100 all 0.3735
recall_1000 all 0.3735
ndcg all 0.3690
ndcg_cut_10 all 0.4688
ndcg_cut_100 all 0.3859
ndcg_cut_1000 all 0.3698
uogtr_se¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6510
ndcg_cut_100 all 0.4703
ndcg_cut_1000 all 0.3714
summary (trec_eval)
map all 0.2252
bpref all 0.2836
recip_rank all 0.8023
P_10 all 0.6000
P_100 all 0.2221
P_1000 all 0.0222
recall_10 all 0.1410
recall_100 all 0.4137
recall_1000 all 0.4137
ndcg all 0.4227
ndcg_cut_10 all 0.5726
ndcg_cut_100 all 0.4414
ndcg_cut_1000 all 0.4235
uogtr_be¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6235
ndcg_cut_100 all 0.4186
ndcg_cut_1000 all 0.3251
summary (trec_eval)
map all 0.1896
bpref all 0.2459
recip_rank all 0.7782
P_10 all 0.5684
P_100 all 0.1859
P_1000 all 0.0186
recall_10 all 0.1332
recall_100 all 0.3349
recall_1000 all 0.3349
ndcg all 0.3638
ndcg_cut_10 all 0.5391
ndcg_cut_100 all 0.3812
ndcg_cut_1000 all 0.3645
uogtr_c¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5217
ndcg_cut_100 all 0.3283
ndcg_cut_1000 all 0.2641
summary (trec_eval)
map all 0.1319
bpref all 0.1754
recip_rank all 0.7153
P_10 all 0.4053
P_100 all 0.1224
P_1000 all 0.0122
recall_10 all 0.1029
recall_100 all 0.2409
recall_1000 all 0.2409
ndcg all 0.2723
ndcg_cut_10 all 0.4088
ndcg_cut_100 all 0.2842
ndcg_cut_1000 all 0.2730
uogtr_be_gb¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6480
ndcg_cut_100 all 0.4503
ndcg_cut_1000 all 0.3527
summary (trec_eval)
map all 0.2113
bpref all 0.2725
recip_rank all 0.7907
P_10 all 0.6053
P_100 all 0.2120
P_1000 all 0.0212
recall_10 all 0.1370
recall_100 all 0.3802
recall_1000 all 0.3802
ndcg all 0.4009
ndcg_cut_10 all 0.5721
ndcg_cut_100 all 0.4194
ndcg_cut_1000 all 0.4017
uogtr_se_gb¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6508
ndcg_cut_100 all 0.4702
ndcg_cut_1000 all 0.3713
summary (trec_eval)
map all 0.2252
bpref all 0.2836
recip_rank all 0.8023
P_10 all 0.6000
P_100 all 0.2218
P_1000 all 0.0222
recall_10 all 0.1409
recall_100 all 0.4133
recall_1000 all 0.4133
ndcg all 0.4227
ndcg_cut_10 all 0.5723
ndcg_cut_100 all 0.4414
ndcg_cut_1000 all 0.4235
uogtr_e_gb¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6501
ndcg_cut_100 all 0.4704
ndcg_cut_1000 all 0.3718
summary (trec_eval)
map all 0.2257
bpref all 0.2848
recip_rank all 0.8023
P_10 all 0.5987
P_100 all 0.2228
P_1000 all 0.0223
recall_10 all 0.1403
recall_100 all 0.4149
recall_1000 all 0.4149
ndcg all 0.4234
ndcg_cut_10 all 0.5716
ndcg_cut_100 all 0.4421
ndcg_cut_1000 all 0.4242
uogtr_se_gt¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6508
ndcg_cut_100 all 0.4709
ndcg_cut_1000 all 0.3719
summary (trec_eval)
map all 0.2256
bpref all 0.2839
recip_rank all 0.8023
P_10 all 0.6000
P_100 all 0.2222
P_1000 all 0.0222
recall_10 all 0.1409
recall_100 all 0.4140
recall_1000 all 0.4140
ndcg all 0.4227
ndcg_cut_10 all 0.5723
ndcg_cut_100 all 0.4414
ndcg_cut_1000 all 0.4236
uogtr_t_cprf¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5078
ndcg_cut_100 all 0.3902
ndcg_cut_1000 all 0.3085
summary (trec_eval)
map all 0.1646
bpref all 0.2285
recip_rank all 0.6269
P_10 all 0.4329
P_100 all 0.1787
P_1000 all 0.0179
recall_10 all 0.1030
recall_100 all 0.3410
recall_1000 all 0.3410
ndcg all 0.3327
ndcg_cut_10 all 0.4200
ndcg_cut_100 all 0.3481
ndcg_cut_1000 all 0.3333
uogtr_s_cprf¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5682
ndcg_cut_100 all 0.4237
ndcg_cut_1000 all 0.3350
summary (trec_eval)
map all 0.1866
bpref all 0.2470
recip_rank all 0.6743
P_10 all 0.5013
P_100 all 0.2001
P_1000 all 0.0200
recall_10 all 0.1159
recall_100 all 0.3665
recall_1000 all 0.3665
ndcg all 0.3606
ndcg_cut_10 all 0.4710
ndcg_cut_100 all 0.3768
ndcg_cut_1000 all 0.3614
uogtr_c_cprf¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5075
ndcg_cut_100 all 0.3269
ndcg_cut_1000 all 0.2644
summary (trec_eval)
map all 0.1355
bpref all 0.1849
recip_rank all 0.6390
P_10 all 0.4184
P_100 all 0.1243
P_1000 all 0.0124
recall_10 all 0.1086
recall_100 all 0.2480
recall_1000 all 0.2480
ndcg all 0.2704
ndcg_cut_10 all 0.4071
ndcg_cut_100 all 0.2826
ndcg_cut_1000 all 0.2711
uogtr_e_cprf_t5¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6182
ndcg_cut_100 all 0.4510
ndcg_cut_1000 all 0.3573
summary (trec_eval)
map all 0.2061
bpref all 0.2573
recip_rank all 0.7541
P_10 all 0.5539
P_100 all 0.1972
P_1000 all 0.0197
recall_10 all 0.1383
recall_100 all 0.3739
recall_1000 all 0.3739
ndcg all 0.3881
ndcg_cut_10 all 0.5281
ndcg_cut_100 all 0.4048
ndcg_cut_1000 all 0.3887
uogtr_doc_dph_bo1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1199
bpref all 0.1843
recip_rank all 0.6702
P_10 all 0.4961
P_100 all 0.2445
P_1000 all 0.0244
recall_10 all 0.0516
recall_100 all 0.2213
recall_1000 all 0.2213
ndcg all 0.2497
ndcg_cut_10 all 0.3625
ndcg_cut_100 all 0.2971
ndcg_cut_1000 all 0.2523
uogtr_doc_dph¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1099
bpref all 0.1759
recip_rank all 0.7093
P_10 all 0.4776
P_100 all 0.2350
P_1000 all 0.0235
recall_10 all 0.0470
recall_100 all 0.2162
recall_1000 all 0.2162
ndcg all 0.2433
ndcg_cut_10 all 0.3603
ndcg_cut_100 all 0.2898
ndcg_cut_1000 all 0.2458
SPLADE_PP_ED¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5786
ndcg_cut_100 all 0.4464
ndcg_cut_1000 all 0.3510
summary (trec_eval)
map all 0.1801
bpref all 0.2347
recip_rank all 0.7588
P_10 all 0.4961
P_100 all 0.1953
P_1000 all 0.0195
recall_10 all 0.1207
recall_100 all 0.3681
recall_1000 all 0.3681
ndcg all 0.3703
ndcg_cut_10 all 0.4856
ndcg_cut_100 all 0.3870
ndcg_cut_1000 all 0.3711
SPLADE_PP_ED_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2656
bpref all 0.3167
recip_rank all 0.9101
P_10 all 0.7895
P_100 all 0.3982
P_1000 all 0.0398
recall_10 all 0.1014
recall_100 all 0.3840
recall_1000 all 0.3840
ndcg all 0.4370
ndcg_cut_10 all 0.6448
ndcg_cut_100 all 0.5124
ndcg_cut_1000 all 0.4401
SPLADE_PP_ED_RCIO_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2864
bpref all 0.3434
recip_rank all 0.9457
P_10 all 0.8184
P_100 all 0.4159
P_1000 all 0.0416
recall_10 all 0.1042
recall_100 all 0.3968
recall_1000 all 0.3968
ndcg all 0.4551
ndcg_cut_10 all 0.6566
ndcg_cut_100 all 0.5322
ndcg_cut_1000 all 0.4585
SPLADE_PP_ED_RCIO¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5917
ndcg_cut_100 all 0.4564
ndcg_cut_1000 all 0.3604
summary (trec_eval)
map all 0.1923
bpref all 0.2472
recip_rank all 0.7230
P_10 all 0.5171
P_100 all 0.2029
P_1000 all 0.0203
recall_10 all 0.1179
recall_100 all 0.3762
recall_1000 all 0.3762
ndcg all 0.3757
ndcg_cut_10 all 0.4921
ndcg_cut_100 all 0.3928
ndcg_cut_1000 all 0.3766
Infosense-1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4832
ndcg_cut_100 all 0.2694
ndcg_cut_1000 all 0.2032
summary (trec_eval)
map all 0.0830
bpref all 0.1114
recip_rank all 0.7044
P_10 all 0.3645
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0828
recall_100 all 0.1382
recall_1000 all 0.1382
ndcg all 0.1910
ndcg_cut_10 all 0.3735
ndcg_cut_100 all 0.2046
ndcg_cut_1000 all 0.1918
Infosense-2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4848
ndcg_cut_100 all 0.2708
ndcg_cut_1000 all 0.2046
summary (trec_eval)
map all 0.0846
bpref all 0.1120
recip_rank all 0.7429
P_10 all 0.3618
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0798
recall_100 all 0.1382
recall_1000 all 0.1382
ndcg all 0.1955
ndcg_cut_10 all 0.3811
ndcg_cut_100 all 0.2092
ndcg_cut_1000 all 0.1963
SPLADE_PP_SD_RCIO¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5897
ndcg_cut_100 all 0.4558
ndcg_cut_1000 all 0.3584
summary (trec_eval)
map all 0.1968
bpref all 0.2541
recip_rank all 0.6938
P_10 all 0.5224
P_100 all 0.2097
P_1000 all 0.0210
recall_10 all 0.1218
recall_100 all 0.3822
recall_1000 all 0.3822
ndcg all 0.3763
ndcg_cut_10 all 0.4859
ndcg_cut_100 all 0.3942
ndcg_cut_1000 all 0.3771
SPLADE_PP_SD_RCIO_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2835
bpref all 0.3375
recip_rank all 0.9162
P_10 all 0.8197
P_100 all 0.4126
P_1000 all 0.0413
recall_10 all 0.1022
recall_100 all 0.3985
recall_1000 all 0.3985
ndcg all 0.4516
ndcg_cut_10 all 0.6471
ndcg_cut_100 all 0.5286
ndcg_cut_1000 all 0.4550
SPLADE_PP_SD_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2692
bpref all 0.3196
recip_rank all 0.9173
P_10 all 0.7803
P_100 all 0.4012
P_1000 all 0.0401
recall_10 all 0.0980
recall_100 all 0.3887
recall_1000 all 0.3887
ndcg all 0.4410
ndcg_cut_10 all 0.6269
ndcg_cut_100 all 0.5170
ndcg_cut_1000 all 0.4443
SPLADE_PP_SD¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5705
ndcg_cut_100 all 0.4466
ndcg_cut_1000 all 0.3508
summary (trec_eval)
map all 0.1846
bpref all 0.2407
recip_rank all 0.7005
P_10 all 0.4947
P_100 all 0.2014
P_1000 all 0.0201
recall_10 all 0.1228
recall_100 all 0.3742
recall_1000 all 0.3742
ndcg all 0.3708
ndcg_cut_10 all 0.4704
ndcg_cut_100 all 0.3876
ndcg_cut_1000 all 0.3715
SPLADE_ENSEMBLE_PP¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5789
ndcg_cut_100 all 0.4538
ndcg_cut_1000 all 0.3564
summary (trec_eval)
map all 0.1862
bpref all 0.2384
recip_rank all 0.7360
P_10 all 0.4987
P_100 all 0.2025
P_1000 all 0.0202
recall_10 all 0.1212
recall_100 all 0.3793
recall_1000 all 0.3793
ndcg all 0.3766
ndcg_cut_10 all 0.4844
ndcg_cut_100 all 0.3936
ndcg_cut_1000 all 0.3773
SPLADE_ENSEMBLE_PP_RCIO¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5991
ndcg_cut_100 all 0.4664
ndcg_cut_1000 all 0.3676
summary (trec_eval)
map all 0.2005
bpref all 0.2521
recip_rank all 0.7410
P_10 all 0.5316
P_100 all 0.2104
P_1000 all 0.0210
recall_10 all 0.1260
recall_100 all 0.3842
recall_1000 all 0.3842
ndcg all 0.3841
ndcg_cut_10 all 0.5030
ndcg_cut_100 all 0.4021
ndcg_cut_1000 all 0.3849
SPLADE_ENSEMBLE_PP_RCIO_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2933
bpref all 0.3469
recip_rank all 0.9323
P_10 all 0.8224
P_100 all 0.4204
P_1000 all 0.0420
recall_10 all 0.1039
recall_100 all 0.4048
recall_1000 all 0.4048
ndcg all 0.4602
ndcg_cut_10 all 0.6584
ndcg_cut_100 all 0.5380
ndcg_cut_1000 all 0.4636
SPLADE_ENSEMBLE_PP_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2740
bpref all 0.3242
recip_rank all 0.9205
P_10 all 0.7947
P_100 all 0.4089
P_1000 all 0.0409
recall_10 all 0.1005
recall_100 all 0.3936
recall_1000 all 0.3936
ndcg all 0.4455
ndcg_cut_10 all 0.6402
ndcg_cut_100 all 0.5225
ndcg_cut_1000 all 0.4488
SPLADE_EFF_V_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2345
bpref all 0.2840
recip_rank all 0.9039
P_10 all 0.7395
P_100 all 0.3701
P_1000 all 0.0370
recall_10 all 0.0865
recall_100 all 0.3471
recall_1000 all 0.3471
ndcg all 0.4055
ndcg_cut_10 all 0.6094
ndcg_cut_100 all 0.4766
ndcg_cut_1000 all 0.4086
SPLADE_EFF_V_RCIO_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2524
bpref all 0.3041
recip_rank all 0.8917
P_10 all 0.7566
P_100 all 0.3945
P_1000 all 0.0394
recall_10 all 0.0831
recall_100 all 0.3671
recall_1000 all 0.3671
ndcg all 0.4173
ndcg_cut_10 all 0.6031
ndcg_cut_100 all 0.4904
ndcg_cut_1000 all 0.4204
SPLADE_EFF_V_RCIO¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5452
ndcg_cut_100 all 0.4144
ndcg_cut_1000 all 0.3228
summary (trec_eval)
map all 0.1725
bpref all 0.2270
recip_rank all 0.6402
P_10 all 0.4803
P_100 all 0.1970
P_1000 all 0.0197
recall_10 all 0.1013
recall_100 all 0.3284
recall_1000 all 0.3284
ndcg all 0.3368
ndcg_cut_10 all 0.4475
ndcg_cut_100 all 0.3540
ndcg_cut_1000 all 0.3376
SPLADE_EFF_V¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5509
ndcg_cut_100 all 0.4178
ndcg_cut_1000 all 0.3256
summary (trec_eval)
map all 0.1631
bpref all 0.2129
recip_rank all 0.6985
P_10 all 0.4776
P_100 all 0.1847
P_1000 all 0.0185
recall_10 all 0.1093
recall_100 all 0.3394
recall_1000 all 0.3394
ndcg all 0.3431
ndcg_cut_10 all 0.4583
ndcg_cut_100 all 0.3596
ndcg_cut_1000 all 0.3439
SPLADE_EFF_VI-BT¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5271
ndcg_cut_100 all 0.3923
ndcg_cut_1000 all 0.3017
summary (trec_eval)
map all 0.1452
bpref all 0.1917
recip_rank all 0.6620
P_10 all 0.4395
P_100 all 0.1718
P_1000 all 0.0172
recall_10 all 0.1007
recall_100 all 0.3159
recall_1000 all 0.3159
ndcg all 0.3182
ndcg_cut_10 all 0.4318
ndcg_cut_100 all 0.3345
ndcg_cut_1000 all 0.3190
SPLADE_EFF_VI-BT_RCIO¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5084
ndcg_cut_100 all 0.3798
ndcg_cut_1000 all 0.2929
summary (trec_eval)
map all 0.1452
bpref all 0.1990
recip_rank all 0.6096
P_10 all 0.4145
P_100 all 0.1711
P_1000 all 0.0171
recall_10 all 0.0927
recall_100 all 0.3025
recall_1000 all 0.3025
ndcg all 0.3014
ndcg_cut_10 all 0.3940
ndcg_cut_100 all 0.3167
ndcg_cut_1000 all 0.3023
SPLADE_EFF_VI-BT_RCIO_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2245
bpref all 0.2773
recip_rank all 0.8832
P_10 all 0.7474
P_100 all 0.3597
P_1000 all 0.0360
recall_10 all 0.0819
recall_100 all 0.3392
recall_1000 all 0.3392
ndcg all 0.3854
ndcg_cut_10 all 0.5755
ndcg_cut_100 all 0.4556
ndcg_cut_1000 all 0.3886
SPLADE_EFF_VI-BT_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2152
bpref all 0.2629
recip_rank all 0.8856
P_10 all 0.7053
P_100 all 0.3564
P_1000 all 0.0356
recall_10 all 0.0800
recall_100 all 0.3298
recall_1000 all 0.3298
ndcg all 0.3818
ndcg_cut_10 all 0.5758
ndcg_cut_100 all 0.4520
ndcg_cut_1000 all 0.3851
NLE_SPLADE_RR¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.7092
ndcg_cut_100 all 0.5626
ndcg_cut_1000 all 0.4483
summary (trec_eval)
map all 0.2977
bpref all 0.3441
recip_rank all 0.8322
P_10 all 0.6592
P_100 all 0.2646
P_1000 all 0.0265
recall_10 all 0.1615
recall_100 all 0.4867
recall_1000 all 0.4867
ndcg all 0.4975
ndcg_cut_10 all 0.6336
ndcg_cut_100 all 0.5192
ndcg_cut_1000 all 0.4983
NLE_SPLADE_RR_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3453
bpref all 0.3910
recip_rank all 0.9770
P_10 all 0.8868
P_100 all 0.4563
P_1000 all 0.0456
recall_10 all 0.1218
recall_100 all 0.4423
recall_1000 all 0.4423
ndcg all 0.5250
ndcg_cut_10 all 0.7611
ndcg_cut_100 all 0.6127
ndcg_cut_1000 all 0.5289
NLE_SPLADE_CBERT_RR_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3387
bpref all 0.3832
recip_rank all 0.9836
P_10 all 0.8855
P_100 all 0.4497
P_1000 all 0.0450
recall_10 all 0.1197
recall_100 all 0.4359
recall_1000 all 0.4359
ndcg all 0.5201
ndcg_cut_10 all 0.7601
ndcg_cut_100 all 0.6073
ndcg_cut_1000 all 0.5240
NLE_SPLADE_CBERT_RR¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.7141
ndcg_cut_100 all 0.5590
ndcg_cut_1000 all 0.4452
summary (trec_eval)
map all 0.2963
bpref all 0.3429
recip_rank all 0.8374
P_10 all 0.6697
P_100 all 0.2633
P_1000 all 0.0263
recall_10 all 0.1650
recall_100 all 0.4857
recall_1000 all 0.4857
ndcg all 0.4966
ndcg_cut_10 all 0.6405
ndcg_cut_100 all 0.5181
ndcg_cut_1000 all 0.4974
NLE_SPLADE_CBERT_DT5_RR¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.7145
ndcg_cut_100 all 0.5590
ndcg_cut_1000 all 0.4440
summary (trec_eval)
map all 0.2950
bpref all 0.3392
recip_rank all 0.8408
P_10 all 0.6684
P_100 all 0.2618
P_1000 all 0.0262
recall_10 all 0.1670
recall_100 all 0.4803
recall_1000 all 0.4803
ndcg all 0.4935
ndcg_cut_10 all 0.6405
ndcg_cut_100 all 0.5152
ndcg_cut_1000 all 0.4944
NLE_SPLADE_CBERT_DT5_RR_D¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3405
bpref all 0.3842
recip_rank all 0.9781
P_10 all 0.8908
P_100 all 0.4549
P_1000 all 0.0455
recall_10 all 0.1211
recall_100 all 0.4407
recall_1000 all 0.4407
ndcg all 0.5230
ndcg_cut_10 all 0.7598
ndcg_cut_100 all 0.6111
ndcg_cut_1000 all 0.5269
p_bm25¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.2692
ndcg_cut_100 all 0.2133
ndcg_cut_1000 all 0.1555
summary (trec_eval)
map all 0.0325
bpref all 0.0665
recip_rank all 0.3256
P_10 all 0.1421
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0289
recall_100 all 0.1382
recall_1000 all 0.1382
ndcg all 0.1187
ndcg_cut_10 all 0.1345
ndcg_cut_100 all 0.1304
ndcg_cut_1000 all 0.1194
p_bm25rm3¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.2724
ndcg_cut_100 all 0.2076
ndcg_cut_1000 all 0.1515
summary (trec_eval)
map all 0.0326
bpref all 0.0693
recip_rank all 0.2678
P_10 all 0.1474
P_100 all 0.0795
P_1000 all 0.0079
recall_10 all 0.0242
recall_100 all 0.1274
recall_1000 all 0.1274
ndcg all 0.1138
ndcg_cut_10 all 0.1297
ndcg_cut_100 all 0.1249
ndcg_cut_1000 all 0.1146
p_bm25rocchio¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.2741
ndcg_cut_100 all 0.2159
ndcg_cut_1000 all 0.1571
summary (trec_eval)
map all 0.0340
bpref all 0.0705
recip_rank all 0.2729
P_10 all 0.1421
P_100 all 0.0832
P_1000 all 0.0083
recall_10 all 0.0250
recall_100 all 0.1396
recall_1000 all 0.1396
ndcg all 0.1201
ndcg_cut_10 all 0.1297
ndcg_cut_100 all 0.1318
ndcg_cut_1000 all 0.1209
paug_bm25¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.2742
ndcg_cut_100 all 0.1972
ndcg_cut_1000 all 0.1482
summary (trec_eval)
map all 0.0346
bpref all 0.0692
recip_rank all 0.3091
P_10 all 0.1671
P_100 all 0.0717
P_1000 all 0.0072
recall_10 all 0.0337
recall_100 all 0.1426
recall_1000 all 0.1426
ndcg all 0.1209
ndcg_cut_10 all 0.1459
ndcg_cut_100 all 0.1299
ndcg_cut_1000 all 0.1216
paug_bm25rm3¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.2591
ndcg_cut_100 all 0.1797
ndcg_cut_1000 all 0.1369
summary (trec_eval)
map all 0.0318
bpref all 0.0605
recip_rank all 0.2911
P_10 all 0.1461
P_100 all 0.0678
P_1000 all 0.0068
recall_10 all 0.0273
recall_100 all 0.1238
recall_1000 all 0.1238
ndcg all 0.1057
ndcg_cut_10 all 0.1322
ndcg_cut_100 all 0.1146
ndcg_cut_1000 all 0.1065
paug_bm25rocchio¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.2593
ndcg_cut_100 all 0.1787
ndcg_cut_1000 all 0.1353
summary (trec_eval)
map all 0.0314
bpref all 0.0611
recip_rank all 0.2994
P_10 all 0.1461
P_100 all 0.0667
P_1000 all 0.0067
recall_10 all 0.0254
recall_100 all 0.1216
recall_1000 all 0.1216
ndcg all 0.1046
ndcg_cut_10 all 0.1316
ndcg_cut_100 all 0.1136
ndcg_cut_1000 all 0.1053
p_tct¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5329
ndcg_cut_100 all 0.3892
ndcg_cut_1000 all 0.3080
summary (trec_eval)
map all 0.1540
bpref all 0.2066
recip_rank all 0.6823
P_10 all 0.4289
P_100 all 0.1642
P_1000 all 0.0164
recall_10 all 0.1082
recall_100 all 0.3292
recall_1000 all 0.3292
ndcg all 0.3290
ndcg_cut_10 all 0.4247
ndcg_cut_100 all 0.3428
ndcg_cut_1000 all 0.3296
p_d2q_bm25¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.3599
ndcg_cut_100 all 0.2871
ndcg_cut_1000 all 0.2198
summary (trec_eval)
map all 0.0748
bpref all 0.1261
recip_rank all 0.4221
P_10 all 0.2513
P_100 all 0.1186
P_1000 all 0.0119
recall_10 all 0.0593
recall_100 all 0.2259
recall_1000 all 0.2259
ndcg all 0.2047
ndcg_cut_10 all 0.2322
ndcg_cut_100 all 0.2171
ndcg_cut_1000 all 0.2055
p_d2q_bm25rm3¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.3704
ndcg_cut_100 all 0.3013
ndcg_cut_1000 all 0.2270
summary (trec_eval)
map all 0.0864
bpref all 0.1371
recip_rank all 0.4167
P_10 all 0.2671
P_100 all 0.1312
P_1000 all 0.0131
recall_10 all 0.0614
recall_100 all 0.2454
recall_1000 all 0.2454
ndcg all 0.2175
ndcg_cut_10 all 0.2462
ndcg_cut_100 all 0.2308
ndcg_cut_1000 all 0.2183
p_d2q_bm25rocchio¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.3712
ndcg_cut_100 all 0.3023
ndcg_cut_1000 all 0.2279
summary (trec_eval)
map all 0.0868
bpref all 0.1384
recip_rank all 0.4273
P_10 all 0.2645
P_100 all 0.1301
P_1000 all 0.0130
recall_10 all 0.0598
recall_100 all 0.2434
recall_1000 all 0.2434
ndcg all 0.2177
ndcg_cut_10 all 0.2440
ndcg_cut_100 all 0.2311
ndcg_cut_1000 all 0.2185
paug_d2q_bm25¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.3609
ndcg_cut_100 all 0.2856
ndcg_cut_1000 all 0.2213
summary (trec_eval)
map all 0.0735
bpref all 0.1186
recip_rank all 0.4396
P_10 all 0.2434
P_100 all 0.1161
P_1000 all 0.0116
recall_10 all 0.0560
recall_100 all 0.2331
recall_1000 all 0.2331
ndcg all 0.2044
ndcg_cut_10 all 0.2320
ndcg_cut_100 all 0.2157
ndcg_cut_1000 all 0.2052
paug_d2q_bm25rm3¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.3754
ndcg_cut_100 all 0.2867
ndcg_cut_1000 all 0.2206
summary (trec_eval)
map all 0.0818
bpref all 0.1304
recip_rank all 0.4583
P_10 all 0.2539
P_100 all 0.1187
P_1000 all 0.0119
recall_10 all 0.0609
recall_100 all 0.2249
recall_1000 all 0.2249
ndcg all 0.2053
ndcg_cut_10 all 0.2450
ndcg_cut_100 all 0.2171
ndcg_cut_1000 all 0.2061
paug_d2q_bm25rocchio¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.3801
ndcg_cut_100 all 0.2923
ndcg_cut_1000 all 0.2254
summary (trec_eval)
map all 0.0860
bpref all 0.1332
recip_rank all 0.4583
P_10 all 0.2579
P_100 all 0.1199
P_1000 all 0.0120
recall_10 all 0.0599
recall_100 all 0.2314
recall_1000 all 0.2314
ndcg all 0.2119
ndcg_cut_10 all 0.2488
ndcg_cut_100 all 0.2234
ndcg_cut_1000 all 0.2127
p_agg¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5282
ndcg_cut_100 all 0.3796
ndcg_cut_1000 all 0.2979
summary (trec_eval)
map all 0.1461
bpref all 0.1979
recip_rank all 0.6520
P_10 all 0.4447
P_100 all 0.1625
P_1000 all 0.0162
recall_10 all 0.1093
recall_100 all 0.3102
recall_1000 all 0.3102
ndcg all 0.3108
ndcg_cut_10 all 0.4238
ndcg_cut_100 all 0.3246
ndcg_cut_1000 all 0.3114
p_unicoil_noexp¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4077
ndcg_cut_100 all 0.2939
ndcg_cut_1000 all 0.2210
summary (trec_eval)
map all 0.0754
bpref all 0.1195
recip_rank all 0.5258
P_10 all 0.2987
P_100 all 0.1241
P_1000 all 0.0124
recall_10 all 0.0537
recall_100 all 0.2151
recall_1000 all 0.2151
ndcg all 0.2099
ndcg_cut_10 all 0.2937
ndcg_cut_100 all 0.2234
ndcg_cut_1000 all 0.2107
p_unicoil_noexp_rocchio¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4164
ndcg_cut_100 all 0.3150
ndcg_cut_1000 all 0.2379
summary (trec_eval)
map all 0.0974
bpref all 0.1379
recip_rank all 0.4659
P_10 all 0.3303
P_100 all 0.1374
P_1000 all 0.0137
recall_10 all 0.0581
recall_100 all 0.2440
recall_1000 all 0.2440
ndcg all 0.2299
ndcg_cut_10 all 0.3041
ndcg_cut_100 all 0.2433
ndcg_cut_1000 all 0.2306
p_unicoil_exp¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4614
ndcg_cut_100 all 0.3467
ndcg_cut_1000 all 0.2654
summary (trec_eval)
map all 0.1050
bpref all 0.1546
recip_rank all 0.5831
P_10 all 0.3711
P_100 all 0.1496
P_1000 all 0.0150
recall_10 all 0.0792
recall_100 all 0.2716
recall_1000 all 0.2716
ndcg all 0.2626
ndcg_cut_10 all 0.3532
ndcg_cut_100 all 0.2775
ndcg_cut_1000 all 0.2634
p_unicoil_exp_rocchio¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.4886
ndcg_cut_100 all 0.3602
ndcg_cut_1000 all 0.2790
summary (trec_eval)
map all 0.1225
bpref all 0.1729
recip_rank all 0.5577
P_10 all 0.4079
P_100 all 0.1583
P_1000 all 0.0158
recall_10 all 0.0813
recall_100 all 0.2860
recall_1000 all 0.2860
ndcg all 0.2755
ndcg_cut_10 all 0.3733
ndcg_cut_100 all 0.2906
ndcg_cut_1000 all 0.2763
p_dhr¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.5524
ndcg_cut_100 all 0.4138
ndcg_cut_1000 all 0.3257
summary (trec_eval)
map all 0.1662
bpref all 0.2183
recip_rank all 0.6948
P_10 all 0.4829
P_100 all 0.1801
P_1000 all 0.0180
recall_10 all 0.1186
recall_100 all 0.3411
recall_1000 all 0.3411
ndcg all 0.3404
ndcg_cut_10 all 0.4544
ndcg_cut_100 all 0.3546
ndcg_cut_1000 all 0.3409
p_d2q_bm25rocchio_mt5¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6282
ndcg_cut_100 all 0.4573
ndcg_cut_1000 all 0.3595
summary (trec_eval)
map all 0.2122
bpref all 0.2667
recip_rank all 0.7522
P_10 all 0.5684
P_100 all 0.2053
P_1000 all 0.0205
recall_10 all 0.1375
recall_100 all 0.3755
recall_1000 all 0.3755
ndcg all 0.3951
ndcg_cut_10 all 0.5402
ndcg_cut_100 all 0.4131
ndcg_cut_1000 all 0.3959
p_d2q_bm25rocchio_mdt5¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.6933
ndcg_cut_100 all 0.4749
ndcg_cut_1000 all 0.3754
summary (trec_eval)
map all 0.2374
bpref all 0.2873
recip_rank all 0.8417
P_10 all 0.6434
P_100 all 0.2053
P_1000 all 0.0205
recall_10 all 0.1612
recall_100 all 0.3755
recall_1000 all 0.3755
ndcg all 0.4163
ndcg_cut_10 all 0.6165
ndcg_cut_100 all 0.4350
ndcg_cut_1000 all 0.4171
f_sum_mdt5¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndcg)| Appendix
summary (ndcg)
ndcg_cut_10 all 0.7030
ndcg_cut_100 all 0.5062
ndcg_cut_1000 all 0.4028
summary (trec_eval)
map all 0.2698
bpref all 0.3246
recip_rank all 0.8366
P_10 all 0.6658
P_100 all 0.2364
P_1000 all 0.0236
recall_10 all 0.1632
recall_100 all 0.4282
recall_1000 all 0.4282
ndcg all 0.4597
ndcg_cut_10 all 0.6365
ndcg_cut_100 all 0.4794
ndcg_cut_1000 all 0.4604
plm_512¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0816
bpref all 0.1503
recip_rank all 0.6371
P_10 all 0.3671
P_100 all 0.1880
P_1000 all 0.0188
recall_10 all 0.0375
recall_100 all 0.1756
recall_1000 all 0.1756
ndcg all 0.1934
ndcg_cut_10 all 0.2721
ndcg_cut_100 all 0.2270
ndcg_cut_1000 all 0.1951
plm_128¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0905
bpref all 0.1513
recip_rank all 0.7070
P_10 all 0.4329
P_100 all 0.1880
P_1000 all 0.0188
recall_10 all 0.0470
recall_100 all 0.1756
recall_1000 all 0.1756
ndcg all 0.2059
ndcg_cut_10 all 0.3387
ndcg_cut_100 all 0.2430
ndcg_cut_1000 all 0.2079
plm_64¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0909
bpref all 0.1505
recip_rank all 0.6665
P_10 all 0.4184
P_100 all 0.1880
P_1000 all 0.0188
recall_10 all 0.0485
recall_100 all 0.1756
recall_1000 all 0.1756
ndcg all 0.2038
ndcg_cut_10 all 0.3227
ndcg_cut_100 all 0.2392
ndcg_cut_1000 all 0.2056