Results - Deep Learning 2021¶
NLE_P_v1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.7347
ndcg_cut_100 all 0.6430
ndcg_cut_1000 all 0.5767
summary (trec_eval)
map all 0.3923
bpref all 0.4304
recip_rank all 0.8697
P_10 all 0.6642
P_100 all 0.3138
P_1000 all 0.0314
recall_10 all 0.1887
recall_100 all 0.6039
recall_1000 all 0.6039
ndcg all 0.5858
ndcg_cut_10 all 0.6431
ndcg_cut_100 all 0.6154
ndcg_cut_1000 all 0.5858
Fast_Forward_2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2773
bpref all 0.3366
recip_rank all 0.9247
P_10 all 0.8140
P_100 all 0.4500
P_1000 all 0.0450
recall_10 all 0.0932
recall_100 all 0.3856
recall_1000 all 0.3856
ndcg all 0.4672
ndcg_cut_10 all 0.6338
ndcg_cut_100 all 0.5467
ndcg_cut_1000 all 0.4672
Fast_Forward_5¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2730
bpref all 0.3249
recip_rank all 0.9373
P_10 all 0.7982
P_100 all 0.4333
P_1000 all 0.0433
recall_10 all 0.0944
recall_100 all 0.3733
recall_1000 all 0.3733
ndcg all 0.4587
ndcg_cut_10 all 0.6282
ndcg_cut_100 all 0.5383
ndcg_cut_1000 all 0.4587
Fast_Forward_7¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2525
bpref all 0.3098
recip_rank all 0.8952
P_10 all 0.7544
P_100 all 0.4086
P_1000 all 0.0409
recall_10 all 0.0903
recall_100 all 0.3552
recall_1000 all 0.3552
ndcg all 0.4343
ndcg_cut_10 all 0.5905
ndcg_cut_100 all 0.5096
ndcg_cut_1000 all 0.4343
Fast_Forward_3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5451
ndcg_cut_100 all 0.4708
ndcg_cut_1000 all 0.4212
summary (trec_eval)
map all 0.1927
bpref all 0.2458
recip_rank all 0.6401
P_10 all 0.4642
P_100 all 0.2091
P_1000 all 0.0209
recall_10 all 0.1229
recall_100 all 0.4066
recall_1000 all 0.4066
ndcg all 0.3786
ndcg_cut_10 all 0.4201
ndcg_cut_100 all 0.3987
ndcg_cut_1000 all 0.3786
Fast_ForwardP_2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5521
ndcg_cut_100 all 0.4749
ndcg_cut_1000 all 0.4253
summary (trec_eval)
map all 0.1998
bpref all 0.2526
recip_rank all 0.6486
P_10 all 0.4717
P_100 all 0.2128
P_1000 all 0.0213
recall_10 all 0.1229
recall_100 all 0.4121
recall_1000 all 0.4121
ndcg all 0.3868
ndcg_cut_10 all 0.4291
ndcg_cut_100 all 0.4065
ndcg_cut_1000 all 0.3868
Fast_ForwardP_5¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5132
ndcg_cut_100 all 0.4441
ndcg_cut_1000 all 0.3972
summary (trec_eval)
map all 0.1728
bpref all 0.2309
recip_rank all 0.6034
P_10 all 0.4226
P_100 all 0.1911
P_1000 all 0.0191
recall_10 all 0.1129
recall_100 all 0.3713
recall_1000 all 0.3713
ndcg all 0.3468
ndcg_cut_10 all 0.3836
ndcg_cut_100 all 0.3655
ndcg_cut_1000 all 0.3468
bl_bcai_trad¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2494
bpref all 0.2981
recip_rank all 0.9276
P_10 all 0.7561
P_100 all 0.3956
P_1000 all 0.0396
recall_10 all 0.0884
recall_100 all 0.3413
recall_1000 all 0.3413
ndcg all 0.4317
ndcg_cut_10 all 0.6136
ndcg_cut_100 all 0.5065
ndcg_cut_1000 all 0.4317
bl_bcai_nn_rtr¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2749
bpref all 0.3242
recip_rank all 0.9630
P_10 all 0.8140
P_100 all 0.4254
P_1000 all 0.0425
recall_10 all 0.0963
recall_100 all 0.3586
recall_1000 all 0.3586
ndcg all 0.4641
ndcg_cut_10 all 0.6671
ndcg_cut_100 all 0.5444
ndcg_cut_1000 all 0.4641
bcai_bertm1_ens¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2559
bpref all 0.3130
recip_rank all 0.9444
P_10 all 0.8140
P_100 all 0.4158
P_1000 all 0.0416
recall_10 all 0.0942
recall_100 all 0.3512
recall_1000 all 0.3512
ndcg all 0.4625
ndcg_cut_10 all 0.6812
ndcg_cut_100 all 0.5424
ndcg_cut_1000 all 0.4625
WLUPassage¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4432
ndcg_cut_100 all 0.3897
ndcg_cut_1000 all 0.3475
summary (trec_eval)
map all 0.1348
bpref all 0.1880
recip_rank all 0.5682
P_10 all 0.3604
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.0823
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.2936
ndcg_cut_10 all 0.3325
ndcg_cut_100 all 0.3111
ndcg_cut_1000 all 0.2936
WLUPassage1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4093
ndcg_cut_100 all 0.3770
ndcg_cut_1000 all 0.3354
summary (trec_eval)
map all 0.1170
bpref all 0.1753
recip_rank all 0.4886
P_10 all 0.3321
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.0743
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.2754
ndcg_cut_10 all 0.2884
ndcg_cut_100 all 0.2927
ndcg_cut_1000 all 0.2754
CIP_run1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2445
bpref all 0.2880
recip_rank all 0.9505
P_10 all 0.8158
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.0977
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4245
ndcg_cut_10 all 0.6755
ndcg_cut_100 all 0.4950
ndcg_cut_1000 all 0.4245
CIP_run2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2478
bpref all 0.2911
recip_rank all 0.9373
P_10 all 0.8140
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.0978
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4270
ndcg_cut_10 all 0.6783
ndcg_cut_100 all 0.4977
ndcg_cut_1000 all 0.4270
CIP_run3¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2457
bpref all 0.2888
recip_rank all 0.9567
P_10 all 0.8175
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.0980
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4233
ndcg_cut_10 all 0.6668
ndcg_cut_100 all 0.4931
ndcg_cut_1000 all 0.4233
TUW_DR_Base¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4991
ndcg_cut_100 all 0.3861
ndcg_cut_1000 all 0.3463
summary (trec_eval)
map all 0.1540
bpref all 0.2237
recip_rank all 0.6768
P_10 all 0.4208
P_100 all 0.1751
P_1000 all 0.0175
recall_10 all 0.0988
recall_100 all 0.3610
recall_1000 all 0.3610
ndcg all 0.3288
ndcg_cut_10 all 0.3942
ndcg_cut_100 all 0.3465
ndcg_cut_1000 all 0.3288
TUW_TAS-B_768¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5619
ndcg_cut_100 all 0.4783
ndcg_cut_1000 all 0.4300
summary (trec_eval)
map all 0.2093
bpref all 0.2682
recip_rank all 0.7333
P_10 all 0.4679
P_100 all 0.2170
P_1000 all 0.0217
recall_10 all 0.1159
recall_100 all 0.4544
recall_1000 all 0.4544
ndcg all 0.4120
ndcg_cut_10 all 0.4520
ndcg_cut_100 all 0.4332
ndcg_cut_1000 all 0.4120
TUW_TAS-B_ANN¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5426
ndcg_cut_100 all 0.4665
ndcg_cut_1000 all 0.4173
summary (trec_eval)
map all 0.1932
bpref all 0.2570
recip_rank all 0.7015
P_10 all 0.4566
P_100 all 0.2185
P_1000 all 0.0218
recall_10 all 0.1120
recall_100 all 0.4429
recall_1000 all 0.4429
ndcg all 0.3907
ndcg_cut_10 all 0.4252
ndcg_cut_100 all 0.4122
ndcg_cut_1000 all 0.3907
pass_full_1000¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6434
ndcg_cut_100 all 0.4789
ndcg_cut_1000 all 0.4297
summary (trec_eval)
map all 0.2413
bpref all 0.2899
recip_rank all 0.7695
P_10 all 0.5491
P_100 all 0.2108
P_1000 all 0.0211
recall_10 all 0.1496
recall_100 all 0.4212
recall_1000 all 0.4212
ndcg all 0.4283
ndcg_cut_10 all 0.5331
ndcg_cut_100 all 0.4505
ndcg_cut_1000 all 0.4283
doc_full_100¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2465
bpref all 0.3114
recip_rank all 0.9308
P_10 all 0.7930
P_100 all 0.4125
P_1000 all 0.0412
recall_10 all 0.0907
recall_100 all 0.3653
recall_1000 all 0.3653
ndcg all 0.4511
ndcg_cut_10 all 0.6414
ndcg_cut_100 all 0.5256
ndcg_cut_1000 all 0.4511
yorku21_a¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6965
ndcg_cut_100 all 0.5779
ndcg_cut_1000 all 0.5176
summary (trec_eval)
map all 0.3309
bpref all 0.3728
recip_rank all 0.8629
P_10 all 0.6151
P_100 all 0.2800
P_1000 all 0.0280
recall_10 all 0.1706
recall_100 all 0.5484
recall_1000 all 0.5484
ndcg all 0.5288
ndcg_cut_10 all 0.6012
ndcg_cut_100 all 0.5557
ndcg_cut_1000 all 0.5288
yorku21_b¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5694
ndcg_cut_100 all 0.4424
ndcg_cut_1000 all 0.3954
summary (trec_eval)
map all 0.2032
bpref all 0.2687
recip_rank all 0.7180
P_10 all 0.4792
P_100 all 0.2068
P_1000 all 0.0207
recall_10 all 0.1152
recall_100 all 0.4068
recall_1000 all 0.4068
ndcg all 0.3890
ndcg_cut_10 all 0.4581
ndcg_cut_100 all 0.4095
ndcg_cut_1000 all 0.3890
yorku21_c¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6930
ndcg_cut_100 all 0.5763
ndcg_cut_1000 all 0.5166
summary (trec_eval)
map all 0.3323
bpref all 0.3755
recip_rank all 0.8393
P_10 all 0.6189
P_100 all 0.2749
P_1000 all 0.0275
recall_10 all 0.1739
recall_100 all 0.5379
recall_1000 all 0.5379
ndcg all 0.5259
ndcg_cut_10 all 0.5978
ndcg_cut_100 all 0.5522
ndcg_cut_1000 all 0.5259
webis-dl-1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2254
bpref all 0.2731
recip_rank all 0.9356
P_10 all 0.7368
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.0831
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4008
ndcg_cut_10 all 0.5831
ndcg_cut_100 all 0.4694
ndcg_cut_1000 all 0.4008
webis-dl-2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2224
bpref all 0.2726
recip_rank all 0.9396
P_10 all 0.7298
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.0850
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.3989
ndcg_cut_10 all 0.5747
ndcg_cut_100 all 0.4670
ndcg_cut_1000 all 0.3989
webis-dl-3¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2305
bpref all 0.2767
recip_rank all 0.9488
P_10 all 0.7456
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.0859
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4041
ndcg_cut_10 all 0.5918
ndcg_cut_100 all 0.4725
ndcg_cut_1000 all 0.4041
pass_rank_100¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5389
ndcg_cut_100 all 0.4202
ndcg_cut_1000 all 0.3772
summary (trec_eval)
map all 0.1781
bpref all 0.2307
recip_rank all 0.6588
P_10 all 0.4377
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.1276
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.3346
ndcg_cut_10 all 0.4134
ndcg_cut_100 all 0.3516
ndcg_cut_1000 all 0.3346
doc_rank_100¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2168
bpref all 0.2748
recip_rank all 0.9392
P_10 all 0.7386
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.0866
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4051
ndcg_cut_10 all 0.6175
ndcg_cut_100 all 0.4740
ndcg_cut_1000 all 0.4051
NLE_P_V1andV2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6724
ndcg_cut_100 all 0.5977
ndcg_cut_1000 all 0.5368
summary (trec_eval)
map all 0.3381
bpref all 0.3795
recip_rank all 0.7756
P_10 all 0.6170
P_100 all 0.2883
P_1000 all 0.0288
recall_10 all 0.1738
recall_100 all 0.5701
recall_1000 all 0.5701
ndcg all 0.5320
ndcg_cut_10 all 0.5764
ndcg_cut_100 all 0.5577
ndcg_cut_1000 all 0.5320
NLE_P_quick¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6087
ndcg_cut_100 all 0.5081
ndcg_cut_1000 all 0.4544
summary (trec_eval)
map all 0.2443
bpref all 0.3078
recip_rank all 0.7342
P_10 all 0.5302
P_100 all 0.2419
P_1000 all 0.0242
recall_10 all 0.1338
recall_100 all 0.4677
recall_1000 all 0.4677
ndcg all 0.4381
ndcg_cut_10 all 0.4914
ndcg_cut_100 all 0.4612
ndcg_cut_1000 all 0.4381
NLE_D_v1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3133
bpref all 0.3733
recip_rank all 1.0000
P_10 all 0.8719
P_100 all 0.4658
P_1000 all 0.0466
recall_10 all 0.1074
recall_100 all 0.4131
recall_1000 all 0.4131
ndcg all 0.5109
ndcg_cut_10 all 0.7215
ndcg_cut_100 all 0.5921
ndcg_cut_1000 all 0.5109
NLE_D_V1andV2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2969
bpref all 0.3591
recip_rank all 0.9503
P_10 all 0.8509
P_100 all 0.4528
P_1000 all 0.0453
recall_10 all 0.1038
recall_100 all 0.3956
recall_1000 all 0.3956
ndcg all 0.4904
ndcg_cut_10 all 0.6871
ndcg_cut_100 all 0.5696
ndcg_cut_1000 all 0.4904
NLE_D_quick¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2198
bpref all 0.2847
recip_rank all 0.9024
P_10 all 0.7702
P_100 all 0.3654
P_1000 all 0.0365
recall_10 all 0.0847
recall_100 all 0.3133
recall_1000 all 0.3133
ndcg all 0.4039
ndcg_cut_10 all 0.6015
ndcg_cut_100 all 0.4708
ndcg_cut_1000 all 0.4039
pass_full_1000e¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6071
ndcg_cut_100 all 0.4949
ndcg_cut_1000 all 0.4456
summary (trec_eval)
map all 0.2425
bpref all 0.3014
recip_rank all 0.7339
P_10 all 0.5340
P_100 all 0.2264
P_1000 all 0.0226
recall_10 all 0.1483
recall_100 all 0.4520
recall_1000 all 0.4520
ndcg all 0.4359
ndcg_cut_10 all 0.5095
ndcg_cut_100 all 0.4569
ndcg_cut_1000 all 0.4359
doc_full_100e¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2465
bpref all 0.3114
recip_rank all 0.9308
P_10 all 0.7930
P_100 all 0.4125
P_1000 all 0.0412
recall_10 all 0.0907
recall_100 all 0.3653
recall_1000 all 0.3653
ndcg all 0.4511
ndcg_cut_10 all 0.6414
ndcg_cut_100 all 0.5256
ndcg_cut_1000 all 0.4511
pash_r1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6951
ndcg_cut_100 all 0.4640
ndcg_cut_1000 all 0.4168
summary (trec_eval)
map all 0.2362
bpref all 0.2628
recip_rank all 0.8663
P_10 all 0.6057
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.1633
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.3869
ndcg_cut_10 all 0.5878
ndcg_cut_100 all 0.4066
ndcg_cut_1000 all 0.3869
p_bm25¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4458
ndcg_cut_100 all 0.3913
ndcg_cut_1000 all 0.3497
summary (trec_eval)
map all 0.1357
bpref all 0.1971
recip_rank all 0.5060
P_10 all 0.3547
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.0955
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.2940
ndcg_cut_10 all 0.3160
ndcg_cut_100 all 0.3108
ndcg_cut_1000 all 0.2940
p_bm25rm3¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4480
ndcg_cut_100 all 0.4040
ndcg_cut_1000 all 0.3613
summary (trec_eval)
map all 0.1632
bpref all 0.2135
recip_rank all 0.4925
P_10 all 0.3604
P_100 all 0.1772
P_1000 all 0.0177
recall_10 all 0.0925
recall_100 all 0.3498
recall_1000 all 0.3498
ndcg all 0.3107
ndcg_cut_10 all 0.3214
ndcg_cut_100 all 0.3267
ndcg_cut_1000 all 0.3107
paug_bm25¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.3977
ndcg_cut_100 all 0.3204
ndcg_cut_1000 all 0.2903
summary (trec_eval)
map all 0.0977
bpref all 0.1572
recip_rank all 0.5303
P_10 all 0.2755
P_100 all 0.1275
P_1000 all 0.0128
recall_10 all 0.0718
recall_100 all 0.2709
recall_1000 all 0.2709
ndcg all 0.2390
ndcg_cut_10 all 0.2600
ndcg_cut_100 all 0.2505
ndcg_cut_1000 all 0.2390
paug_bm25rm3¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.3906
ndcg_cut_100 all 0.3227
ndcg_cut_1000 all 0.2943
summary (trec_eval)
map all 0.1050
bpref all 0.1580
recip_rank all 0.4906
P_10 all 0.2585
P_100 all 0.1262
P_1000 all 0.0126
recall_10 all 0.0651
recall_100 all 0.2795
recall_1000 all 0.2795
ndcg all 0.2418
ndcg_cut_10 all 0.2459
ndcg_cut_100 all 0.2523
ndcg_cut_1000 all 0.2418
d_bm25¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2126
bpref all 0.2784
recip_rank all 0.8367
P_10 all 0.6684
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.0778
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.3832
ndcg_cut_10 all 0.5116
ndcg_cut_100 all 0.4491
ndcg_cut_1000 all 0.3832
d_bm25rm3¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2453
bpref all 0.3073
recip_rank all 0.7994
P_10 all 0.7175
P_100 all 0.3982
P_1000 all 0.0398
recall_10 all 0.0855
recall_100 all 0.3374
recall_1000 all 0.3374
ndcg all 0.4004
ndcg_cut_10 all 0.5339
ndcg_cut_100 all 0.4707
ndcg_cut_1000 all 0.4004
dseg_bm25¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2436
bpref all 0.3053
recip_rank all 0.8937
P_10 all 0.7509
P_100 all 0.3947
P_1000 all 0.0395
recall_10 all 0.0921
recall_100 all 0.3478
recall_1000 all 0.3478
ndcg all 0.4208
ndcg_cut_10 all 0.5776
ndcg_cut_100 all 0.4911
ndcg_cut_1000 all 0.4208
dseg_bm25rm3¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2933
bpref all 0.3496
recip_rank all 0.9018
P_10 all 0.8228
P_100 all 0.4402
P_1000 all 0.0440
recall_10 all 0.1056
recall_100 all 0.3892
recall_1000 all 0.3892
ndcg all 0.4608
ndcg_cut_10 all 0.6185
ndcg_cut_100 all 0.5379
ndcg_cut_1000 all 0.4608
pash_r2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.7076
ndcg_cut_100 all 0.4669
ndcg_cut_1000 all 0.4197
summary (trec_eval)
map all 0.2389
bpref all 0.2645
recip_rank all 0.8678
P_10 all 0.6189
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.1682
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.3880
ndcg_cut_10 all 0.5989
ndcg_cut_100 all 0.4076
ndcg_cut_1000 all 0.3880
watpfp¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4950
ndcg_cut_100 all 0.4185
ndcg_cut_1000 all 0.3728
summary (trec_eval)
map all 0.1738
bpref all 0.2247
recip_rank all 0.5985
P_10 all 0.3962
P_100 all 0.1906
P_1000 all 0.0191
recall_10 all 0.1030
recall_100 all 0.3677
recall_1000 all 0.3677
ndcg all 0.3326
ndcg_cut_10 all 0.3543
ndcg_cut_100 all 0.3503
ndcg_cut_1000 all 0.3326
watpfd¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.3672
ndcg_cut_100 all 0.2657
ndcg_cut_1000 all 0.2386
summary (trec_eval)
map all 0.0688
bpref all 0.1235
recip_rank all 0.4833
P_10 all 0.2453
P_100 all 0.0991
P_1000 all 0.0099
recall_10 all 0.0634
recall_100 all 0.2149
recall_1000 all 0.2149
ndcg all 0.1899
ndcg_cut_10 all 0.2233
ndcg_cut_100 all 0.1995
ndcg_cut_1000 all 0.1899
watpff¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4408
ndcg_cut_100 all 0.3901
ndcg_cut_1000 all 0.3501
summary (trec_eval)
map all 0.1346
bpref all 0.2011
recip_rank all 0.5104
P_10 all 0.3321
P_100 all 0.1694
P_1000 all 0.0169
recall_10 all 0.0885
recall_100 all 0.3402
recall_1000 all 0.3402
ndcg all 0.2924
ndcg_cut_10 all 0.2917
ndcg_cut_100 all 0.3070
ndcg_cut_1000 all 0.2924
bigrams_cont_qe¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2957
bpref all 0.3465
recip_rank all 0.8751
P_10 all 0.7860
P_100 all 0.4505
P_1000 all 0.0451
recall_10 all 0.0948
recall_100 all 0.3834
recall_1000 all 0.3834
ndcg all 0.4544
ndcg_cut_10 all 0.5941
ndcg_cut_100 all 0.5313
ndcg_cut_1000 all 0.4544
watdff¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2961
bpref all 0.3520
recip_rank all 0.9211
P_10 all 0.8193
P_100 all 0.4726
P_1000 all 0.0473
recall_10 all 0.0957
recall_100 all 0.3928
recall_1000 all 0.3928
ndcg all 0.4630
ndcg_cut_10 all 0.6060
ndcg_cut_100 all 0.5439
ndcg_cut_1000 all 0.4630
watdfd¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2504
bpref all 0.3130
recip_rank all 0.8895
P_10 all 0.7579
P_100 all 0.4335
P_1000 all 0.0434
recall_10 all 0.0813
recall_100 all 0.3567
recall_1000 all 0.3567
ndcg all 0.4194
ndcg_cut_10 all 0.5615
ndcg_cut_100 all 0.4953
ndcg_cut_1000 all 0.4194
watdfp¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2351
bpref all 0.3043
recip_rank all 0.8874
P_10 all 0.7632
P_100 all 0.3965
P_1000 all 0.0396
recall_10 all 0.0841
recall_100 all 0.3375
recall_1000 all 0.3375
ndcg all 0.4067
ndcg_cut_10 all 0.5580
ndcg_cut_100 all 0.4745
ndcg_cut_1000 all 0.4067
uogTrBasePD¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4619
ndcg_cut_100 all 0.3804
ndcg_cut_1000 all 0.3417
summary (trec_eval)
map all 0.1439
bpref all 0.2021
recip_rank all 0.5610
P_10 all 0.3698
P_100 all 0.1630
P_1000 all 0.0163
recall_10 all 0.0926
recall_100 all 0.3313
recall_1000 all 0.3313
ndcg all 0.3034
ndcg_cut_10 all 0.3378
ndcg_cut_100 all 0.3185
ndcg_cut_1000 all 0.3034
uogTrBasePDQ¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4747
ndcg_cut_100 all 0.4082
ndcg_cut_1000 all 0.3676
summary (trec_eval)
map all 0.1724
bpref all 0.2303
recip_rank all 0.5611
P_10 all 0.4000
P_100 all 0.1853
P_1000 all 0.0185
recall_10 all 0.1025
recall_100 all 0.3598
recall_1000 all 0.3598
ndcg all 0.3289
ndcg_cut_10 all 0.3587
ndcg_cut_100 all 0.3441
ndcg_cut_1000 all 0.3289
uogTrBaseDDQ¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2487
bpref all 0.3033
recip_rank all 0.8297
P_10 all 0.7561
P_100 all 0.4114
P_1000 all 0.0411
recall_10 all 0.0853
recall_100 all 0.3493
recall_1000 all 0.3493
ndcg all 0.4231
ndcg_cut_10 all 0.5704
ndcg_cut_100 all 0.4974
ndcg_cut_1000 all 0.4231
uogTrBaseDD¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2487
bpref all 0.3033
recip_rank all 0.8297
P_10 all 0.7561
P_100 all 0.4114
P_1000 all 0.0411
recall_10 all 0.0853
recall_100 all 0.3493
recall_1000 all 0.3493
ndcg all 0.4231
ndcg_cut_10 all 0.5704
ndcg_cut_100 all 0.4974
ndcg_cut_1000 all 0.4231
uogTrBaseDDpmp¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1769
bpref all 0.2388
recip_rank all 0.8563
P_10 all 0.6772
P_100 all 0.3105
P_1000 all 0.0311
recall_10 all 0.0755
recall_100 all 0.2635
recall_1000 all 0.2635
ndcg all 0.3350
ndcg_cut_10 all 0.5070
ndcg_cut_100 all 0.3910
ndcg_cut_1000 all 0.3350
uogTrBaseDDQpmp¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2029
bpref all 0.2673
recip_rank all 0.8316
P_10 all 0.6895
P_100 all 0.3472
P_1000 all 0.0347
recall_10 all 0.0811
recall_100 all 0.2934
recall_1000 all 0.2934
ndcg all 0.3600
ndcg_cut_10 all 0.5105
ndcg_cut_100 all 0.4208
ndcg_cut_1000 all 0.3600
top1000¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5104
ndcg_cut_100 all 0.3000
ndcg_cut_1000 all 0.2610
summary (trec_eval)
map all 0.1217
bpref all 0.1710
recip_rank all 0.6566
P_10 all 0.4321
P_100 all 0.1347
P_1000 all 0.0135
recall_10 all 0.0947
recall_100 all 0.2151
recall_1000 all 0.2151
ndcg all 0.2533
ndcg_cut_10 all 0.4055
ndcg_cut_100 all 0.2716
ndcg_cut_1000 all 0.2533
watdrd¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2529
bpref all 0.2855
recip_rank all 0.9520
P_10 all 0.8088
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.0973
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4207
ndcg_cut_10 all 0.6411
ndcg_cut_100 all 0.4907
ndcg_cut_1000 all 0.4207
watprp¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5493
ndcg_cut_100 all 0.4236
ndcg_cut_1000 all 0.3801
summary (trec_eval)
map all 0.1728
bpref all 0.2138
recip_rank all 0.6827
P_10 all 0.4491
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.1326
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.3278
ndcg_cut_10 all 0.4155
ndcg_cut_100 all 0.3454
ndcg_cut_1000 all 0.3278
bl_bcai_p_trad¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4261
ndcg_cut_100 all 0.3530
ndcg_cut_1000 all 0.3140
summary (trec_eval)
map all 0.1133
bpref all 0.1811
recip_rank all 0.5086
P_10 all 0.3208
P_100 all 0.1549
P_1000 all 0.0155
recall_10 all 0.0777
recall_100 all 0.3003
recall_1000 all 0.3003
ndcg all 0.2664
ndcg_cut_10 all 0.2926
ndcg_cut_100 all 0.2826
ndcg_cut_1000 all 0.2664
watprd¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4698
ndcg_cut_100 all 0.4012
ndcg_cut_1000 all 0.3597
summary (trec_eval)
map all 0.1442
bpref all 0.1971
recip_rank all 0.6240
P_10 all 0.3491
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.0926
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.3032
ndcg_cut_10 all 0.3302
ndcg_cut_100 all 0.3193
ndcg_cut_1000 all 0.3032
watprf¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5184
ndcg_cut_100 all 0.4155
ndcg_cut_1000 all 0.3730
summary (trec_eval)
map all 0.1631
bpref all 0.2130
recip_rank all 0.6050
P_10 all 0.4264
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.1077
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.3159
ndcg_cut_10 all 0.3787
ndcg_cut_100 all 0.3325
ndcg_cut_1000 all 0.3159
watdrf¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2533
bpref all 0.2826
recip_rank all 0.9693
P_10 all 0.8193
P_100 all 0.3549
P_1000 all 0.0355
recall_10 all 0.1021
recall_100 all 0.3074
recall_1000 all 0.3074
ndcg all 0.4162
ndcg_cut_10 all 0.6467
ndcg_cut_100 all 0.4849
ndcg_cut_1000 all 0.4162
watdrp¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2419
bpref all 0.2785
recip_rank all 0.9386
P_10 all 0.8053
P_100 all 0.3549
P_1000 all 0.0355
recall_10 all 0.0970
recall_100 all 0.3074
recall_1000 all 0.3074
ndcg all 0.4070
ndcg_cut_10 all 0.6307
ndcg_cut_100 all 0.4752
ndcg_cut_1000 all 0.4070
bl_bcai_p_nn_rt¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5245
ndcg_cut_100 all 0.4162
ndcg_cut_1000 all 0.3774
summary (trec_eval)
map all 0.1691
bpref all 0.2327
recip_rank all 0.6852
P_10 all 0.4132
P_100 all 0.1683
P_1000 all 0.0168
recall_10 all 0.1109
recall_100 all 0.3669
recall_1000 all 0.3669
ndcg all 0.3457
ndcg_cut_10 all 0.3903
ndcg_cut_100 all 0.3608
ndcg_cut_1000 all 0.3457
bcai_p_mbert¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6363
ndcg_cut_100 all 0.4956
ndcg_cut_1000 all 0.4454
summary (trec_eval)
map all 0.2487
bpref all 0.2995
recip_rank all 0.7765
P_10 all 0.5717
P_100 all 0.2194
P_1000 all 0.0219
recall_10 all 0.1547
recall_100 all 0.4348
recall_1000 all 0.4348
ndcg all 0.4368
ndcg_cut_10 all 0.5486
ndcg_cut_100 all 0.4580
ndcg_cut_1000 all 0.4368
bcai_p_vbert¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6502
ndcg_cut_100 all 0.4737
ndcg_cut_1000 all 0.4274
summary (trec_eval)
map all 0.2323
bpref all 0.2853
recip_rank all 0.7957
P_10 all 0.5811
P_100 all 0.2021
P_1000 all 0.0202
recall_10 all 0.1586
recall_100 all 0.4125
recall_1000 all 0.4125
ndcg all 0.4177
ndcg_cut_10 all 0.5557
ndcg_cut_100 all 0.4366
ndcg_cut_1000 all 0.4177
bl_bcai_wloo_p¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6029
ndcg_cut_100 all 0.4483
ndcg_cut_1000 all 0.4028
summary (trec_eval)
map all 0.2077
bpref all 0.2569
recip_rank all 0.7691
P_10 all 0.5245
P_100 all 0.1853
P_1000 all 0.0185
recall_10 all 0.1380
recall_100 all 0.3734
recall_1000 all 0.3734
ndcg all 0.3902
ndcg_cut_10 all 0.5135
ndcg_cut_100 all 0.4092
ndcg_cut_1000 all 0.3902
d_tct0¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2418
bpref all 0.2993
recip_rank all 0.9455
P_10 all 0.8053
P_100 all 0.3816
P_1000 all 0.0382
recall_10 all 0.0908
recall_100 all 0.3256
recall_1000 all 0.3256
ndcg all 0.4339
ndcg_cut_10 all 0.6537
ndcg_cut_100 all 0.5055
ndcg_cut_1000 all 0.4339
d_tct1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1794
bpref all 0.2333
recip_rank all 0.9190
P_10 all 0.7649
P_100 all 0.2898
P_1000 all 0.0290
recall_10 all 0.0860
recall_100 all 0.2517
recall_1000 all 0.2517
ndcg all 0.3596
ndcg_cut_10 all 0.6269
ndcg_cut_100 all 0.4166
ndcg_cut_1000 all 0.3596
d_unicoil0¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2495
bpref all 0.3183
recip_rank all 0.9088
P_10 all 0.7825
P_100 all 0.3958
P_1000 all 0.0396
recall_10 all 0.0940
recall_100 all 0.3483
recall_1000 all 0.3483
ndcg all 0.4377
ndcg_cut_10 all 0.6325
ndcg_cut_100 all 0.5080
ndcg_cut_1000 all 0.4377
d_fusion00¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2887
bpref all 0.3441
recip_rank all 0.9630
P_10 all 0.8544
P_100 all 0.4391
P_1000 all 0.0439
recall_10 all 0.1000
recall_100 all 0.3784
recall_1000 all 0.3784
ndcg all 0.4832
ndcg_cut_10 all 0.7003
ndcg_cut_100 all 0.5633
ndcg_cut_1000 all 0.4832
d_fusion10¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2518
bpref all 0.3084
recip_rank all 0.9423
P_10 all 0.8316
P_100 all 0.3874
P_1000 all 0.0387
recall_10 all 0.0959
recall_100 all 0.3442
recall_1000 all 0.3442
ndcg all 0.4475
ndcg_cut_10 all 0.6831
ndcg_cut_100 all 0.5179
ndcg_cut_1000 all 0.4475
p_tct0¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5001
ndcg_cut_100 all 0.3812
ndcg_cut_1000 all 0.3425
summary (trec_eval)
map all 0.1332
bpref all 0.1959
recip_rank all 0.6574
P_10 all 0.3774
P_100 all 0.1575
P_1000 all 0.0158
recall_10 all 0.0951
recall_100 all 0.3257
recall_1000 all 0.3257
ndcg all 0.3077
ndcg_cut_10 all 0.3742
ndcg_cut_100 all 0.3243
ndcg_cut_1000 all 0.3077
p_tct1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4499
ndcg_cut_100 all 0.3318
ndcg_cut_1000 all 0.2997
summary (trec_eval)
map all 0.1159
bpref all 0.1839
recip_rank all 0.5703
P_10 all 0.3755
P_100 all 0.1385
P_1000 all 0.0138
recall_10 all 0.0876
recall_100 all 0.2927
recall_1000 all 0.2927
ndcg all 0.2746
ndcg_cut_10 all 0.3487
ndcg_cut_100 all 0.2877
ndcg_cut_1000 all 0.2746
p_unicoil0¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5785
ndcg_cut_100 all 0.4654
ndcg_cut_1000 all 0.4165
summary (trec_eval)
map all 0.2165
bpref all 0.2766
recip_rank all 0.6788
P_10 all 0.4981
P_100 all 0.2125
P_1000 all 0.0212
recall_10 all 0.1283
recall_100 all 0.4129
recall_1000 all 0.4129
ndcg all 0.3948
ndcg_cut_10 all 0.4680
ndcg_cut_100 all 0.4151
ndcg_cut_1000 all 0.3948
p_fusion00¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5713
ndcg_cut_100 all 0.4791
ndcg_cut_1000 all 0.4302
summary (trec_eval)
map all 0.2005
bpref all 0.2642
recip_rank all 0.7783
P_10 all 0.4472
P_100 all 0.2157
P_1000 all 0.0216
recall_10 all 0.1237
recall_100 all 0.4350
recall_1000 all 0.4350
ndcg all 0.4036
ndcg_cut_10 all 0.4536
ndcg_cut_100 all 0.4241
ndcg_cut_1000 all 0.4036
p_fusion10¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5857
ndcg_cut_100 all 0.4446
ndcg_cut_1000 all 0.3994
summary (trec_eval)
map all 0.1855
bpref all 0.2398
recip_rank all 0.7854
P_10 all 0.4698
P_100 all 0.1853
P_1000 all 0.0185
recall_10 all 0.1241
recall_100 all 0.3734
recall_1000 all 0.3734
ndcg all 0.3718
ndcg_cut_10 all 0.4668
ndcg_cut_100 all 0.3908
ndcg_cut_1000 all 0.3718
bl_bcai_wloo_d¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2534
bpref all 0.3110
recip_rank all 0.9230
P_10 all 0.7947
P_100 all 0.3874
P_1000 all 0.0387
recall_10 all 0.0989
recall_100 all 0.3442
recall_1000 all 0.3442
ndcg all 0.4517
ndcg_cut_10 all 0.6762
ndcg_cut_100 all 0.5222
ndcg_cut_1000 all 0.4517
ielab-TILDEv2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.5825
ndcg_cut_100 all 0.4746
ndcg_cut_1000 all 0.4256
summary (trec_eval)
map all 0.2112
bpref all 0.2703
recip_rank all 0.6926
P_10 all 0.4906
P_100 all 0.2119
P_1000 all 0.0212
recall_10 all 0.1318
recall_100 all 0.4139
recall_1000 all 0.4139
ndcg all 0.3949
ndcg_cut_10 all 0.4643
ndcg_cut_100 all 0.4155
ndcg_cut_1000 all 0.3949
ielab-TILDEv2d¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2262
bpref all 0.2866
recip_rank all 0.8829
P_10 all 0.7842
P_100 all 0.3668
P_1000 all 0.0367
recall_10 all 0.0916
recall_100 all 0.3197
recall_1000 all 0.3197
ndcg all 0.4010
ndcg_cut_10 all 0.6022
ndcg_cut_100 all 0.4679
ndcg_cut_1000 all 0.4010
max-firstp-pass¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2321
bpref all 0.2854
recip_rank all 0.9363
P_10 all 0.8263
P_100 all 0.3663
P_1000 all 0.0366
recall_10 all 0.0930
recall_100 all 0.3143
recall_1000 all 0.3143
ndcg all 0.4215
ndcg_cut_10 all 0.6727
ndcg_cut_100 all 0.4900
ndcg_cut_1000 all 0.4215
maxp¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2308
bpref all 0.2850
recip_rank all 0.9538
P_10 all 0.8211
P_100 all 0.3581
P_1000 all 0.0358
recall_10 all 0.0955
recall_100 all 0.3119
recall_1000 all 0.3119
ndcg all 0.4192
ndcg_cut_10 all 0.6672
ndcg_cut_100 all 0.4854
ndcg_cut_1000 all 0.4192
maxp-firstp¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2278
bpref all 0.2817
recip_rank all 0.9436
P_10 all 0.8246
P_100 all 0.3582
P_1000 all 0.0358
recall_10 all 0.0944
recall_100 all 0.3088
recall_1000 all 0.3088
ndcg all 0.4159
ndcg_cut_10 all 0.6709
ndcg_cut_100 all 0.4824
ndcg_cut_1000 all 0.4159
pash_r3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.7072
ndcg_cut_100 all 0.4670
ndcg_cut_1000 all 0.4197
summary (trec_eval)
map all 0.2385
bpref all 0.2642
recip_rank all 0.8675
P_10 all 0.6170
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.1658
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.3880
ndcg_cut_10 all 0.5978
ndcg_cut_100 all 0.4077
ndcg_cut_1000 all 0.3880
maxp_h3¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2198
bpref all 0.2935
recip_rank all 0.9313
P_10 all 0.7491
P_100 all 0.3796
P_1000 all 0.0380
recall_10 all 0.0861
recall_100 all 0.3324
recall_1000 all 0.3324
ndcg all 0.4212
ndcg_cut_10 all 0.6017
ndcg_cut_100 all 0.4876
ndcg_cut_1000 all 0.4212
parade_bm25¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2490
bpref all 0.2883
recip_rank all 0.9592
P_10 all 0.8088
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.0975
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4262
ndcg_cut_10 all 0.6707
ndcg_cut_100 all 0.4966
ndcg_cut_1000 all 0.4262
parade_h3¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2590
bpref all 0.3285
recip_rank all 0.9488
P_10 all 0.7789
P_100 all 0.4209
P_1000 all 0.0421
recall_10 all 0.0963
recall_100 all 0.3667
recall_1000 all 0.3667
ndcg all 0.4582
ndcg_cut_10 all 0.6295
ndcg_cut_100 all 0.5319
ndcg_cut_1000 all 0.4582
mono_d3¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6037
ndcg_cut_100 all 0.4462
ndcg_cut_1000 all 0.4013
summary (trec_eval)
map all 0.2150
bpref all 0.2757
recip_rank all 0.7341
P_10 all 0.5472
P_100 all 0.1979
P_1000 all 0.0198
recall_10 all 0.1441
recall_100 all 0.3979
recall_1000 all 0.3979
ndcg all 0.3996
ndcg_cut_10 all 0.5116
ndcg_cut_100 all 0.4186
ndcg_cut_1000 all 0.3996
mono_h3¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6115
ndcg_cut_100 all 0.5140
ndcg_cut_1000 all 0.4615
summary (trec_eval)
map all 0.2548
bpref all 0.3139
recip_rank all 0.7267
P_10 all 0.5566
P_100 all 0.2423
P_1000 all 0.0242
recall_10 all 0.1462
recall_100 all 0.4857
recall_1000 all 0.4857
ndcg all 0.4548
ndcg_cut_10 all 0.5182
ndcg_cut_100 all 0.4769
ndcg_cut_1000 all 0.4548
mono_electra_h3¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6753
ndcg_cut_100 all 0.5547
ndcg_cut_1000 all 0.5002
summary (trec_eval)
map all 0.2880
bpref all 0.3420
recip_rank all 0.7887
P_10 all 0.6057
P_100 all 0.2542
P_1000 all 0.0254
recall_10 all 0.1606
recall_100 all 0.5298
recall_1000 all 0.5298
ndcg all 0.4954
ndcg_cut_10 all 0.5721
ndcg_cut_100 all 0.5183
ndcg_cut_1000 all 0.4954
pash_f1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.7494
ndcg_cut_100 all 0.5742
ndcg_cut_1000 all 0.5185
summary (trec_eval)
map all 0.3193
bpref all 0.3439
recip_rank all 0.8732
P_10 all 0.6698
P_100 all 0.2366
P_1000 all 0.0237
recall_10 all 0.1892
recall_100 all 0.4868
recall_1000 all 0.4868
ndcg all 0.5018
ndcg_cut_10 all 0.6464
ndcg_cut_100 all 0.5260
ndcg_cut_1000 all 0.5018
pash_f2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.7494
ndcg_cut_100 all 0.6063
ndcg_cut_1000 all 0.5449
summary (trec_eval)
map all 0.3318
bpref all 0.3599
recip_rank all 0.8737
P_10 all 0.6698
P_100 all 0.2630
P_1000 all 0.0263
recall_10 all 0.1892
recall_100 all 0.5300
recall_1000 all 0.5300
ndcg all 0.5269
ndcg_cut_10 all 0.6464
ndcg_cut_100 all 0.5534
ndcg_cut_1000 all 0.5269
pash_f3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.7494
ndcg_cut_100 all 0.6164
ndcg_cut_1000 all 0.5543
summary (trec_eval)
map all 0.3378
bpref all 0.3653
recip_rank all 0.8737
P_10 all 0.6698
P_100 all 0.2728
P_1000 all 0.0273
recall_10 all 0.1892
recall_100 all 0.5500
recall_1000 all 0.5500
ndcg all 0.5376
ndcg_cut_10 all 0.6464
ndcg_cut_100 all 0.5646
ndcg_cut_1000 all 0.5376
TUW_IDCM_S4¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2460
bpref all 0.2861
recip_rank all 0.9115
P_10 all 0.8088
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.0993
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4186
ndcg_cut_10 all 0.6494
ndcg_cut_100 all 0.4883
ndcg_cut_1000 all 0.4186
TUW_IDCM_ALL¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2460
bpref all 0.2863
recip_rank all 0.9092
P_10 all 0.8035
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.0989
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4205
ndcg_cut_10 all 0.6455
ndcg_cut_100 all 0.4902
ndcg_cut_1000 all 0.4205
ielab-AD-uni¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6714
ndcg_cut_100 all 0.5545
ndcg_cut_1000 all 0.4944
summary (trec_eval)
map all 0.2842
bpref all 0.3397
recip_rank all 0.8045
P_10 all 0.5887
P_100 all 0.2643
P_1000 all 0.0264
recall_10 all 0.1551
recall_100 all 0.5029
recall_1000 all 0.5029
ndcg all 0.4808
ndcg_cut_10 all 0.5562
ndcg_cut_100 all 0.5071
ndcg_cut_1000 all 0.4808
pash_doc_r1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2665
bpref all 0.2947
recip_rank all 0.9772
P_10 all 0.8544
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.1053
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4403
ndcg_cut_10 all 0.7150
ndcg_cut_100 all 0.5121
ndcg_cut_1000 all 0.4403
ielab-uniCOIL¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6420
ndcg_cut_100 all 0.5480
ndcg_cut_1000 all 0.4890
summary (trec_eval)
map all 0.2745
bpref all 0.3234
recip_rank all 0.7975
P_10 all 0.5453
P_100 all 0.2553
P_1000 all 0.0255
recall_10 all 0.1325
recall_100 all 0.4905
recall_1000 all 0.4905
ndcg all 0.4711
ndcg_cut_10 all 0.5255
ndcg_cut_100 all 0.4961
ndcg_cut_1000 all 0.4711
ielab-AD-uni-d¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2492
bpref all 0.3115
recip_rank all 0.9684
P_10 all 0.8088
P_100 all 0.4000
P_1000 all 0.0400
recall_10 all 0.0923
recall_100 all 0.3493
recall_1000 all 0.3493
ndcg all 0.4402
ndcg_cut_10 all 0.6424
ndcg_cut_100 all 0.5124
ndcg_cut_1000 all 0.4402
ielab-uniCOIL-d¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2492
bpref all 0.3115
recip_rank all 0.9684
P_10 all 0.8088
P_100 all 0.4000
P_1000 all 0.0400
recall_10 all 0.0923
recall_100 all 0.3493
recall_1000 all 0.3493
ndcg all 0.4402
ndcg_cut_10 all 0.6424
ndcg_cut_100 all 0.5124
ndcg_cut_1000 all 0.4402
pash_doc_r2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2640
bpref all 0.2929
recip_rank all 0.9772
P_10 all 0.8561
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.1062
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4372
ndcg_cut_10 all 0.7076
ndcg_cut_100 all 0.5091
ndcg_cut_1000 all 0.4372
pash_doc_f1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3111
bpref all 0.3410
recip_rank all 0.9795
P_10 all 0.9053
P_100 all 0.4133
P_1000 all 0.0413
recall_10 all 0.1154
recall_100 all 0.3683
recall_1000 all 0.3683
ndcg all 0.4896
ndcg_cut_10 all 0.7437
ndcg_cut_100 all 0.5682
ndcg_cut_1000 all 0.4896
pash_doc_f4¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3498
bpref all 0.3920
recip_rank all 0.9795
P_10 all 0.9053
P_100 all 0.4944
P_1000 all 0.0494
recall_10 all 0.1154
recall_100 all 0.4412
recall_1000 all 0.4412
ndcg all 0.5410
ndcg_cut_10 all 0.7404
ndcg_cut_100 all 0.6287
ndcg_cut_1000 all 0.5410
bigram_qe_cedr¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2802
bpref all 0.3378
recip_rank all 0.8872
P_10 all 0.7754
P_100 all 0.4516
P_1000 all 0.0452
recall_10 all 0.0900
recall_100 all 0.3932
recall_1000 all 0.3932
ndcg all 0.4541
ndcg_cut_10 all 0.5920
ndcg_cut_100 all 0.5306
ndcg_cut_1000 all 0.4541
pash_doc_f5¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3521
bpref all 0.3926
recip_rank all 0.9795
P_10 all 0.8947
P_100 all 0.4954
P_1000 all 0.0495
recall_10 all 0.1122
recall_100 all 0.4419
recall_1000 all 0.4419
ndcg all 0.5427
ndcg_cut_10 all 0.7368
ndcg_cut_100 all 0.6307
ndcg_cut_1000 all 0.5427
uogTrPCP¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.1389
ndcg_cut_100 all 0.1452
ndcg_cut_1000 all 0.1269
summary (trec_eval)
map all 0.0451
bpref all 0.0763
recip_rank all 0.2381
P_10 all 0.1038
P_100 all 0.0628
P_1000 all 0.0063
recall_10 all 0.0207
recall_100 all 0.1389
recall_1000 all 0.1389
ndcg all 0.1264
ndcg_cut_10 all 0.0993
ndcg_cut_100 all 0.1343
ndcg_cut_1000 all 0.1264
uogTrPC¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.4611
ndcg_cut_100 all 0.2029
ndcg_cut_1000 all 0.1798
summary (trec_eval)
map all 0.0855
bpref all 0.1060
recip_rank all 0.6119
P_10 all 0.3755
P_100 all 0.0628
P_1000 all 0.0063
recall_10 all 0.0895
recall_100 all 0.1389
recall_1000 all 0.1389
ndcg all 0.1855
ndcg_cut_10 all 0.3762
ndcg_cut_100 all 0.1957
ndcg_cut_1000 all 0.1855
uogTrDCPpmp¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.0459
bpref all 0.0809
recip_rank all 0.3829
P_10 all 0.2421
P_100 all 0.1251
P_1000 all 0.0125
recall_10 all 0.0166
recall_100 all 0.1023
recall_1000 all 0.1023
ndcg all 0.1351
ndcg_cut_10 all 0.1673
ndcg_cut_100 all 0.1630
ndcg_cut_1000 all 0.1351
ihsm_colbert64¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6453
ndcg_cut_100 all 0.4496
ndcg_cut_1000 all 0.4036
summary (trec_eval)
map all 0.2148
bpref all 0.2448
recip_rank all 0.8463
P_10 all 0.5528
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.1478
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.3704
ndcg_cut_10 all 0.5365
ndcg_cut_100 all 0.3893
ndcg_cut_1000 all 0.3704
ielab-robertav1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6551
ndcg_cut_100 all 0.4523
ndcg_cut_1000 all 0.4061
summary (trec_eval)
map all 0.2246
bpref all 0.2560
recip_rank all 0.8144
P_10 all 0.5679
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.1559
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.3740
ndcg_cut_10 all 0.5457
ndcg_cut_100 all 0.3931
ndcg_cut_1000 all 0.3740
ielab-robertav2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6226
ndcg_cut_100 all 0.4437
ndcg_cut_1000 all 0.3986
summary (trec_eval)
map all 0.2000
bpref all 0.2393
recip_rank all 0.7645
P_10 all 0.5226
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.1360
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.3559
ndcg_cut_10 all 0.4976
ndcg_cut_100 all 0.3741
ndcg_cut_1000 all 0.3559
ihsm_bicolbert¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6393
ndcg_cut_100 all 0.4478
ndcg_cut_1000 all 0.4021
summary (trec_eval)
map all 0.2111
bpref all 0.2465
recip_rank all 0.7962
P_10 all 0.5547
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.1514
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.3652
ndcg_cut_10 all 0.5231
ndcg_cut_100 all 0.3840
ndcg_cut_1000 all 0.3652
ielab-roberta2d¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2040
bpref all 0.2385
recip_rank all 0.9470
P_10 all 0.8000
P_100 all 0.2879
P_1000 all 0.0288
recall_10 all 0.0972
recall_100 all 0.2533
recall_1000 all 0.2533
ndcg all 0.3655
ndcg_cut_10 all 0.6431
ndcg_cut_100 all 0.4243
ndcg_cut_1000 all 0.3655
ielab-roberta1d¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2039
bpref all 0.2399
recip_rank all 0.9591
P_10 all 0.8088
P_100 all 0.2879
P_1000 all 0.0288
recall_10 all 0.1006
recall_100 all 0.2533
recall_1000 all 0.2533
ndcg all 0.3661
ndcg_cut_10 all 0.6522
ndcg_cut_100 all 0.4256
ndcg_cut_1000 all 0.3661
uogTrDDQt5¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2963
bpref all 0.3277
recip_rank all 0.9737
P_10 all 0.8596
P_100 all 0.4114
P_1000 all 0.0411
recall_10 all 0.1011
recall_100 all 0.3493
recall_1000 all 0.3493
ndcg all 0.4687
ndcg_cut_10 all 0.7201
ndcg_cut_100 all 0.5483
ndcg_cut_1000 all 0.4687
ihsm_poly8q¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6342
ndcg_cut_100 all 0.4465
ndcg_cut_1000 all 0.4008
summary (trec_eval)
map all 0.2059
bpref all 0.2390
recip_rank all 0.8233
P_10 all 0.5302
P_100 all 0.1658
P_1000 all 0.0166
recall_10 all 0.1405
recall_100 all 0.3261
recall_1000 all 0.3261
ndcg all 0.3659
ndcg_cut_10 all 0.5160
ndcg_cut_100 all 0.3845
ndcg_cut_1000 all 0.3659
uogTrBaseDDQC¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2869
bpref all 0.3237
recip_rank all 0.9649
P_10 all 0.8456
P_100 all 0.4114
P_1000 all 0.0411
recall_10 all 0.0998
recall_100 all 0.3493
recall_1000 all 0.3493
ndcg all 0.4620
ndcg_cut_10 all 0.6966
ndcg_cut_100 all 0.5405
ndcg_cut_1000 all 0.4620
pash_doc_r3¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2672
bpref all 0.2976
recip_rank all 0.9772
P_10 all 0.8526
P_100 all 0.3660
P_1000 all 0.0366
recall_10 all 0.1087
recall_100 all 0.3195
recall_1000 all 0.3195
ndcg all 0.4396
ndcg_cut_10 all 0.7164
ndcg_cut_100 all 0.5114
ndcg_cut_1000 all 0.4396
uogTrPot5¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6517
ndcg_cut_100 all 0.4624
ndcg_cut_1000 all 0.4175
summary (trec_eval)
map all 0.2499
bpref all 0.2814
recip_rank all 0.8160
P_10 all 0.5736
P_100 all 0.1853
P_1000 all 0.0185
recall_10 all 0.1454
recall_100 all 0.3598
recall_1000 all 0.3598
ndcg all 0.3999
ndcg_cut_10 all 0.5507
ndcg_cut_100 all 0.4176
ndcg_cut_1000 all 0.3999
d_f10_mdt53b¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2837
bpref all 0.3395
recip_rank all 0.9883
P_10 all 0.8684
P_100 all 0.4311
P_1000 all 0.0431
recall_10 all 0.1067
recall_100 all 0.3694
recall_1000 all 0.3694
ndcg all 0.4834
ndcg_cut_10 all 0.7256
ndcg_cut_100 all 0.5642
ndcg_cut_1000 all 0.4834
d_f10_mt53b¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2767
bpref all 0.3368
recip_rank all 0.9605
P_10 all 0.8544
P_100 all 0.4311
P_1000 all 0.0431
recall_10 all 0.1033
recall_100 all 0.3694
recall_1000 all 0.3694
ndcg all 0.4764
ndcg_cut_10 all 0.7024
ndcg_cut_100 all 0.5566
ndcg_cut_1000 all 0.4764
d_f10_mdt5base¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2376
bpref all 0.3023
recip_rank all 0.9401
P_10 all 0.8035
P_100 all 0.3907
P_1000 all 0.0391
recall_10 all 0.0937
recall_100 all 0.3415
recall_1000 all 0.3415
ndcg all 0.4400
ndcg_cut_10 all 0.6606
ndcg_cut_100 all 0.5128
ndcg_cut_1000 all 0.4400
p_f10_mdt53b¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6617
ndcg_cut_100 all 0.4502
ndcg_cut_1000 all 0.4053
summary (trec_eval)
map all 0.2089
bpref all 0.2601
recip_rank all 0.7871
P_10 all 0.5774
P_100 all 0.1838
P_1000 all 0.0184
recall_10 all 0.1457
recall_100 all 0.3662
recall_1000 all 0.3662
ndcg all 0.3860
ndcg_cut_10 all 0.5443
ndcg_cut_100 all 0.4056
ndcg_cut_1000 all 0.3860
p_f10_mt53b¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6394
ndcg_cut_100 all 0.4427
ndcg_cut_1000 all 0.3985
summary (trec_eval)
map all 0.1992
bpref all 0.2558
recip_rank all 0.7700
P_10 all 0.5660
P_100 all 0.1838
P_1000 all 0.0184
recall_10 all 0.1381
recall_100 all 0.3662
recall_1000 all 0.3662
ndcg all 0.3755
ndcg_cut_10 all 0.5220
ndcg_cut_100 all 0.3948
ndcg_cut_1000 all 0.3755
p_f10_mdt5base¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
ndcg_cut_10 all 0.6193
ndcg_cut_100 all 0.4206
ndcg_cut_1000 all 0.3794
summary (trec_eval)
map all 0.1819
bpref all 0.2350
recip_rank all 0.7486
P_10 all 0.5340
P_100 all 0.1689
P_1000 all 0.0169
recall_10 all 0.1372
recall_100 all 0.3528
recall_1000 all 0.3528
ndcg all 0.3615
ndcg_cut_10 all 0.5032
ndcg_cut_100 all 0.3789
ndcg_cut_1000 all 0.3615
uogTrDot5pmp¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2077
bpref all 0.2426
recip_rank all 0.9386
P_10 all 0.7842
P_100 all 0.3018
P_1000 all 0.0302
recall_10 all 0.0907
recall_100 all 0.2574
recall_1000 all 0.2574
ndcg all 0.3695
ndcg_cut_10 all 0.6411
ndcg_cut_100 all 0.4302
ndcg_cut_1000 all 0.3695