Results - Round 2 2020¶
RMITBFuseM1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3654
map all 0.1572
ndcg all 0.4207
P_5 all 0.5486
rbp_p5 all 0.4942
cogir-ibm-qQ-PolRnk¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.425
map all 0.2628
ndcg all 0.6104
P_5 all 0.7314
rbp_p5 all 0.648
cogir-ibm-qQ-combs¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4222
map all 0.259
ndcg all 0.6131
P_5 all 0.7086
rbp_p5 all 0.6456
cogir-ibm-q-PolRnk¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4082
map all 0.238
ndcg all 0.589
P_5 all 0.6971
rbp_p5 all 0.6174
W2VJPDRMM¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2031
map all 0.0216
ndcg all 0.1179
P_5 all 0.1829
rbp_p5 all 0.1596
fusionOfFusions¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2141
map all 0.0704
ndcg all 0.2409
P_5 all 0.3543
rbp_p5 all 0.2967
allFiltering¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2267
map all 0.0981
ndcg all 0.3237
P_5 all 0.4343
rbp_p5 all 0.3488
soboroffFiltering¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2193
map all 0.0826
ndcg all 0.3078
P_5 all 0.4571
rbp_p5 all 0.3332
IRIT_markers_all¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4348
map all 0.2174
ndcg all 0.5366
P_5 all 0.6629
rbp_p5 all 0.6089
IRIT_markers_base_un¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4343
map all 0.2169
ndcg all 0.529
P_5 all 0.6629
rbp_p5 all 0.6083
IRIT_markers_base_mu¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4327
map all 0.214
ndcg all 0.5292
P_5 all 0.6514
rbp_p5 all 0.6025
r2.fusion2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4284
map all 0.2725
ndcg all 0.5553
P_5 all 0.68
rbp_p5 all 0.5737
r2.fusion1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4003
map all 0.2418
ndcg all 0.4827
P_5 all 0.6114
rbp_p5 all 0.5428
factum-hybrid-qa¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3417
map all 0.1138
ndcg all 0.3106
P_5 all 0.4
rbp_p5 all 0.329
factum-dense-qa¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2743
map all 0.0746
ndcg all 0.2124
P_5 all 0.2457
rbp_p5 all 0.2058
factum-hybrid¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3463
map all 0.1174
ndcg all 0.3253
P_5 all 0.4343
rbp_p5 all 0.3713
irc_bm25_altmetric¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3272
map all 0.1264
ndcg all 0.3636
P_5 all 0.48
rbp_p5 all 0.426
irc_logreg_tfidf¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4025
map all 0.1666
ndcg all 0.417
P_5 all 0.5371
rbp_p5 all 0.4841
mpiid5_run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4609
map all 0.2946
ndcg all 0.6677
P_5 all 0.7771
rbp_p5 all 0.7305
mpiid5_run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4943
map all 0.3185
ndcg all 0.6864
P_5 all 0.8057
rbp_p5 all 0.7472
mpiid5_run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5679
map all 0.338
ndcg all 0.6893
P_5 all 0.8514
rbp_p5 all 0.7547
COMBSUM¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3784
map all 0.2135
ndcg all 0.5028
P_5 all 0.6114
rbp_p5 all 0.5471
TF_IDF_Bo1QE¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3829
map all 0.2209
ndcg all 0.5149
P_5 all 0.6171
rbp_p5 all 0.547
PL2_Bo1QE¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3662
map all 0.1967
ndcg all 0.4715
P_5 all 0.5886
rbp_p5 all 0.497
PS-r2-allebd¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3066
map all 0.1323
ndcg all 0.394
P_5 all 0.52
rbp_p5 all 0.4648
PS-r2-termebd¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3049
map all 0.1287
ndcg all 0.385
P_5 all 0.5029
rbp_p5 all 0.4503
PS-r2-origin¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2841
map all 0.1246
ndcg all 0.3644
P_5 all 0.4686
rbp_p5 all 0.4439
covidex.t5¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4876
map all 0.288
ndcg all 0.625
P_5 all 0.7314
rbp_p5 all 0.6634
covidex.fuse¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5345
map all 0.291
ndcg all 0.5904
P_5 all 0.6743
rbp_p5 all 0.6544
covidex.sim¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4546
map all 0.1567
ndcg all 0.3254
P_5 all 0.3829
rbp_p5 all 0.3511
bm25_safir_s01p_rrf¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.391
map all 0.2093
ndcg all 0.4954
P_5 all 0.6057
rbp_p5 all 0.5333
cord19.vespa.ai-bm25¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3607
map all 0.1914
ndcg all 0.5549
P_5 all 0.64
rbp_p5 all 0.6359
bm25_safir_rrf¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3883
map all 0.209
ndcg all 0.5053
P_5 all 0.6171
rbp_p5 all 0.5457
bm25_safir_nvsm_rrf¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3875
map all 0.2068
ndcg all 0.4981
P_5 all 0.6171
rbp_p5 all 0.5379
cord19.vespa.ai-gbdt¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3887
map all 0.1884
ndcg all 0.5422
P_5 all 0.6686
rbp_p5 all 0.6324
MDA.QQ_RevW¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1178
map all 0.0386
ndcg all 0.0895
P_5 all 0.1029
rbp_p5 all 0.0748
MDA.QQ_RFW¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1311
map all 0.0478
ndcg all 0.1025
P_5 all 0.1143
rbp_p5 all 0.086
MDA.QQN_RevW¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1081
map all 0.0254
ndcg all 0.0839
P_5 all 0.0971
rbp_p5 all 0.0954
run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3919
map all 0.2037
ndcg all 0.5092
P_5 all 0.6343
rbp_p5 all 0.5951
run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3844
map all 0.1826
ndcg all 0.4601
P_5 all 0.5486
rbp_p5 all 0.5563
ucd_cs_r1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.366
map all 0.157
ndcg all 0.4208
P_5 all 0.56
rbp_p5 all 0.4653
run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3919
map all 0.2037
ndcg all 0.5092
P_5 all 0.6343
rbp_p5 all 0.5951
ucd_cs_r2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3877
map all 0.1512
ndcg all 0.3411
P_5 all 0.4
rbp_p5 all 0.3789
savantx_nist_run_1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1716
map all 0.0574
ndcg all 0.2541
P_5 all 0.3771
rbp_p5 all 0.2515
savantx_nist_run_2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.194
map all 0.0626
ndcg all 0.2421
P_5 all 0.3314
rbp_p5 all 0.244
ucd_cs_r3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3801
map all 0.1949
ndcg all 0.4527
P_5 all 0.5429
rbp_p5 all 0.4932
savantx_nist_run_3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1961
map all 0.0616
ndcg all 0.23
P_5 all 0.3143
rbp_p5 all 0.2331
Emory_IRLab_Run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3539
map all 0.2247
ndcg all 0.5832
P_5 all 0.6971
rbp_p5 all 0.6338
ir_covid19_cle_BM25¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3124
map all 0.145
ndcg all 0.3834
P_5 all 0.5029
rbp_p5 all 0.4526
req_rec_run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3824
map all 0.1075
ndcg all 0.3502
P_5 all 0.5143
rbp_p5 all 0.4127
req_rec_run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3314
map all 0.1458
ndcg all 0.3617
P_5 all 0.4571
rbp_p5 all 0.4285
req_rec_run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3824
map all 0.1075
ndcg all 0.3502
P_5 all 0.5143
rbp_p5 all 0.4127
SFDC-round2-baseline¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3956
map all 0.1469
ndcg all 0.4503
P_5 all 0.6114
rbp_p5 all 0.5426
CincyMedIR-11¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3544
map all 0.1749
ndcg all 0.5122
P_5 all 0.6286
rbp_p5 all 0.6134
CincyMedIR-6¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3414
map all 0.1695
ndcg all 0.5083
P_5 all 0.6229
rbp_p5 all 0.5753
CincyMedIR-4¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3378
map all 0.1655
ndcg all 0.4994
P_5 all 0.6
rbp_p5 all 0.5666
ir_covid19_cle_IB¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.305
map all 0.1423
ndcg all 0.3662
P_5 all 0.4686
rbp_p5 all 0.4283
udel_fang_FB¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4185
map all 0.2436
ndcg all 0.5625
P_5 all 0.6686
rbp_p5 all 0.6237
udel_fang_NIR¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3801
map all 0.1244
ndcg all 0.3084
P_5 all 0.3657
rbp_p5 all 0.3436
udel_fang_L2R¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3904
map all 0.2434
ndcg all 0.6132
P_5 all 0.6857
rbp_p5 all 0.6426
ir_covid19_cle_LMJ¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3042
map all 0.109
ndcg all 0.3046
P_5 all 0.3771
rbp_p5 all 0.3378
xj4wang_run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.481
map all 0.2146
ndcg all 0.586
P_5 all 0.7314
rbp_p5 all 0.6543
xj4wang_run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4862
map all 0.1742
ndcg all 0.3474
P_5 all 0.3543
rbp_p5 all 0.2464
xj4wang_run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4823
map all 0.221
ndcg all 0.5907
P_5 all 0.7314
rbp_p5 all 0.6546
cu_dbmi_bm25¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4132
map all 0.2083
ndcg all 0.5564
P_5 all 0.6171
rbp_p5 all 0.6355
GUIR_S2_run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4569
map all 0.2842
ndcg all 0.6251
P_5 all 0.7486
rbp_p5 all 0.6787
GUIR_S2_run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4067
map all 0.2531
ndcg all 0.6286
P_5 all 0.7771
rbp_p5 all 0.6805
GUIR_S2_run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3008
map all 0.2019
ndcg all 0.5286
P_5 all 0.6229
rbp_p5 all 0.5663
sab20.2.meta.docs¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4211
map all 0.2452
ndcg all 0.543
P_5 all 0.6457
rbp_p5 all 0.5871
SFDC-round2-qna¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3978
map all 0.142
ndcg all 0.3963
P_5 all 0.4857
rbp_p5 all 0.4611
UIowaS_Run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4853
map all 0.283
ndcg all 0.6365
P_5 all 0.76
rbp_p5 all 0.7042
UIowaS_Run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4887
map all 0.2855
ndcg all 0.6349
P_5 all 0.7714
rbp_p5 all 0.699
UIowaS_Run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4867
map all 0.2845
ndcg all 0.6382
P_5 all 0.7657
rbp_p5 all 0.7037
cu_dbmi_sent_embed¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2882
map all 0.0807
ndcg all 0.3182
P_5 all 0.4114
rbp_p5 all 0.3559
BBGhelani1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5045
map all 0.2412
ndcg all 0.5846
P_5 all 0.7543
rbp_p5 all 0.6374
BBGhelani2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.502
map all 0.2402
ndcg all 0.5846
P_5 all 0.7543
rbp_p5 all 0.6374
BBGhelani3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5027
map all 0.2386
ndcg all 0.5868
P_5 all 0.7543
rbp_p5 all 0.6376
random_bert_tiab¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.0583
map all 0.0028
ndcg all 0.0342
P_5 all 0.0514
rbp_p5 all 0.0384
Emory_IRLab_Run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3528
map all 0.2211
ndcg all 0.5766
P_5 all 0.68
rbp_p5 all 0.627
FullTxt_R2_Orig¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4479
map all 0.2373
ndcg all 0.5103
P_5 all 0.6114
rbp_p5 all 0.5079
FullTxt_R2_Time¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4525
map all 0.268
ndcg all 0.5969
P_5 all 0.7029
rbp_p5 all 0.6193
OHSU_BCB_round2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3695
map all 0.1998
ndcg all 0.5093
P_5 all 0.5943
rbp_p5 all 0.5495
ASU_MDLabs_STS_qqn¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1688
map all 0.0484
ndcg all 0.2359
P_5 all 0.3143
rbp_p5 all 0.2718
ASU_MDLabs_STS_qn¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1627
map all 0.0469
ndcg all 0.1951
P_5 all 0.2629
rbp_p5 all 0.2397
ASU_MDLabs_STS_qq¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1701
map all 0.0445
ndcg all 0.2053
P_5 all 0.28
rbp_p5 all 0.2464
BITEM_BL¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4358
map all 0.218
ndcg all 0.4875
P_5 all 0.6
rbp_p5 all 0.5411
DD_prf¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3802
map all 0.2064
ndcg all 0.5482
P_5 all 0.6629
rbp_p5 all 0.6018
DD_bm25¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3677
map all 0.2122
ndcg all 0.4958
P_5 all 0.6229
rbp_p5 all 0.543
DD_rm3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3923
map all 0.2064
ndcg all 0.4941
P_5 all 0.6171
rbp_p5 all 0.5809
bm25_syn_0.8_2.6¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4054
map all 0.2132
ndcg all 0.5655
P_5 all 0.6914
rbp_p5 all 0.6635
sab20.2.dfo.metadocs¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4704
map all 0.2269
ndcg all 0.6161
P_5 all 0.7086
rbp_p5 all 0.6746
sab20.2.dfo.meta¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4226
map all 0.1677
ndcg all 0.4927
P_5 all 0.5657
rbp_p5 all 0.553
UPrrf16lgbertd50-r2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4414
map all 0.3
ndcg all 0.632
P_5 all 0.7086
rbp_p5 all 0.7153
UPrrf16lgbert50-r2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4414
map all 0.2964
ndcg all 0.6077
P_5 all 0.6971
rbp_p5 all 0.6507
UPrrf16bert20-r2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4391
map all 0.2958
ndcg all 0.6099
P_5 all 0.6743
rbp_p5 all 0.6758
BITEM_DC_comb¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3749
map all 0.1613
ndcg all 0.4071
P_5 all 0.4857
rbp_p5 all 0.4551
combined_bm25_dfr¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4203
map all 0.2312
ndcg all 0.5998
P_5 all 0.7143
rbp_p5 all 0.6773
ES_Baseline¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3082
map all 0.1156
ndcg all 0.3113
P_5 all 0.3886
rbp_p5 all 0.3534
ES_Defaults¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3991
map all 0.2117
ndcg all 0.5112
P_5 all 0.6686
rbp_p5 all 0.5628
ES_Covid¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3904
map all 0.2042
ndcg all 0.495
P_5 all 0.64
rbp_p5 all 0.5382
ES_Covid_Vector¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3425
map all 0.1256
ndcg all 0.311
P_5 all 0.36
rbp_p5 all 0.3197
Bioinfo-run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3237
map all 0.1418
ndcg all 0.4357
P_5 all 0.5257
rbp_p5 all 0.5272
elhuyar_rRnk_cbert1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4793
map all 0.2941
ndcg all 0.5912
P_5 all 0.72
rbp_p5 all 0.6313
ES_QueryNarrative¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1752
map all 0.0255
ndcg all 0.1027
P_5 all 0.1257
rbp_p5 all 0.169
Technion-RRF¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.429
map all 0.2465
ndcg all 0.5566
P_5 all 0.68
rbp_p5 all 0.6236
elhuyar_rRnk_cbert2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4772
map all 0.2851
ndcg all 0.59
P_5 all 0.7314
rbp_p5 all 0.6203
elhuyar_rRnk_cbert3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4791
map all 0.2923
ndcg all 0.5905
P_5 all 0.7314
rbp_p5 all 0.6227
Technion-LTR¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4252
map all 0.2497
ndcg all 0.5491
P_5 all 0.64
rbp_p5 all 0.5919
TMACC_SeTA_tfidf_q¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.106
map all 0.0039
ndcg all 0.027
P_5 all 0.0286
rbp_p5 all 0.0278
ES_Covid_ML¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3916
map all 0.2043
ndcg all 0.4967
P_5 all 0.64
rbp_p5 all 0.5372
Technion-JPDs¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4268
map all 0.2356
ndcg all 0.5221
P_5 all 0.5943
rbp_p5 all 0.6007
Bioinfo-run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3612
map all 0.169
ndcg all 0.4535
P_5 all 0.5657
rbp_p5 all 0.523
HKPU-Gos1-pPRF¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3596
map all 0.1718
ndcg all 0.3662
P_5 all 0.4629
rbp_p5 all 0.4064
CSIROmed_RF_RR¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4358
map all 0.2176
ndcg all 0.5804
P_5 all 0.68
rbp_p5 all 0.6481
CSIROmedNIR¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3755
map all 0.192
ndcg all 0.578
P_5 all 0.72
rbp_p5 all 0.6899
CSIROmedNIRR¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3714
map all 0.1857
ndcg all 0.568
P_5 all 0.7029
rbp_p5 all 0.6737
TMACC_SeTA_tfidf¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2018
map all 0.0243
ndcg all 0.1011
P_5 all 0.1314
rbp_p5 all 0.1286
poznan_run_p2_3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3141
map all 0.093
ndcg all 0.3625
P_5 all 0.4571
rbp_p5 all 0.4595
shamra_tag¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.281
map all 0.1098
ndcg all 0.3837
P_5 all 0.4914
rbp_p5 all 0.4706
SparseDenseSciBert¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5096
map all 0.3115
ndcg all 0.6772
P_5 all 0.76
rbp_p5 all 0.752
ReInfoSelect¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4435
map all 0.285
ndcg all 0.6259
P_5 all 0.6971
rbp_p5 all 0.667
ContrastNLGSciBert¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4302
map all 0.2775
ndcg all 0.6138
P_5 all 0.7314
rbp_p5 all 0.6933
ru-tn-exp-rnd2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2187
map all 0.1404
ndcg all 0.4358
P_5 all 0.5714
rbp_p5 all 0.4534
ru-t-exp-rnd2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1979
map all 0.1117
ndcg all 0.3887
P_5 all 0.4971
rbp_p5 all 0.4424
poznan_p2_2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3148
map all 0.0998
ndcg all 0.3709
P_5 all 0.4857
rbp_p5 all 0.4824
ru-tw-exp-rnd2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1876
map all 0.1053
ndcg all 0.3666
P_5 all 0.48
rbp_p5 all 0.4066
poznan_run_p2_1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3189
map all 0.095
ndcg all 0.3723
P_5 all 0.4629
rbp_p5 all 0.4646
TMACC_SeTA_sent2vec¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.0877
map all 0.0114
ndcg all 0.0702
P_5 all 0.1371
rbp_p5 all 0.0892
Bioinfo-run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3648
map all 0.183
ndcg all 0.5016
P_5 all 0.5943
rbp_p5 all 0.5863
VTechBase¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3281
map all 0.1406
ndcg all 0.383
P_5 all 0.4971
rbp_p5 all 0.4587
combined¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4237
map all 0.2243
ndcg all 0.5878
P_5 all 0.6971
rbp_p5 all 0.6743
VTechPRF¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3703
map all 0.1856
ndcg all 0.4524
P_5 all 0.5429
rbp_p5 all 0.5274
ielab-rbp-meta¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3273
map all 0.1249
ndcg all 0.3429
P_5 all 0.4629
rbp_p5 all 0.4354
ielab-rbp-baseline¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2672
map all 0.0611
ndcg all 0.1997
P_5 all 0.2171
rbp_p5 all 0.241
ielab-combmnz-meta¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3526
map all 0.1556
ndcg all 0.4131
P_5 all 0.4686
rbp_p5 all 0.4721
VTechcrowd¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3604
map all 0.1662
ndcg all 0.4879
P_5 all 0.6171
rbp_p5 all 0.5677