Results - Round 4 2020¶
jlbasernd4-jlQErnd4¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3305
map all 0.1664
ndcg_20 all 0.5296
P_20 all 0.5511
rbp_p5 all 0.698
jlbasernd4¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.333
map all 0.1593
ndcg_20 all 0.5134
P_20 all 0.55
rbp_p5 all 0.621
jlQErnd4¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1999
map all 0.0868
ndcg_20 all 0.3601
P_20 all 0.3722
rbp_p5 all 0.4518
HKPU-MATF-pPRF¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5438
map all 0.3125
ndcg_20 all 0.637
P_20 all 0.6533
rbp_p5 all 0.767
HKPU-Gos1-pPRF¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5251
map all 0.2746
ndcg_20 all 0.5856
P_20 all 0.6111
rbp_p5 all 0.6901
HKPU-SPUD-pPRF¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5429
map all 0.314
ndcg_20 all 0.6389
P_20 all 0.6589
rbp_p5 all 0.7558
UPrrf38rrf3-r4¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6801
map all 0.4681
ndcg_20 all 0.7843
P_20 all 0.8211
rbp_p5 all 0.8599
UPrrf38rrf3v2-r4¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6514
map all 0.431
ndcg_20 all 0.7706
P_20 all 0.7856
rbp_p5 all 0.8718
UPrrf38rrf2-r4¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5917
map all 0.3612
ndcg_20 all 0.6792
P_20 all 0.7156
rbp_p5 all 0.7602
OHSU_R4_totalfusion¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5038
map all 0.2524
ndcg_20 all 0.5319
P_20 all 0.5622
rbp_p5 all 0.6294
OHSU_TF_UDGEN_AVG¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4927
map all 0.2706
ndcg_20 all 0.5722
P_20 all 0.5967
rbp_p5 all 0.6836
OHSU_totalfusion_avg¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5073
map all 0.2638
ndcg_20 all 0.5458
P_20 all 0.5778
rbp_p5 all 0.6407
combined¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.548
map all 0.2963
ndcg_20 all 0.6451
P_20 all 0.6522
rbp_p5 all 0.7739
bm25_bertsim_run4¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3463
map all 0.0837
ndcg_20 all 0.2972
P_20 all 0.3133
rbp_p5 all 0.4027
bm25_bl_run4¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3844
map all 0.171
ndcg_20 all 0.4631
P_20 all 0.4978
rbp_p5 all 0.5515
Marouane_QQ_EnM-BTN¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2379
map all 0.1199
ndcg_20 all 0.4778
P_20 all 0.4978
rbp_p5 all 0.6209
Marouane_eQQ_EnM-BTN¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2305
map all 0.1111
ndcg_20 all 0.4558
P_20 all 0.4744
rbp_p5 all 0.6079
r4.rf¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5607
map all 0.3519
ndcg_20 all 0.6976
P_20 all 0.7344
rbp_p5 all 0.8174
r4.fusion2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5302
map all 0.3088
ndcg_20 all 0.6089
P_20 all 0.6589
rbp_p5 all 0.6715
r4.fusion1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5014
map all 0.2666
ndcg_20 all 0.5244
P_20 all 0.5611
rbp_p5 all 0.5918
xj4wang_run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5507
map all 0.2963
ndcg_20 all 0.7019
P_20 all 0.7244
rbp_p5 all 0.7946
xj4wang_run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5216
map all 0.2774
ndcg_20 all 0.6855
P_20 all 0.7278
rbp_p5 all 0.7486
xj4wang_run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5084
map all 0.2775
ndcg_20 all 0.7019
P_20 all 0.7244
rbp_p5 all 0.7946
covidex.r4.d2q.duot5¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5589
map all 0.3122
ndcg_20 all 0.7219
P_20 all 0.7267
rbp_p5 all 0.8502
covidex.r4.duot5.lr¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5825
map all 0.3846
ndcg_20 all 0.7745
P_20 all 0.7967
rbp_p5 all 0.8838
covidex.r4.duot5¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5576
map all 0.3283
ndcg_20 all 0.6877
P_20 all 0.6922
rbp_p5 all 0.813
BITEM_COVOC4¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3427
map all 0.1516
ndcg_20 all 0.4507
P_20 all 0.4789
rbp_p5 all 0.5674
uab.run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.0987
map all 0.0345
ndcg_20 all 0.2187
P_20 all 0.25
rbp_p5 all 0.2955
SFDC-fus12-enc34¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5887
map all 0.3436
ndcg_20 all 0.6726
P_20 all 0.7011
rbp_p5 all 0.7697
SFDC-re-fus12-enc24¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5874
map all 0.342
ndcg_20 all 0.6763
P_20 all 0.7056
rbp_p5 all 0.7686
SFDC-re-fus12-enc34¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5875
map all 0.3431
ndcg_20 all 0.6741
P_20 all 0.7067
rbp_p5 all 0.7609
ucd_cs_r4_r1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4871
map all 0.2976
ndcg_20 all 0.6474
P_20 all 0.6911
rbp_p5 all 0.7307
ucd_cs_r4_r2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3173
map all 0.1393
ndcg_20 all 0.4273
P_20 all 0.4567
rbp_p5 all 0.4999
ucd_cs_r4_r3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5265
map all 0.3178
ndcg_20 all 0.6528
P_20 all 0.6844
rbp_p5 all 0.7534
poznan_p4_run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.318
map all 0.1741
ndcg_20 all 0.5642
P_20 all 0.5933
rbp_p5 all 0.6718
poznan_p4_run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3178
map all 0.1763
ndcg_20 all 0.5691
P_20 all 0.6022
rbp_p5 all 0.6739
sab20.4.metadocs_m¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5242
map all 0.2935
ndcg_20 all 0.6358
P_20 all 0.6533
rbp_p5 all 0.7898
sab20.4.rocchio¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5802
map all 0.3333
ndcg_20 all 0.6921
P_20 all 0.7133
rbp_p5 all 0.8291
udel_fang_lambdarank¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6161
map all 0.3907
ndcg_20 all 0.7534
P_20 all 0.7844
rbp_p5 all 0.866
aserini2000-t53¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.0011
map all 0.0002
ndcg_20 all 0.003
P_20 all 0.0056
rbp_p5 all 0.0015
udel_fang_ltr_nobert¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6152
map all 0.3865
ndcg_20 all 0.7336
P_20 all 0.76
rbp_p5 all 0.8745
sab20.4.dfo¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6257
map all 0.3722
ndcg_20 all 0.7247
P_20 all 0.7556
rbp_p5 all 0.8346
udel_fang_nir¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6095
map all 0.3104
ndcg_20 all 0.5976
P_20 all 0.6033
rbp_p5 all 0.7274
poznan_p4_run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3066
map all 0.1187
ndcg_20 all 0.4468
P_20 all 0.4589
rbp_p5 all 0.5843
CincyMedIR-7¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4336
map all 0.2037
ndcg_20 all 0.5262
P_20 all 0.5456
rbp_p5 all 0.6735
CincyMedIR-8¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4317
map all 0.2043
ndcg_20 all 0.5247
P_20 all 0.5467
rbp_p5 all 0.6678
CincyMedIR-9¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4318
map all 0.2001
ndcg_20 all 0.5177
P_20 all 0.5289
rbp_p5 all 0.6755
active_learning¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5464
map all 0.2946
ndcg_20 all 0.6551
P_20 all 0.6533
rbp_p5 all 0.8056
ILPS_UvA_zeroshot_BE¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5059
map all 0.2206
ndcg_20 all 0.4222
P_20 all 0.4456
rbp_p5 all 0.5001
CSIROmedNIR¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4713
map all 0.2625
ndcg_20 all 0.6353
P_20 all 0.6633
rbp_p5 all 0.7483
CSIROmedNO¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3415
map all 0.1035
ndcg_20 all 0.3455
P_20 all 0.32
rbp_p5 all 0.4852
CSIROmedBM¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4486
map all 0.2445
ndcg_20 all 0.5968
P_20 all 0.63
rbp_p5 all 0.7075
uw_base¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5622
map all 0.3471
ndcg_20 all 0.6494
P_20 all 0.6867
rbp_p5 all 0.7411
BioInfo-run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3669
map all 0.2155
ndcg_20 all 0.6147
P_20 all 0.6544
rbp_p5 all 0.7309
BioInfo-run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3665
map all 0.2161
ndcg_20 all 0.6191
P_20 all 0.6667
rbp_p5 all 0.719
uw_fb¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6348
map all 0.3846
ndcg_20 all 0.6559
P_20 all 0.6978
rbp_p5 all 0.7659
run1_C_A_SciB¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6256
map all 0.3992
ndcg_20 all 0.742
P_20 all 0.7633
rbp_p5 all 0.8551
BioInfo-run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5494
map all 0.3058
ndcg_20 all 0.6334
P_20 all 0.6822
rbp_p5 all 0.7394
run2_Crf_A_SciB_MAP¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6292
map all 0.4079
ndcg_20 all 0.747
P_20 all 0.77
rbp_p5 all 0.8612
run3_Crf_A_SciB_N¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6299
map all 0.3967
ndcg_20 all 0.7345
P_20 all 0.7522
rbp_p5 all 0.8598
uogTrDPH_QE¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5362
map all 0.3186
ndcg_20 all 0.6439
P_20 all 0.6656
rbp_p5 all 0.7752
uw_crowd¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6317
map all 0.3923
ndcg_20 all 0.6811
P_20 all 0.7189
rbp_p5 all 0.7725
uogTrDPH_QE_SCB1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.551
map all 0.3457
ndcg_20 all 0.682
P_20 all 0.7144
rbp_p5 all 0.8003
mpiid5_run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6132
map all 0.3993
ndcg_20 all 0.7391
P_20 all 0.7589
rbp_p5 all 0.8622
BITEM_BERT4¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3602
map all 0.1662
ndcg_20 all 0.5274
P_20 all 0.5444
rbp_p5 all 0.67
uogTrDPH_QE_SCB_PM1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5524
map all 0.3342
ndcg_20 all 0.6597
P_20 all 0.6844
rbp_p5 all 0.7844
ILPS_UvA_big_diverse¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3921
map all 0.0625
ndcg_20 all 0.097
P_20 all 0.14
rbp_p5 all 0.0716
Emory_rnd4_run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4603
map all 0.2246
ndcg_20 all 0.5598
P_20 all 0.5744
rbp_p5 all 0.6709
Emory_rnd4_run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4622
map all 0.2479
ndcg_20 all 0.588
P_20 all 0.5989
rbp_p5 all 0.7338
Emory_rnd4_run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4642
map all 0.2259
ndcg_20 all 0.5032
P_20 all 0.5089
rbp_p5 all 0.5946
ILPS_UvA_allrounds_c¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4211
map all 0.1244
ndcg_20 all 0.2916
P_20 all 0.3278
rbp_p5 all 0.3892
l2r¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5598
map all 0.3103
ndcg_20 all 0.6501
P_20 all 0.6667
rbp_p5 all 0.7647