Results - Round 3 2020¶
CORD-19-LTR¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4167
map all 0.2124
ndcg all 0.6108
P_5 all 0.71
rbp_p5 all 0.6534
jlbasernd3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3227
map all 0.1188
ndcg all 0.4564
P_5 all 0.56
rbp_p5 all 0.5476
jlbase-QE-rnd3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.0633
map all 0.0469
ndcg all 0.4317
P_5 all 0.585
rbp_p5 all 0.5275
jlbasernd3-jlQErnd3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3216
map all 0.1294
ndcg all 0.551
P_5 all 0.68
rbp_p5 all 0.6224
R3QQTETRA¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.27
map all 0.09
ndcg all 0.3737
P_5 all 0.48
rbp_p5 all 0.4089
R3QTETRA¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2475
map all 0.0744
ndcg all 0.3306
P_5 all 0.42
rbp_p5 all 0.4021
sim_run¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.0101
map all 0.0019
ndcg all 0.0348
P_5 all 0.075
rbp_p5 all 0.0387
r3.rf¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5204
map all 0.2817
ndcg all 0.6883
P_5 all 0.795
rbp_p5 all 0.7284
r3.fusion2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4953
map all 0.2641
ndcg all 0.61
P_5 all 0.715
rbp_p5 all 0.6586
r3.fusion1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.468
map all 0.2293
ndcg all 0.5359
P_5 all 0.61
rbp_p5 all 0.5823
R3QQMETRA¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2462
map all 0.0611
ndcg all 0.268
P_5 all 0.35
rbp_p5 all 0.3439
BioInfo-run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.556
map all 0.3188
ndcg all 0.7715
P_5 all 0.865
rbp_p5 all 0.8024
BioInfo-run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.497
map all 0.2625
ndcg all 0.6355
P_5 all 0.73
rbp_p5 all 0.6733
BioInfo-run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5467
map all 0.3237
ndcg all 0.7463
P_5 all 0.86
rbp_p5 all 0.7787
covidex.r3.monot5¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5254
map all 0.2635
ndcg all 0.6596
P_5 all 0.78
rbp_p5 all 0.7356
covidex.r3.t5_lr¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5543
map all 0.3333
ndcg all 0.774
P_5 all 0.86
rbp_p5 all 0.8068
CincyMedIR-1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3679
map all 0.1639
ndcg all 0.5876
P_5 all 0.67
rbp_p5 all 0.6228
sab20.3.metadocs_m¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5202
map all 0.26
ndcg all 0.6032
P_5 all 0.69
rbp_p5 all 0.664
sab20.3.dfo¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5872
map all 0.3147
ndcg all 0.7029
P_5 all 0.795
rbp_p5 all 0.7396
sab20.3.rocchio¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5636
map all 0.3077
ndcg all 0.673
P_5 all 0.785
rbp_p5 all 0.7216
poznan_run_p3_1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.0901
map all 0.0253
ndcg all 0.2161
P_5 all 0.335
rbp_p5 all 0.2597
ucd_cs_r2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3373
map all 0.0386
ndcg all 0.0398
P_5 all 0.05
rbp_p5 all 0.0507
ucd_cs_r1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3688
map all 0.1418
ndcg all 0.438
P_5 all 0.555
rbp_p5 all 0.4636
udel_fang_lambdarank¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5764
map all 0.3238
ndcg all 0.7567
P_5 all 0.89
rbp_p5 all 0.7779
udel_fang_FB1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5736
map all 0.321
ndcg all 0.7243
P_5 all 0.865
rbp_p5 all 0.7691
udel_fang_FB2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5037
map all 0.269
ndcg all 0.6366
P_5 all 0.775
rbp_p5 all 0.7112
poznan_p3_2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.0902
map all 0.0261
ndcg all 0.2274
P_5 all 0.365
rbp_p5 all 0.2398
OHSU_BCB_round3-bcb¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4048
map all 0.1701
ndcg all 0.5252
P_5 all 0.62
rbp_p5 all 0.5815
OHSU_Rerank¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4771
map all 0.1544
ndcg all 0.5515
P_5 all 0.65
rbp_p5 all 0.5668
covidex.r3.duot5¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5261
map all 0.2676
ndcg all 0.6626
P_5 all 0.77
rbp_p5 all 0.7571
OHSU_Fusion¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5828
map all 0.3244
ndcg all 0.6816
P_5 all 0.79
rbp_p5 all 0.742
poznan_run_p3_3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.0835
map all 0.0211
ndcg all 0.1685
P_5 all 0.27
rbp_p5 all 0.2036
CincyMedIR-12¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3405
map all 0.1247
ndcg all 0.4117
P_5 all 0.49
rbp_p5 all 0.477
CincyMedIR-9¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2758
map all 0.0699
ndcg all 0.2627
P_5 all 0.315
rbp_p5 all 0.2696
SFDC-fus12-enc3-tf3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5509
map all 0.3182
ndcg all 0.6716
P_5 all 0.765
rbp_p5 all 0.7052
SFDC-fus12-enc23-tf3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.566
map all 0.316
ndcg all 0.6867
P_5 all 0.78
rbp_p5 all 0.7227
Yibo_round3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.099
map all 0.0483
ndcg all 0.3628
P_5 all 0.46
rbp_p5 all 0.3887
xj4wang_run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5681
map all 0.2836
ndcg all 0.7431
P_5 all 0.835
rbp_p5 all 0.73
xj4wang_run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5537
map all 0.2534
ndcg all 0.6252
P_5 all 0.7
rbp_p5 all 0.6303
xj4wang_run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5464
map all 0.2751
ndcg all 0.7413
P_5 all 0.835
rbp_p5 all 0.7299
Yibo_round3_test2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2608
map all 0.0701
ndcg all 0.3628
P_5 all 0.46
rbp_p5 all 0.3887
UIowaS_Rd3MLReRank¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5995
map all 0.267
ndcg all 0.7175
P_5 all 0.8
rbp_p5 all 0.7405
UIowaS_Run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5759
map all 0.3182
ndcg all 0.7559
P_5 all 0.895
rbp_p5 all 0.7955
UIowaS_Rd3Borda¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5778
map all 0.3207
ndcg all 0.7658
P_5 all 0.89
rbp_p5 all 0.7965
combined¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5068
map all 0.2426
ndcg all 0.6956
P_5 all 0.795
rbp_p5 all 0.7443
BITEM_BL¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3596
map all 0.1192
ndcg all 0.3828
P_5 all 0.45
rbp_p5 all 0.4131
active_learning¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5065
map all 0.2449
ndcg all 0.7285
P_5 all 0.835
rbp_p5 all 0.777
cord19.vespa.ai-bm25¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2756
map all 0.0968
ndcg all 0.5224
P_5 all 0.63
rbp_p5 all 0.566
TF_IDF_Feedback¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5357
map all 0.2902
ndcg all 0.6818
P_5 all 0.79
rbp_p5 all 0.727
cord19.vespa.ai-gb-1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4284
map all 0.1231
ndcg all 0.4184
P_5 all 0.455
rbp_p5 all 0.4945
fusionoffusion¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5472
map all 0.3057
ndcg all 0.6495
P_5 all 0.745
rbp_p5 all 0.6632
cord19.vespa.ai-gb-2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4321
map all 0.1117
ndcg all 0.3543
P_5 all 0.41
rbp_p5 all 0.381
UPrrf20maxens-r3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4952
map all 0.274
ndcg all 0.6954
P_5 all 0.765
rbp_p5 all 0.742
fusionofruns¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5487
map all 0.3084
ndcg all 0.6564
P_5 all 0.735
rbp_p5 all 0.6692
SFDC-e23-f12-re-tf3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5665
map all 0.3098
ndcg all 0.6716
P_5 all 0.775
rbp_p5 all 0.6914
UPrrf20lgprel50v2-r3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4964
map all 0.2783
ndcg all 0.7134
P_5 all 0.79
rbp_p5 all 0.7743
UPrrf20lgbert50-r3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4958
map all 0.2754
ndcg all 0.6849
P_5 all 0.8
rbp_p5 all 0.7675
CSIROmedNIR¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4175
map all 0.1913
ndcg all 0.6253
P_5 all 0.725
rbp_p5 all 0.652
CSIROmedNIRR¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3886
map all 0.1414
ndcg all 0.4882
P_5 all 0.575
rbp_p5 all 0.5665
CSIROmedFusion¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3949
map all 0.1439
ndcg all 0.4925
P_5 all 0.575
rbp_p5 all 0.5667
ucd_cs_r3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3696
map all 0.1097
ndcg all 0.3159
P_5 all 0.455
rbp_p5 all 0.3022
uogTrDPH_QE_QQN¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3493
map all 0.1473
ndcg all 0.523
P_5 all 0.665
rbp_p5 all 0.603
Emory_IRLab_rnd3_r1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5444
map all 0.2132
ndcg all 0.5867
P_5 all 0.715
rbp_p5 all 0.6114
mpiid5_run1¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.6084
map all 0.301
ndcg all 0.706
P_5 all 0.78
rbp_p5 all 0.7012
mpiid5_run2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5947
map all 0.3193
ndcg all 0.7235
P_5 all 0.83
rbp_p5 all 0.7935
factum-sparse¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4154
map all 0.1402
ndcg all 0.3672
P_5 all 0.415
rbp_p5 all 0.4188
mpiid5_run3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5935
map all 0.2317
ndcg all 0.3583
P_5 all 0.425
rbp_p5 all 0.3458
uogTrDPH_RF_QQN¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3818
map all 0.176
ndcg all 0.6319
P_5 all 0.77
rbp_p5 all 0.6822
Emory_IRLab_rnd3_r2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5444
map all 0.2132
ndcg all 0.5867
P_5 all 0.715
rbp_p5 all 0.6114
sparse-dense-0.45¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5364
map all 0.2778
ndcg all 0.6698
P_5 all 0.745
rbp_p5 all 0.74
crowd¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4698
map all 0.2214
ndcg all 0.605
P_5 all 0.695
rbp_p5 all 0.6524
sparse-dense-SBrr-2¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5419
map all 0.3134
ndcg all 0.7272
P_5 all 0.8
rbp_p5 all 0.7675
PRF¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4209
map all 0.1834
ndcg all 0.4787
P_5 all 0.57
rbp_p5 all 0.5408
sparse-dense-SBrr-3¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.5553
map all 0.3099
ndcg all 0.7051
P_5 all 0.825
rbp_p5 all 0.7953
factum-sparse-rerank¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1124
map all 0.0868
ndcg all 0.5373
P_5 all 0.665
rbp_p5 all 0.5611
ruir-q2narr4task4¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.1603
map all 0.0925
ndcg all 0.4672
P_5 all 0.585
rbp_p5 all 0.5038
l2r¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.2229
map all 0.0995
ndcg all 0.3608
P_5 all 0.39
rbp_p5 all 0.3856
BITEM_AX0¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.3142
map all 0.064
ndcg all 0.2307
P_5 all 0.295
rbp_p5 all 0.2358
crowdPRF¶
Metadata | Participants| Input| Appendix
summary (trec_eval)
bpref all 0.4914
map all 0.232
ndcg all 0.6027
P_5 all 0.695
rbp_p5 all 0.664