Results - Precision Medicine 2020¶
PA1run¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2655
summary (sample-eval)
infAP all 0.1922
infNDCG all 0.4382
iP10 all 0.4548
iP100 all 0.2869
summary (trec_eval)
map all 0.3028
bpref all 0.3383
recip_rank all 0.6196
P_10 all 0.4548
P_100 all 0.2745
P_1000 all 0.0601
ebm¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2606
summary (sample-eval)
infAP all 0.2211
infNDCG all 0.4727
iP10 all 0.4548
iP100 all 0.2792
summary (trec_eval)
map all 0.3286
bpref all 0.3622
recip_rank all 0.6627
P_10 all 0.4548
P_100 all 0.2694
P_1000 all 0.0593
r1st¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2457
summary (sample-eval)
infAP all 0.2585
infNDCG all 0.4927
iP10 all 0.4839
iP100 all 0.3063
summary (trec_eval)
map all 0.3732
bpref all 0.4098
recip_rank all 0.6442
P_10 all 0.4839
P_100 all 0.2890
P_1000 all 0.0605
tier1st¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2522
summary (sample-eval)
infAP all 0.2354
infNDCG all 0.4631
iP10 all 0.4742
iP100 all 0.2811
summary (trec_eval)
map all 0.3277
bpref all 0.3751
recip_rank all 0.6978
P_10 all 0.4742
P_100 all 0.2623
P_1000 all 0.0584
ens¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2988
summary (sample-eval)
infAP all 0.2276
infNDCG all 0.4959
iP10 all 0.5226
iP100 all 0.2982
summary (trec_eval)
map all 0.3494
bpref all 0.3652
recip_rank all 0.6868
P_10 all 0.5226
P_100 all 0.2916
P_1000 all 0.0605
run_bm25¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2732
summary (sample-eval)
infAP all 0.1419
infNDCG all 0.3587
iP10 all 0.4452
iP100 all 0.2426
summary (trec_eval)
map all 0.2135
bpref all 0.2454
recip_rank all 0.6554
P_10 all 0.4452
P_100 all 0.2277
P_1000 all 0.0447
bm25_synonyms¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2274
summary (sample-eval)
infAP all 0.0960
infNDCG all 0.2357
iP10 all 0.2839
iP100 all 0.1514
summary (trec_eval)
map all 0.1427
bpref all 0.1744
recip_rank all 0.4240
P_10 all 0.2839
P_100 all 0.1413
P_1000 all 0.0313
bm25_p10¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2513
summary (sample-eval)
infAP all 0.1863
infNDCG all 0.4206
iP10 all 0.4806
iP100 all 0.2639
summary (trec_eval)
map all 0.2788
bpref all 0.3082
recip_rank all 0.7559
P_10 all 0.4806
P_100 all 0.2474
P_1000 all 0.0518
rrf_p10¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2736
summary (sample-eval)
infAP all 0.1974
infNDCG all 0.4483
iP10 all 0.4581
iP100 all 0.2803
summary (trec_eval)
map all 0.3045
bpref all 0.3145
recip_rank all 0.7768
P_10 all 0.4581
P_100 all 0.2687
P_1000 all 0.0553
rrf_prf_p10¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2816
summary (sample-eval)
infAP all 0.2136
infNDCG all 0.4574
iP10 all 0.4452
iP100 all 0.3029
summary (trec_eval)
map all 0.3233
bpref all 0.3385
recip_rank all 0.7420
P_10 all 0.4452
P_100 all 0.2884
P_1000 all 0.0569
rrf_prf_rprec¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2819
summary (sample-eval)
infAP all 0.2217
infNDCG all 0.4644
iP10 all 0.4516
iP100 all 0.3049
summary (trec_eval)
map all 0.3290
bpref all 0.3442
recip_rank all 0.7511
P_10 all 0.4516
P_100 all 0.2871
P_1000 all 0.0562
rrf_prf_infndcg¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2783
summary (sample-eval)
infAP all 0.2222
infNDCG all 0.4613
iP10 all 0.4613
iP100 all 0.3072
summary (trec_eval)
map all 0.3281
bpref all 0.3482
recip_rank all 0.7261
P_10 all 0.4613
P_100 all 0.2929
P_1000 all 0.0560
damoespb1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.4127
summary (sample-eval)
infAP all 0.2052
infNDCG all 0.4112
iP10 all 0.4452
iP100 all 0.2836
summary (trec_eval)
map all 0.3006
bpref all 0.3378
recip_rank all 0.7407
P_10 all 0.4452
P_100 all 0.2635
P_1000 all 0.0524
damoespb2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.4127
summary (sample-eval)
infAP all 0.2295
infNDCG all 0.4533
iP10 all 0.4742
iP100 all 0.3030
summary (trec_eval)
map all 0.3260
bpref all 0.3574
recip_rank all 0.7837
P_10 all 0.4742
P_100 all 0.2835
P_1000 all 0.0527
damoespcbh1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (sample-eval)
infAP all 0.2148
infNDCG all 0.4304
iP10 all 0.4742
iP100 all 0.3000
summary (trec_eval)
map all 0.3136
bpref all 0.3451
recip_rank all 0.7060
P_10 all 0.4742
P_100 all 0.2806
P_1000 all 0.0525
damoespcbh2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.4356
summary (sample-eval)
infAP all 0.2189
infNDCG all 0.4384
iP10 all 0.4710
iP100 all 0.3058
summary (trec_eval)
map all 0.3177
bpref all 0.3472
recip_rank all 0.7059
P_10 all 0.4710
P_100 all 0.2858
P_1000 all 0.0526
damoespcbh3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.4344
summary (sample-eval)
infAP all 0.2219
infNDCG all 0.4424
iP10 all 0.4742
iP100 all 0.3077
summary (trec_eval)
map all 0.3205
bpref all 0.3495
recip_rank all 0.7052
P_10 all 0.4742
P_100 all 0.2887
P_1000 all 0.0527
CornellTech1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.0065
summary (sample-eval)
infAP all 0.0015
infNDCG all 0.0116
iP10 all 0.0129
iP100 all 0.0143
summary (trec_eval)
map all 0.0033
bpref all 0.0207
recip_rank all 0.0473
P_10 all 0.0129
P_100 all 0.0119
P_1000 all 0.0073
CornellTech2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.0112
summary (sample-eval)
infAP all 0.0035
infNDCG all 0.0224
iP10 all 0.0161
iP100 all 0.0239
summary (trec_eval)
map all 0.0064
bpref all 0.0237
recip_rank all 0.0626
P_10 all 0.0161
P_100 all 0.0203
P_1000 all 0.0073
DA_DCU_IBM_1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2493
summary (sample-eval)
infAP all 0.0954
infNDCG all 0.2561
iP10 all 0.3516
iP100 all 0.1709
summary (trec_eval)
map all 0.1139
bpref all 0.1495
recip_rank all 0.5678
P_10 all 0.3516
P_100 all 0.1506
P_1000 all 0.0196
DA_DCU_IBM_4¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2499
summary (sample-eval)
infAP all 0.0959
infNDCG all 0.2576
iP10 all 0.3516
iP100 all 0.1731
summary (trec_eval)
map all 0.1139
bpref all 0.1498
recip_rank all 0.5677
P_10 all 0.3516
P_100 all 0.1523
P_1000 all 0.0198
DA_DCU_IBM_2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2511
summary (sample-eval)
infAP all 0.0968
infNDCG all 0.2597
iP10 all 0.3548
iP100 all 0.1758
summary (trec_eval)
map all 0.1147
bpref all 0.1508
recip_rank all 0.5703
P_10 all 0.3548
P_100 all 0.1532
P_1000 all 0.0200
DA_DCU_IBM_3¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2499
summary (sample-eval)
infAP all 0.1103
infNDCG all 0.2880
iP10 all 0.3806
iP100 all 0.1851
summary (trec_eval)
map all 0.1283
bpref all 0.1609
recip_rank all 0.6428
P_10 all 0.3806
P_100 all 0.1613
P_1000 all 0.0196
uog_ufmg_DFRee¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2475
summary (sample-eval)
infAP all 0.2216
infNDCG all 0.4184
iP10 all 0.5000
iP100 all 0.2457
summary (trec_eval)
map all 0.2864
bpref all 0.2999
recip_rank all 0.6956
P_10 all 0.5000
P_100 all 0.2245
P_1000 all 0.0316
uog_ufmg_s_dfr5¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2914
summary (sample-eval)
infAP all 0.2108
infNDCG all 0.4083
iP10 all 0.5129
iP100 all 0.2571
summary (trec_eval)
map all 0.2757
bpref all 0.2874
recip_rank all 0.6910
P_10 all 0.5129
P_100 all 0.2297
P_1000 all 0.0316
uog_ufmg_secL2R¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2688
summary (sample-eval)
infAP all 0.2069
infNDCG all 0.4012
iP10 all 0.4548
iP100 all 0.2428
summary (trec_eval)
map all 0.2731
bpref all 0.2918
recip_rank all 0.6968
P_10 all 0.4548
P_100 all 0.2232
P_1000 all 0.0316
uog_ufmg_s_dfr0¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.1866
summary (sample-eval)
infAP all 0.1136
infNDCG all 0.2798
iP10 all 0.3323
iP100 all 0.1963
summary (trec_eval)
map all 0.1633
bpref all 0.1907
recip_rank all 0.5325
P_10 all 0.3323
P_100 all 0.1648
P_1000 all 0.0316
uog_ufmg_sb_df5¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.3025
summary (sample-eval)
infAP all 0.2563
infNDCG all 0.4979
iP10 all 0.5484
iP100 all 0.3073
summary (trec_eval)
map all 0.3724
bpref all 0.3923
recip_rank all 0.7769
P_10 all 0.5484
P_100 all 0.2932
P_1000 all 0.0569
sibtm_run1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2349
summary (sample-eval)
infAP all 0.2654
infNDCG all 0.5276
iP10 all 0.5323
iP100 all 0.3045
summary (trec_eval)
map all 0.3842
bpref all 0.4019
recip_rank all 0.7220
P_10 all 0.5323
P_100 all 0.2935
P_1000 all 0.0605
sibtm_run2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2016
summary (sample-eval)
infAP all 0.2374
infNDCG all 0.4747
iP10 all 0.4742
iP100 all 0.2743
summary (trec_eval)
map all 0.3319
bpref all 0.3708
recip_rank all 0.6770
P_10 all 0.4742
P_100 all 0.2552
P_1000 all 0.0564
sibtm_run3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.1571
summary (sample-eval)
infAP all 0.1784
infNDCG all 0.4156
iP10 all 0.4484
iP100 all 0.2364
summary (trec_eval)
map all 0.2661
bpref all 0.2915
recip_rank all 0.7173
P_10 all 0.4484
P_100 all 0.2287
P_1000 all 0.0543
baseline¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2717
summary (sample-eval)
infAP all 0.2767
infNDCG all 0.5325
iP10 all 0.5516
iP100 all 0.3070
summary (trec_eval)
map all 0.3994
bpref all 0.4237
recip_rank all 0.8497
P_10 all 0.5516
P_100 all 0.2935
P_1000 all 0.0575
nnrun1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2956
summary (sample-eval)
infAP all 0.2657
infNDCG all 0.5145
iP10 all 0.5097
iP100 all 0.3183
summary (trec_eval)
map all 0.3775
bpref all 0.4117
recip_rank all 0.7545
P_10 all 0.5097
P_100 all 0.2997
P_1000 all 0.0575
nnrun2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2878
summary (sample-eval)
infAP all 0.2631
infNDCG all 0.5071
iP10 all 0.5161
iP100 all 0.3126
summary (trec_eval)
map all 0.3765
bpref all 0.4086
recip_rank all 0.7573
P_10 all 0.5161
P_100 all 0.2942
P_1000 all 0.0575
nnrun3¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2669
summary (sample-eval)
infAP all 0.2380
infNDCG all 0.4652
iP10 all 0.4903
iP100 all 0.3024
summary (trec_eval)
map all 0.3504
bpref all 0.3763
recip_rank all 0.6697
P_10 all 0.4903
P_100 all 0.2877
P_1000 all 0.0575
sibtm_run4¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.1743
summary (sample-eval)
infAP all 0.1732
infNDCG all 0.4077
iP10 all 0.4452
iP100 all 0.2324
summary (trec_eval)
map all 0.2584
bpref all 0.2835
recip_rank all 0.7626
P_10 all 0.4452
P_100 all 0.2248
P_1000 all 0.0516
rrf¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2948
summary (sample-eval)
infAP all 0.2745
infNDCG all 0.5245
iP10 all 0.5161
iP100 all 0.3211
summary (trec_eval)
map all 0.3948
bpref all 0.4174
recip_rank all 0.7905
P_10 all 0.5161
P_100 all 0.3094
P_1000 all 0.0575
sibtm_run5¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.1879
summary (sample-eval)
infAP all 0.1530
infNDCG all 0.3860
iP10 all 0.4355
iP100 all 0.2190
summary (trec_eval)
map all 0.2355
bpref all 0.2648
recip_rank all 0.7345
P_10 all 0.4355
P_100 all 0.2145
P_1000 all 0.0497
bm25¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2765
summary (sample-eval)
infAP all 0.2492
infNDCG all 0.4978
iP10 all 0.5355
iP100 all 0.2947
summary (trec_eval)
map all 0.3732
bpref all 0.3907
recip_rank all 0.7694
P_10 all 0.5355
P_100 all 0.2842
P_1000 all 0.0590
uwman¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2647
summary (sample-eval)
infAP all 0.2138
infNDCG all 0.4510
iP10 all 0.5194
iP100 all 0.2662
summary (trec_eval)
map all 0.3122
bpref all 0.3572
recip_rank all 0.7094
P_10 all 0.5194
P_100 all 0.2487
P_1000 all 0.0556
uwbm25¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2709
summary (sample-eval)
infAP all 0.2222
infNDCG all 0.4539
iP10 all 0.5097
iP100 all 0.2939
summary (trec_eval)
map all 0.3326
bpref all 0.3542
recip_rank all 0.7148
P_10 all 0.5097
P_100 all 0.2806
P_1000 all 0.0571
uwr¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2425
summary (sample-eval)
infAP all 0.2122
infNDCG all 0.4371
iP10 all 0.4677
iP100 all 0.2860
summary (trec_eval)
map all 0.3063
bpref all 0.3531
recip_rank all 0.6572
P_10 all 0.4677
P_100 all 0.2610
P_1000 all 0.0554
uwrn¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2018
summary (sample-eval)
infAP all 0.1759
infNDCG all 0.3926
iP10 all 0.4516
iP100 all 0.2521
summary (trec_eval)
map all 0.2551
bpref all 0.3089
recip_rank all 0.6397
P_10 all 0.4516
P_100 all 0.2281
P_1000 all 0.0517
uwpr¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2340
summary (sample-eval)
infAP all 0.1878
infNDCG all 0.4269
iP10 all 0.4355
iP100 all 0.2965
summary (trec_eval)
map all 0.2770
bpref all 0.3212
recip_rank all 0.5825
P_10 all 0.4355
P_100 all 0.2661
P_1000 all 0.0552
CincyMedIR_28¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.0122
summary (sample-eval)
infAP all 0.0151
infNDCG all 0.0852
iP10 all 0.0710
iP100 all 0.0566
summary (trec_eval)
map all 0.0281
bpref all 0.0646
recip_rank all 0.0910
P_10 all 0.0710
P_100 all 0.0494
P_1000 all 0.0187
CincyMedIR28dgt¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.0142
summary (sample-eval)
infAP all 0.0166
infNDCG all 0.0900
iP10 all 0.0742
iP100 all 0.0572
summary (trec_eval)
map all 0.0302
bpref all 0.0659
recip_rank all 0.0965
P_10 all 0.0742
P_100 all 0.0500
P_1000 all 0.0187
CincyMedIR_28_t¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.1333
summary (sample-eval)
infAP all 0.1259
infNDCG all 0.2721
iP10 all 0.3839
iP100 all 0.1340
summary (trec_eval)
map all 0.1495
bpref all 0.1742
recip_rank all 0.6172
P_10 all 0.3839
P_100 all 0.1294
P_1000 all 0.0187
CincyMedIR_20¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.0147
summary (sample-eval)
infAP all 0.0119
infNDCG all 0.0621
iP10 all 0.0516
iP100 all 0.0485
summary (trec_eval)
map all 0.0210
bpref all 0.0483
recip_rank all 0.1133
P_10 all 0.0516
P_100 all 0.0426
P_1000 all 0.0167
CincyMedIR_dgt¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2662
summary (sample-eval)
infAP all 0.1609
infNDCG all 0.3877
iP10 all 0.4452
iP100 all 0.2454
summary (trec_eval)
map all 0.2266
bpref all 0.2491
recip_rank all 0.7035
P_10 all 0.4452
P_100 all 0.2352
P_1000 all 0.0405
CSIROmed_strDFR¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2184
summary (sample-eval)
infAP all 0.2724
infNDCG all 0.5132
iP10 all 0.5258
iP100 all 0.3202
summary (trec_eval)
map all 0.3817
bpref all 0.4301
recip_rank all 0.7208
P_10 all 0.5258
P_100 all 0.2887
P_1000 all 0.0612
CSIROmed_rlxRR¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.1849
summary (sample-eval)
infAP all 0.2322
infNDCG all 0.4752
iP10 all 0.4839
iP100 all 0.3072
summary (trec_eval)
map all 0.3522
bpref all 0.3735
recip_rank all 0.6699
P_10 all 0.4839
P_100 all 0.2955
P_1000 all 0.0602
CSIROmed_rRRa¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2458
summary (sample-eval)
infAP all 0.2414
infNDCG all 0.4929
iP10 all 0.5323
iP100 all 0.3072
summary (trec_eval)
map all 0.3632
bpref all 0.3777
recip_rank all 0.7258
P_10 all 0.5323
P_100 all 0.2955
P_1000 all 0.0602
CSIROmed_strRR¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2457
summary (sample-eval)
infAP all 0.2971
infNDCG all 0.5303
iP10 all 0.5645
iP100 all 0.3208
summary (trec_eval)
map all 0.4078
bpref all 0.4556
recip_rank all 0.7248
P_10 all 0.5645
P_100 all 0.2890
P_1000 all 0.0612
CSIROmed_sRRa¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2446
summary (sample-eval)
infAP all 0.2870
infNDCG all 0.5268
iP10 all 0.5290
iP100 all 0.3202
summary (trec_eval)
map all 0.3973
bpref all 0.4410
recip_rank all 0.7532
P_10 all 0.5290
P_100 all 0.2887
P_1000 all 0.0612
f_CTD_run2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.0579
summary (sample-eval)
infAP all 0.0491
infNDCG all 0.1883
iP10 all 0.1151
iP100 all 0.1415
summary (trec_eval)
map all 0.0895
bpref all 0.1720
recip_rank all 0.2301
P_10 all 0.1065
P_100 all 0.1190
P_1000 all 0.0392
f_CTD_run1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.0732
summary (sample-eval)
infAP all 0.0702
infNDCG all 0.2449
iP10 all 0.1839
iP100 all 0.1701
summary (trec_eval)
map all 0.1076
bpref all 0.2068
recip_rank all 0.3143
P_10 all 0.1839
P_100 all 0.1365
P_1000 all 0.0393
duoT5rct¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.3568
summary (sample-eval)
infAP all 0.1965
infNDCG all 0.4344
iP10 all 0.4839
iP100 all 0.2903
summary (trec_eval)
map all 0.3181
bpref all 0.3410
recip_rank all 0.6520
P_10 all 0.4839
P_100 all 0.2752
P_1000 all 0.0590
monoT5rct¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.4019
summary (sample-eval)
infAP all 0.1747
infNDCG all 0.4039
iP10 all 0.4323
iP100 all 0.2900
summary (trec_eval)
map all 0.2943
bpref all 0.3163
recip_rank all 0.5552
P_10 all 0.4323
P_100 all 0.2745
P_1000 all 0.0590
duoT5¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.3049
summary (sample-eval)
infAP all 0.2619
infNDCG all 0.5116
iP10 all 0.5290
iP100 all 0.3307
summary (trec_eval)
map all 0.3814
bpref all 0.4014
recip_rank all 0.7595
P_10 all 0.5290
P_100 all 0.3113
P_1000 all 0.0590
monoT5¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2931
summary (sample-eval)
infAP all 0.2542
infNDCG all 0.5028
iP10 all 0.5000
iP100 all 0.3302
summary (trec_eval)
map all 0.3712
bpref all 0.4004
recip_rank all 0.7183
P_10 all 0.5000
P_100 all 0.3110
P_1000 all 0.0590
f_run1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.0823
summary (sample-eval)
infAP all 0.0752
infNDCG all 0.2626
iP10 all 0.2129
iP100 all 0.1742
summary (trec_eval)
map all 0.1122
bpref all 0.2168
recip_rank all 0.3698
P_10 all 0.2129
P_100 all 0.1390
P_1000 all 0.0391
f_run0¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.1705
summary (sample-eval)
infAP all 0.1075
infNDCG all 0.3159
iP10 all 0.2806
iP100 all 0.2017
summary (trec_eval)
map all 0.1609
bpref all 0.2701
recip_rank all 0.4679
P_10 all 0.2806
P_100 all 0.1752
P_1000 all 0.0448
monoT5e1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2393
summary (sample-eval)
infAP all 0.1464
infNDCG all 0.3635
iP10 all 0.2710
iP100 all 0.2903
summary (trec_eval)
map all 0.2593
bpref all 0.2960
recip_rank all 0.2842
P_10 all 0.2710
P_100 all 0.2752
P_1000 all 0.0590
pozadditional¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.1467
summary (sample-eval)
infAP all 0.1229
infNDCG all 0.2854
iP10 all 0.3258
iP100 all 0.2049
summary (trec_eval)
map all 0.1745
bpref all 0.2329
recip_rank all 0.5317
P_10 all 0.3258
P_100 all 0.1806
P_1000 all 0.0366
pozreranked¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2429
summary (sample-eval)
infAP all 0.2433
infNDCG all 0.4822
iP10 all 0.5226
iP100 all 0.3079
summary (trec_eval)
map all 0.3620
bpref all 0.3793
recip_rank all 0.7298
P_10 all 0.5226
P_100 all 0.2919
P_1000 all 0.0588
pozbaseline¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval) | Summary (evidence-eval)| Appendix
summary (evidence-eval)
ndcg_cut_10 all 0.2318
summary (sample-eval)
infAP all 0.2296
infNDCG all 0.4718
iP10 all 0.5323
iP100 all 0.2892
summary (trec_eval)
map all 0.3424
bpref all 0.3607
recip_rank all 0.7690
P_10 all 0.5323
P_100 all 0.2758
P_1000 all 0.0562