Skip to content

Results - Clinical Decision Support 2015

SCIAILuceneA

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0185
infNDCG         all 0.0919
iP10            all 0.3767
iP100           all 0.0597
summary (trec_eval)
map             all 0.0284
bpref           all 0.0437
recip_rank      all 0.5353
P_10            all 0.3767
P_100           all 0.0597
P_1000          all 0.0060

HipocratAr1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0307
infNDCG         all 0.1750
iP10            all 0.2567
iP100           all 0.1968
summary (trec_eval)
map             all 0.0718
bpref           all 0.1411
recip_rank      all 0.4982
P_10            all 0.2567
P_100           all 0.1703
P_1000          all 0.0542

HipocratAr2

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0230
infNDCG         all 0.1452
iP10            all 0.2267
iP100           all 0.1681
summary (trec_eval)
map             all 0.0634
bpref           all 0.1370
recip_rank      all 0.3492
P_10            all 0.2267
P_100           all 0.1577
P_1000          all 0.0542

HipocratAr3

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0348
infNDCG         all 0.1904
iP10            all 0.3133
iP100           all 0.2101
summary (trec_eval)
map             all 0.0820
bpref           all 0.1535
recip_rank      all 0.5589
P_10            all 0.3133
P_100           all 0.1787
P_1000          all 0.0557

EMSEasmer

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0502
infNDCG         all 0.2314
iP10            all 0.4067
iP100           all 0.2451
summary (trec_eval)
map             all 0.1160
bpref           all 0.1792
recip_rank      all 0.6105
P_10            all 0.4067
P_100           all 0.2230
P_1000          all 0.0642

EMSElsi

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0447
infNDCG         all 0.2157
iP10            all 0.3767
iP100           all 0.2301
summary (trec_eval)
map             all 0.1137
bpref           all 0.1782
recip_rank      all 0.5943
P_10            all 0.3767
P_100           all 0.2153
P_1000          all 0.0662

EMSErm3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0439
infNDCG         all 0.2122
iP10            all 0.3933
iP100           all 0.2236
summary (trec_eval)
map             all 0.1068
bpref           all 0.1703
recip_rank      all 0.6002
P_10            all 0.3933
P_100           all 0.2073
P_1000          all 0.0613

CAMspud1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0758
infNDCG         all 0.2823
iP10            all 0.4533
iP100           all 0.3088
summary (trec_eval)
map             all 0.1839
bpref           all 0.2369
recip_rank      all 0.6351
P_10            all 0.4533
P_100           all 0.2917
P_1000          all 0.0835

CAMspud3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0725
infNDCG         all 0.2791
iP10            all 0.4433
iP100           all 0.3072
summary (trec_eval)
map             all 0.1770
bpref           all 0.2281
recip_rank      all 0.6416
P_10            all 0.4433
P_100           all 0.2830
P_1000          all 0.0838

CAMspud5

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0731
infNDCG         all 0.2713
iP10            all 0.4033
iP100           all 0.3138
summary (trec_eval)
map             all 0.1678
bpref           all 0.2228
recip_rank      all 0.5719
P_10            all 0.4033
P_100           all 0.2727
P_1000          all 0.0771

BtBase1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0091
infNDCG         all 0.0705
iP10            all 0.1333
iP100           all 0.0789
summary (trec_eval)
map             all 0.0144
bpref           all 0.0502
recip_rank      all 0.3094
P_10            all 0.1333
P_100           all 0.0603
P_1000          all 0.0139

BtBase3

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0200
infNDCG         all 0.1297
iP10            all 0.2467
iP100           all 0.1427
summary (trec_eval)
map             all 0.0470
bpref           all 0.1030
recip_rank      all 0.4539
P_10            all 0.2467
P_100           all 0.1250
P_1000          all 0.0382

BtCleanAll4

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0244
infNDCG         all 0.1481
iP10            all 0.2433
iP100           all 0.1714
summary (trec_eval)
map             all 0.0540
bpref           all 0.1141
recip_rank      all 0.4689
P_10            all 0.2433
P_100           all 0.1437
P_1000          all 0.0399

artificial

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0409
infNDCG         all 0.2045
iP10            all 0.3233
iP100           all 0.2360
summary (trec_eval)
map             all 0.0996
bpref           all 0.1770
recip_rank      all 0.4620
P_10            all 0.3233
P_100           all 0.1937
P_1000          all 0.0649

SH1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0277
infNDCG         all 0.1534
iP10            all 0.2500
iP100           all 0.1641
summary (trec_eval)
map             all 0.0678
bpref           all 0.1266
recip_rank      all 0.4546
P_10            all 0.2500
P_100           all 0.1403
P_1000          all 0.0467

UWMUO1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0465
infNDCG         all 0.2085
iP10            all 0.3867
iP100           all 0.2212
summary (trec_eval)
map             all 0.1143
bpref           all 0.1724
recip_rank      all 0.6014
P_10            all 0.3867
P_100           all 0.2090
P_1000          all 0.0652

UWMUO2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0659
infNDCG         all 0.2634
iP10            all 0.4500
iP100           all 0.2842
summary (trec_eval)
map             all 0.1535
bpref           all 0.2247
recip_rank      all 0.6039
P_10            all 0.4500
P_100           all 0.2590
P_1000          all 0.0781

UWMUO3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0661
infNDCG         all 0.2656
iP10            all 0.4467
iP100           all 0.2887
summary (trec_eval)
map             all 0.1522
bpref           all 0.2224
recip_rank      all 0.6024
P_10            all 0.4467
P_100           all 0.2607
P_1000          all 0.0773

UWMUO4

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0473
infNDCG         all 0.2193
iP10            all 0.4067
iP100           all 0.2372
summary (trec_eval)
map             all 0.1216
bpref           all 0.1825
recip_rank      all 0.6210
P_10            all 0.4067
P_100           all 0.2220
P_1000          all 0.0705

UWMUO5

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0655
infNDCG         all 0.2663
iP10            all 0.4300
iP100           all 0.2947
summary (trec_eval)
map             all 0.1520
bpref           all 0.2236
recip_rank      all 0.6079
P_10            all 0.4300
P_100           all 0.2647
P_1000          all 0.0753

runindri

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0205
infNDCG         all 0.1351
iP10            all 0.1733
iP100           all 0.1497
summary (trec_eval)
map             all 0.0492
bpref           all 0.1131
recip_rank      all 0.3395
P_10            all 0.1733
P_100           all 0.1133
P_1000          all 0.0428

FORTHICSd0

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0248
infNDCG         all 0.1578
iP10            all 0.2733
iP100           all 0.1869
summary (trec_eval)
map             all 0.0519
bpref           all 0.1089
recip_rank      all 0.4718
P_10            all 0.2733
P_100           all 0.1557
P_1000          all 0.0394

FORTHICSd2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0235
infNDCG         all 0.1529
iP10            all 0.2633
iP100           all 0.1851
summary (trec_eval)
map             all 0.0504
bpref           all 0.1082
recip_rank      all 0.4579
P_10            all 0.2633
P_100           all 0.1523
P_1000          all 0.0394

FORTHICSs0

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0267
infNDCG         all 0.1601
iP10            all 0.2733
iP100           all 0.1909
summary (trec_eval)
map             all 0.0532
bpref           all 0.1073
recip_rank      all 0.4782
P_10            all 0.2733
P_100           all 0.1520
P_1000          all 0.0394

FrameAFinal

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0070
infNDCG         all 0.0465
iP10            all 0.2667
iP100           all 0.0267
summary (trec_eval)
map             all 0.0107
bpref           all 0.0184
recip_rank      all 0.3714
P_10            all 0.2667
P_100           all 0.0267
P_1000          all 0.0027

UWCSolrBM25

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0449
infNDCG         all 0.2121
iP10            all 0.3933
iP100           all 0.2305
summary (trec_eval)
map             all 0.1151
bpref           all 0.1747
recip_rank      all 0.5890
P_10            all 0.3933
P_100           all 0.2153
P_1000          all 0.0686

UWCPL2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0630
infNDCG         all 0.2542
iP10            all 0.4300
iP100           all 0.2793
summary (trec_eval)
map             all 0.1590
bpref           all 0.2111
recip_rank      all 0.6291
P_10            all 0.4300
P_100           all 0.2670
P_1000          all 0.0776

udelArun1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0655
infNDCG         all 0.2620
iP10            all 0.4100
iP100           all 0.2904
summary (trec_eval)
map             all 0.1523
bpref           all 0.2118
recip_rank      all 0.5928
P_10            all 0.4100
P_100           all 0.2557
P_1000          all 0.0767

udelArun2

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0716
infNDCG         all 0.2676
iP10            all 0.4000
iP100           all 0.2954
summary (trec_eval)
map             all 0.1597
bpref           all 0.2166
recip_rank      all 0.5879
P_10            all 0.4000
P_100           all 0.2587
P_1000          all 0.0765

UWCSolrTerr

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0053
infNDCG         all 0.0655
iP10            all 0.1200
iP100           all 0.0909
summary (trec_eval)
map             all 0.0056
bpref           all 0.0252
recip_rank      all 0.2213
P_10            all 0.1200
P_100           all 0.0427
P_1000          all 0.0084

KISTI001

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0424
infNDCG         all 0.2043
iP10            all 0.3500
iP100           all 0.2239
summary (trec_eval)
map             all 0.1026
bpref           all 0.1654
recip_rank      all 0.5247
P_10            all 0.3500
P_100           all 0.2043
P_1000          all 0.0627

KISTI002

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0503
infNDCG         all 0.2229
iP10            all 0.3667
iP100           all 0.2474
summary (trec_eval)
map             all 0.1222
bpref           all 0.1844
recip_rank      all 0.6182
P_10            all 0.3667
P_100           all 0.2207
P_1000          all 0.0690

KISTI003

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0670
infNDCG         all 0.2509
iP10            all 0.3967
iP100           all 0.2815
summary (trec_eval)
map             all 0.1494
bpref           all 0.2070
recip_rank      all 0.6127
P_10            all 0.3967
P_100           all 0.2480
P_1000          all 0.0698

SIBTEX2CITIN

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0581
infNDCG         all 0.2272
iP10            all 0.3967
iP100           all 0.2438
summary (trec_eval)
map             all 0.1421
bpref           all 0.2028
recip_rank      all 0.6172
P_10            all 0.3967
P_100           all 0.2273
P_1000          all 0.0734

SIBTEX3CTOUT

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0587
infNDCG         all 0.2280
iP10            all 0.3800
iP100           all 0.2475
summary (trec_eval)
map             all 0.1430
bpref           all 0.2027
recip_rank      all 0.5245
P_10            all 0.3800
P_100           all 0.2337
P_1000          all 0.0740

SIBTEX5COMBO

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0435
infNDCG         all 0.2042
iP10            all 0.3400
iP100           all 0.2308
summary (trec_eval)
map             all 0.1199
bpref           all 0.1718
recip_rank      all 0.5527
P_10            all 0.3400
P_100           all 0.2123
P_1000          all 0.0741

PL2c28

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0398
infNDCG         all 0.2045
iP10            all 0.3467
iP100           all 0.2269
summary (trec_eval)
map             all 0.0964
bpref           all 0.1630
recip_rank      all 0.6210
P_10            all 0.3467
P_100           all 0.2040
P_1000          all 0.0542

run1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0400
infNDCG         all 0.1954
iP10            all 0.3633
iP100           all 0.2138
summary (trec_eval)
map             all 0.0908
bpref           all 0.1607
recip_rank      all 0.5662
P_10            all 0.3633
P_100           all 0.1867
P_1000          all 0.0584

run2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0432
infNDCG         all 0.2117
iP10            all 0.3767
iP100           all 0.2333
summary (trec_eval)
map             all 0.1106
bpref           all 0.1766
recip_rank      all 0.5756
P_10            all 0.3767
P_100           all 0.2113
P_1000          all 0.0675

DuthStef

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0429
infNDCG         all 0.2318
iP10            all 0.3500
iP100           all 0.2582
summary (trec_eval)
map             all 0.0726
bpref           all 0.1564
recip_rank      all 0.5634
P_10            all 0.3500
P_100           all 0.1730
P_1000          all 0.0417

DuthMmMt16s

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0265
infNDCG         all 0.1620
iP10            all 0.2900
iP100           all 0.1827
summary (trec_eval)
map             all 0.0501
bpref           all 0.1162
recip_rank      all 0.5049
P_10            all 0.2900
P_100           all 0.1453
P_1000          all 0.0365

DuthMmMt16f

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0404
infNDCG         all 0.1849
iP10            all 0.3133
iP100           all 0.2051
summary (trec_eval)
map             all 0.0822
bpref           all 0.1467
recip_rank      all 0.5293
P_10            all 0.3133
P_100           all 0.1760
P_1000          all 0.0513

runindriML

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0196
infNDCG         all 0.1308
iP10            all 0.1767
iP100           all 0.1462
summary (trec_eval)
map             all 0.0491
bpref           all 0.1122
recip_rank      all 0.3419
P_10            all 0.1767
P_100           all 0.1123
P_1000          all 0.0428

udelArun3

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0611
infNDCG         all 0.2480
iP10            all 0.4000
iP100           all 0.2702
summary (trec_eval)
map             all 0.1381
bpref           all 0.2114
recip_rank      all 0.5281
P_10            all 0.4000
P_100           all 0.2270
P_1000          all 0.0762

PL2c6

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0442
infNDCG         all 0.2232
iP10            all 0.3800
iP100           all 0.2380
summary (trec_eval)
map             all 0.1099
bpref           all 0.1751
recip_rank      all 0.6578
P_10            all 0.3800
P_100           all 0.2193
P_1000          all 0.0618

PL2c10

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0433
infNDCG         all 0.2181
iP10            all 0.3800
iP100           all 0.2342
summary (trec_eval)
map             all 0.1089
bpref           all 0.1755
recip_rank      all 0.6170
P_10            all 0.3800
P_100           all 0.2170
P_1000          all 0.0616

ECNUPB

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0062
infNDCG         all 0.0702
iP10            all 0.1033
iP100           all 0.0858
summary (trec_eval)
map             all 0.0220
bpref           all 0.0782
recip_rank      all 0.2481
P_10            all 0.1033
P_100           all 0.0710
P_1000          all 0.0320

ecnu1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0655
infNDCG         all 0.2664
iP10            all 0.4500
iP100           all 0.2910
summary (trec_eval)
map             all 0.1641
bpref           all 0.2166
recip_rank      all 0.6299
P_10            all 0.4500
P_100           all 0.2717
P_1000          all 0.0802

ecnu2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0651
infNDCG         all 0.2680
iP10            all 0.4533
iP100           all 0.2936
summary (trec_eval)
map             all 0.1632
bpref           all 0.2157
recip_rank      all 0.6299
P_10            all 0.4533
P_100           all 0.2710
P_1000          all 0.0802

utdhltril2r

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0261
infNDCG         all 0.1522
iP10            all 0.2633
iP100           all 0.1848
summary (trec_eval)
map             all 0.0591
bpref           all 0.1338
recip_rank      all 0.3987
P_10            all 0.2633
P_100           all 0.1457
P_1000          all 0.0494

TUW1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0560
infNDCG         all 0.2416
iP10            all 0.3900
iP100           all 0.2621
summary (trec_eval)
map             all 0.1381
bpref           all 0.1975
recip_rank      all 0.5990
P_10            all 0.3900
P_100           all 0.2433
P_1000          all 0.0731

TUW2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0539
infNDCG         all 0.2197
iP10            all 0.3800
iP100           all 0.2384
summary (trec_eval)
map             all 0.1275
bpref           all 0.1908
recip_rank      all 0.6136
P_10            all 0.3800
P_100           all 0.2217
P_1000          all 0.0691

TUW3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0528
infNDCG         all 0.2339
iP10            all 0.4067
iP100           all 0.2549
summary (trec_eval)
map             all 0.1350
bpref           all 0.1939
recip_rank      all 0.6338
P_10            all 0.4067
P_100           all 0.2393
P_1000          all 0.0750

manual

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0207
infNDCG         all 0.1855
iP10            all 0.2367
iP100           all 0.2167
summary (trec_eval)
map             all 0.0526
bpref           all 0.1646
recip_rank      all 0.4165
P_10            all 0.2367
P_100           all 0.1333
P_1000          all 0.0582

auto

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0109
infNDCG         all 0.0858
iP10            all 0.1700
iP100           all 0.1120
summary (trec_eval)
map             all 0.0230
bpref           all 0.0673
recip_rank      all 0.2636
P_10            all 0.1700
P_100           all 0.0850
P_1000          all 0.0256

lamdarun01

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0364
infNDCG         all 0.1798
iP10            all 0.3133
iP100           all 0.2080
summary (trec_eval)
map             all 0.0932
bpref           all 0.1509
recip_rank      all 0.4837
P_10            all 0.3133
P_100           all 0.1903
P_1000          all 0.0623

lamdarun02

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0364
infNDCG         all 0.1798
iP10            all 0.3133
iP100           all 0.2080
summary (trec_eval)
map             all 0.0932
bpref           all 0.1509
recip_rank      all 0.4837
P_10            all 0.3133
P_100           all 0.1903
P_1000          all 0.0623

Run1DBpSimp

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0715
infNDCG         all 0.2571
iP10            all 0.4100
iP100           all 0.2719
summary (trec_eval)
map             all 0.1658
bpref           all 0.2234
recip_rank      all 0.5822
P_10            all 0.4100
P_100           all 0.2460
P_1000          all 0.0733

hybrid

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0227
infNDCG         all 0.1933
iP10            all 0.2867
iP100           all 0.2194
summary (trec_eval)
map             all 0.0619
bpref           all 0.1828
recip_rank      all 0.4624
P_10            all 0.2867
P_100           all 0.1390
P_1000          all 0.0682

Run2DBpComb

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0787
infNDCG         all 0.2894
iP10            all 0.4533
iP100           all 0.3184
summary (trec_eval)
map             all 0.1770
bpref           all 0.2427
recip_rank      all 0.5455
P_10            all 0.4533
P_100           all 0.2817
P_1000          all 0.0791

FDUAuto1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0599
infNDCG         all 0.2469
iP10            all 0.3900
iP100           all 0.2625
summary (trec_eval)
map             all 0.1423
bpref           all 0.2130
recip_rank      all 0.5150
P_10            all 0.3900
P_100           all 0.2217
P_1000          all 0.0747

Run4HLM

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0746
infNDCG         all 0.2768
iP10            all 0.4500
iP100           all 0.3072
summary (trec_eval)
map             all 0.1641
bpref           all 0.2391
recip_rank      all 0.5432
P_10            all 0.4500
P_100           all 0.2623
P_1000          all 0.0791

FDUAuto2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0600
infNDCG         all 0.2539
iP10            all 0.3933
iP100           all 0.2720
summary (trec_eval)
map             all 0.1439
bpref           all 0.2131
recip_rank      all 0.5442
P_10            all 0.3933
P_100           all 0.2317
P_1000          all 0.0776

FDUManual

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0611
infNDCG         all 0.2689
iP10            all 0.3900
iP100           all 0.2836
summary (trec_eval)
map             all 0.1366
bpref           all 0.2161
recip_rank      all 0.5594
P_10            all 0.3900
P_100           all 0.2263
P_1000          all 0.0732

GRIUMenRun1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0417
infNDCG         all 0.2119
iP10            all 0.3533
iP100           all 0.2229
summary (trec_eval)
map             all 0.0948
bpref           all 0.1628
recip_rank      all 0.5891
P_10            all 0.3533
P_100           all 0.1940
P_1000          all 0.0605

QFB

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0611
infNDCG         all 0.2613
iP10            all 0.4367
iP100           all 0.2833
summary (trec_eval)
map             all 0.1463
bpref           all 0.2061
recip_rank      all 0.6396
P_10            all 0.4367
P_100           all 0.2533
P_1000          all 0.0750

UMLS

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0411
infNDCG         all 0.2089
iP10            all 0.3500
iP100           all 0.2439
summary (trec_eval)
map             all 0.1104
bpref           all 0.1799
recip_rank      all 0.5164
P_10            all 0.3500
P_100           all 0.2053
P_1000          all 0.0704

PPR

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0345
infNDCG         all 0.2002
iP10            all 0.3167
iP100           all 0.2337
summary (trec_eval)
map             all 0.0976
bpref           all 0.1701
recip_rank      all 0.4846
P_10            all 0.3167
P_100           all 0.1967
P_1000          all 0.0677

GRIUMenRun2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0434
infNDCG         all 0.2107
iP10            all 0.3567
iP100           all 0.2279
summary (trec_eval)
map             all 0.1023
bpref           all 0.1668
recip_rank      all 0.6041
P_10            all 0.3567
P_100           all 0.2027
P_1000          all 0.0633

lamdarun03

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0363
infNDCG         all 0.1811
iP10            all 0.3167
iP100           all 0.2114
summary (trec_eval)
map             all 0.0914
bpref           all 0.1515
recip_rank      all 0.4795
P_10            all 0.3167
P_100           all 0.1903
P_1000          all 0.0617

cbnu0

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0481
infNDCG         all 0.2179
iP10            all 0.3733
iP100           all 0.2281
summary (trec_eval)
map             all 0.1209
bpref           all 0.1796
recip_rank      all 0.6059
P_10            all 0.3733
P_100           all 0.2193
P_1000          all 0.0685

cbnu1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0484
infNDCG         all 0.2317
iP10            all 0.3833
iP100           all 0.2520
summary (trec_eval)
map             all 0.1263
bpref           all 0.1890
recip_rank      all 0.6188
P_10            all 0.3833
P_100           all 0.2360
P_1000          all 0.0731

cbnu2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0507
infNDCG         all 0.2327
iP10            all 0.3967
iP100           all 0.2486
summary (trec_eval)
map             all 0.1248
bpref           all 0.1849
recip_rank      all 0.6337
P_10            all 0.3967
P_100           all 0.2317
P_1000          all 0.0697

LIMSIrun1BoW

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0362
infNDCG         all 0.1642
iP10            all 0.2667
iP100           all 0.2104
summary (trec_eval)
map             all 0.0976
bpref           all 0.1617
recip_rank      all 0.3137
P_10            all 0.2667
P_100           all 0.1837
P_1000          all 0.0663

prna1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0190
infNDCG         all 0.0805
iP10            all 0.1233
iP100           all 0.0998
summary (trec_eval)
map             all 0.0289
bpref           all 0.0576
recip_rank      all 0.2345
P_10            all 0.1233
P_100           all 0.0653
P_1000          all 0.0200

nuuuuncDFML

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0776
infNDCG         all 0.3019
iP10            all 0.5133
iP100           all 0.3180
summary (trec_eval)
map             all 0.1305
bpref           all 0.2124
recip_rank      all 0.6856
P_10            all 0.5133
P_100           all 0.2363
P_1000          all 0.0498

prna2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0073
infNDCG         all 0.0770
iP10            all 0.0933
iP100           all 0.1215
summary (trec_eval)
map             all 0.0146
bpref           all 0.0522
recip_rank      all 0.1652
P_10            all 0.0933
P_100           all 0.0620
P_1000          all 0.0235

utdhltripar

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0183
infNDCG         all 0.1309
iP10            all 0.1733
iP100           all 0.1664
summary (trec_eval)
map             all 0.0511
bpref           all 0.1200
recip_rank      all 0.2374
P_10            all 0.1733
P_100           all 0.1243
P_1000          all 0.0480

utdhltrikcv

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0186
infNDCG         all 0.1317
iP10            all 0.1767
iP100           all 0.1706
summary (trec_eval)
map             all 0.0523
bpref           all 0.1181
recip_rank      all 0.2482
P_10            all 0.1767
P_100           all 0.1273
P_1000          all 0.0479

nuuuuncMDRUN

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0725
infNDCG         all 0.2925
iP10            all 0.4867
iP100           all 0.3186
summary (trec_eval)
map             all 0.1247
bpref           all 0.2181
recip_rank      all 0.6870
P_10            all 0.4867
P_100           all 0.2267
P_1000          all 0.0530

prna3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0164
infNDCG         all 0.0662
iP10            all 0.0867
iP100           all 0.0859
summary (trec_eval)
map             all 0.0238
bpref           all 0.0556
recip_rank      all 0.1291
P_10            all 0.0867
P_100           all 0.0533
P_1000          all 0.0179

FusionAuto

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0641
infNDCG         all 0.2445
iP10            all 0.3733
iP100           all 0.2663
summary (trec_eval)
map             all 0.1451
bpref           all 0.2064
recip_rank      all 0.4967
P_10            all 0.3733
P_100           all 0.2370
P_1000          all 0.0707

FusionManual

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0738
infNDCG         all 0.2815
iP10            all 0.4600
iP100           all 0.3066
summary (trec_eval)
map             all 0.1692
bpref           all 0.2339
recip_rank      all 0.5990
P_10            all 0.4600
P_100           all 0.2750
P_1000          all 0.0798

nuuuuncHAKT

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0354
infNDCG         all 0.1794
iP10            all 0.2800
iP100           all 0.2007
summary (trec_eval)
map             all 0.0600
bpref           all 0.1171
recip_rank      all 0.4473
P_10            all 0.2800
P_100           all 0.1293
P_1000          all 0.0330

SNUMedinfo1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0537
infNDCG         all 0.2469
iP10            all 0.4133
iP100           all 0.2540
summary (trec_eval)
map             all 0.1373
bpref           all 0.2092
recip_rank      all 0.6943
P_10            all 0.4133
P_100           all 0.2260
P_1000          all 0.0773

SNUMedinfo2

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0467
infNDCG         all 0.2384
iP10            all 0.3800
iP100           all 0.2523
summary (trec_eval)
map             all 0.1251
bpref           all 0.2027
recip_rank      all 0.6426
P_10            all 0.3800
P_100           all 0.2150
P_1000          all 0.0774

SNUMedinfo3

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0503
infNDCG         all 0.2365
iP10            all 0.3900
iP100           all 0.2410
summary (trec_eval)
map             all 0.1326
bpref           all 0.2043
recip_rank      all 0.6784
P_10            all 0.3900
P_100           all 0.2177
P_1000          all 0.0770

wsuirsaa

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0777
infNDCG         all 0.2928
iP10            all 0.4633
iP100           all 0.3190
summary (trec_eval)
map             all 0.1851
bpref           all 0.2391
recip_rank      all 0.6376
P_10            all 0.4633
P_100           all 0.2953
P_1000          all 0.0862

wsuirdaa

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0842
infNDCG         all 0.2939
iP10            all 0.4667
iP100           all 0.3302
summary (trec_eval)
map             all 0.1864
bpref           all 0.2525
recip_rank      all 0.6634
P_10            all 0.4667
P_100           all 0.2943
P_1000          all 0.0834

LIMSIrun2MSH

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0602
infNDCG         all 0.2507
iP10            all 0.3767
iP100           all 0.2905
summary (trec_eval)
map             all 0.1367
bpref           all 0.2159
recip_rank      all 0.4609
P_10            all 0.3767
P_100           all 0.2397
P_1000          all 0.0737

EPBRNTFIDFR1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0186
infNDCG         all 0.1297
iP10            all 0.2567
iP100           all 0.1405
summary (trec_eval)
map             all 0.0405
bpref           all 0.0974
recip_rank      all 0.4967
P_10            all 0.2567
P_100           all 0.1097
P_1000          all 0.0346

EPBRNBM25R2

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0192
infNDCG         all 0.1325
iP10            all 0.2600
iP100           all 0.1443
summary (trec_eval)
map             all 0.0423
bpref           all 0.1005
recip_rank      all 0.5047
P_10            all 0.2600
P_100           all 0.1143
P_1000          all 0.0361

LIMSIrun3SmF

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0197
infNDCG         all 0.1199
iP10            all 0.2067
iP100           all 0.1615
summary (trec_eval)
map             all 0.0364
bpref           all 0.0863
recip_rank      all 0.2706
P_10            all 0.2067
P_100           all 0.1007
P_1000          all 0.0263

EPBRNRSVMR3

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0158
infNDCG         all 0.1121
iP10            all 0.1700
iP100           all 0.1478
summary (trec_eval)
map             all 0.0399
bpref           all 0.0991
recip_rank      all 0.3524
P_10            all 0.1700
P_100           all 0.1183
P_1000          all 0.0365

FusionMAll

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0816
infNDCG         all 0.2954
iP10            all 0.4700
iP100           all 0.3172
summary (trec_eval)
map             all 0.1735
bpref           all 0.2353
recip_rank      all 0.6351
P_10            all 0.4700
P_100           all 0.2823
P_1000          all 0.0793

hltcoe5srf

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0706
infNDCG         all 0.2643
iP10            all 0.4000
iP100           all 0.2939
summary (trec_eval)
map             all 0.1619
bpref           all 0.2232
recip_rank      all 0.6251
P_10            all 0.4000
P_100           all 0.2627
P_1000          all 0.0785

hltcoe4srf

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0690
infNDCG         all 0.2419
iP10            all 0.3900
iP100           all 0.2612
summary (trec_eval)
map             all 0.1552
bpref           all 0.2156
recip_rank      all 0.6053
P_10            all 0.3900
P_100           all 0.2357
P_1000          all 0.0760

hltcoewsrf

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0680
infNDCG         all 0.2670
iP10            all 0.4267
iP100           all 0.2887
summary (trec_eval)
map             all 0.1571
bpref           all 0.2165
recip_rank      all 0.5932
P_10            all 0.4267
P_100           all 0.2590
P_1000          all 0.0757

NOVASEARCH1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0490
infNDCG         all 0.2242
iP10            all 0.3567
iP100           all 0.2592
summary (trec_eval)
map             all 0.1355
bpref           all 0.1930
recip_rank      all 0.4619
P_10            all 0.3567
P_100           all 0.2387
P_1000          all 0.0745

NOVASEARCH2

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0475
infNDCG         all 0.2208
iP10            all 0.3467
iP100           all 0.2451
summary (trec_eval)
map             all 0.1268
bpref           all 0.1909
recip_rank      all 0.5183
P_10            all 0.3467
P_100           all 0.2217
P_1000          all 0.0724

NOVASEARCH3

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0509
infNDCG         all 0.2295
iP10            all 0.3567
iP100           all 0.2653
summary (trec_eval)
map             all 0.1424
bpref           all 0.1976
recip_rank      all 0.4613
P_10            all 0.3567
P_100           all 0.2510
P_1000          all 0.0784

DAIICTrun1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0408
infNDCG         all 0.1900
iP10            all 0.2833
iP100           all 0.1953
summary (trec_eval)
map             all 0.0973
bpref           all 0.1590
recip_rank      all 0.5450
P_10            all 0.2833
P_100           all 0.1737
P_1000          all 0.0552

DAIICTrun2

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0475
infNDCG         all 0.1803
iP10            all 0.2500
iP100           all 0.2006
summary (trec_eval)
map             all 0.0942
bpref           all 0.1588
recip_rank      all 0.3921
P_10            all 0.2500
P_100           all 0.1650
P_1000          all 0.0517

wsuirdma

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0880
infNDCG         all 0.3109
iP10            all 0.4733
iP100           all 0.3347
summary (trec_eval)
map             all 0.1968
bpref           all 0.2610
recip_rank      all 0.6969
P_10            all 0.4733
P_100           all 0.3057
P_1000          all 0.0862

SCIAILuceneB

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0229
infNDCG         all 0.1111
iP10            all 0.4167
iP100           all 0.0770
summary (trec_eval)
map             all 0.0362
bpref           all 0.0523
recip_rank      all 0.5206
P_10            all 0.4167
P_100           all 0.0770
P_1000          all 0.0077

RRFfused

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0131
infNDCG         all 0.0734
iP10            all 0.4067
iP100           all 0.0407
summary (trec_eval)
map             all 0.0209
bpref           all 0.0309
recip_rank      all 0.5276
P_10            all 0.4067
P_100           all 0.0407
P_1000          all 0.0041

UWMUO6

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0776
infNDCG         all 0.2962
iP10            all 0.4900
iP100           all 0.3073
summary (trec_eval)
map             all 0.1816
bpref           all 0.2501
recip_rank      all 0.6731
P_10            all 0.4900
P_100           all 0.2823
P_1000          all 0.0852

QFBdiag

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0778
infNDCG         all 0.3201
iP10            all 0.5033
iP100           all 0.3324
summary (trec_eval)
map             all 0.1886
bpref           all 0.2491
recip_rank      all 0.7084
P_10            all 0.5033
P_100           all 0.3027
P_1000          all 0.0865

UMLSdiag

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0629
infNDCG         all 0.2703
iP10            all 0.4367
iP100           all 0.2982
summary (trec_eval)
map             all 0.1567
bpref           all 0.2306
recip_rank      all 0.6074
P_10            all 0.4367
P_100           all 0.2593
P_1000          all 0.0818

PPRdiag

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0529
infNDCG         all 0.2493
iP10            all 0.3967
iP100           all 0.2821
summary (trec_eval)
map             all 0.1390
bpref           all 0.2130
recip_rank      all 0.5359
P_10            all 0.3967
P_100           all 0.2470
P_1000          all 0.0790

KISTI001B

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0528
infNDCG         all 0.2379
iP10            all 0.4100
iP100           all 0.2541
summary (trec_eval)
map             all 0.1307
bpref           all 0.1927
recip_rank      all 0.5410
P_10            all 0.4100
P_100           all 0.2353
P_1000          all 0.0721

KISTI002B

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0688
infNDCG         all 0.2744
iP10            all 0.4367
iP100           all 0.2910
summary (trec_eval)
map             all 0.1587
bpref           all 0.2180
recip_rank      all 0.6520
P_10            all 0.4367
P_100           all 0.2580
P_1000          all 0.0782

KISTI003B

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0771
infNDCG         all 0.2923
iP10            all 0.4500
iP100           all 0.3171
summary (trec_eval)
map             all 0.1765
bpref           all 0.2359
recip_rank      all 0.7145
P_10            all 0.4500
P_100           all 0.2823
P_1000          all 0.0819

SNUMedinfo13

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0989
infNDCG         all 0.3611
iP10            all 0.5567
iP100           all 0.3541
summary (trec_eval)
map             all 0.2143
bpref           all 0.3056
recip_rank      all 0.8652
P_10            all 0.5567
P_100           all 0.2967
P_1000          all 0.0888

SNUMedinfo12

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0999
infNDCG         all 0.3587
iP10            all 0.5667
iP100           all 0.3482
summary (trec_eval)
map             all 0.2108
bpref           all 0.3024
recip_rank      all 0.8819
P_10            all 0.5667
P_100           all 0.2927
P_1000          all 0.0835

SNUMedinfo11

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0997
infNDCG         all 0.3609
iP10            all 0.5633
iP100           all 0.3541
summary (trec_eval)
map             all 0.2161
bpref           all 0.3075
recip_rank      all 0.8819
P_10            all 0.5633
P_100           all 0.2960
P_1000          all 0.0900

runindriB

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0894
infNDCG         all 0.3258
iP10            all 0.5000
iP100           all 0.3262
summary (trec_eval)
map             all 0.1776
bpref           all 0.2598
recip_rank      all 0.6401
P_10            all 0.5000
P_100           all 0.2707
P_1000          all 0.0701

artificialB

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0861
infNDCG         all 0.3168
iP10            all 0.4567
iP100           all 0.3431
summary (trec_eval)
map             all 0.1603
bpref           all 0.2518
recip_rank      all 0.5893
P_10            all 0.4567
P_100           all 0.2653
P_1000          all 0.0659

DuthBaseF

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0446
infNDCG         all 0.2105
iP10            all 0.3933
iP100           all 0.2278
summary (trec_eval)
map             all 0.1011
bpref           all 0.1617
recip_rank      all 0.5678
P_10            all 0.3933
P_100           all 0.2120
P_1000          all 0.0575

DuthBaseS

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0305
infNDCG         all 0.1723
iP10            all 0.3500
iP100           all 0.1921
summary (trec_eval)
map             all 0.0591
bpref           all 0.1224
recip_rank      all 0.5244
P_10            all 0.3500
P_100           all 0.1613
P_1000          all 0.0383

DuthMmMtB16f

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0475
infNDCG         all 0.2394
iP10            all 0.3800
iP100           all 0.2474
summary (trec_eval)
map             all 0.1065
bpref           all 0.1836
recip_rank      all 0.6059
P_10            all 0.3800
P_100           all 0.2200
P_1000          all 0.0638

SHB1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0450
infNDCG         all 0.2145
iP10            all 0.3233
iP100           all 0.2205
summary (trec_eval)
map             all 0.1034
bpref           all 0.1639
recip_rank      all 0.5839
P_10            all 0.3233
P_100           all 0.1897
P_1000          all 0.0572

runnetwork

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0879
infNDCG         all 0.3237
iP10            all 0.5000
iP100           all 0.3224
summary (trec_eval)
map             all 0.1755
bpref           all 0.2586
recip_rank      all 0.6402
P_10            all 0.5000
P_100           all 0.2687
P_1000          all 0.0696

CAMspud6

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0786
infNDCG         all 0.3059
iP10            all 0.4800
iP100           all 0.3180
summary (trec_eval)
map             all 0.1890
bpref           all 0.2394
recip_rank      all 0.7333
P_10            all 0.4800
P_100           all 0.2977
P_1000          all 0.0891

CAMspud7

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0941
infNDCG         all 0.3471
iP10            all 0.5267
iP100           all 0.3654
summary (trec_eval)
map             all 0.2232
bpref           all 0.2811
recip_rank      all 0.7273
P_10            all 0.5267
P_100           all 0.3357
P_1000          all 0.0971

CAMspud8

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0912
infNDCG         all 0.3410
iP10            all 0.5200
iP100           all 0.3594
summary (trec_eval)
map             all 0.2190
bpref           all 0.2764
recip_rank      all 0.7183
P_10            all 0.5200
P_100           all 0.3277
P_1000          all 0.0960

ECNUBP

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0355
infNDCG         all 0.1656
iP10            all 0.1967
iP100           all 0.1864
summary (trec_eval)
map             all 0.1010
bpref           all 0.2128
recip_rank      all 0.2707
P_10            all 0.1967
P_100           all 0.1600
P_1000          all 0.0679

FORTHICSd0e7

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0191
infNDCG         all 0.1451
iP10            all 0.2267
iP100           all 0.1761
summary (trec_eval)
map             all 0.0457
bpref           all 0.1057
recip_rank      all 0.4787
P_10            all 0.2267
P_100           all 0.1470
P_1000          all 0.0394

ecnu3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.1140
infNDCG         all 0.3821
iP10            all 0.5633
iP100           all 0.3971
summary (trec_eval)
map             all 0.2216
bpref           all 0.3066
recip_rank      all 0.7582
P_10            all 0.5633
P_100           all 0.3250
P_1000          all 0.0842

ecnu4

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.1106
infNDCG         all 0.3749
iP10            all 0.5533
iP100           all 0.3887
summary (trec_eval)
map             all 0.2207
bpref           all 0.3049
recip_rank      all 0.7410
P_10            all 0.5533
P_100           all 0.3210
P_1000          all 0.0842

TUW4

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0958
infNDCG         all 0.3561
iP10            all 0.5167
iP100           all 0.3667
summary (trec_eval)
map             all 0.2044
bpref           all 0.2785
recip_rank      all 0.6620
P_10            all 0.5167
P_100           all 0.3093
P_1000          all 0.0833

TUW5

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.1017
infNDCG         all 0.3616
iP10            all 0.5367
iP100           all 0.3763
summary (trec_eval)
map             all 0.2097
bpref           all 0.2911
recip_rank      all 0.6883
P_10            all 0.5367
P_100           all 0.3133
P_1000          all 0.0834

TUW6

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0904
infNDCG         all 0.3430
iP10            all 0.5133
iP100           all 0.3483
summary (trec_eval)
map             all 0.2087
bpref           all 0.2825
recip_rank      all 0.7534
P_10            all 0.5133
P_100           all 0.3087
P_1000          all 0.0938

AUEBrun1B

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0400
infNDCG         all 0.1954
iP10            all 0.3633
iP100           all 0.2138
summary (trec_eval)
map             all 0.0908
bpref           all 0.1607
recip_rank      all 0.5662
P_10            all 0.3633
P_100           all 0.1867
P_1000          all 0.0584

AUEBrun2B

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0656
infNDCG         all 0.2898
iP10            all 0.4733
iP100           all 0.3116
summary (trec_eval)
map             all 0.1712
bpref           all 0.2461
recip_rank      all 0.7264
P_10            all 0.4733
P_100           all 0.2787
P_1000          all 0.0857

Run5DBpAbs

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0801
infNDCG         all 0.2855
iP10            all 0.4000
iP100           all 0.3168
summary (trec_eval)
map             all 0.1608
bpref           all 0.2374
recip_rank      all 0.5363
P_10            all 0.4000
P_100           all 0.2457
P_1000          all 0.0743

utdhltrikcvb

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0123
infNDCG         all 0.0940
iP10            all 0.1233
iP100           all 0.1219
summary (trec_eval)
map             all 0.0433
bpref           all 0.1076
recip_rank      all 0.2746
P_10            all 0.1233
P_100           all 0.0967
P_1000          all 0.0483

nuuuuncHMKTB

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0600
infNDCG         all 0.2796
iP10            all 0.5167
iP100           all 0.2830
summary (trec_eval)
map             all 0.1058
bpref           all 0.1835
recip_rank      all 0.7733
P_10            all 0.5167
P_100           all 0.1967
P_1000          all 0.0448

nuuuuncMDRUB

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0887
infNDCG         all 0.3255
iP10            all 0.5133
iP100           all 0.3518
summary (trec_eval)
map             all 0.1510
bpref           all 0.2511
recip_rank      all 0.7564
P_10            all 0.5133
P_100           all 0.2557
P_1000          all 0.0608

nuuuuncDFMLB

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0485
infNDCG         all 0.2204
iP10            all 0.3800
iP100           all 0.2294
summary (trec_eval)
map             all 0.0851
bpref           all 0.1570
recip_rank      all 0.5496
P_10            all 0.3800
P_100           all 0.1693
P_1000          all 0.0397

udelBrun1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0807
infNDCG         all 0.3154
iP10            all 0.4867
iP100           all 0.3297
summary (trec_eval)
map             all 0.1856
bpref           all 0.2500
recip_rank      all 0.7164
P_10            all 0.4867
P_100           all 0.2910
P_1000          all 0.0861

udelBrun2

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0816
infNDCG         all 0.3156
iP10            all 0.4900
iP100           all 0.3310
summary (trec_eval)
map             all 0.1853
bpref           all 0.2497
recip_rank      all 0.6998
P_10            all 0.4900
P_100           all 0.2923
P_1000          all 0.0853

manualb

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0209
infNDCG         all 0.1879
iP10            all 0.2400
iP100           all 0.2219
summary (trec_eval)
map             all 0.0531
bpref           all 0.1651
recip_rank      all 0.4141
P_10            all 0.2400
P_100           all 0.1363
P_1000          all 0.0583

udelBrun3

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0734
infNDCG         all 0.3071
iP10            all 0.4800
iP100           all 0.3232
summary (trec_eval)
map             all 0.1641
bpref           all 0.2399
recip_rank      all 0.6759
P_10            all 0.4800
P_100           all 0.2630
P_1000          all 0.0846

FORTHICSdQE

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0247
infNDCG         all 0.1540
iP10            all 0.2700
iP100           all 0.1710
summary (trec_eval)
map             all 0.0657
bpref           all 0.1265
recip_rank      all 0.5222
P_10            all 0.2700
P_100           all 0.1467
P_1000          all 0.0498

FORTHICSdQER

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0339
infNDCG         all 0.1880
iP10            all 0.3300
iP100           all 0.2076
summary (trec_eval)
map             all 0.0745
bpref           all 0.1370
recip_rank      all 0.5221
P_10            all 0.3300
P_100           all 0.1750
P_1000          all 0.0498

NOVASEARCH4

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0665
infNDCG         all 0.2964
iP10            all 0.4567
iP100           all 0.3189
summary (trec_eval)
map             all 0.1697
bpref           all 0.2402
recip_rank      all 0.6288
P_10            all 0.4567
P_100           all 0.2843
P_1000          all 0.0839

NOVASEARCH5

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0783
infNDCG         all 0.3207
iP10            all 0.4933
iP100           all 0.3446
summary (trec_eval)
map             all 0.2048
bpref           all 0.2620
recip_rank      all 0.6024
P_10            all 0.4933
P_100           all 0.3270
P_1000          all 0.0973

NOVASEARCH6

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0675
infNDCG         all 0.2992
iP10            all 0.4900
iP100           all 0.3181
summary (trec_eval)
map             all 0.1483
bpref           all 0.2162
recip_rank      all 0.6310
P_10            all 0.4900
P_100           all 0.2850
P_1000          all 0.0741

utdhltriprfb

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0151
infNDCG         all 0.0863
iP10            all 0.1333
iP100           all 0.1080
summary (trec_eval)
map             all 0.0403
bpref           all 0.0845
recip_rank      all 0.1860
P_10            all 0.1333
P_100           all 0.0817
P_1000          all 0.0323

prnaB1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0561
infNDCG         all 0.2131
iP10            all 0.3267
iP100           all 0.2168
summary (trec_eval)
map             all 0.0949
bpref           all 0.1525
recip_rank      all 0.5817
P_10            all 0.3267
P_100           all 0.1680
P_1000          all 0.0393

prnaB2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0539
infNDCG         all 0.2097
iP10            all 0.2933
iP100           all 0.2171
summary (trec_eval)
map             all 0.0888
bpref           all 0.1453
recip_rank      all 0.5338
P_10            all 0.2933
P_100           all 0.1617
P_1000          all 0.0346

prnaB3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0558
infNDCG         all 0.2130
iP10            all 0.3300
iP100           all 0.2109
summary (trec_eval)
map             all 0.0923
bpref           all 0.1478
recip_rank      all 0.5907
P_10            all 0.3300
P_100           all 0.1637
P_1000          all 0.0345

lamdarun04

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0508
infNDCG         all 0.2337
iP10            all 0.3867
iP100           all 0.2511
summary (trec_eval)
map             all 0.1229
bpref           all 0.1811
recip_rank      all 0.5281
P_10            all 0.3867
P_100           all 0.2290
P_1000          all 0.0710

utdhltrisprf

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0061
infNDCG         all 0.0546
iP10            all 0.0933
iP100           all 0.0618
summary (trec_eval)
map             all 0.0197
bpref           all 0.0538
recip_rank      all 0.1851
P_10            all 0.0933
P_100           all 0.0470
P_1000          all 0.0202

lamdarun05

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0657
infNDCG         all 0.2758
iP10            all 0.4267
iP100           all 0.3073
summary (trec_eval)
map             all 0.1572
bpref           all 0.2254
recip_rank      all 0.5897
P_10            all 0.4267
P_100           all 0.2643
P_1000          all 0.0814

FusionAutoB

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0841
infNDCG         all 0.3298
iP10            all 0.4633
iP100           all 0.3573
summary (trec_eval)
map             all 0.1941
bpref           all 0.2701
recip_rank      all 0.6134
P_10            all 0.4633
P_100           all 0.3097
P_1000          all 0.0880

FusionManB

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0955
infNDCG         all 0.3535
iP10            all 0.5233
iP100           all 0.3767
summary (trec_eval)
map             all 0.2175
bpref           all 0.2885
recip_rank      all 0.6779
P_10            all 0.5233
P_100           all 0.3303
P_1000          all 0.0926

lamdarun06

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0656
infNDCG         all 0.2708
iP10            all 0.4400
iP100           all 0.2896
summary (trec_eval)
map             all 0.1511
bpref           all 0.2149
recip_rank      all 0.5772
P_10            all 0.4400
P_100           all 0.2473
P_1000          all 0.0810

autob

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0135
infNDCG         all 0.1016
iP10            all 0.1800
iP100           all 0.1261
summary (trec_eval)
map             all 0.0312
bpref           all 0.0833
recip_rank      all 0.2772
P_10            all 0.1800
P_100           all 0.0950
P_1000          all 0.0331

hybridb

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0237
infNDCG         all 0.1972
iP10            all 0.2900
iP100           all 0.2293
summary (trec_eval)
map             all 0.0659
bpref           all 0.1857
recip_rank      all 0.4598
P_10            all 0.2900
P_100           all 0.1467
P_1000          all 0.0700

FusionAdv

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0951
infNDCG         all 0.3473
iP10            all 0.5300
iP100           all 0.3684
summary (trec_eval)
map             all 0.2178
bpref           all 0.2893
recip_rank      all 0.6605
P_10            all 0.5300
P_100           all 0.3260
P_1000          all 0.0920

FDUAuto

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0766
infNDCG         all 0.3222
iP10            all 0.4967
iP100           all 0.3221
summary (trec_eval)
map             all 0.1718
bpref           all 0.2518
recip_rank      all 0.6422
P_10            all 0.4967
P_100           all 0.2680
P_1000          all 0.0814

FDUManual1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0820
infNDCG         all 0.3288
iP10            all 0.5100
iP100           all 0.3429
summary (trec_eval)
map             all 0.1864
bpref           all 0.2861
recip_rank      all 0.6827
P_10            all 0.5100
P_100           all 0.2830
P_1000          all 0.0906

FDUManual2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.1008
infNDCG         all 0.3809
iP10            all 0.5600
iP100           all 0.3917
summary (trec_eval)
map             all 0.2130
bpref           all 0.3277
recip_rank      all 0.7933
P_10            all 0.5600
P_100           all 0.3083
P_1000          all 0.0990

wsuirsab

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0875
infNDCG         all 0.3246
iP10            all 0.5067
iP100           all 0.3500
summary (trec_eval)
map             all 0.2180
bpref           all 0.2764
recip_rank      all 0.6799
P_10            all 0.5067
P_100           all 0.3257
P_1000          all 0.0980

LIMSIrun4Syn

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0827
infNDCG         all 0.3303
iP10            all 0.5000
iP100           all 0.3398
summary (trec_eval)
map             all 0.1420
bpref           all 0.2281
recip_rank      all 0.6248
P_10            all 0.5000
P_100           all 0.2520
P_1000          all 0.0528

LIMSIrun5MPF

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0982
infNDCG         all 0.3507
iP10            all 0.4767
iP100           all 0.3612
summary (trec_eval)
map             all 0.1778
bpref           all 0.2801
recip_rank      all 0.6532
P_10            all 0.4767
P_100           all 0.2653
P_1000          all 0.0744

wsuirdmb

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.1014
infNDCG         all 0.3690
iP10            all 0.5200
iP100           all 0.3910
summary (trec_eval)
map             all 0.2331
bpref           all 0.3062
recip_rank      all 0.7386
P_10            all 0.5200
P_100           all 0.3427
P_1000          all 0.0954

cbnu3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0474
infNDCG         all 0.2260
iP10            all 0.4000
iP100           all 0.2494
summary (trec_eval)
map             all 0.1172
bpref           all 0.1761
recip_rank      all 0.5924
P_10            all 0.4000
P_100           all 0.2243
P_1000          all 0.0664

cbnu4

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0723
infNDCG         all 0.2917
iP10            all 0.4900
iP100           all 0.3110
summary (trec_eval)
map             all 0.1768
bpref           all 0.2504
recip_rank      all 0.6997
P_10            all 0.4900
P_100           all 0.2870
P_1000          all 0.0837

cbnu5

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0730
infNDCG         all 0.3033
iP10            all 0.4800
iP100           all 0.3272
summary (trec_eval)
map             all 0.1781
bpref           all 0.2537
recip_rank      all 0.7151
P_10            all 0.4800
P_100           all 0.2913
P_1000          all 0.0851

wsuirsmb

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0856
infNDCG         all 0.3208
iP10            all 0.5033
iP100           all 0.3435
summary (trec_eval)
map             all 0.2116
bpref           all 0.2667
recip_rank      all 0.7159
P_10            all 0.5033
P_100           all 0.3227
P_1000          all 0.0959

hltcoe5sdrf

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0872
infNDCG         all 0.3245
iP10            all 0.5000
iP100           all 0.3480
summary (trec_eval)
map             all 0.2038
bpref           all 0.2737
recip_rank      all 0.6961
P_10            all 0.5000
P_100           all 0.3127
P_1000          all 0.0896

hltcoe4sdrf

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0863
infNDCG         all 0.3105
iP10            all 0.4700
iP100           all 0.3347
summary (trec_eval)
map             all 0.1961
bpref           all 0.2670
recip_rank      all 0.6968
P_10            all 0.4700
P_100           all 0.2943
P_1000          all 0.0886

hltcoewsdrf

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0841
infNDCG         all 0.3275
iP10            all 0.4933
iP100           all 0.3470
summary (trec_eval)
map             all 0.2007
bpref           all 0.2616
recip_rank      all 0.6671
P_10            all 0.4933
P_100           all 0.3103
P_1000          all 0.0890

LIMSIrun6Wik

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0098
infNDCG         all 0.0783
iP10            all 0.1300
iP100           all 0.0862
summary (trec_eval)
map             all 0.0148
bpref           all 0.0504
recip_rank      all 0.2698
P_10            all 0.1300
P_100           all 0.0487
P_1000          all 0.0125