Skip to content

Results - Clinical Decision Support 2016

nkuRun5

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0276
infNDCG         all 0.1976
iP10            all 0.2767
iP100           all 0.2342
summary (trec_eval)
map             all 0.0655
bpref           all 0.1393
recip_rank      all 0.4429
P_10            all 0.2767
P_100           all 0.1530
P_1000          all 0.0522

nkuRun3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0286
infNDCG         all 0.1984
iP10            all 0.2700
iP100           all 0.2304
summary (trec_eval)
map             all 0.0787
bpref           all 0.1548
recip_rank      all 0.3687
P_10            all 0.2700
P_100           all 0.1787
P_1000          all 0.0580

UWM0

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0209
infNDCG         all 0.1808
iP10            all 0.2533
iP100           all 0.2122
summary (trec_eval)
map             all 0.0719
bpref           all 0.1353
recip_rank      all 0.4720
P_10            all 0.2533
P_100           all 0.1737
P_1000          all 0.0623

UWM1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0273
infNDCG         all 0.2048
iP10            all 0.2767
iP100           all 0.2344
summary (trec_eval)
map             all 0.0739
bpref           all 0.1528
recip_rank      all 0.4879
P_10            all 0.2767
P_100           all 0.1657
P_1000          all 0.0576

UWM2

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0214
infNDCG         all 0.1753
iP10            all 0.2567
iP100           all 0.2079
summary (trec_eval)
map             all 0.0681
bpref           all 0.1351
recip_rank      all 0.4070
P_10            all 0.2567
P_100           all 0.1617
P_1000          all 0.0588

nkuRun2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0198
infNDCG         all 0.1570
iP10            all 0.2233
iP100           all 0.1772
summary (trec_eval)
map             all 0.0614
bpref           all 0.1153
recip_rank      all 0.4332
P_10            all 0.2233
P_100           all 0.1510
P_1000          all 0.0554

nkuRun4

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0142
infNDCG         all 0.1516
iP10            all 0.2100
iP100           all 0.1655
summary (trec_eval)
map             all 0.0493
bpref           all 0.1039
recip_rank      all 0.4162
P_10            all 0.2100
P_100           all 0.1370
P_1000          all 0.0548

LucBase

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0055
infNDCG         all 0.0673
iP10            all 0.2500
iP100           all 0.0513
summary (trec_eval)
map             all 0.0121
bpref           all 0.0290
recip_rank      all 0.3803
P_10            all 0.2300
P_100           all 0.0493
P_1000          all 0.0049

LucNote

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0032
infNDCG         all 0.0378
iP10            all 0.1444
iP100           all 0.0318
summary (trec_eval)
map             all 0.0060
bpref           all 0.0177
recip_rank      all 0.2362
P_10            all 0.1267
P_100           all 0.0300
P_1000          all 0.0030

CCNUSUMR1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0316
infNDCG         all 0.2179
iP10            all 0.2933
iP100           all 0.2596
summary (trec_eval)
map             all 0.0768
bpref           all 0.1546
recip_rank      all 0.4320
P_10            all 0.2933
P_100           all 0.1747
P_1000          all 0.0553

CCNUDESR2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0104
infNDCG         all 0.1047
iP10            all 0.1533
iP100           all 0.1233
summary (trec_eval)
map             all 0.0315
bpref           all 0.0853
recip_rank      all 0.2816
P_10            all 0.1533
P_100           all 0.1043
P_1000          all 0.0413

CCNUNOTER1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0140
infNDCG         all 0.1184
iP10            all 0.1767
iP100           all 0.1418
summary (trec_eval)
map             all 0.0346
bpref           all 0.0848
recip_rank      all 0.2551
P_10            all 0.1767
P_100           all 0.1040
P_1000          all 0.0375

CCNUNOTER2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0084
infNDCG         all 0.0955
iP10            all 0.1167
iP100           all 0.1236
summary (trec_eval)
map             all 0.0277
bpref           all 0.0802
recip_rank      all 0.2065
P_10            all 0.1167
P_100           all 0.0890
P_1000          all 0.0389

CCNUNOTER3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0088
infNDCG         all 0.1091
iP10            all 0.1533
iP100           all 0.1446
summary (trec_eval)
map             all 0.0274
bpref           all 0.0770
recip_rank      all 0.2007
P_10            all 0.1533
P_100           all 0.1013
P_1000          all 0.0353

LucWghtFrame

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0043
infNDCG         all 0.0491
iP10            all 0.2770
iP100           all 0.0277
summary (trec_eval)
map             all 0.0102
bpref           all 0.0171
recip_rank      all 0.4556
P_10            all 0.2767
P_100           all 0.0277
P_1000          all 0.0028

d2vDescIrit

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0017
infNDCG         all 0.0442
iP10            all 0.0467
iP100           all 0.0704
summary (trec_eval)
map             all 0.0038
bpref           all 0.0370
recip_rank      all 0.1044
P_10            all 0.0433
P_100           all 0.0303
P_1000          all 0.0167

d2vCombIrit

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0018
infNDCG         all 0.0463
iP10            all 0.0533
iP100           all 0.0707
summary (trec_eval)
map             all 0.0042
bpref           all 0.0364
recip_rank      all 0.1247
P_10            all 0.0533
P_100           all 0.0303
P_1000          all 0.0167

AutoNote

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0134
infNDCG         all 0.1378
iP10            all 0.2067
iP100           all 0.1735
summary (trec_eval)
map             all 0.0447
bpref           all 0.1007
recip_rank      all 0.3231
P_10            all 0.2067
P_100           all 0.1407
P_1000          all 0.0494

LucNoteFrame

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0017
infNDCG         all 0.0266
iP10            all 0.1600
iP100           all 0.0160
summary (trec_eval)
map             all 0.0039
bpref           all 0.0092
recip_rank      all 0.3007
P_10            all 0.1600
P_100           all 0.0160
P_1000          all 0.0016

AutoSummary

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0258
infNDCG         all 0.2109
iP10            all 0.2967
iP100           all 0.2453
summary (trec_eval)
map             all 0.0828
bpref           all 0.1517
recip_rank      all 0.4493
P_10            all 0.2967
P_100           all 0.2017
P_1000          all 0.0678

AutoSummary1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0454
infNDCG         all 0.2815
iP10            all 0.4033
iP100           all 0.3188
summary (trec_eval)
map             all 0.0960
bpref           all 0.2046
recip_rank      all 0.4893
P_10            all 0.4033
P_100           all 0.1997
P_1000          all 0.0608

LucWeight

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0061
infNDCG         all 0.0683
iP10            all 0.2767
iP100           all 0.0570
summary (trec_eval)
map             all 0.0129
bpref           all 0.0282
recip_rank      all 0.3953
P_10            all 0.2467
P_100           all 0.0540
P_1000          all 0.0054

AutoDes

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0131
infNDCG         all 0.1512
iP10            all 0.2067
iP100           all 0.1854
summary (trec_eval)
map             all 0.0448
bpref           all 0.0995
recip_rank      all 0.3430
P_10            all 0.2067
P_100           all 0.1410
P_1000          all 0.0541

noteUIOWAS1

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0046
infNDCG         all 0.0829
iP10            all 0.1200
iP100           all 0.1160
summary (trec_eval)
map             all 0.0104
bpref           all 0.0478
recip_rank      all 0.2891
P_10            all 0.1200
P_100           all 0.0670
P_1000          all 0.0200

descUIOWAS2

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0059
infNDCG         all 0.0965
iP10            all 0.1433
iP100           all 0.1396
summary (trec_eval)
map             all 0.0153
bpref           all 0.0567
recip_rank      all 0.2632
P_10            all 0.1433
P_100           all 0.0833
P_1000          all 0.0271

summUIOWAS3

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0140
infNDCG         all 0.1472
iP10            all 0.1900
iP100           all 0.1888
summary (trec_eval)
map             all 0.0298
bpref           all 0.0903
recip_rank      all 0.3008
P_10            all 0.1900
P_100           all 0.1030
P_1000          all 0.0347

DUTHsaRPF

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0302
infNDCG         all 0.2265
iP10            all 0.2867
iP100           all 0.2653
summary (trec_eval)
map             all 0.0501
bpref           all 0.0959
recip_rank      all 0.6035
P_10            all 0.2867
P_100           all 0.1890
P_1000          all 0.0189

DUTHmaRPF

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0281
infNDCG         all 0.2007
iP10            all 0.2867
iP100           all 0.2368
summary (trec_eval)
map             all 0.0459
bpref           all 0.0884
recip_rank      all 0.5060
P_10            all 0.2867
P_100           all 0.1630
P_1000          all 0.0163

DUTHaaRPF

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0192
infNDCG         all 0.1652
iP10            all 0.2467
iP100           all 0.1976
summary (trec_eval)
map             all 0.0308
bpref           all 0.0652
recip_rank      all 0.4023
P_10            all 0.2467
P_100           all 0.1373
P_1000          all 0.0137

nkuRun1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0289
infNDCG         all 0.1959
iP10            all 0.2900
iP100           all 0.2236
summary (trec_eval)
map             all 0.0597
bpref           all 0.1383
recip_rank      all 0.4534
P_10            all 0.2900
P_100           all 0.1317
P_1000          all 0.0566

ETHNote

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0239
infNDCG         all 0.1876
iP10            all 0.2567
iP100           all 0.2177
summary (trec_eval)
map             all 0.0638
bpref           all 0.1314
recip_rank      all 0.4371
P_10            all 0.2567
P_100           all 0.1613
P_1000          all 0.0511

ETHSumm

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0261
infNDCG         all 0.2135
iP10            all 0.3033
iP100           all 0.2401
summary (trec_eval)
map             all 0.0782
bpref           all 0.1545
recip_rank      all 0.5338
P_10            all 0.3033
P_100           all 0.1823
P_1000          all 0.0652

SumClsRerank

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0143
infNDCG         all 0.1356
iP10            all 0.2300
iP100           all 0.1697
summary (trec_eval)
map             all 0.0348
bpref           all 0.1070
recip_rank      all 0.3939
P_10            all 0.2200
P_100           all 0.1027
P_1000          all 0.0386

SumCmbRank

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0239
infNDCG         all 0.2007
iP10            all 0.2833
iP100           all 0.2358
summary (trec_eval)
map             all 0.0513
bpref           all 0.1340
recip_rank      all 0.4799
P_10            all 0.2833
P_100           all 0.1390
P_1000          all 0.0457

SumES

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0321
infNDCG         all 0.2222
iP10            all 0.3378
iP100           all 0.2432
summary (trec_eval)
map             all 0.0604
bpref           all 0.1450
recip_rank      all 0.6321
P_10            all 0.3367
P_100           all 0.1550
P_1000          all 0.0446

ManualRun

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0535
infNDCG         all 0.2882
iP10            all 0.4600
iP100           all 0.3055
summary (trec_eval)
map             all 0.0545
bpref           all 0.0981
recip_rank      all 0.6120
P_10            all 0.4600
P_100           all 0.1380
P_1000          all 0.0165

NoteES

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0185
infNDCG         all 0.1590
iP10            all 0.2533
iP100           all 0.1946
summary (trec_eval)
map             all 0.0430
bpref           all 0.1071
recip_rank      all 0.4223
P_10            all 0.2533
P_100           all 0.1257
P_1000          all 0.0351

ETHDescRR

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0165
infNDCG         all 0.1576
iP10            all 0.2267
iP100           all 0.1839
summary (trec_eval)
map             all 0.0444
bpref           all 0.1115
recip_rank      all 0.5070
P_10            all 0.2267
P_100           all 0.1277
P_1000          all 0.0432

ETHNoteRR

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0254
infNDCG         all 0.1943
iP10            all 0.2567
iP100           all 0.2219
summary (trec_eval)
map             all 0.0648
bpref           all 0.1295
recip_rank      all 0.4754
P_10            all 0.2567
P_100           all 0.1653
P_1000          all 0.0511

ETHSummRR

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0272
infNDCG         all 0.2179
iP10            all 0.3067
iP100           all 0.2419
summary (trec_eval)
map             all 0.0784
bpref           all 0.1551
recip_rank      all 0.5240
P_10            all 0.3067
P_100           all 0.1837
P_1000          all 0.0652

mayoas

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0252
infNDCG         all 0.2146
iP10            all 0.3067
iP100           all 0.2526
summary (trec_eval)
map             all 0.0866
bpref           all 0.1587
recip_rank      all 0.4683
P_10            all 0.3067
P_100           all 0.2043
P_1000          all 0.0721

mayoad

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0121
infNDCG         all 0.1315
iP10            all 0.2167
iP100           all 0.1585
summary (trec_eval)
map             all 0.0441
bpref           all 0.1003
recip_rank      all 0.3493
P_10            all 0.2167
P_100           all 0.1283
P_1000          all 0.0556

mayoan

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0113
infNDCG         all 0.1309
iP10            all 0.2200
iP100           all 0.1682
summary (trec_eval)
map             all 0.0434
bpref           all 0.0995
recip_rank      all 0.3417
P_10            all 0.2200
P_100           all 0.1363
P_1000          all 0.0518

MrkUmlsXgb

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0315
infNDCG         all 0.2493
iP10            all 0.3500
iP100           all 0.2832
summary (trec_eval)
map             all 0.0892
bpref           all 0.1735
recip_rank      all 0.4923
P_10            all 0.3500
P_100           all 0.2217
P_1000          all 0.0694

MRKUmlsSolr

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0285
infNDCG         all 0.2261
iP10            all 0.3067
iP100           all 0.2628
summary (trec_eval)
map             all 0.0884
bpref           all 0.1654
recip_rank      all 0.4511
P_10            all 0.3067
P_100           all 0.2110
P_1000          all 0.0719

ECNUmanual

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0243
infNDCG         all 0.1810
iP10            all 0.2433
iP100           all 0.2050
summary (trec_eval)
map             all 0.0741
bpref           all 0.1318
recip_rank      all 0.4281
P_10            all 0.2433
P_100           all 0.1607
P_1000          all 0.0620

ECNUrun3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0276
infNDCG         all 0.2168
iP10            all 0.2733
iP100           all 0.2503
summary (trec_eval)
map             all 0.0797
bpref           all 0.1529
recip_rank      all 0.4479
P_10            all 0.2733
P_100           all 0.1833
P_1000          all 0.0619

ECNUrun1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0296
infNDCG         all 0.2225
iP10            all 0.2867
iP100           all 0.2596
summary (trec_eval)
map             all 0.0845
bpref           all 0.1615
recip_rank      all 0.4584
P_10            all 0.2867
P_100           all 0.1917
P_1000          all 0.0649

ECNUrun5

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0313
infNDCG         all 0.2334
iP10            all 0.3367
iP100           all 0.2651
summary (trec_eval)
map             all 0.0900
bpref           all 0.1638
recip_rank      all 0.4625
P_10            all 0.3367
P_100           all 0.1910
P_1000          all 0.0668

ECNUrun4

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0242
infNDCG         all 0.1814
iP10            all 0.2433
iP100           all 0.2293
summary (trec_eval)
map             all 0.0586
bpref           all 0.1281
recip_rank      all 0.4368
P_10            all 0.2433
P_100           all 0.1427
P_1000          all 0.0505

NLMrun1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0239
infNDCG         all 0.1872
iP10            all 0.2500
iP100           all 0.2362
summary (trec_eval)
map             all 0.0728
bpref           all 0.1472
recip_rank      all 0.4158
P_10            all 0.2500
P_100           all 0.1803
P_1000          all 0.0574

UDelInfoCDS1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0083
infNDCG         all 0.1068
iP10            all 0.1833
iP100           all 0.1450
summary (trec_eval)
map             all 0.0250
bpref           all 0.0739
recip_rank      all 0.2719
P_10            all 0.1833
P_100           all 0.1007
P_1000          all 0.0356

SDPHBo1NE

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0287
infNDCG         all 0.2071
iP10            all 0.2867
iP100           all 0.2357
summary (trec_eval)
map             all 0.0848
bpref           all 0.1475
recip_rank      all 0.4666
P_10            all 0.2867
P_100           all 0.1937
P_1000          all 0.0627

UDelInfoCDS4

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0084
infNDCG         all 0.1153
iP10            all 0.1700
iP100           all 0.1502
summary (trec_eval)
map             all 0.0250
bpref           all 0.0779
recip_rank      all 0.3073
P_10            all 0.1700
P_100           all 0.1030
P_1000          all 0.0376

UDelInfoCDS5

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0311
infNDCG         all 0.2362
iP10            all 0.3367
iP100           all 0.2846
summary (trec_eval)
map             all 0.0861
bpref           all 0.1654
recip_rank      all 0.5042
P_10            all 0.3367
P_100           all 0.1953
P_1000          all 0.0640

UDelInfoCDS2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0084
infNDCG         all 0.1095
iP10            all 0.1667
iP100           all 0.1571
summary (trec_eval)
map             all 0.0244
bpref           all 0.0725
recip_rank      all 0.2365
P_10            all 0.1667
P_100           all 0.1043
P_1000          all 0.0356

udelSB

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0283
infNDCG         all 0.2097
iP10            all 0.2767
iP100           all 0.2399
summary (trec_eval)
map             all 0.0762
bpref           all 0.1517
recip_rank      all 0.4738
P_10            all 0.2767
P_100           all 0.1713
P_1000          all 0.0582

udelSDI

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0263
infNDCG         all 0.1975
iP10            all 0.2867
iP100           all 0.2330
summary (trec_eval)
map             all 0.0717
bpref           all 0.1469
recip_rank      all 0.4989
P_10            all 0.2867
P_100           all 0.1620
P_1000          all 0.0545

NLMrun2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0230
infNDCG         all 0.1853
iP10            all 0.2467
iP100           all 0.2195
summary (trec_eval)
map             all 0.0775
bpref           all 0.1477
recip_rank      all 0.4248
P_10            all 0.2467
P_100           all 0.1813
P_1000          all 0.0634

udelSRef

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0302
infNDCG         all 0.2123
iP10            all 0.3033
iP100           all 0.2531
summary (trec_eval)
map             all 0.0783
bpref           all 0.1633
recip_rank      all 0.4931
P_10            all 0.3033
P_100           all 0.1777
P_1000          all 0.0590

udelNB

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0181
infNDCG         all 0.1513
iP10            all 0.2100
iP100           all 0.1892
summary (trec_eval)
map             all 0.0521
bpref           all 0.1115
recip_rank      all 0.3515
P_10            all 0.2100
P_100           all 0.1320
P_1000          all 0.0492

UDelInfoCDS3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0083
infNDCG         all 0.1042
iP10            all 0.1700
iP100           all 0.1447
summary (trec_eval)
map             all 0.0244
bpref           all 0.0726
recip_rank      all 0.2608
P_10            all 0.1700
P_100           all 0.1017
P_1000          all 0.0354

NLMrun3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0228
infNDCG         all 0.1871
iP10            all 0.2400
iP100           all 0.2186
summary (trec_eval)
map             all 0.0714
bpref           all 0.1467
recip_rank      all 0.3654
P_10            all 0.2400
P_100           all 0.1673
P_1000          all 0.0615

udelNRef

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0203
infNDCG         all 0.1601
iP10            all 0.2133
iP100           all 0.1959
summary (trec_eval)
map             all 0.0557
bpref           all 0.1172
recip_rank      all 0.3395
P_10            all 0.2133
P_100           all 0.1353
P_1000          all 0.0501

UNTIIANA

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0153
infNDCG         all 0.1554
iP10            all 0.2267
iP100           all 0.1987
summary (trec_eval)
map             all 0.0410
bpref           all 0.1058
recip_rank      all 0.3775
P_10            all 0.2267
P_100           all 0.1263
P_1000          all 0.0464

UNTIIANM

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0144
infNDCG         all 0.1405
iP10            all 0.1933
iP100           all 0.1783
summary (trec_eval)
map             all 0.0388
bpref           all 0.0994
recip_rank      all 0.2428
P_10            all 0.1933
P_100           all 0.1270
P_1000          all 0.0456

UNTIIASA

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0153
infNDCG         all 0.1554
iP10            all 0.2267
iP100           all 0.1987
summary (trec_eval)
map             all 0.0410
bpref           all 0.1058
recip_rank      all 0.3775
P_10            all 0.2267
P_100           all 0.1263
P_1000          all 0.0464

UNTIIANMERG

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0132
infNDCG         all 0.1481
iP10            all 0.2133
iP100           all 0.1931
summary (trec_eval)
map             all 0.0373
bpref           all 0.1033
recip_rank      all 0.3151
P_10            all 0.2133
P_100           all 0.1160
P_1000          all 0.0455

UNTIIASMERG

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0113
infNDCG         all 0.1414
iP10            all 0.1933
iP100           all 0.1746
summary (trec_eval)
map             all 0.0360
bpref           all 0.1006
recip_rank      all 0.3215
P_10            all 0.1933
P_100           all 0.1180
P_1000          all 0.0475

NLMrun4

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0146
infNDCG         all 0.1477
iP10            all 0.2400
iP100           all 0.1786
summary (trec_eval)
map             all 0.0417
bpref           all 0.1025
recip_rank      all 0.3581
P_10            all 0.2400
P_100           all 0.1240
P_1000          all 0.0409

NLMrun5

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0202
infNDCG         all 0.1687
iP10            all 0.2533
iP100           all 0.2087
summary (trec_eval)
map             all 0.0448
bpref           all 0.1104
recip_rank      all 0.3745
P_10            all 0.2533
P_100           all 0.1273
P_1000          all 0.0398

lssbn

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0075
infNDCG         all 0.0976
iP10            all 0.1867
iP100           all 0.1317
summary (trec_eval)
map             all 0.0146
bpref           all 0.0549
recip_rank      all 0.2635
P_10            all 0.1867
P_100           all 0.0663
P_1000          all 0.0191

lssbd

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0068
infNDCG         all 0.0923
iP10            all 0.1667
iP100           all 0.1233
summary (trec_eval)
map             all 0.0146
bpref           all 0.0609
recip_rank      all 0.3061
P_10            all 0.1667
P_100           all 0.0700
P_1000          all 0.0215

lssbs

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0141
infNDCG         all 0.1301
iP10            all 0.2233
iP100           all 0.1658
summary (trec_eval)
map             all 0.0244
bpref           all 0.0801
recip_rank      all 0.4141
P_10            all 0.2233
P_100           all 0.0887
P_1000          all 0.0245

RONE

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0011
infNDCG         all 0.0303
iP10            all 0.0533
iP100           all 0.0482
summary (trec_eval)
map             all 0.0012
bpref           all 0.0063
recip_rank      all 0.1076
P_10            all 0.0533
P_100           all 0.0147
P_1000          all 0.0022

prna2desc

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0026
infNDCG         all 0.0527
iP10            all 0.0867
iP100           all 0.0657
summary (trec_eval)
map             all 0.0035
bpref           all 0.0227
recip_rank      all 0.1811
P_10            all 0.0867
P_100           all 0.0253
P_1000          all 0.0073

prna3note

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0075
infNDCG         all 0.0935
iP10            all 0.1467
iP100           all 0.1236
summary (trec_eval)
map             all 0.0095
bpref           all 0.0415
recip_rank      all 0.1805
P_10            all 0.1467
P_100           all 0.0507
P_1000          all 0.0146

prna4note

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0067
infNDCG         all 0.0373
iP10            all 0.0633
iP100           all 0.0414
summary (trec_eval)
map             all 0.0083
bpref           all 0.0277
recip_rank      all 0.1373
P_10            all 0.0633
P_100           all 0.0203
P_1000          all 0.0078

prna5note

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0031
infNDCG         all 0.0632
iP10            all 0.1100
iP100           all 0.0864
summary (trec_eval)
map             all 0.0066
bpref           all 0.0453
recip_rank      all 0.2019
P_10            all 0.1067
P_100           all 0.0480
P_1000          all 0.0153

prna1sum

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0102
infNDCG         all 0.0958
iP10            all 0.1333
iP100           all 0.1184
summary (trec_eval)
map             all 0.0132
bpref           all 0.0558
recip_rank      all 0.2168
P_10            all 0.1300
P_100           all 0.0523
P_1000          all 0.0170

run1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0196
infNDCG         all 0.2018
iP10            all 0.2867
iP100           all 0.2375
summary (trec_eval)
map             all 0.0474
bpref           all 0.1309
recip_rank      all 0.4715
P_10            all 0.2867
P_100           all 0.1380
P_1000          all 0.0478

run2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0139
infNDCG         all 0.1510
iP10            all 0.2467
iP100           all 0.1909
summary (trec_eval)
map             all 0.0351
bpref           all 0.1012
recip_rank      all 0.4099
P_10            all 0.2467
P_100           all 0.1217
P_1000          all 0.0381

run3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0162
infNDCG         all 0.1588
iP10            all 0.2567
iP100           all 0.2023
summary (trec_eval)
map             all 0.0362
bpref           all 0.1008
recip_rank      all 0.3954
P_10            all 0.2567
P_100           all 0.1240
P_1000          all 0.0352

run4

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0185
infNDCG         all 0.1671
iP10            all 0.2433
iP100           all 0.2109
summary (trec_eval)
map             all 0.0430
bpref           all 0.1157
recip_rank      all 0.4138
P_10            all 0.2433
P_100           all 0.1323
P_1000          all 0.0398

run5

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0205
infNDCG         all 0.1817
iP10            all 0.2700
iP100           all 0.2301
summary (trec_eval)
map             all 0.0429
bpref           all 0.1151
recip_rank      all 0.4179
P_10            all 0.2700
P_100           all 0.1310
P_1000          all 0.0351

mayomd

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0109
infNDCG         all 0.1199
iP10            all 0.1600
iP100           all 0.1439
summary (trec_eval)
map             all 0.0342
bpref           all 0.0884
recip_rank      all 0.3575
P_10            all 0.1600
P_100           all 0.1127
P_1000          all 0.0485

WHUIRGroup1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0104
infNDCG         all 0.1190
iP10            all 0.1700
iP100           all 0.1554
summary (trec_eval)
map             all 0.0356
bpref           all 0.0903
recip_rank      all 0.2557
P_10            all 0.1700
P_100           all 0.1200
P_1000          all 0.0443

lsbn

Metadata | Participants| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0074
infNDCG         all 0.0966
iP10            all 0.1533
iP100           all 0.1250
summary (trec_eval)
map             all 0.0218
bpref           all 0.0678
recip_rank      all 0.2430
P_10            all 0.1533
P_100           all 0.0780
P_1000          all 0.0291

DDPHBo1MWRe

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0154
infNDCG         all 0.1608
iP10            all 0.1900
iP100           all 0.1957
summary (trec_eval)
map             all 0.0452
bpref           all 0.1091
recip_rank      all 0.3093
P_10            all 0.1900
P_100           all 0.1540
P_1000          all 0.0484

DDPHBo1CM

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0172
infNDCG         all 0.1701
iP10            all 0.2367
iP100           all 0.1972
summary (trec_eval)
map             all 0.0570
bpref           all 0.1220
recip_rank      all 0.3801
P_10            all 0.2367
P_100           all 0.1513
P_1000          all 0.0608

NDPHBo1C

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0221
infNDCG         all 0.1727
iP10            all 0.2433
iP100           all 0.1950
summary (trec_eval)
map             all 0.0660
bpref           all 0.1168
recip_rank      all 0.4529
P_10            all 0.2433
P_100           all 0.1587
P_1000          all 0.0545

NDPHBo1CM

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0207
infNDCG         all 0.1785
iP10            all 0.2500
iP100           all 0.2119
summary (trec_eval)
map             all 0.0711
bpref           all 0.1276
recip_rank      all 0.4215
P_10            all 0.2500
P_100           all 0.1747
P_1000          all 0.0633

WHUIRGroup2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0068
infNDCG         all 0.0981
iP10            all 0.1467
iP100           all 0.1357
summary (trec_eval)
map             all 0.0162
bpref           all 0.0686
recip_rank      all 0.2984
P_10            all 0.1467
P_100           all 0.0760
P_1000          all 0.0274

MRKPrfNote

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0179
infNDCG         all 0.1504
iP10            all 0.2167
iP100           all 0.1758
summary (trec_eval)
map             all 0.0527
bpref           all 0.1054
recip_rank      all 0.5065
P_10            all 0.2167
P_100           all 0.1410
P_1000          all 0.0517

MRKSumCln

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0272
infNDCG         all 0.2223
iP10            all 0.3367
iP100           all 0.2693
summary (trec_eval)
map             all 0.0782
bpref           all 0.1655
recip_rank      all 0.4569
P_10            all 0.3367
P_100           all 0.1993
P_1000          all 0.0627

mayomn

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0130
infNDCG         all 0.1407
iP10            all 0.2167
iP100           all 0.1811
summary (trec_eval)
map             all 0.0476
bpref           all 0.1055
recip_rank      all 0.3951
P_10            all 0.2167
P_100           all 0.1433
P_1000          all 0.0549

nacmmf

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0053
infNDCG         all 0.0654
iP10            all 0.1300
iP100           all 0.0837
summary (trec_eval)
map             all 0.0072
bpref           all 0.0331
recip_rank      all 0.2557
P_10            all 0.1300
P_100           all 0.0460
P_1000          all 0.0104

dacmmf

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0080
infNDCG         all 0.0747
iP10            all 0.1467
iP100           all 0.0827
summary (trec_eval)
map             all 0.0117
bpref           all 0.0394
recip_rank      all 0.2963
P_10            all 0.1467
P_100           all 0.0507
P_1000          all 0.0134

sacmmf

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0257
infNDCG         all 0.1748
iP10            all 0.2667
iP100           all 0.2249
summary (trec_eval)
map             all 0.0334
bpref           all 0.0968
recip_rank      all 0.4836
P_10            all 0.2667
P_100           all 0.1070
P_1000          all 0.0254

WHUIRGroup4

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0052
infNDCG         all 0.0778
iP10            all 0.1644
iP100           all 0.0986
summary (trec_eval)
map             all 0.0110
bpref           all 0.0431
recip_rank      all 0.2727
P_10            all 0.1633
P_100           all 0.0770
P_1000          all 0.0131

WHUIRGroup6

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0179
infNDCG         all 0.1654
iP10            all 0.2233
iP100           all 0.2109
summary (trec_eval)
map             all 0.0407
bpref           all 0.1048
recip_rank      all 0.4001
P_10            all 0.2233
P_100           all 0.1533
P_1000          all 0.0364

WHUIRGroup5

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0050
infNDCG         all 0.0748
iP10            all 0.1422
iP100           all 0.1057
summary (trec_eval)
map             all 0.0077
bpref           all 0.0347
recip_rank      all 0.2285
P_10            all 0.1400
P_100           all 0.0553
P_1000          all 0.0103

CSIROmnul

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0168
infNDCG         all 0.1570
iP10            all 0.2700
iP100           all 0.2080
summary (trec_eval)
map             all 0.0281
bpref           all 0.0964
recip_rank      all 0.3796
P_10            all 0.2700
P_100           all 0.1203
P_1000          all 0.0274

CSIROnote

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0093
infNDCG         all 0.1052
iP10            all 0.1600
iP100           all 0.1440
summary (trec_eval)
map             all 0.0172
bpref           all 0.0613
recip_rank      all 0.3255
P_10            all 0.1600
P_100           all 0.0887
P_1000          all 0.0226

DAsummTM

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0253
infNDCG         all 0.1988
iP10            all 0.2667
iP100           all 0.2332
summary (trec_eval)
map             all 0.0760
bpref           all 0.1492
recip_rank      all 0.4392
P_10            all 0.2667
P_100           all 0.1820
P_1000          all 0.0587

DAdescTM

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0255
infNDCG         all 0.1692
iP10            all 0.2900
iP100           all 0.2019
summary (trec_eval)
map             all 0.0606
bpref           all 0.1298
recip_rank      all 0.4154
P_10            all 0.2900
P_100           all 0.1417
P_1000          all 0.0487

DAnoteTM

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0227
infNDCG         all 0.1734
iP10            all 0.2100
iP100           all 0.2073
summary (trec_eval)
map             all 0.0631
bpref           all 0.1276
recip_rank      all 0.3690
P_10            all 0.2100
P_100           all 0.1547
P_1000          all 0.0518

CSIROdSum

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0077
infNDCG         all 0.1142
iP10            all 0.1600
iP100           all 0.1518
summary (trec_eval)
map             all 0.0167
bpref           all 0.0690
recip_rank      all 0.2874
P_10            all 0.1600
P_100           all 0.0937
P_1000          all 0.0266

DAnoteRoc

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0214
infNDCG         all 0.1676
iP10            all 0.2267
iP100           all 0.2041
summary (trec_eval)
map             all 0.0576
bpref           all 0.1192
recip_rank      all 0.3886
P_10            all 0.2267
P_100           all 0.1497
P_1000          all 0.0526

DAnote

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0186
infNDCG         all 0.1536
iP10            all 0.1967
iP100           all 0.1844
summary (trec_eval)
map             all 0.0593
bpref           all 0.1185
recip_rank      all 0.4190
P_10            all 0.1967
P_100           all 0.1487
P_1000          all 0.0530

CSIROsumm

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0119
infNDCG         all 0.1358
iP10            all 0.2167
iP100           all 0.1675
summary (trec_eval)
map             all 0.0227
bpref           all 0.0832
recip_rank      all 0.3771
P_10            all 0.2167
P_100           all 0.1093
P_1000          all 0.0262

CSIROmeta

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0078
infNDCG         all 0.0958
iP10            all 0.2167
iP100           all 0.1205
summary (trec_eval)
map             all 0.0143
bpref           all 0.0549
recip_rank      all 0.4020
P_10            all 0.2167
P_100           all 0.0657
P_1000          all 0.0162

cbnus1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0316
infNDCG         all 0.2382
iP10            all 0.3400
iP100           all 0.2789
summary (trec_eval)
map             all 0.0552
bpref           all 0.1366
recip_rank      all 0.4726
P_10            all 0.3400
P_100           all 0.1560
P_1000          all 0.0406

cbnus2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0295
infNDCG         all 0.2365
iP10            all 0.3367
iP100           all 0.2709
summary (trec_eval)
map             all 0.0603
bpref           all 0.1435
recip_rank      all 0.4531
P_10            all 0.3367
P_100           all 0.1680
P_1000          all 0.0474

cbnun1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (sample-eval)| Appendix

summary (sample-eval)
infAP           all 0.0217
infNDCG         all 0.1723
iP10            all 0.2467
iP100           all 0.2062
summary (trec_eval)
map             all 0.0427
bpref           all 0.1131
recip_rank      all 0.3765
P_10            all 0.2467
P_100           all 0.1290
P_1000          all 0.0405