Skip to content

Results - Microblog 2011

manualWISTUD

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2719
bpref           all 0.3149
recip_rank      all 0.8328
P_10            all 0.5286
P_100           all 0.1357
P_1000          all 0.0139
summary (highrel)
map             all 0.2705
bpref           all 0.2777
recip_rank      all 0.5856
P_10            all 0.2333
P_100           all 0.0412
P_1000          all 0.0042

COMMITbase

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2026
bpref           all 0.2575
recip_rank      all 0.6679
P_10            all 0.2959
P_100           all 0.2061
P_1000          all 0.0246
summary (highrel)
map             all 0.1930
bpref           all 0.1787
recip_rank      all 0.4769
P_10            all 0.1242
P_100           all 0.0785
P_1000          all 0.0084

1

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1781
bpref           all 0.2229
recip_rank      all 0.6705
P_10            all 0.2939
P_100           all 0.1918
P_1000          all 0.0198
summary (highrel)
map             all 0.1529
bpref           all 0.1470
recip_rank      all 0.4403
P_10            all 0.1091
P_100           all 0.0515
P_1000          all 0.0052

baseline

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0727
bpref           all 0.0790
recip_rank      all 0.2330
P_10            all 0.0959
P_100           all 0.0773
P_1000          all 0.0432
summary (highrel)
map             all 0.0353
bpref           all 0.0179
recip_rank      all 0.0919
P_10            all 0.0212
P_100           all 0.0215
P_1000          all 0.0123

PL2NoQeSd

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1561
bpref           all 0.1819
recip_rank      all 0.6885
P_10            all 0.3224
P_100           all 0.0937
P_1000          all 0.0094
summary (highrel)
map             all 0.1608
bpref           all 0.1595
recip_rank      all 0.4399
P_10            all 0.1091
P_100           all 0.0270
P_1000          all 0.0027

PL2NoQeSdExt

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0149
bpref           all 0.0221
recip_rank      all 0.1058
P_10            all 0.0612
P_100           all 0.0190
P_1000          all 0.0019
summary (highrel)
map             all 0.0066
bpref           all 0.0038
recip_rank      all 0.0202
P_10            all 0.0121
P_100           all 0.0039
P_1000          all 0.0004

PL2NoQENoDM

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1584
bpref           all 0.1848
recip_rank      all 0.6819
P_10            all 0.3082
P_100           all 0.0916
P_1000          all 0.0093
summary (highrel)
map             all 0.1662
bpref           all 0.1607
recip_rank      all 0.4362
P_10            all 0.1091
P_100           all 0.0270
P_1000          all 0.0027

PL2Bo1SDExt

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0156
bpref           all 0.0235
recip_rank      all 0.0941
P_10            all 0.0633
P_100           all 0.0198
P_1000          all 0.0020
summary (highrel)
map             all 0.0071
bpref           all 0.0043
recip_rank      all 0.0195
P_10            all 0.0091
P_100           all 0.0045
P_1000          all 0.0005

basicWISTUD

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1110
bpref           all 0.1452
recip_rank      all 0.4908
P_10            all 0.1367
P_100           all 0.0624
P_1000          all 0.0252
summary (highrel)
map             all 0.1207
bpref           all 0.1179
recip_rank      all 0.3375
P_10            all 0.0485
P_100           all 0.0191
P_1000          all 0.0080

COMMITexp

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1673
bpref           all 0.1883
recip_rank      all 0.7265
P_10            all 0.4673
P_100           all 0.0922
P_1000          all 0.0092
summary (highrel)
map             all 0.1527
bpref           all 0.1561
recip_rank      all 0.4041
P_10            all 0.1848
P_100           all 0.0279
P_1000          all 0.0028

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1703
bpref           all 0.1910
recip_rank      all 0.7265
P_10            all 0.4755
P_100           all 0.0939
P_1000          all 0.0094
summary (highrel)
map             all 0.1582
bpref           all 0.1614
recip_rank      all 0.4103
P_10            all 0.1909
P_100           all 0.0288
P_1000          all 0.0029

COMMITfilter

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1643
bpref           all 0.1844
recip_rank      all 0.7299
P_10            all 0.4612
P_100           all 0.0896
P_1000          all 0.0090
summary (highrel)
map             all 0.1454
bpref           all 0.1478
recip_rank      all 0.4041
P_10            all 0.1758
P_100           all 0.0264
P_1000          all 0.0026

run1

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1726
bpref           all 0.2090
recip_rank      all 0.6480
P_10            all 0.4265
P_100           all 0.1192
P_1000          all 0.0124
summary (highrel)
map             all 0.1043
bpref           all 0.1021
recip_rank      all 0.2354
P_10            all 0.1394
P_100           all 0.0364
P_1000          all 0.0038

SienaCLbase

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1498
bpref           all 0.1763
recip_rank      all 0.6779
P_10            all 0.3408
P_100           all 0.0882
P_1000          all 0.0088
summary (highrel)
map             all 0.1329
bpref           all 0.1309
recip_rank      all 0.4281
P_10            all 0.1242
P_100           all 0.0230
P_1000          all 0.0023

omarRun

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0874
bpref           all 0.1140
recip_rank      all 0.4846
P_10            all 0.3265
P_100           all 0.0880
P_1000          all 0.0088
summary (highrel)
map             all 0.0476
bpref           all 0.0529
recip_rank      all 0.2068
P_10            all 0.0970
P_100           all 0.0215
P_1000          all 0.0022

iritfd1

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2115
bpref           all 0.2553
recip_rank      all 0.6683
P_10            all 0.3286
P_100           all 0.1755
P_1000          all 0.0240
summary (highrel)
map             all 0.1934
bpref           all 0.1807
recip_rank      all 0.4501
P_10            all 0.1394
P_100           all 0.0600
P_1000          all 0.0075

iritfd2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1920
bpref           all 0.2305
recip_rank      all 0.6317
P_10            all 0.3306
P_100           all 0.1614
P_1000          all 0.0208
summary (highrel)
map             all 0.1621
bpref           all 0.1539
recip_rank      all 0.4482
P_10            all 0.1455
P_100           all 0.0558
P_1000          all 0.0072

SienaCL342

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1698
bpref           all 0.1867
recip_rank      all 0.6590
P_10            all 0.3306
P_100           all 0.0896
P_1000          all 0.0090
summary (highrel)
map             all 0.2118
bpref           all 0.2029
recip_rank      all 0.5369
P_10            all 0.1697
P_100           all 0.0370
P_1000          all 0.0037

SienaCL31

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1689
bpref           all 0.1885
recip_rank      all 0.6337
P_10            all 0.3449
P_100           all 0.0902
P_1000          all 0.0090
summary (highrel)
map             all 0.2009
bpref           all 0.1942
recip_rank      all 0.5023
P_10            all 0.1697
P_100           all 0.0367
P_1000          all 0.0037

SienaCL1B

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1635
bpref           all 0.1860
recip_rank      all 0.6323
P_10            all 0.3571
P_100           all 0.0924
P_1000          all 0.0092
summary (highrel)
map             all 0.1693
bpref           all 0.1664
recip_rank      all 0.4704
P_10            all 0.1636
P_100           all 0.0364
P_1000          all 0.0036

UDMicroIDF

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1842
bpref           all 0.2127
recip_rank      all 0.7425
P_10            all 0.3796
P_100           all 0.0908
P_1000          all 0.0091
summary (highrel)
map             all 0.2279
bpref           all 0.2252
recip_rank      all 0.5032
P_10            all 0.1697
P_100           all 0.0324
P_1000          all 0.0032

UDMicroIDFD

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1521
bpref           all 0.1812
recip_rank      all 0.6501
P_10            all 0.3367
P_100           all 0.0806
P_1000          all 0.0081
summary (highrel)
map             all 0.1697
bpref           all 0.1755
recip_rank      all 0.4108
P_10            all 0.1303
P_100           all 0.0258
P_1000          all 0.0026

UDMicroComb1

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1571
bpref           all 0.1846
recip_rank      all 0.5334
P_10            all 0.3102
P_100           all 0.0776
P_1000          all 0.0078
summary (highrel)
map             all 0.1699
bpref           all 0.1748
recip_rank      all 0.3203
P_10            all 0.1061
P_100           all 0.0248
P_1000          all 0.0025

UDMicroComb2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1687
bpref           all 0.1968
recip_rank      all 0.7223
P_10            all 0.3694
P_100           all 0.0886
P_1000          all 0.0089
summary (highrel)
map             all 0.1868
bpref           all 0.1954
recip_rank      all 0.4210
P_10            all 0.1485
P_100           all 0.0288
P_1000          all 0.0029

Basic

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0943
bpref           all 0.1203
recip_rank      all 0.4962
P_10            all 0.1980
P_100           all 0.0788
P_1000          all 0.0242
summary (highrel)
map             all 0.0871
bpref           all 0.0877
recip_rank      all 0.3753
P_10            all 0.0848
P_100           all 0.0230
P_1000          all 0.0063

RFD

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0806
bpref           all 0.1089
recip_rank      all 0.4196
P_10            all 0.1245
P_100           all 0.0773
P_1000          all 0.0287
summary (highrel)
map             all 0.0761
bpref           all 0.0715
recip_rank      all 0.3221
P_10            all 0.0455
P_100           all 0.0267
P_1000          all 0.0077

LJQO5

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1633
bpref           all 0.1937
recip_rank      all 0.5962
P_10            all 0.3143
P_100           all 0.1255
P_1000          all 0.0126
summary (highrel)
map             all 0.1494
bpref           all 0.1468
recip_rank      all 0.3755
P_10            all 0.1182
P_100           all 0.0382
P_1000          all 0.0038

LJQO10

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1705
bpref           all 0.2078
recip_rank      all 0.6201
P_10            all 0.2816
P_100           all 0.1894
P_1000          all 0.0189
summary (highrel)
map             all 0.1656
bpref           all 0.1496
recip_rank      all 0.4239
P_10            all 0.1273
P_100           all 0.0591
P_1000          all 0.0059

LMOP5

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0724
bpref           all 0.1005
recip_rank      all 0.5224
P_10            all 0.1612
P_100           all 0.0671
P_1000          all 0.0067
summary (highrel)
map             all 0.0980
bpref           all 0.0983
recip_rank      all 0.3710
P_10            all 0.0636
P_100           all 0.0206
P_1000          all 0.0021

LMOP10

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1053
bpref           all 0.1330
recip_rank      all 0.5348
P_10            all 0.1469
P_100           all 0.1106
P_1000          all 0.0111
summary (highrel)
map             all 0.1279
bpref           all 0.1247
recip_rank      all 0.4062
P_10            all 0.0576
P_100           all 0.0285
P_1000          all 0.0028

WESTfilter

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1109
bpref           all 0.1416
recip_rank      all 0.5013
P_10            all 0.1939
P_100           all 0.1002
P_1000          all 0.0145
summary (highrel)
map             all 0.0887
bpref           all 0.0747
recip_rank      all 0.3699
P_10            all 0.0818
P_100           all 0.0336
P_1000          all 0.0053

WESTrelint

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1109
bpref           all 0.1416
recip_rank      all 0.5013
P_10            all 0.1939
P_100           all 0.1002
P_1000          all 0.0145
summary (highrel)
map             all 0.0887
bpref           all 0.0747
recip_rank      all 0.3699
P_10            all 0.0818
P_100           all 0.0336
P_1000          all 0.0053

ICTNET11MBR1

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1039
bpref           all 0.0976
recip_rank      all 0.7042
P_10            all 0.1000
P_100           all 0.0316
P_1000          all 0.0386
summary (highrel)
map             all 0.1444
bpref           all 0.1306
recip_rank      all 0.5259
P_10            all 0.0636
P_100           all 0.0130
P_1000          all 0.0117

ICTNET11MBR2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0935
bpref           all 0.0908
recip_rank      all 0.7030
P_10            all 0.0959
P_100           all 0.0214
P_1000          all 0.0334
summary (highrel)
map             all 0.1407
bpref           all 0.1301
recip_rank      all 0.5202
P_10            all 0.0636
P_100           all 0.0100
P_1000          all 0.0109

dutirLmFb

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2818
bpref           all 0.3061
recip_rank      all 0.7323
P_10            all 0.3837
P_100           all 0.2241
P_1000          all 0.0295
summary (highrel)
map             all 0.2374
bpref           all 0.2026
recip_rank      all 0.4852
P_10            all 0.1455
P_100           all 0.0694
P_1000          all 0.0092

dutirMixFb

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2902
bpref           all 0.3221
recip_rank      all 0.7501
P_10            all 0.4082
P_100           all 0.2224
P_1000          all 0.0283
summary (highrel)
map             all 0.2351
bpref           all 0.2132
recip_rank      all 0.5190
P_10            all 0.1515
P_100           all 0.0682
P_1000          all 0.0087

dutirTfidfFb

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2197
bpref           all 0.2601
recip_rank      all 0.7052
P_10            all 0.4041
P_100           all 0.1649
P_1000          all 0.0190
summary (highrel)
map             all 0.1683
bpref           all 0.1636
recip_rank      all 0.4258
P_10            all 0.1455
P_100           all 0.0494
P_1000          all 0.0057

dutirMixSp

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2633
bpref           all 0.2984
recip_rank      all 0.7107
P_10            all 0.3816
P_100           all 0.2167
P_1000          all 0.0280
summary (highrel)
map             all 0.2176
bpref           all 0.1961
recip_rank      all 0.4910
P_10            all 0.1364
P_100           all 0.0621
P_1000          all 0.0077

IRSIGoogle1G

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2274
bpref           all 0.2571
recip_rank      all 0.7176
P_10            all 0.3735
P_100           all 0.1496
P_1000          all 0.0150
summary (highrel)
map             all 0.2186
bpref           all 0.2008
recip_rank      all 0.4757
P_10            all 0.1606
P_100           all 0.0515
P_1000          all 0.0052

IRSIGoogle2G

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2044
bpref           all 0.2324
recip_rank      all 0.6205
P_10            all 0.3490
P_100           all 0.1376
P_1000          all 0.0138
summary (highrel)
map             all 0.1952
bpref           all 0.1804
recip_rank      all 0.3984
P_10            all 0.1364
P_100           all 0.0439
P_1000          all 0.0044

Google1GNO

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2265
bpref           all 0.2566
recip_rank      all 0.7229
P_10            all 0.3592
P_100           all 0.1506
P_1000          all 0.0151
summary (highrel)
map             all 0.2114
bpref           all 0.1924
recip_rank      all 0.4570
P_10            all 0.1455
P_100           all 0.0494
P_1000          all 0.0049

UTBase

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0103
bpref           all 0.0117
recip_rank      all 0.0258
P_10            all 0.0143
P_100           all 0.0155
P_1000          all 0.0167
summary (highrel)
map             all 0.0045
bpref           all 0.0007
recip_rank      all 0.0073
P_10            all 0.0030
P_100           all 0.0024
P_1000          all 0.0065

InL2c1

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1525
bpref           all 0.1811
recip_rank      all 0.6171
P_10            all 0.2653
P_100           all 0.1135
P_1000          all 0.0113
summary (highrel)
map             all 0.1389
bpref           all 0.1302
recip_rank      all 0.3897
P_10            all 0.0970
P_100           all 0.0309
P_1000          all 0.0031

UTBaseRTF

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0045
bpref           all 0.0104
recip_rank      all 0.0052
P_10            all 0.0000
P_100           all 0.0051
P_1000          all 0.0058
summary (highrel)
map             all 0.0027
bpref           all 0.0009
recip_rank      all 0.0030
P_10            all 0.0000
P_100           all 0.0027
P_1000          all 0.0024

UTWngFuture

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0246
bpref           all 0.0214
recip_rank      all 0.0402
P_10            all 0.0184
P_100           all 0.0286
P_1000          all 0.0351
summary (highrel)
map             all 0.0087
bpref           all 0.0019
recip_rank      all 0.0131
P_10            all 0.0030
P_100           all 0.0048
P_1000          all 0.0103

UTWngFutureQ

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0192
bpref           all 0.0239
recip_rank      all 0.0267
P_10            all 0.0184
P_100           all 0.0180
P_1000          all 0.0328
summary (highrel)
map             all 0.0089
bpref           all 0.0028
recip_rank      all 0.0108
P_10            all 0.0030
P_100           all 0.0048
P_1000          all 0.0105

UIowaS1

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1364
bpref           all 0.1687
recip_rank      all 0.6594
P_10            all 0.3755
P_100           all 0.0839
P_1000          all 0.0084
summary (highrel)
map             all 0.1438
bpref           all 0.1516
recip_rank      all 0.4421
P_10            all 0.1394
P_100           all 0.0264
P_1000          all 0.0026

UIowaS2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1405
bpref           all 0.1782
recip_rank      all 0.6478
P_10            all 0.3531
P_100           all 0.0873
P_1000          all 0.0087
summary (highrel)
map             all 0.1476
bpref           all 0.1505
recip_rank      all 0.4481
P_10            all 0.1333
P_100           all 0.0264
P_1000          all 0.0026

UIowaS3

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1403
bpref           all 0.1778
recip_rank      all 0.6479
P_10            all 0.3531
P_100           all 0.0876
P_1000          all 0.0088
summary (highrel)
map             all 0.1479
bpref           all 0.1506
recip_rank      all 0.4509
P_10            all 0.1364
P_100           all 0.0264
P_1000          all 0.0026

UIowaS4

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1661
bpref           all 0.2213
recip_rank      all 0.6626
P_10            all 0.2898
P_100           all 0.1500
P_1000          all 0.0190
summary (highrel)
map             all 0.1720
bpref           all 0.1681
recip_rank      all 0.5206
P_10            all 0.1333
P_100           all 0.0579
P_1000          all 0.0070

Rocchio

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0712
bpref           all 0.0941
recip_rank      all 0.3961
P_10            all 0.1020
P_100           all 0.0606
P_1000          all 0.0287
summary (highrel)
map             all 0.0718
bpref           all 0.0650
recip_rank      all 0.3161
P_10            all 0.0424
P_100           all 0.0176
P_1000          all 0.0078

ICTNET11MBR3

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1000
bpref           all 0.0931
recip_rank      all 0.7385
P_10            all 0.0980
P_100           all 0.0282
P_1000          all 0.0386
summary (highrel)
map             all 0.1420
bpref           all 0.1293
recip_rank      all 0.5259
P_10            all 0.0636
P_100           all 0.0103
P_1000          all 0.0117

ICTNET11MBR4

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0972
bpref           all 0.0870
recip_rank      all 0.7380
P_10            all 0.0918
P_100           all 0.0233
P_1000          all 0.0389
summary (highrel)
map             all 0.1392
bpref           all 0.1265
recip_rank      all 0.5253
P_10            all 0.0606
P_100           all 0.0097
P_1000          all 0.0116

run1fix

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2444
bpref           all 0.2757
recip_rank      all 0.8390
P_10            all 0.4694
P_100           all 0.1267
P_1000          all 0.0132
summary (highrel)
map             all 0.2352
bpref           all 0.2240
recip_rank      all 0.6159
P_10            all 0.1879
P_100           all 0.0418
P_1000          all 0.0043

MONASH2NEW

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1144
bpref           all 0.1177
recip_rank      all 0.6858
P_10            all 0.1388
P_100           all 0.0524
P_1000          all 0.0228
summary (highrel)
map             all 0.1485
bpref           all 0.1364
recip_rank      all 0.5100
P_10            all 0.0697
P_100           all 0.0176
P_1000          all 0.0083

MONASH1NEW

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1144
bpref           all 0.1177
recip_rank      all 0.6858
P_10            all 0.1388
P_100           all 0.0524
P_1000          all 0.0228
summary (highrel)
map             all 0.1485
bpref           all 0.1364
recip_rank      all 0.5100
P_10            all 0.0697
P_100           all 0.0176
P_1000          all 0.0083

PRISrun1

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.3302
bpref           all 0.3686
recip_rank      all 0.8345
P_10            all 0.5184
P_100           all 0.2171
P_1000          all 0.0235
summary (highrel)
map             all 0.2688
bpref           all 0.2618
recip_rank      all 0.5728
P_10            all 0.1970
P_100           all 0.0679
P_1000          all 0.0073

scurtuRun1

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1453
bpref           all 0.1645
recip_rank      all 0.7120
P_10            all 0.2837
P_100           all 0.0761
P_1000          all 0.0090
summary (highrel)
map             all 0.1590
bpref           all 0.1578
recip_rank      all 0.4415
P_10            all 0.1030
P_100           all 0.0194
P_1000          all 0.0023

KAUSTExpRrnk

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1638
bpref           all 0.1981
recip_rank      all 0.5594
P_10            all 0.4000
P_100           all 0.1441
P_1000          all 0.0144
summary (highrel)
map             all 0.1151
bpref           all 0.1226
recip_rank      all 0.3042
P_10            all 0.1879
P_100           all 0.0467
P_1000          all 0.0047

KAUSTExp

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1248
bpref           all 0.1543
recip_rank      all 0.6022
P_10            all 0.3878
P_100           all 0.0967
P_1000          all 0.0097
summary (highrel)
map             all 0.0932
bpref           all 0.1082
recip_rank      all 0.3379
P_10            all 0.1636
P_100           all 0.0333
P_1000          all 0.0033

KAUSTRerank

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1699
bpref           all 0.2054
recip_rank      all 0.5879
P_10            all 0.4061
P_100           all 0.1498
P_1000          all 0.0150
summary (highrel)
map             all 0.1201
bpref           all 0.1353
recip_rank      all 0.3148
P_10            all 0.1970
P_100           all 0.0488
P_1000          all 0.0049

KAUSTBase

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1342
bpref           all 0.1638
recip_rank      all 0.6199
P_10            all 0.3816
P_100           all 0.1004
P_1000          all 0.0100
summary (highrel)
map             all 0.1012
bpref           all 0.1182
recip_rank      all 0.3410
P_10            all 0.1636
P_100           all 0.0348
P_1000          all 0.0035

qHtagBaseRun

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1154
bpref           all 0.1469
recip_rank      all 0.4393
P_10            all 0.2816
P_100           all 0.0657
P_1000          all 0.0066
summary (highrel)
map             all 0.0949
bpref           all 0.1053
recip_rank      all 0.1902
P_10            all 0.0697
P_100           all 0.0152
P_1000          all 0.0015

clarity1

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2109
bpref           all 0.2287
recip_rank      all 0.7538
P_10            all 0.4429
P_100           all 0.1263
P_1000          all 0.0126
summary (highrel)
map             all 0.2064
bpref           all 0.1869
recip_rank      all 0.4923
P_10            all 0.1818
P_100           all 0.0430
P_1000          all 0.0043

clarity2

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2182
bpref           all 0.2419
recip_rank      all 0.7700
P_10            all 0.4571
P_100           all 0.1231
P_1000          all 0.0123
summary (highrel)
map             all 0.1989
bpref           all 0.1974
recip_rank      all 0.5110
P_10            all 0.1788
P_100           all 0.0400
P_1000          all 0.0040

clarity3

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2271
bpref           all 0.2474
recip_rank      all 0.7694
P_10            all 0.4694
P_100           all 0.1245
P_1000          all 0.0124
summary (highrel)
map             all 0.1929
bpref           all 0.1924
recip_rank      all 0.4532
P_10            all 0.1788
P_100           all 0.0391
P_1000          all 0.0039

clarity4

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1982
bpref           all 0.2187
recip_rank      all 0.7459
P_10            all 0.4061
P_100           all 0.1161
P_1000          all 0.0116
summary (highrel)
map             all 0.2056
bpref           all 0.2108
recip_rank      all 0.5213
P_10            all 0.1727
P_100           all 0.0412
P_1000          all 0.0041

hitWIt

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.3157
bpref           all 0.3484
recip_rank      all 0.7355
P_10            all 0.4449
P_100           all 0.2324
P_1000          all 0.0290
summary (highrel)
map             all 0.2404
bpref           all 0.2311
recip_rank      all 0.5030
P_10            all 0.1848
P_100           all 0.0718
P_1000          all 0.0085

dbpWISTUD

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2291
bpref           all 0.2794
recip_rank      all 0.6428
P_10            all 0.3224
P_100           all 0.1637
P_1000          all 0.0353
summary (highrel)
map             all 0.1999
bpref           all 0.1788
recip_rank      all 0.4452
P_10            all 0.1273
P_100           all 0.0570
P_1000          all 0.0103

mulnewWISTUD

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1553
bpref           all 0.2177
recip_rank      all 0.5266
P_10            all 0.2469
P_100           all 0.1004
P_1000          all 0.0312
summary (highrel)
map             all 0.1508
bpref           all 0.1394
recip_rank      all 0.3788
P_10            all 0.1242
P_100           all 0.0385
P_1000          all 0.0092

PRISrun2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.3955
bpref           all 0.4542
recip_rank      all 0.8339
P_10            all 0.4776
P_100           all 0.2645
P_1000          all 0.0339
summary (highrel)
map             all 0.3135
bpref           all 0.2846
recip_rank      all 0.5473
P_10            all 0.1970
P_100           all 0.0958
P_1000          all 0.0120

PRISrun3

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2585
bpref           all 0.2960
recip_rank      all 0.7499
P_10            all 0.4245
P_100           all 0.1865
P_1000          all 0.0233
summary (highrel)
map             all 0.2144
bpref           all 0.2040
recip_rank      all 0.4782
P_10            all 0.1515
P_100           all 0.0606
P_1000          all 0.0075

hitWId

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2699
bpref           all 0.3040
recip_rank      all 0.7097
P_10            all 0.3429
P_100           all 0.2163
P_1000          all 0.0282
summary (highrel)
map             all 0.2258
bpref           all 0.2159
recip_rank      all 0.5032
P_10            all 0.1727
P_100           all 0.0706
P_1000          all 0.0087

PRISrun4

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2876
bpref           all 0.3230
recip_rank      all 0.7852
P_10            all 0.4163
P_100           all 0.2333
P_1000          all 0.0284
summary (highrel)
map             all 0.2377
bpref           all 0.2068
recip_rank      all 0.4927
P_10            all 0.1667
P_100           all 0.0827
P_1000          all 0.0098

FASILKOM01

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1809
bpref           all 0.2080
recip_rank      all 0.7596
P_10            all 0.4714
P_100           all 0.1398
P_1000          all 0.0142
summary (highrel)
map             all 0.0971
bpref           all 0.1003
recip_rank      all 0.3037
P_10            all 0.1636
P_100           all 0.0355
P_1000          all 0.0036

QCRIwTagOrg

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1230
bpref           all 0.1588
recip_rank      all 0.5773
P_10            all 0.3796
P_100           all 0.0953
P_1000          all 0.0095
summary (highrel)
map             all 0.0812
bpref           all 0.0788
recip_rank      all 0.2708
P_10            all 0.1333
P_100           all 0.0285
P_1000          all 0.0028

QCRIwoTagOrg

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1208
bpref           all 0.1574
recip_rank      all 0.5331
P_10            all 0.3837
P_100           all 0.0953
P_1000          all 0.0095
summary (highrel)
map             all 0.0715
bpref           all 0.0749
recip_rank      all 0.2315
P_10            all 0.1242
P_100           all 0.0267
P_1000          all 0.0027

runNeMIS

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1194
bpref           all 0.1419
recip_rank      all 0.6561
P_10            all 0.2367
P_100           all 0.0578
P_1000          all 0.0103
summary (highrel)
map             all 0.1407
bpref           all 0.1442
recip_rank      all 0.4220
P_10            all 0.1030
P_100           all 0.0194
P_1000          all 0.0026

runNeMISext

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1186
bpref           all 0.1386
recip_rank      all 0.6528
P_10            all 0.2510
P_100           all 0.0702
P_1000          all 0.0071
summary (highrel)
map             all 0.1469
bpref           all 0.1470
recip_rank      all 0.4255
P_10            all 0.1091
P_100           all 0.0206
P_1000          all 0.0021

run2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2953
bpref           all 0.3300
recip_rank      all 0.8450
P_10            all 0.4735
P_100           all 0.1778
P_1000          all 0.0178
summary (highrel)
map             all 0.2597
bpref           all 0.2368
recip_rank      all 0.6189
P_10            all 0.1939
P_100           all 0.0594
P_1000          all 0.0059

gus

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1132
bpref           all 0.1439
recip_rank      all 0.5976
P_10            all 0.3510
P_100           all 0.0892
P_1000          all 0.0089
summary (highrel)
map             all 0.0739
bpref           all 0.0784
recip_rank      all 0.2513
P_10            all 0.1000
P_100           all 0.0230
P_1000          all 0.0023

gust

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1205
bpref           all 0.1506
recip_rank      all 0.6201
P_10            all 0.3551
P_100           all 0.0908
P_1000          all 0.0091
summary (highrel)
map             all 0.0832
bpref           all 0.0883
recip_rank      all 0.2229
P_10            all 0.1091
P_100           all 0.0242
P_1000          all 0.0024

gustc

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1205
bpref           all 0.1506
recip_rank      all 0.6201
P_10            all 0.3551
P_100           all 0.0908
P_1000          all 0.0091
summary (highrel)
map             all 0.0832
bpref           all 0.0883
recip_rank      all 0.2229
P_10            all 0.1091
P_100           all 0.0242
P_1000          all 0.0024

gut

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1233
bpref           all 0.1559
recip_rank      all 0.5592
P_10            all 0.3673
P_100           all 0.0965
P_1000          all 0.0097
summary (highrel)
map             all 0.0833
bpref           all 0.0899
recip_rank      all 0.2371
P_10            all 0.1182
P_100           all 0.0279
P_1000          all 0.0028

DFReeKLIM

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1563
bpref           all 0.1637
recip_rank      all 0.7475
P_10            all 0.1755
P_100           all 0.0918
P_1000          all 0.0463
summary (highrel)
map             all 0.1706
bpref           all 0.1455
recip_rank      all 0.5717
P_10            all 0.0848
P_100           all 0.0282
P_1000          all 0.0130

DFReeKLIM30

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2316
bpref           all 0.2540
recip_rank      all 0.8219
P_10            all 0.5122
P_100           all 0.1320
P_1000          all 0.0132
summary (highrel)
map             all 0.2286
bpref           all 0.2299
recip_rank      all 0.5323
P_10            all 0.2121
P_100           all 0.0448
P_1000          all 0.0045

FASILKOM03

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1686
bpref           all 0.1956
recip_rank      all 0.7303
P_10            all 0.4551
P_100           all 0.1361
P_1000          all 0.0137
summary (highrel)
map             all 0.0961
bpref           all 0.0957
recip_rank      all 0.3505
P_10            all 0.1333
P_100           all 0.0321
P_1000          all 0.0033

DFReeKLIMDC

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2878
bpref           all 0.3199
recip_rank      all 0.7732
P_10            all 0.4245
P_100           all 0.2427
P_1000          all 0.0256
summary (highrel)
map             all 0.2289
bpref           all 0.2101
recip_rank      all 0.4925
P_10            all 0.1788
P_100           all 0.0730
P_1000          all 0.0073

waterlooa1

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1874
bpref           all 0.2102
recip_rank      all 0.7773
P_10            all 0.4469
P_100           all 0.1110
P_1000          all 0.0111
summary (highrel)
map             all 0.1643
bpref           all 0.1661
recip_rank      all 0.4607
P_10            all 0.1515
P_100           all 0.0300
P_1000          all 0.0030

waterlooa2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1774
bpref           all 0.2006
recip_rank      all 0.7607
P_10            all 0.4306
P_100           all 0.1082
P_1000          all 0.0108
summary (highrel)
map             all 0.1560
bpref           all 0.1609
recip_rank      all 0.4511
P_10            all 0.1515
P_100           all 0.0288
P_1000          all 0.0029

waterlooa3

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2082
bpref           all 0.2282
recip_rank      all 0.8248
P_10            all 0.4714
P_100           all 0.1229
P_1000          all 0.0123
summary (highrel)
map             all 0.1817
bpref           all 0.1778
recip_rank      all 0.4833
P_10            all 0.1515
P_100           all 0.0345
P_1000          all 0.0035

waterlooa4

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1871
bpref           all 0.2087
recip_rank      all 0.7877
P_10            all 0.4367
P_100           all 0.1127
P_1000          all 0.0113
summary (highrel)
map             all 0.1608
bpref           all 0.1642
recip_rank      all 0.4536
P_10            all 0.1364
P_100           all 0.0303
P_1000          all 0.0030

FASILKOM04

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1838
bpref           all 0.2133
recip_rank      all 0.7113
P_10            all 0.4694
P_100           all 0.1398
P_1000          all 0.0141
summary (highrel)
map             all 0.1105
bpref           all 0.1131
recip_rank      all 0.3364
P_10            all 0.1515
P_100           all 0.0385
P_1000          all 0.0039

2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1905
bpref           all 0.2214
recip_rank      all 0.7277
P_10            all 0.3592
P_100           all 0.1304
P_1000          all 0.0238
summary (highrel)
map             all 0.1677
bpref           all 0.1569
recip_rank      all 0.4832
P_10            all 0.1152
P_100           all 0.0370
P_1000          all 0.0066

3

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1905
bpref           all 0.2214
recip_rank      all 0.7277
P_10            all 0.3592
P_100           all 0.1304
P_1000          all 0.0238
summary (highrel)
map             all 0.1677
bpref           all 0.1569
recip_rank      all 0.4832
P_10            all 0.1152
P_100           all 0.0370
P_1000          all 0.0066

4

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1919
bpref           all 0.2227
recip_rank      all 0.7277
P_10            all 0.3612
P_100           all 0.1304
P_1000          all 0.0239
summary (highrel)
map             all 0.1677
bpref           all 0.1570
recip_rank      all 0.4832
P_10            all 0.1152
P_100           all 0.0370
P_1000          all 0.0066

WESTfilext

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1071
bpref           all 0.1347
recip_rank      all 0.4694
P_10            all 0.1959
P_100           all 0.0996
P_1000          all 0.0119
summary (highrel)
map             all 0.0862
bpref           all 0.0755
recip_rank      all 0.3684
P_10            all 0.0727
P_100           all 0.0333
P_1000          all 0.0040

WESTrlext

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1071
bpref           all 0.1347
recip_rank      all 0.4694
P_10            all 0.1959
P_100           all 0.0996
P_1000          all 0.0119
summary (highrel)
map             all 0.0862
bpref           all 0.0755
recip_rank      all 0.3684
P_10            all 0.0727
P_100           all 0.0333
P_1000          all 0.0040

simfoll

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0744
bpref           all 0.0866
recip_rank      all 0.2233
P_10            all 0.1082
P_100           all 0.0771
P_1000          all 0.0351
summary (highrel)
map             all 0.0332
bpref           all 0.0212
recip_rank      all 0.0694
P_10            all 0.0273
P_100           all 0.0248
P_1000          all 0.0098

simfollTP01

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1086
bpref           all 0.1422
recip_rank      all 0.4539
P_10            all 0.1286
P_100           all 0.0690
P_1000          all 0.0326
summary (highrel)
map             all 0.0996
bpref           all 0.0845
recip_rank      all 0.3008
P_10            all 0.0485
P_100           all 0.0209
P_1000          all 0.0096

Nestor

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1292
bpref           all 0.1646
recip_rank      all 0.5811
P_10            all 0.2857
P_100           all 0.1096
P_1000          all 0.0152
summary (highrel)
map             all 0.1286
bpref           all 0.1353
recip_rank      all 0.3820
P_10            all 0.1455
P_100           all 0.0436
P_1000          all 0.0048

sielrun4

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0569
bpref           all 0.0880
recip_rank      all 0.3080
P_10            all 0.1531
P_100           all 0.0604
P_1000          all 0.0166
summary (highrel)
map             all 0.0235
bpref           all 0.0197
recip_rank      all 0.0951
P_10            all 0.0485
P_100           all 0.0185
P_1000          all 0.0052

sielrun3

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0474
bpref           all 0.0706
recip_rank      all 0.1837
P_10            all 0.1020
P_100           all 0.0539
P_1000          all 0.0193
summary (highrel)
map             all 0.0176
bpref           all 0.0173
recip_rank      all 0.0476
P_10            all 0.0273
P_100           all 0.0218
P_1000          all 0.0062

sielrun2

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0509
bpref           all 0.0789
recip_rank      all 0.2571
P_10            all 0.1429
P_100           all 0.0561
P_1000          all 0.0173
summary (highrel)
map             all 0.0209
bpref           all 0.0204
recip_rank      all 0.1004
P_10            all 0.0485
P_100           all 0.0179
P_1000          all 0.0055

sielrun1

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0407
bpref           all 0.0520
recip_rank      all 0.1365
P_10            all 0.0673
P_100           all 0.0465
P_1000          all 0.0197
summary (highrel)
map             all 0.0166
bpref           all 0.0079
recip_rank      all 0.0358
P_10            all 0.0061
P_100           all 0.0130
P_1000          all 0.0073

tfTP01

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1166
bpref           all 0.1540
recip_rank      all 0.6123
P_10            all 0.1388
P_100           all 0.0739
P_1000          all 0.0318
summary (highrel)
map             all 0.1017
bpref           all 0.0895
recip_rank      all 0.4509
P_10            all 0.0576
P_100           all 0.0230
P_1000          all 0.0094

NestorS

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1292
bpref           all 0.1647
recip_rank      all 0.5811
P_10            all 0.2857
P_100           all 0.1096
P_1000          all 0.0152
summary (highrel)
map             all 0.1285
bpref           all 0.1353
recip_rank      all 0.3820
P_10            all 0.1455
P_100           all 0.0436
P_1000          all 0.0048

DFReeKLIMRA

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2619
bpref           all 0.3025
recip_rank      all 0.7786
P_10            all 0.3939
P_100           all 0.2259
P_1000          all 0.0226
summary (highrel)
map             all 0.2165
bpref           all 0.1933
recip_rank      all 0.5579
P_10            all 0.1576
P_100           all 0.0667
P_1000          all 0.0067

nQCRIwTag

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1230
bpref           all 0.1588
recip_rank      all 0.5773
P_10            all 0.3796
P_100           all 0.0953
P_1000          all 0.0095
summary (highrel)
map             all 0.0812
bpref           all 0.0788
recip_rank      all 0.2708
P_10            all 0.1333
P_100           all 0.0285
P_1000          all 0.0028

nQCRIwoTag

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1208
bpref           all 0.1574
recip_rank      all 0.5331
P_10            all 0.3837
P_100           all 0.0953
P_1000          all 0.0095
summary (highrel)
map             all 0.0715
bpref           all 0.0749
recip_rank      all 0.2315
P_10            all 0.1242
P_100           all 0.0267
P_1000          all 0.0027

baselineBM25

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0292
bpref           all 0.0465
recip_rank      all 0.1185
P_10            all 0.0449
P_100           all 0.0355
P_1000          all 0.0151
summary (highrel)
map             all 0.0141
bpref           all 0.0120
recip_rank      all 0.0276
P_10            all 0.0121
P_100           all 0.0082
P_1000          all 0.0042

ikmRun1

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0433
bpref           all 0.0568
recip_rank      all 0.1867
P_10            all 0.0592
P_100           all 0.0506
P_1000          all 0.0281
summary (highrel)
map             all 0.0247
bpref           all 0.0136
recip_rank      all 0.0977
P_10            all 0.0152
P_100           all 0.0152
P_1000          all 0.0091

sylesNoRes

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2114
bpref           all 0.2368
recip_rank      all 0.6759
P_10            all 0.4082
P_100           all 0.1043
P_1000          all 0.0104
summary (highrel)
map             all 0.1902
bpref           all 0.2056
recip_rank      all 0.4160
P_10            all 0.1697
P_100           all 0.0361
P_1000          all 0.0036

isiFD

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1804
bpref           all 0.2076
recip_rank      all 0.6352
P_10            all 0.4837
P_100           all 0.1308
P_1000          all 0.0131
summary (highrel)
map             all 0.1177
bpref           all 0.1229
recip_rank      all 0.3106
P_10            all 0.1697
P_100           all 0.0415
P_1000          all 0.0042

isiFDL

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1892
bpref           all 0.2133
recip_rank      all 0.6255
P_10            all 0.4980
P_100           all 0.1365
P_1000          all 0.0137
summary (highrel)
map             all 0.1137
bpref           all 0.1195
recip_rank      all 0.3135
P_10            all 0.1727
P_100           all 0.0430
P_1000          all 0.0043

isiFDRML

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2397
bpref           all 0.2549
recip_rank      all 0.8226
P_10            all 0.5122
P_100           all 0.1333
P_1000          all 0.0133
summary (highrel)
map             all 0.2346
bpref           all 0.2293
recip_rank      all 0.5405
P_10            all 0.1939
P_100           all 0.0467
P_1000          all 0.0047

isiFDRM

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2401
bpref           all 0.2603
recip_rank      all 0.8173
P_10            all 0.5061
P_100           all 0.1343
P_1000          all 0.0134
summary (highrel)
map             all 0.2476
bpref           all 0.2400
recip_rank      all 0.5497
P_10            all 0.2000
P_100           all 0.0470
P_1000          all 0.0047

melblt

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1409
bpref           all 0.1720
recip_rank      all 0.6650
P_10            all 0.2959
P_100           all 0.0769
P_1000          all 0.0077
summary (highrel)
map             all 0.1579
bpref           all 0.1581
recip_rank      all 0.4512
P_10            all 0.1091
P_100           all 0.0248
P_1000          all 0.0025

FASILKOM02

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1904
bpref           all 0.2191
recip_rank      all 0.7177
P_10            all 0.4673
P_100           all 0.1441
P_1000          all 0.0147
summary (highrel)
map             all 0.0978
bpref           all 0.0962
recip_rank      all 0.3071
P_10            all 0.1394
P_100           all 0.0352
P_1000          all 0.0037

FDUNLP

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1411
bpref           all 0.1615
recip_rank      all 0.5883
P_10            all 0.1857
P_100           all 0.1145
P_1000          all 0.0203
summary (highrel)
map             all 0.1707
bpref           all 0.1556
recip_rank      all 0.4389
P_10            all 0.0879
P_100           all 0.0488
P_1000          all 0.0068

RMITM

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2402
bpref           all 0.2808
recip_rank      all 0.6508
P_10            all 0.3327
P_100           all 0.1747
P_1000          all 0.0209
summary (highrel)
map             all 0.1618
bpref           all 0.1480
recip_rank      all 0.4301
P_10            all 0.1394
P_100           all 0.0576
P_1000          all 0.0061

FDUNLP2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0985
bpref           all 0.1289
recip_rank      all 0.4710
P_10            all 0.1673
P_100           all 0.0916
P_1000          all 0.0172
summary (highrel)
map             all 0.1016
bpref           all 0.1008
recip_rank      all 0.2517
P_10            all 0.0606
P_100           all 0.0382
P_1000          all 0.0054

baseline1

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0624
bpref           all 0.0846
recip_rank      all 0.4008
P_10            all 0.2265
P_100           all 0.0586
P_1000          all 0.0059
summary (highrel)
map             all 0.0661
bpref           all 0.0611
recip_rank      all 0.2071
P_10            all 0.1030
P_100           all 0.0206
P_1000          all 0.0021

EMAX

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0301
bpref           all 0.0368
recip_rank      all 0.2565
P_10            all 0.0714
P_100           all 0.0335
P_1000          all 0.0150
summary (highrel)
map             all 0.0174
bpref           all 0.0194
recip_rank      all 0.1209
P_10            all 0.0242
P_100           all 0.0067
P_1000          all 0.0045

run3

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1416
bpref           all 0.1342
recip_rank      all 0.6961
P_10            all 0.1510
P_100           all 0.0735
P_1000          all 0.0389
summary (highrel)
map             all 0.1615
bpref           all 0.1428
recip_rank      all 0.5426
P_10            all 0.0727
P_100           all 0.0242
P_1000          all 0.0118

run4

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1416
bpref           all 0.1336
recip_rank      all 0.6941
P_10            all 0.1490
P_100           all 0.0741
P_1000          all 0.0389
summary (highrel)
map             all 0.1613
bpref           all 0.1416
recip_rank      all 0.5383
P_10            all 0.0697
P_100           all 0.0242
P_1000          all 0.0119

ciirRun1

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2005
bpref           all 0.2259
recip_rank      all 0.6842
P_10            all 0.4122
P_100           all 0.1214
P_1000          all 0.0121
summary (highrel)
map             all 0.1935
bpref           all 0.1917
recip_rank      all 0.4442
P_10            all 0.1576
P_100           all 0.0403
P_1000          all 0.0040

run3a

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0663
bpref           all 0.0976
recip_rank      all 0.5211
P_10            all 0.2592
P_100           all 0.0610
P_1000          all 0.0061
summary (highrel)
map             all 0.0646
bpref           all 0.0644
recip_rank      all 0.2882
P_10            all 0.0939
P_100           all 0.0167
P_1000          all 0.0017

ciirRun2

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2274
bpref           all 0.2496
recip_rank      all 0.7545
P_10            all 0.4224
P_100           all 0.1288
P_1000          all 0.0129
summary (highrel)
map             all 0.2228
bpref           all 0.2131
recip_rank      all 0.4671
P_10            all 0.1636
P_100           all 0.0430
P_1000          all 0.0043

ciirRun3

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2032
bpref           all 0.2274
recip_rank      all 0.7191
P_10            all 0.4102
P_100           all 0.1267
P_1000          all 0.0127
summary (highrel)
map             all 0.1792
bpref           all 0.1824
recip_rank      all 0.4551
P_10            all 0.1636
P_100           all 0.0424
P_1000          all 0.0042

ciirRun4

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1848
bpref           all 0.2121
recip_rank      all 0.6727
P_10            all 0.3673
P_100           all 0.1127
P_1000          all 0.0113
summary (highrel)
map             all 0.1811
bpref           all 0.1806
recip_rank      all 0.4229
P_10            all 0.1424
P_100           all 0.0345
P_1000          all 0.0035

RMITMR

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2307
bpref           all 0.2687
recip_rank      all 0.6250
P_10            all 0.2714
P_100           all 0.1463
P_1000          all 0.0235
summary (highrel)
map             all 0.1648
bpref           all 0.1500
recip_rank      all 0.3927
P_10            all 0.1152
P_100           all 0.0506
P_1000          all 0.0077

cyfrun1

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1309
bpref           all 0.1339
recip_rank      all 0.5567
P_10            all 0.1286
P_100           all 0.0731
P_1000          all 0.0327
summary (highrel)
map             all 0.1501
bpref           all 0.1373
recip_rank      all 0.4105
P_10            all 0.0606
P_100           all 0.0261
P_1000          all 0.0094

YNDXTPC2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1026
bpref           all 0.1305
recip_rank      all 0.5424
P_10            all 0.2490
P_100           all 0.0647
P_1000          all 0.0065
summary (highrel)
map             all 0.1265
bpref           all 0.1392
recip_rank      all 0.3432
P_10            all 0.1061
P_100           all 0.0209
P_1000          all 0.0021

cyfrun2

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1154
bpref           all 0.1183
recip_rank      all 0.5033
P_10            all 0.1245
P_100           all 0.0659
P_1000          all 0.0294
summary (highrel)
map             all 0.1279
bpref           all 0.1156
recip_rank      all 0.3541
P_10            all 0.0485
P_100           all 0.0185
P_1000          all 0.0081

run4a

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0477
bpref           all 0.0789
recip_rank      all 0.3821
P_10            all 0.1878
P_100           all 0.0592
P_1000          all 0.0059
summary (highrel)
map             all 0.0353
bpref           all 0.0346
recip_rank      all 0.2043
P_10            all 0.0485
P_100           all 0.0155
P_1000          all 0.0015

PKUICST

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2728
bpref           all 0.3093
recip_rank      all 0.8209
P_10            all 0.4082
P_100           all 0.1912
P_1000          all 0.0234
summary (highrel)
map             all 0.2554
bpref           all 0.2385
recip_rank      all 0.5829
P_10            all 0.1788
P_100           all 0.0655
P_1000          all 0.0083

RMITAR

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2369
bpref           all 0.2735
recip_rank      all 0.5967
P_10            all 0.2816
P_100           all 0.1476
P_1000          all 0.0231
summary (highrel)
map             all 0.1671
bpref           all 0.1492
recip_rank      all 0.3587
P_10            all 0.1182
P_100           all 0.0488
P_1000          all 0.0059

IDEABASIC

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1092
bpref           all 0.1350
recip_rank      all 0.5350
P_10            all 0.1633
P_100           all 0.0892
P_1000          all 0.0270
summary (highrel)
map             all 0.1110
bpref           all 0.0978
recip_rank      all 0.3114
P_10            all 0.0515
P_100           all 0.0327
P_1000          all 0.0076

PKUICST2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2196
bpref           all 0.2450
recip_rank      all 0.8177
P_10            all 0.4061
P_100           all 0.1182
P_1000          all 0.0118
summary (highrel)
map             all 0.2380
bpref           all 0.2324
recip_rank      all 0.5876
P_10            all 0.1697
P_100           all 0.0427
P_1000          all 0.0043

PKUICST3

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2447
bpref           all 0.2674
recip_rank      all 0.7980
P_10            all 0.3245
P_100           all 0.2459
P_1000          all 0.0246
summary (highrel)
map             all 0.2272
bpref           all 0.2069
recip_rank      all 0.5754
P_10            all 0.1333
P_100           all 0.0779
P_1000          all 0.0078

IDEABASICQE

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1106
bpref           all 0.1378
recip_rank      all 0.5269
P_10            all 0.1612
P_100           all 0.0894
P_1000          all 0.0271
summary (highrel)
map             all 0.1153
bpref           all 0.1005
recip_rank      all 0.3292
P_10            all 0.0576
P_100           all 0.0330
P_1000          all 0.0077

PKUICST4

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2190
bpref           all 0.2367
recip_rank      all 0.7826
P_10            all 0.2714
P_100           all 0.1694
P_1000          all 0.0370
summary (highrel)
map             all 0.2125
bpref           all 0.1794
recip_rank      all 0.5781
P_10            all 0.1212
P_100           all 0.0612
P_1000          all 0.0120

IDEAACTQE

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1106
bpref           all 0.1378
recip_rank      all 0.5269
P_10            all 0.1612
P_100           all 0.0894
P_1000          all 0.0271
summary (highrel)
map             all 0.1153
bpref           all 0.1005
recip_rank      all 0.3292
P_10            all 0.0576
P_100           all 0.0330
P_1000          all 0.0077

YNDXTPC1

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0974
bpref           all 0.1217
recip_rank      all 0.5184
P_10            all 0.2347
P_100           all 0.0608
P_1000          all 0.0061
summary (highrel)
map             all 0.1222
bpref           all 0.1346
recip_rank      all 0.3161
P_10            all 0.1091
P_100           all 0.0200
P_1000          all 0.0020

RMITMRR

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2311
bpref           all 0.2589
recip_rank      all 0.6615
P_10            all 0.3673
P_100           all 0.1400
P_1000          all 0.0140
summary (highrel)
map             all 0.1716
bpref           all 0.1624
recip_rank      all 0.4311
P_10            all 0.1333
P_100           all 0.0391
P_1000          all 0.0039

run1a

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0748
bpref           all 0.0960
recip_rank      all 0.4494
P_10            all 0.2061
P_100           all 0.0404
P_1000          all 0.0040
summary (highrel)
map             all 0.0797
bpref           all 0.0864
recip_rank      all 0.2211
P_10            all 0.0667
P_100           all 0.0112
P_1000          all 0.0011

IDEABASICACT

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1092
bpref           all 0.1350
recip_rank      all 0.5350
P_10            all 0.1633
P_100           all 0.0892
P_1000          all 0.0270
summary (highrel)
map             all 0.1110
bpref           all 0.0978
recip_rank      all 0.3114
P_10            all 0.0515
P_100           all 0.0327
P_1000          all 0.0076

run2a

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0478
bpref           all 0.0712
recip_rank      all 0.4100
P_10            all 0.1878
P_100           all 0.0508
P_1000          all 0.0051
summary (highrel)
map             all 0.0419
bpref           all 0.0450
recip_rank      all 0.2056
P_10            all 0.0667
P_100           all 0.0127
P_1000          all 0.0013

MorpheusRun1

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0206
bpref           all 0.0335
recip_rank      all 0.2418
P_10            all 0.1490
P_100           all 0.0345
P_1000          all 0.0034
summary (highrel)
map             all 0.0130
bpref           all 0.0209
recip_rank      all 0.1018
P_10            all 0.0485
P_100           all 0.0115
P_1000          all 0.0012

uogTrUB2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1014
bpref           all 0.1445
recip_rank      all 0.4715
P_10            all 0.2367
P_100           all 0.1141
P_1000          all 0.0167
summary (highrel)
map             all 0.0714
bpref           all 0.0726
recip_rank      all 0.2475
P_10            all 0.1091
P_100           all 0.0400
P_1000          all 0.0059

myRun

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1714
bpref           all 0.1940
recip_rank      all 0.6276
P_10            all 0.4265
P_100           all 0.0961
P_1000          all 0.0096
summary (highrel)
map             all 0.1753
bpref           all 0.1684
recip_rank      all 0.4051
P_10            all 0.1545
P_100           all 0.0336
P_1000          all 0.0034

myrun3

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2062
bpref           all 0.2347
recip_rank      all 0.6700
P_10            all 0.4469
P_100           all 0.1149
P_1000          all 0.0115
summary (highrel)
map             all 0.1998
bpref           all 0.1941
recip_rank      all 0.4269
P_10            all 0.1606
P_100           all 0.0376
P_1000          all 0.0038

myrun2

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1977
bpref           all 0.2278
recip_rank      all 0.6867
P_10            all 0.4551
P_100           all 0.1198
P_1000          all 0.0120
summary (highrel)
map             all 0.1787
bpref           all 0.1772
recip_rank      all 0.4570
P_10            all 0.1636
P_100           all 0.0361
P_1000          all 0.0036

rit

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1588
bpref           all 0.1869
recip_rank      all 0.7069
P_10            all 0.2592
P_100           all 0.0910
P_1000          all 0.0091
summary (highrel)
map             all 0.1783
bpref           all 0.1689
recip_rank      all 0.5578
P_10            all 0.1061
P_100           all 0.0330
P_1000          all 0.0033

ri

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2203
bpref           all 0.2430
recip_rank      all 0.7896
P_10            all 0.4939
P_100           all 0.1280
P_1000          all 0.0128
summary (highrel)
map             all 0.2078
bpref           all 0.1960
recip_rank      all 0.5885
P_10            all 0.1818
P_100           all 0.0391
P_1000          all 0.0039

normal

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1594
bpref           all 0.1867
recip_rank      all 0.6658
P_10            all 0.3755
P_100           all 0.0941
P_1000          all 0.0094
summary (highrel)
map             all 0.1582
bpref           all 0.1496
recip_rank      all 0.4011
P_10            all 0.1303
P_100           all 0.0261
P_1000          all 0.0026

rit3

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1305
bpref           all 0.1561
recip_rank      all 0.5978
P_10            all 0.1980
P_100           all 0.0786
P_1000          all 0.0079
summary (highrel)
map             all 0.1965
bpref           all 0.1843
recip_rank      all 0.5259
P_10            all 0.1000
P_100           all 0.0373
P_1000          all 0.0037

WiseFouthRun

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1923
bpref           all 0.2204
recip_rank      all 0.6134
P_10            all 0.3857
P_100           all 0.1447
P_1000          all 0.0145
summary (highrel)
map             all 0.1606
bpref           all 0.1576
recip_rank      all 0.3764
P_10            all 0.1394
P_100           all 0.0445
P_1000          all 0.0045

RTB

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0131
bpref           all 0.0190
recip_rank      all 0.1594
P_10            all 0.0429
P_100           all 0.0173
P_1000          all 0.0017
summary (highrel)
map             all 0.0035
bpref           all 0.0075
recip_rank      all 0.0271
P_10            all 0.0091
P_100           all 0.0064
P_1000          all 0.0006

WiseThirdRun

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2030
bpref           all 0.2312
recip_rank      all 0.6238
P_10            all 0.3571
P_100           all 0.1565
P_1000          all 0.0157
summary (highrel)
map             all 0.1545
bpref           all 0.1459
recip_rank      all 0.3998
P_10            all 0.1485
P_100           all 0.0509
P_1000          all 0.0051

Wise2ndRun

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.2030
bpref           all 0.2312
recip_rank      all 0.6238
P_10            all 0.3571
P_100           all 0.1565
P_1000          all 0.0157
summary (highrel)
map             all 0.1545
bpref           all 0.1459
recip_rank      all 0.3998
P_10            all 0.1485
P_100           all 0.0509
P_1000          all 0.0051

WiseFifthRun

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1687
bpref           all 0.1923
recip_rank      all 0.7097
P_10            all 0.3939
P_100           all 0.1073
P_1000          all 0.0107
summary (highrel)
map             all 0.1486
bpref           all 0.1404
recip_rank      all 0.4477
P_10            all 0.1424
P_100           all 0.0327
P_1000          all 0.0033

uiucsf

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0007
bpref           all 0.0032
recip_rank      all 0.0453
P_10            all 0.0122
P_100           all 0.0037
P_1000          all 0.0004
summary (highrel)
map             all 0.0020
bpref           all 0.0019
recip_rank      all 0.0085
P_10            all 0.0030
P_100           all 0.0006
P_1000          all 0.0001

uogTrLqea

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0625
bpref           all 0.0975
recip_rank      all 0.2798
P_10            all 0.1306
P_100           all 0.0894
P_1000          all 0.0216
summary (highrel)
map             all 0.0402
bpref           all 0.0344
recip_rank      all 0.1105
P_10            all 0.0545
P_100           all 0.0391
P_1000          all 0.0073

baseline2

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1239
bpref           all 0.1500
recip_rank      all 0.6035
P_10            all 0.3347
P_100           all 0.0878
P_1000          all 0.0088
summary (highrel)
map             all 0.0983
bpref           all 0.0980
recip_rank      all 0.2871
P_10            all 0.1333
P_100           all 0.0285
P_1000          all 0.0028

kanopeRun

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0553
bpref           all 0.0606
recip_rank      all 0.4636
P_10            all 0.0633
P_100           all 0.0120
P_1000          all 0.0012
summary (highrel)
map             all 0.0899
bpref           all 0.0919
recip_rank      all 0.3409
P_10            all 0.0364
P_100           all 0.0052
P_1000          all 0.0005

relevanceRun

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1862
bpref           all 0.2082
recip_rank      all 0.7322
P_10            all 0.4388
P_100           all 0.1055
P_1000          all 0.0106
summary (highrel)
map             all 0.1473
bpref           all 0.1480
recip_rank      all 0.4936
P_10            all 0.1545
P_100           all 0.0270
P_1000          all 0.0027

balanceRun

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1343
bpref           all 0.1539
recip_rank      all 0.6375
P_10            all 0.2592
P_100           all 0.0751
P_1000          all 0.0075
summary (highrel)
map             all 0.1402
bpref           all 0.1374
recip_rank      all 0.4802
P_10            all 0.1091
P_100           all 0.0282
P_1000          all 0.0028

ya3

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0779
bpref           all 0.1083
recip_rank      all 0.4757
P_10            all 0.2571
P_100           all 0.0657
P_1000          all 0.0066
summary (highrel)
map             all 0.0533
bpref           all 0.0623
recip_rank      all 0.1921
P_10            all 0.0848
P_100           all 0.0155
P_1000          all 0.0015

uicir1

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0916
bpref           all 0.1227
recip_rank      all 0.5525
P_10            all 0.2939
P_100           all 0.0757
P_1000          all 0.0076
summary (highrel)
map             all 0.0692
bpref           all 0.0884
recip_rank      all 0.2343
P_10            all 0.1030
P_100           all 0.0303
P_1000          all 0.0030

uicir2

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0982
bpref           all 0.1351
recip_rank      all 0.5193
P_10            all 0.2714
P_100           all 0.1049
P_1000          all 0.0105
summary (highrel)
map             all 0.0772
bpref           all 0.0935
recip_rank      all 0.2707
P_10            all 0.0970
P_100           all 0.0430
P_1000          all 0.0043

uogTrLqeabdd

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0625
bpref           all 0.0975
recip_rank      all 0.2798
P_10            all 0.1306
P_100           all 0.0894
P_1000          all 0.0216
summary (highrel)
map             all 0.0402
bpref           all 0.0344
recip_rank      all 0.1105
P_10            all 0.0545
P_100           all 0.0391
P_1000          all 0.0073

ya4

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0822
bpref           all 0.1143
recip_rank      all 0.5066
P_10            all 0.2735
P_100           all 0.0714
P_1000          all 0.0071
summary (highrel)
map             all 0.0552
bpref           all 0.0695
recip_rank      all 0.2075
P_10            all 0.0848
P_100           all 0.0194
P_1000          all 0.0019

qRefLThresh

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1270
bpref           all 0.1409
recip_rank      all 0.6238
P_10            all 0.2592
P_100           all 0.0612
P_1000          all 0.0061
summary (highrel)
map             all 0.1389
bpref           all 0.1340
recip_rank      all 0.4355
P_10            all 0.1091
P_100           all 0.0248
P_1000          all 0.0025

refRelRun

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1764
bpref           all 0.1991
recip_rank      all 0.7454
P_10            all 0.3918
P_100           all 0.0990
P_1000          all 0.0099
summary (highrel)
map             all 0.1748
bpref           all 0.1697
recip_rank      all 0.4793
P_10            all 0.1485
P_100           all 0.0273
P_1000          all 0.0027

RunPure

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1145
bpref           all 0.1478
recip_rank      all 0.4773
P_10            all 0.2837
P_100           all 0.1182
P_1000          all 0.0118
summary (highrel)
map             all 0.0516
bpref           all 0.0597
recip_rank      all 0.1578
P_10            all 0.0818
P_100           all 0.0300
P_1000          all 0.0030

refBalRun

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1410
bpref           all 0.1601
recip_rank      all 0.6780
P_10            all 0.2571
P_100           all 0.0729
P_1000          all 0.0073
summary (highrel)
map             all 0.1712
bpref           all 0.1668
recip_rank      all 0.5226
P_10            all 0.1212
P_100           all 0.0294
P_1000          all 0.0029

uogTrLqeabd

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0625
bpref           all 0.0975
recip_rank      all 0.2798
P_10            all 0.1306
P_100           all 0.0894
P_1000          all 0.0216
summary (highrel)
map             all 0.0402
bpref           all 0.0344
recip_rank      all 0.1105
P_10            all 0.0545
P_100           all 0.0391
P_1000          all 0.0073

RunFut

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0988
bpref           all 0.1348
recip_rank      all 0.4681
P_10            all 0.2694
P_100           all 0.1112
P_1000          all 0.0111
summary (highrel)
map             all 0.0506
bpref           all 0.0556
recip_rank      all 0.1913
P_10            all 0.0848
P_100           all 0.0327
P_1000          all 0.0033

LThresh

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1293
bpref           all 0.1459
recip_rank      all 0.6638
P_10            all 0.2653
P_100           all 0.0637
P_1000          all 0.0064
summary (highrel)
map             all 0.1382
bpref           all 0.1471
recip_rank      all 0.4491
P_10            all 0.1212
P_100           all 0.0258
P_1000          all 0.0026

RunAll

Metadata | Participants| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0918
bpref           all 0.1265
recip_rank      all 0.4802
P_10            all 0.2327
P_100           all 0.1063
P_1000          all 0.0106
summary (highrel)
map             all 0.0468
bpref           all 0.0550
recip_rank      all 0.1592
P_10            all 0.0727
P_100           all 0.0279
P_1000          all 0.0028

udelIndri

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.1230
bpref           all 0.1615
recip_rank      all 0.5031
P_10            all 0.3367
P_100           all 0.1200
P_1000          all 0.0120
summary (highrel)
map             all 0.0633
bpref           all 0.0675
recip_rank      all 0.2182
P_10            all 0.1061
P_100           all 0.0318
P_1000          all 0.0032

udelLucene

Metadata | Participants | Proceedings| Input| Summary (highrel) | Summary (allrel)| Appendix

summary (allrel)
map             all 0.0461
bpref           all 0.0622
recip_rank      all 0.3170
P_10            all 0.1673
P_100           all 0.0396
P_1000          all 0.0047
summary (highrel)
map             all 0.0400
bpref           all 0.0394
recip_rank      all 0.1304
P_10            all 0.0788
P_100           all 0.0139
P_1000          all 0.0016