Skip to content

Results - Legal 2008

xk

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0752
bpref           all 0.4108
recip_rank      all 0.6763
P_10            all 0.3962
P_100           all 0.1319
P_1000          all 0.0366
summary (adhocH)
map             all 0.0911
bpref           all 0.1978
recip_rank      all 0.4151
P_10            all 0.2000
P_100           all 0.0604
P_1000          all 0.0158

uvabase

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0732
bpref           all 0.4003
recip_rank      all 0.6152
P_10            all 0.3769
P_100           all 0.1296
P_1000          all 0.0359
summary (adhocH)
map             all 0.0898
bpref           all 0.1918
recip_rank      all 0.4019
P_10            all 0.1958
P_100           all 0.0579
P_1000          all 0.0156

xconst

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0752
bpref           all 0.4108
recip_rank      all 0.6763
P_10            all 0.3962
P_100           all 0.1319
P_1000          all 0.0366
summary (adhocH)
map             all 0.0911
bpref           all 0.1978
recip_rank      all 0.4151
P_10            all 0.2000
P_100           all 0.0604
P_1000          all 0.0158

xb

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0752
bpref           all 0.4108
recip_rank      all 0.6763
P_10            all 0.3962
P_100           all 0.1319
P_1000          all 0.0366
summary (adhocH)
map             all 0.0911
bpref           all 0.1978
recip_rank      all 0.4151
P_10            all 0.2000
P_100           all 0.0604
P_1000          all 0.0158

otL08fb

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0767
bpref           all 0.4124
recip_rank      all 0.7658
P_10            all 0.4308
P_100           all 0.1304
P_1000          all 0.0333
summary (adhocH)
map             all 0.0425
bpref           all 0.1599
recip_rank      all 0.2777
P_10            all 0.1250
P_100           all 0.0488
P_1000          all 0.0126

otL08frw

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1394
bpref           all 0.5590
recip_rank      all 0.8683
P_10            all 0.5462
P_100           all 0.1831
P_1000          all 0.0438
summary (adhocH)
map             all 0.1129
bpref           all 0.2444
recip_rank      all 0.4532
P_10            all 0.2292
P_100           all 0.0746
P_1000          all 0.0171

otL08fbe

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0923
bpref           all 0.4919
recip_rank      all 0.7095
P_10            all 0.5038
P_100           all 0.1562
P_1000          all 0.0348
summary (adhocH)
map             all 0.0652
bpref           all 0.1971
recip_rank      all 0.2791
P_10            all 0.2250
P_100           all 0.0621
P_1000          all 0.0133

UrsinusBM25a

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0668
bpref           all 0.4138
recip_rank      all 0.6568
P_10            all 0.4038
P_100           all 0.1431
P_1000          all 0.0368
summary (adhocH)
map             all 0.0918
bpref           all 0.2004
recip_rank      all 0.3867
P_10            all 0.1708
P_100           all 0.0629
P_1000          all 0.0156

otL08rvl

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1174
bpref           all 0.4926
recip_rank      all 0.7056
P_10            all 0.4923
P_100           all 0.1969
P_1000          all 0.0493
summary (adhocH)
map             all 0.1205
bpref           all 0.2292
recip_rank      all 0.4347
P_10            all 0.2667
P_100           all 0.0883
P_1000          all 0.0212

otL08fv

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0967
bpref           all 0.4719
recip_rank      all 0.6170
P_10            all 0.4231
P_100           all 0.1585
P_1000          all 0.0380
summary (adhocH)
map             all 0.0585
bpref           all 0.1514
recip_rank      all 0.1917
P_10            all 0.1167
P_100           all 0.0479
P_1000          all 0.0128

otL08rvlq

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0741
bpref           all 0.4010
recip_rank      all 0.6130
P_10            all 0.3769
P_100           all 0.1400
P_1000          all 0.0325
summary (adhocH)
map             all 0.0793
bpref           all 0.1692
recip_rank      all 0.3199
P_10            all 0.1292
P_100           all 0.0596
P_1000          all 0.0130

otL08rv

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1046
bpref           all 0.4777
recip_rank      all 0.7014
P_10            all 0.4346
P_100           all 0.1858
P_1000          all 0.0440
summary (adhocH)
map             all 0.1302
bpref           all 0.2427
recip_rank      all 0.5006
P_10            all 0.2083
P_100           all 0.0875
P_1000          all 0.0190

UMKCTL08RF2

Metadata | Participants| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1906
bpref           all 0.4799
recip_rank      all 0.7176
P_10            all 0.5667
P_100           all 0.2142
P_1000          all 0.0494
summary (residH)
map             all 0.1201
bpref           all 0.1940
recip_rank      all 0.3515
P_10            all 0.2222
P_100           all 0.1078
P_1000          all 0.0191

UMKCTL08RF1

Metadata | Participants| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1974
bpref           all 0.5167
recip_rank      all 0.7262
P_10            all 0.5417
P_100           all 0.2092
P_1000          all 0.0492
summary (residH)
map             all 0.1246
bpref           all 0.1952
recip_rank      all 0.2505
P_10            all 0.2333
P_100           all 0.1100
P_1000          all 0.0189

UMDSTD

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0963
bpref           all 0.4580
recip_rank      all 0.7359
P_10            all 0.4462
P_100           all 0.1700
P_1000          all 0.0418
summary (adhocH)
map             all 0.0826
bpref           all 0.1964
recip_rank      all 0.3316
P_10            all 0.1750
P_100           all 0.0725
P_1000          all 0.0169

wat1fuse

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1459
bpref           all 0.5542
recip_rank      all 0.8165
P_10            all 0.6115
P_100           all 0.2058
P_1000          all 0.0471
summary (adhocH)
map             all 0.1328
bpref           all 0.2413
recip_rank      all 0.4707
P_10            all 0.2667
P_100           all 0.0842
P_1000          all 0.0181

wat2text

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1049
bpref           all 0.4821
recip_rank      all 0.7429
P_10            all 0.5000
P_100           all 0.1815
P_1000          all 0.0438
summary (adhocH)
map             all 0.0998
bpref           all 0.2049
recip_rank      all 0.3765
P_10            all 0.2417
P_100           all 0.0758
P_1000          all 0.0178

wat3nobool

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0366
bpref           all 0.2118
recip_rank      all 0.7104
P_10            all 0.3654
P_100           all 0.0804
P_1000          all 0.0164
summary (adhocH)
map             all 0.0283
bpref           all 0.0819
recip_rank      all 0.2633
P_10            all 0.1250
P_100           all 0.0263
P_1000          all 0.0047

wat4fuse

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1459
bpref           all 0.5542
recip_rank      all 0.8165
P_10            all 0.6115
P_100           all 0.2058
P_1000          all 0.0471
summary (adhocH)
map             all 0.1328
bpref           all 0.2413
recip_rank      all 0.4707
P_10            all 0.2667
P_100           all 0.0842
P_1000          all 0.0181

wat5fuse

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1459
bpref           all 0.5542
recip_rank      all 0.8165
P_10            all 0.6115
P_100           all 0.2058
P_1000          all 0.0471
summary (adhocH)
map             all 0.1328
bpref           all 0.2413
recip_rank      all 0.4707
P_10            all 0.2667
P_100           all 0.0842
P_1000          all 0.0181

wat6fuse

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1459
bpref           all 0.5542
recip_rank      all 0.8165
P_10            all 0.6115
P_100           all 0.2058
P_1000          all 0.0471
summary (adhocH)
map             all 0.1328
bpref           all 0.2413
recip_rank      all 0.4707
P_10            all 0.2667
P_100           all 0.0842
P_1000          all 0.0181

otRF08fb

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1223
bpref           all 0.3003
recip_rank      all 0.8056
P_10            all 0.4667
P_100           all 0.1742
P_1000          all 0.0327
summary (residH)
map             all 0.1008
bpref           all 0.2100
recip_rank      all 0.3043
P_10            all 0.2000
P_100           all 0.0700
P_1000          all 0.0128

wat8fuse

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1459
bpref           all 0.5542
recip_rank      all 0.8165
P_10            all 0.6115
P_100           all 0.2058
P_1000          all 0.0471
summary (adhocH)
map             all 0.1328
bpref           all 0.2413
recip_rank      all 0.4707
P_10            all 0.2667
P_100           all 0.0842
P_1000          all 0.0181

wat7fuse

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1459
bpref           all 0.5542
recip_rank      all 0.8165
P_10            all 0.6115
P_100           all 0.2058
P_1000          all 0.0471
summary (adhocH)
map             all 0.1328
bpref           all 0.2413
recip_rank      all 0.4707
P_10            all 0.2667
P_100           all 0.0842
P_1000          all 0.0181

UrsinusPwrA

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0419
bpref           all 0.3915
recip_rank      all 0.3947
P_10            all 0.2385
P_100           all 0.1085
P_1000          all 0.0317
summary (adhocH)
map             all 0.0595
bpref           all 0.1816
recip_rank      all 0.2236
P_10            all 0.1250
P_100           all 0.0513
P_1000          all 0.0143

otRF08F

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1333
bpref           all 0.4286
recip_rank      all 0.6669
P_10            all 0.4833
P_100           all 0.1450
P_1000          all 0.0333
summary (residH)
map             all 0.0757
bpref           all 0.1439
recip_rank      all 0.3508
P_10            all 0.1889
P_100           all 0.0700
P_1000          all 0.0127

otRF08fbF

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1458
bpref           all 0.4915
recip_rank      all 0.7322
P_10            all 0.5417
P_100           all 0.1583
P_1000          all 0.0420
summary (residH)
map             all 0.0927
bpref           all 0.2005
recip_rank      all 0.4272
P_10            all 0.1889
P_100           all 0.0756
P_1000          all 0.0177

UrsinusPwrB

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0423
bpref           all 0.4046
recip_rank      all 0.3912
P_10            all 0.2808
P_100           all 0.1019
P_1000          all 0.0293
summary (adhocH)
map             all 0.0595
bpref           all 0.1885
recip_rank      all 0.2203
P_10            all 0.1500
P_100           all 0.0475
P_1000          all 0.0132

otRF08rvl

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1139
bpref           all 0.4157
recip_rank      all 0.5645
P_10            all 0.4167
P_100           all 0.1725
P_1000          all 0.0482
summary (residH)
map             all 0.0771
bpref           all 0.1311
recip_rank      all 0.3604
P_10            all 0.1778
P_100           all 0.0622
P_1000          all 0.0131

CTFggeBkBr0

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0783
bpref           all 0.4945
recip_rank      all 0.5831
P_10            all 0.4346
P_100           all 0.1473
P_1000          all 0.0365
summary (adhocH)
map             all 0.0533
bpref           all 0.1708
recip_rank      all 0.3168
P_10            all 0.1625
P_100           all 0.0558
P_1000          all 0.0133

CTFggeSkBr0

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0783
bpref           all 0.4945
recip_rank      all 0.5831
P_10            all 0.4346
P_100           all 0.1473
P_1000          all 0.0365
summary (adhocH)
map             all 0.0533
bpref           all 0.1708
recip_rank      all 0.3168
P_10            all 0.1625
P_100           all 0.0558
P_1000          all 0.0133

RMITrp2

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1131
bpref           all 0.4724
recip_rank      all 0.7101
P_10            all 0.5077
P_100           all 0.1923
P_1000          all 0.0440
summary (adhocH)
map             all 0.1129
bpref           all 0.2349
recip_rank      all 0.4191
P_10            all 0.2375
P_100           all 0.0846
P_1000          all 0.0189

UrsinusBM25b

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0692
bpref           all 0.4485
recip_rank      all 0.6861
P_10            all 0.4115
P_100           all 0.1377
P_1000          all 0.0358
summary (adhocH)
map             all 0.0996
bpref           all 0.2264
recip_rank      all 0.4235
P_10            all 0.1917
P_100           all 0.0583
P_1000          all 0.0160

UIowa08LegE1

Metadata | Participants| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0145
bpref           all 0.1687
recip_rank      all 0.3249
P_10            all 0.1500
P_100           all 0.0365
P_1000          all 0.0093
summary (adhocH)
map             all 0.0048
bpref           all 0.0619
recip_rank      all 0.0810
P_10            all 0.0375
P_100           all 0.0100
P_1000          all 0.0033

UIowa08LegE2

Metadata | Participants| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0145
bpref           all 0.1687
recip_rank      all 0.3249
P_10            all 0.1500
P_100           all 0.0365
P_1000          all 0.0093
summary (adhocH)
map             all 0.0048
bpref           all 0.0619
recip_rank      all 0.0810
P_10            all 0.0375
P_100           all 0.0100
P_1000          all 0.0033

UIowa08LegE0

Metadata | Participants| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0478
bpref           all 0.3572
recip_rank      all 0.3052
P_10            all 0.2269
P_100           all 0.0923
P_1000          all 0.0238
summary (adhocH)
map             all 0.0561
bpref           all 0.1425
recip_rank      all 0.1464
P_10            all 0.0958
P_100           all 0.0413
P_1000          all 0.0099

UIowa08LegE4

Metadata | Participants| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0000
bpref           all 0.0021
recip_rank      all 0.0009
P_10            all 0.0000
P_100           all 0.0004
P_1000          all 0.0000
summary (adhocH)
map             all 0.0000
bpref           all 0.0000
recip_rank      all 0.0000
P_10            all 0.0000
P_100           all 0.0000
P_1000          all 0.0000

UrsinusPwrC

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0408
bpref           all 0.3910
recip_rank      all 0.3945
P_10            all 0.2423
P_100           all 0.1062
P_1000          all 0.0311
summary (adhocH)
map             all 0.0581
bpref           all 0.1834
recip_rank      all 0.2229
P_10            all 0.1292
P_100           all 0.0488
P_1000          all 0.0138

UCRFBM25BL

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.0604
bpref           all 0.3281
recip_rank      all 0.3667
P_10            all 0.2417
P_100           all 0.1183
P_1000          all 0.0375
summary (residH)
map             all 0.0248
bpref           all 0.0627
recip_rank      all 0.1606
P_10            all 0.0667
P_100           all 0.0367
P_1000          all 0.0094

UCBM25T10Th5

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.0648
bpref           all 0.3391
recip_rank      all 0.4655
P_10            all 0.2917
P_100           all 0.1267
P_1000          all 0.0358
summary (residH)
map             all 0.0308
bpref           all 0.0741
recip_rank      all 0.1259
P_10            all 0.0889
P_100           all 0.0422
P_1000          all 0.0129

UCBM25T5Th5

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.0727
bpref           all 0.3281
recip_rank      all 0.5734
P_10            all 0.3167
P_100           all 0.1208
P_1000          all 0.0348
summary (residH)
map             all 0.0318
bpref           all 0.0805
recip_rank      all 0.1492
P_10            all 0.0778
P_100           all 0.0422
P_1000          all 0.0130

UMDCRP3

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0918
bpref           all 0.4191
recip_rank      all 0.5948
P_10            all 0.3692
P_100           all 0.1385
P_1000          all 0.0374
summary (adhocH)
map             all 0.0759
bpref           all 0.1577
recip_rank      all 0.2103
P_10            all 0.1292
P_100           all 0.0442
P_1000          all 0.0140

UMDAURCP3

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0519
bpref           all 0.3666
recip_rank      all 0.4688
P_10            all 0.2538
P_100           all 0.0731
P_1000          all 0.0217
summary (adhocH)
map             all 0.0414
bpref           all 0.1306
recip_rank      all 0.1954
P_10            all 0.0917
P_100           all 0.0279
P_1000          all 0.0083

UrsinusVa

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0060
bpref           all 0.2189
recip_rank      all 0.1701
P_10            all 0.0538
P_100           all 0.0188
P_1000          all 0.0072
summary (adhocH)
map             all 0.0032
bpref           all 0.0556
recip_rank      all 0.0062
P_10            all 0.0000
P_100           all 0.0071
P_1000          all 0.0026

UMDAURCC40

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0591
bpref           all 0.3914
recip_rank      all 0.4700
P_10            all 0.2538
P_100           all 0.0985
P_1000          all 0.0291
summary (adhocH)
map             all 0.0442
bpref           all 0.1439
recip_rank      all 0.1986
P_10            all 0.0917
P_100           all 0.0358
P_1000          all 0.0108

UMDCRC40

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0934
bpref           all 0.4244
recip_rank      all 0.5948
P_10            all 0.3692
P_100           all 0.1500
P_1000          all 0.0390
summary (adhocH)
map             all 0.0763
bpref           all 0.1662
recip_rank      all 0.2108
P_10            all 0.1292
P_100           all 0.0508
P_1000          all 0.0150

IowaSL08Ref

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0401
bpref           all 0.3527
recip_rank      all 0.4472
P_10            all 0.1962
P_100           all 0.0746
P_1000          all 0.0250
summary (adhocH)
map             all 0.0696
bpref           all 0.1622
recip_rank      all 0.2700
P_10            all 0.0667
P_100           all 0.0308
P_1000          all 0.0103

UCEDLSIa

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0110
bpref           all 0.2455
recip_rank      all 0.1893
P_10            all 0.0692
P_100           all 0.0208
P_1000          all 0.0129
summary (adhocH)
map             all 0.0044
bpref           all 0.0659
recip_rank      all 0.0113
P_10            all 0.0000
P_100           all 0.0063
P_1000          all 0.0049

UMKCTL08RF3

Metadata | Participants| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1961
bpref           all 0.5081
recip_rank      all 0.6467
P_10            all 0.5583
P_100           all 0.2275
P_1000          all 0.0517
summary (residH)
map             all 0.1160
bpref           all 0.1957
recip_rank      all 0.3266
P_10            all 0.2000
P_100           all 0.1211
P_1000          all 0.0200

IowaSL0804

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1426
bpref           all 0.5173
recip_rank      all 0.7167
P_10            all 0.5808
P_100           all 0.1900
P_1000          all 0.0439
summary (adhocH)
map             all 0.0813
bpref           all 0.1707
recip_rank      all 0.2762
P_10            all 0.1792
P_100           all 0.0671
P_1000          all 0.0158

IowaSL0804b

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1500
bpref           all 0.5385
recip_rank      all 0.8004
P_10            all 0.6231
P_100           all 0.1977
P_1000          all 0.0446
summary (adhocH)
map             all 0.1027
bpref           all 0.2027
recip_rank      all 0.3332
P_10            all 0.2250
P_100           all 0.0717
P_1000          all 0.0155

IowaSL0805

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1379
bpref           all 0.5231
recip_rank      all 0.7100
P_10            all 0.5692
P_100           all 0.1912
P_1000          all 0.0448
summary (adhocH)
map             all 0.0818
bpref           all 0.1709
recip_rank      all 0.2815
P_10            all 0.1792
P_100           all 0.0633
P_1000          all 0.0163

SabL08ar2

Metadata | Participants| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0343
bpref           all 0.3415
recip_rank      all 0.4490
P_10            all 0.2500
P_100           all 0.0862
P_1000          all 0.0226
summary (adhocH)
map             all 0.0300
bpref           all 0.1201
recip_rank      all 0.2058
P_10            all 0.1208
P_100           all 0.0417
P_1000          all 0.0085

otRF08fv

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1267
bpref           all 0.4330
recip_rank      all 0.6910
P_10            all 0.3917
P_100           all 0.1825
P_1000          all 0.0459
summary (residH)
map             all 0.0919
bpref           all 0.1613
recip_rank      all 0.2137
P_10            all 0.1667
P_100           all 0.0744
P_1000          all 0.0182

IowaSL0805b

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1495
bpref           all 0.5412
recip_rank      all 0.7933
P_10            all 0.6115
P_100           all 0.2012
P_1000          all 0.0461
summary (adhocH)
map             all 0.1043
bpref           all 0.1999
recip_rank      all 0.3384
P_10            all 0.2292
P_100           all 0.0717
P_1000          all 0.0159

IowaSL0808b

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1474
bpref           all 0.5394
recip_rank      all 0.7875
P_10            all 0.5962
P_100           all 0.1942
P_1000          all 0.0439
summary (adhocH)
map             all 0.1020
bpref           all 0.2007
recip_rank      all 0.2940
P_10            all 0.2167
P_100           all 0.0700
P_1000          all 0.0150

UCRFPwrBL

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.0167
bpref           all 0.2761
recip_rank      all 0.1927
P_10            all 0.0833
P_100           all 0.0383
P_1000          all 0.0202
summary (residH)
map             all 0.0055
bpref           all 0.0171
recip_rank      all 0.0385
P_10            all 0.0111
P_100           all 0.0056
P_1000          all 0.0037

IowaSL0808m2

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1519
bpref           all 0.5421
recip_rank      all 0.8004
P_10            all 0.6269
P_100           all 0.2008
P_1000          all 0.0447
summary (adhocH)
map             all 0.1042
bpref           all 0.2010
recip_rank      all 0.3567
P_10            all 0.2250
P_100           all 0.0721
P_1000          all 0.0153

otRF08frw

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1756
bpref           all 0.5118
recip_rank      all 0.8694
P_10            all 0.6250
P_100           all 0.2050
P_1000          all 0.0488
summary (residH)
map             all 0.1458
bpref           all 0.2407
recip_rank      all 0.4035
P_10            all 0.2444
P_100           all 0.0900
P_1000          all 0.0178

IowaSL0808m3

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1494
bpref           all 0.5419
recip_rank      all 0.8068
P_10            all 0.6269
P_100           all 0.1954
P_1000          all 0.0442
summary (adhocH)
map             all 0.1027
bpref           all 0.2007
recip_rank      all 0.3363
P_10            all 0.2375
P_100           all 0.0696
P_1000          all 0.0151

UIowa08Leg3

Metadata | Participants| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0005
bpref           all 0.0157
recip_rank      all 0.0574
P_10            all 0.0192
P_100           all 0.0035
P_1000          all 0.0004
summary (adhocH)
map             all 0.0001
bpref           all 0.0044
recip_rank      all 0.0084
P_10            all 0.0042
P_100           all 0.0008
P_1000          all 0.0001

UCEDLSIb

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0089
bpref           all 0.2324
recip_rank      all 0.1245
P_10            all 0.0538
P_100           all 0.0227
P_1000          all 0.0135
summary (adhocH)
map             all 0.0045
bpref           all 0.0629
recip_rank      all 0.0089
P_10            all 0.0042
P_100           all 0.0075
P_1000          all 0.0049

UIowa08Lega

Metadata | Participants| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0562
bpref           all 0.4453
recip_rank      all 0.5461
P_10            all 0.3231
P_100           all 0.1031
P_1000          all 0.0298
summary (adhocH)
map             all 0.0298
bpref           all 0.1487
recip_rank      all 0.1813
P_10            all 0.1083
P_100           all 0.0458
P_1000          all 0.0130

IowaSL08RF1B

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1626
bpref           all 0.4829
recip_rank      all 0.7276
P_10            all 0.4917
P_100           all 0.2175
P_1000          all 0.0582
summary (residH)
map             all 0.1638
bpref           all 0.2062
recip_rank      all 0.6972
P_10            all 0.2667
P_100           all 0.0867
P_1000          all 0.0200

UCPwrT5Th5

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.0297
bpref           all 0.2537
recip_rank      all 0.3471
P_10            all 0.2167
P_100           all 0.0658
P_1000          all 0.0224
summary (residH)
map             all 0.0162
bpref           all 0.0488
recip_rank      all 0.0910
P_10            all 0.0667
P_100           all 0.0289
P_1000          all 0.0086

otL08db

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0509
bpref           all 0.1549
recip_rank      all 0.6635
P_10            all 0.3346
P_100           all 0.0796
P_1000          all 0.0154
summary (adhocH)
map             all 0.0450
bpref           all 0.1217
recip_rank      all 0.3348
P_10            all 0.1542
P_100           all 0.0433
P_1000          all 0.0087

IowaSL08RF1A

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1242
bpref           all 0.3846
recip_rank      all 0.4819
P_10            all 0.3250
P_100           all 0.1417
P_1000          all 0.0387
summary (residH)
map             all 0.0726
bpref           all 0.1257
recip_rank      all 0.1863
P_10            all 0.1222
P_100           all 0.0556
P_1000          all 0.0128

SabL08arbn

Metadata | Participants| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0811
bpref           all 0.4421
recip_rank      all 0.6541
P_10            all 0.4500
P_100           all 0.1396
P_1000          all 0.0325
summary (adhocH)
map             all 0.0259
bpref           all 0.1109
recip_rank      all 0.1975
P_10            all 0.0917
P_100           all 0.0400
P_1000          all 0.0104

IowaSL08RF2B

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1190
bpref           all 0.3822
recip_rank      all 0.5986
P_10            all 0.4333
P_100           all 0.1800
P_1000          all 0.0439
summary (residH)
map             all 0.1181
bpref           all 0.1648
recip_rank      all 0.4874
P_10            all 0.2222
P_100           all 0.0700
P_1000          all 0.0167

IowaSL08RF2A

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.0731
bpref           all 0.3570
recip_rank      all 0.4298
P_10            all 0.2417
P_100           all 0.1058
P_1000          all 0.0259
summary (residH)
map             all 0.0547
bpref           all 0.0973
recip_rank      all 0.2345
P_10            all 0.0778
P_100           all 0.0356
P_1000          all 0.0080

IowaSL08RF3B

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1157
bpref           all 0.4474
recip_rank      all 0.7313
P_10            all 0.5250
P_100           all 0.1708
P_1000          all 0.0380
summary (residH)
map             all 0.1174
bpref           all 0.2181
recip_rank      all 0.6771
P_10            all 0.2667
P_100           all 0.0711
P_1000          all 0.0157

otRF08FR

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1333
bpref           all 0.4286
recip_rank      all 0.6669
P_10            all 0.4833
P_100           all 0.1450
P_1000          all 0.0333
summary (residH)
map             all 0.0757
bpref           all 0.1439
recip_rank      all 0.3508
P_10            all 0.1889
P_100           all 0.0700
P_1000          all 0.0127

IowaSL08RF3A

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.0609
bpref           all 0.3618
recip_rank      all 0.3965
P_10            all 0.3250
P_100           all 0.1142
P_1000          all 0.0319
summary (residH)
map             all 0.0644
bpref           all 0.1609
recip_rank      all 0.3138
P_10            all 0.1667
P_100           all 0.0433
P_1000          all 0.0103

IowaSL08RF2C

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.0765
bpref           all 0.3404
recip_rank      all 0.4832
P_10            all 0.3000
P_100           all 0.1075
P_1000          all 0.0252
summary (residH)
map             all 0.0558
bpref           all 0.0930
recip_rank      all 0.2401
P_10            all 0.1222
P_100           all 0.0333
P_1000          all 0.0072

otRF08fbFR

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1458
bpref           all 0.4915
recip_rank      all 0.7322
P_10            all 0.5417
P_100           all 0.1583
P_1000          all 0.0420
summary (residH)
map             all 0.0927
bpref           all 0.2005
recip_rank      all 0.4272
P_10            all 0.1889
P_100           all 0.0756
P_1000          all 0.0177

UCPwrT10Th5

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.0424
bpref           all 0.2852
recip_rank      all 0.3828
P_10            all 0.2750
P_100           all 0.1025
P_1000          all 0.0288
summary (residH)
map             all 0.0136
bpref           all 0.0453
recip_rank      all 0.0707
P_10            all 0.0444
P_100           all 0.0278
P_1000          all 0.0090

IowaSL08RFTr

Metadata | Participants | Proceedings| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1508
bpref           all 0.4242
recip_rank      all 0.6522
P_10            all 0.4917
P_100           all 0.1867
P_1000          all 0.0398
summary (residH)
map             all 0.1464
bpref           all 0.1997
recip_rank      all 0.5791
P_10            all 0.3333
P_100           all 0.1078
P_1000          all 0.0179

SabL08ab1

Metadata | Participants| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0732
bpref           all 0.4461
recip_rank      all 0.6128
P_10            all 0.4192
P_100           all 0.1212
P_1000          all 0.0315
summary (adhocH)
map             all 0.0216
bpref           all 0.1139
recip_rank      all 0.1591
P_10            all 0.0958
P_100           all 0.0338
P_1000          all 0.0100

SabL08rf1

Metadata | Participants| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1748
bpref           all 0.5173
recip_rank      all 0.7525
P_10            all 0.5167
P_100           all 0.1608
P_1000          all 0.0406
summary (residH)
map             all 0.0741
bpref           all 0.1266
recip_rank      all 0.1999
P_10            all 0.1556
P_100           all 0.0700
P_1000          all 0.0143

SabL08rfbase

Metadata | Participants| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.0500
bpref           all 0.3614
recip_rank      all 0.4933
P_10            all 0.2833
P_100           all 0.1075
P_1000          all 0.0343
summary (residH)
map             all 0.0206
bpref           all 0.0699
recip_rank      all 0.2232
P_10            all 0.0778
P_100           all 0.0289
P_1000          all 0.0107

UMKCTL08RF5

Metadata | Participants| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.2091
bpref           all 0.5182
recip_rank      all 0.7302
P_10            all 0.5833
P_100           all 0.2158
P_1000          all 0.0508
summary (residH)
map             all 0.1298
bpref           all 0.1940
recip_rank      all 0.3576
P_10            all 0.2556
P_100           all 0.1078
P_1000          all 0.0194

UMKCTL08RF6

Metadata | Participants| Summary (resid) | Summary (residH)| Appendix

summary (resid)
map             all 0.1938
bpref           all 0.5465
recip_rank      all 0.7718
P_10            all 0.5667
P_100           all 0.1967
P_1000          all 0.0536
summary (residH)
map             all 0.1737
bpref           all 0.2500
recip_rank      all 0.4797
P_10            all 0.3111
P_100           all 0.1156
P_1000          all 0.0192

RMITrp3

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0757
bpref           all 0.4170
recip_rank      all 0.5831
P_10            all 0.3308
P_100           all 0.1412
P_1000          all 0.0379
summary (adhocH)
map             all 0.0783
bpref           all 0.2044
recip_rank      all 0.2946
P_10            all 0.1833
P_100           all 0.0700
P_1000          all 0.0173

RMITbp3

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0573
bpref           all 0.3937
recip_rank      all 0.5503
P_10            all 0.3269
P_100           all 0.1081
P_1000          all 0.0283
summary (adhocH)
map             all 0.0404
bpref           all 0.1268
recip_rank      all 0.2709
P_10            all 0.0958
P_100           all 0.0317
P_1000          all 0.0090

RMITbp2

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0608
bpref           all 0.3927
recip_rank      all 0.5384
P_10            all 0.3538
P_100           all 0.1104
P_1000          all 0.0283
summary (adhocH)
map             all 0.0331
bpref           all 0.1229
recip_rank      all 0.1898
P_10            all 0.0792
P_100           all 0.0304
P_1000          all 0.0089

RMITbp1

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0596
bpref           all 0.3858
recip_rank      all 0.4816
P_10            all 0.3423
P_100           all 0.1135
P_1000          all 0.0276
summary (adhocH)
map             all 0.0315
bpref           all 0.1243
recip_rank      all 0.1922
P_10            all 0.0833
P_100           all 0.0338
P_1000          all 0.0087

RMITrp1

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.1138
bpref           all 0.4726
recip_rank      all 0.7140
P_10            all 0.4923
P_100           all 0.1908
P_1000          all 0.0436
summary (adhocH)
map             all 0.1133
bpref           all 0.2350
recip_rank      all 0.4142
P_10            all 0.2292
P_100           all 0.0850
P_1000          all 0.0192

CTFrtSk

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0607
bpref           all 0.3960
recip_rank      all 0.5676
P_10            all 0.2962
P_100           all 0.1108
P_1000          all 0.0311
summary (adhocH)
map             all 0.0636
bpref           all 0.1437
recip_rank      all 0.2132
P_10            all 0.0958
P_100           all 0.0346
P_1000          all 0.0115

CTFrtSkBr0

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0599
bpref           all 0.4502
recip_rank      all 0.5960
P_10            all 0.3577
P_100           all 0.1123
P_1000          all 0.0301
summary (adhocH)
map             all 0.0498
bpref           all 0.1597
recip_rank      all 0.2871
P_10            all 0.1208
P_100           all 0.0417
P_1000          all 0.0120

CTFgge10kBr0

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0783
bpref           all 0.4945
recip_rank      all 0.5831
P_10            all 0.4346
P_100           all 0.1473
P_1000          all 0.0365
summary (adhocH)
map             all 0.0533
bpref           all 0.1708
recip_rank      all 0.3168
P_10            all 0.1625
P_100           all 0.0558
P_1000          all 0.0133

CTFgge4kBr0

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0783
bpref           all 0.4945
recip_rank      all 0.5831
P_10            all 0.4346
P_100           all 0.1473
P_1000          all 0.0365
summary (adhocH)
map             all 0.0533
bpref           all 0.1708
recip_rank      all 0.3168
P_10            all 0.1625
P_100           all 0.0558
P_1000          all 0.0133

CTFggeRkBr0

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0783
bpref           all 0.4945
recip_rank      all 0.5831
P_10            all 0.4346
P_100           all 0.1473
P_1000          all 0.0365
summary (adhocH)
map             all 0.0533
bpref           all 0.1708
recip_rank      all 0.3168
P_10            all 0.1625
P_100           all 0.0558
P_1000          all 0.0133

CTFggeBkBr1

Metadata | Participants | Proceedings| Summary (adhoc) | Summary (adhocH)| Appendix

summary (adhoc)
map             all 0.0828
bpref           all 0.5013
recip_rank      all 0.5831
P_10            all 0.4346
P_100           all 0.1485
P_1000          all 0.0377
summary (adhocH)
map             all 0.0593
bpref           all 0.1764
recip_rank      all 0.3168
P_10            all 0.1625
P_100           all 0.0575
P_1000          all 0.0138