Results - Web 2011¶
srchvrs11b¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.13145
ndcg all 0.2331
summary (ndeval)
ERR-IA@10 all 0.45036
alpha-nDCG@10 all 0.531223
P-IA@10 all 0.291533
MAP-IA all 0.106055
summary (trec_eval)
map all 0.1098
bpref all 0.1740
recip_rank all 0.5550
P_10 all 0.3520
P_100 all 0.1376
P_1000 all 0.0252
srchvrs11o¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.11224
ndcg all 0.21366
summary (ndeval)
ERR-IA@10 all 0.423117
alpha-nDCG@10 all 0.505601
P-IA@10 all 0.307233
MAP-IA all 0.131736
summary (trec_eval)
map all 0.1251
bpref all 0.1883
recip_rank all 0.5077
P_10 all 0.3480
P_100 all 0.1724
P_1000 all 0.0261
Otago2011cnw¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.0608
ndcg all 0.10868
summary (ndeval)
ERR-IA@10 all 0.220281
alpha-nDCG@10 all 0.258332
P-IA@10 all 0.173633
MAP-IA all 0.050887
summary (trec_eval)
map all 0.0478
bpref all 0.0666
recip_rank all 0.2442
P_10 all 0.1820
P_100 all 0.0660
P_1000 all 0.0075
Otago2011cn¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.09502
ndcg all 0.1707
summary (ndeval)
ERR-IA@10 all 0.298961
alpha-nDCG@10 all 0.378195
P-IA@10 all 0.2408
MAP-IA all 0.088701
summary (trec_eval)
map all 0.0888
bpref all 0.1593
recip_rank all 0.3975
P_10 all 0.2640
P_100 all 0.1324
P_1000 all 0.0249
uogTrA45Vm¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14854
ndcg all 0.30515
summary (ndeval)
ERR-IA@10 all 0.492632
alpha-nDCG@10 all 0.574989
P-IA@10 all 0.329533
MAP-IA all 0.177542
summary (trec_eval)
map all 0.2025
bpref all 0.2830
recip_rank all 0.6259
P_10 all 0.3880
P_100 all 0.1942
P_1000 all 0.0399
uogTrA45Nm¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14813
ndcg all 0.30434
summary (ndeval)
ERR-IA@10 all 0.498365
alpha-nDCG@10 all 0.582311
P-IA@10 all 0.334167
MAP-IA all 0.186261
summary (trec_eval)
map all 0.2087
bpref all 0.2878
recip_rank all 0.6249
P_10 all 0.3880
P_100 all 0.1994
P_1000 all 0.0409
uogTrB47Vm¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.12313
ndcg all 0.22777
summary (ndeval)
ERR-IA@10 all 0.440314
alpha-nDCG@10 all 0.513958
P-IA@10 all 0.296567
MAP-IA all 0.121744
summary (trec_eval)
map all 0.1266
bpref all 0.1864
recip_rank all 0.5518
P_10 all 0.3520
P_100 all 0.1630
P_1000 all 0.0255
uogTrA45Vmx¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14806
ndcg all 0.31088
summary (ndeval)
ERR-IA@10 all 0.513838
alpha-nDCG@10 all 0.595192
P-IA@10 all 0.345467
MAP-IA all 0.185017
summary (trec_eval)
map all 0.2084
bpref all 0.2905
recip_rank all 0.6630
P_10 all 0.3960
P_100 all 0.1998
P_1000 all 0.0399
uogTrA45Nmx2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14767
ndcg all 0.3104
summary (ndeval)
ERR-IA@10 all 0.520663
alpha-nDCG@10 all 0.602502
P-IA@10 all 0.352067
MAP-IA all 0.193291
summary (trec_eval)
map all 0.2141
bpref all 0.2968
recip_rank all 0.6609
P_10 all 0.3940
P_100 all 0.2038
P_1000 all 0.0409
uogTrB47Vmx¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.12524
ndcg all 0.22568
summary (ndeval)
ERR-IA@10 all 0.459373
alpha-nDCG@10 all 0.53777
P-IA@10 all 0.322267
MAP-IA all 0.125455
summary (trec_eval)
map all 0.1249
bpref all 0.1868
recip_rank all 0.5340
P_10 all 0.3660
P_100 all 0.1650
P_1000 all 0.0251
UDPattern¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.09708
ndcg all 0.16054
summary (ndeval)
ERR-IA@10 all 0.344908
alpha-nDCG@10 all 0.404429
P-IA@10 all 0.2431
MAP-IA all 0.072833
summary (trec_eval)
map all 0.0764
bpref all 0.1256
recip_rank all 0.4140
P_10 all 0.2700
P_100 all 0.1274
P_1000 all 0.0189
UDCombine1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.08848
ndcg all 0.16369
summary (ndeval)
ERR-IA@10 all 0.345135
alpha-nDCG@10 all 0.413406
P-IA@10 all 0.245833
MAP-IA all 0.073158
summary (trec_eval)
map all 0.0749
bpref all 0.1213
recip_rank all 0.3950
P_10 all 0.2680
P_100 all 0.1274
P_1000 all 0.0189
UDCombine2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.09545
ndcg all 0.15357
summary (ndeval)
ERR-IA@10 all 0.366443
alpha-nDCG@10 all 0.428817
P-IA@10 all 0.238933
MAP-IA all 0.070255
summary (trec_eval)
map all 0.0711
bpref all 0.1174
recip_rank all 0.4335
P_10 all 0.2580
P_100 all 0.1274
P_1000 all 0.0189
umassIFuse¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.10291
ndcg all 0.20719
summary (ndeval)
ERR-IA@10 all 0.363885
alpha-nDCG@10 all 0.431778
P-IA@10 all 0.294
MAP-IA all 0.141399
summary (trec_eval)
map all 0.1499
bpref all 0.2126
recip_rank all 0.4574
P_10 all 0.3380
P_100 all 0.1564
P_1000 all 0.0332
umassGQdist¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.11728
ndcg all 0.23428
summary (ndeval)
ERR-IA@10 all 0.443293
alpha-nDCG@10 all 0.517416
P-IA@10 all 0.3479
MAP-IA all 0.174557
summary (trec_eval)
map all 0.1832
bpref all 0.2607
recip_rank all 0.5300
P_10 all 0.3840
P_100 all 0.2016
P_1000 all 0.0338
umassGFuse¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.10457
ndcg all 0.22734
summary (ndeval)
ERR-IA@10 all 0.363932
alpha-nDCG@10 all 0.436925
P-IA@10 all 0.308633
MAP-IA all 0.148795
summary (trec_eval)
map all 0.1565
bpref all 0.2265
recip_rank all 0.4397
P_10 all 0.3540
P_100 all 0.1826
P_1000 all 0.0353
UWatMDSql¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14349
ndcg all 0.22097
summary (ndeval)
ERR-IA@10 all 0.441612
alpha-nDCG@10 all 0.5049
P-IA@10 all 0.2838
MAP-IA all 0.138663
summary (trec_eval)
map all 0.1422
bpref all 0.2011
recip_rank all 0.5495
P_10 all 0.3260
P_100 all 0.1796
P_1000 all 0.0336
UWatMDSqlt¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.1444
ndcg all 0.24235
summary (ndeval)
ERR-IA@10 all 0.495122
alpha-nDCG@10 all 0.563513
P-IA@10 all 0.2918
MAP-IA all 0.132957
summary (trec_eval)
map all 0.1349
bpref all 0.1985
recip_rank all 0.6479
P_10 all 0.3420
P_100 all 0.1638
P_1000 all 0.0305
UWatMDSdm¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14137
ndcg all 0.27392
summary (ndeval)
ERR-IA@10 all 0.477236
alpha-nDCG@10 all 0.562325
P-IA@10 all 0.3357
MAP-IA all 0.175501
summary (trec_eval)
map all 0.1860
bpref all 0.2553
recip_rank all 0.5642
P_10 all 0.3820
P_100 all 0.2056
P_1000 all 0.0346
UWatMDSdmsr¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.13791
ndcg all 0.26948
summary (ndeval)
ERR-IA@10 all 0.472264
alpha-nDCG@10 all 0.554845
P-IA@10 all 0.3174
MAP-IA all 0.163411
summary (trec_eval)
map all 0.1784
bpref all 0.2432
recip_rank all 0.5688
P_10 all 0.3880
P_100 all 0.1992
P_1000 all 0.0342
UWatMDSqlsr¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.13689
ndcg all 0.21047
summary (ndeval)
ERR-IA@10 all 0.428984
alpha-nDCG@10 all 0.489202
P-IA@10 all 0.2636
MAP-IA all 0.132973
summary (trec_eval)
map all 0.1389
bpref all 0.1993
recip_rank all 0.5263
P_10 all 0.3060
P_100 all 0.1802
P_1000 all 0.0337
UWatMDSqltsr¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14368
ndcg all 0.23886
summary (ndeval)
ERR-IA@10 all 0.482454
alpha-nDCG@10 all 0.553509
P-IA@10 all 0.279567
MAP-IA all 0.129231
summary (trec_eval)
map all 0.1333
bpref all 0.1961
recip_rank all 0.6311
P_10 all 0.3320
P_100 all 0.1610
P_1000 all 0.0305
liaQEWikiGoo¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.09517
ndcg all 0.22278
summary (ndeval)
ERR-IA@10 all 0.360682
alpha-nDCG@10 all 0.434751
P-IA@10 all 0.301833
MAP-IA all 0.124955
summary (trec_eval)
map all 0.1321
bpref all 0.2076
recip_rank all 0.4302
P_10 all 0.3500
P_100 all 0.1638
P_1000 all 0.0278
liaQEWikiGoA¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.07651
ndcg all 0.19775
summary (ndeval)
ERR-IA@10 all 0.257768
alpha-nDCG@10 all 0.32371
P-IA@10 all 0.227333
MAP-IA all 0.141585
summary (trec_eval)
map all 0.1566
bpref all 0.2807
recip_rank all 0.3432
P_10 all 0.2480
P_100 all 0.1700
P_1000 all 0.0400
liaQEWikiA¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.05189
ndcg all 0.1567
summary (ndeval)
ERR-IA@10 all 0.19851
alpha-nDCG@10 all 0.257591
P-IA@10 all 0.198467
MAP-IA all 0.12025
summary (trec_eval)
map all 0.1323
bpref all 0.2626
recip_rank all 0.2506
P_10 all 0.2200
P_100 all 0.1550
P_1000 all 0.0391
liaQEWikiAnA¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.06064
ndcg all 0.16295
summary (ndeval)
ERR-IA@10 all 0.215179
alpha-nDCG@10 all 0.271518
P-IA@10 all 0.213033
MAP-IA all 0.111763
summary (trec_eval)
map all 0.1218
bpref all 0.2432
recip_rank all 0.2745
P_10 all 0.2540
P_100 all 0.1374
P_1000 all 0.0353
qutir11a¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.04665
ndcg all 0.08702
summary (ndeval)
ERR-IA@10 all 0.175634
alpha-nDCG@10 all 0.231323
P-IA@10 all 0.1134
MAP-IA all 0.026903
summary (trec_eval)
map all 0.0312
bpref all 0.0858
recip_rank all 0.2696
P_10 all 0.1460
P_100 all 0.0716
P_1000 all 0.0123
DFalah11¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.1219
ndcg all 0.20441
summary (ndeval)
ERR-IA@10 all 0.397607
alpha-nDCG@10 all 0.472751
P-IA@10 all 0.2546
MAP-IA all 0.072658
summary (trec_eval)
map all 0.0794
bpref all 0.1224
recip_rank all 0.4783
P_10 all 0.2960
P_100 all 0.1020
P_1000 all 0.0115
qutir11b¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.06859
ndcg all 0.12148
summary (ndeval)
ERR-IA@10 all 0.245472
alpha-nDCG@10 all 0.303872
P-IA@10 all 0.149733
MAP-IA all 0.03712
summary (trec_eval)
map all 0.0469
bpref all 0.0913
recip_rank all 0.3642
P_10 all 0.1940
P_100 all 0.0802
P_1000 all 0.0122
uwBA¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.11854
ndcg all 0.17151
summary (ndeval)
ERR-IA@10 all 0.386714
alpha-nDCG@10 all 0.4496
P-IA@10 all 0.234867
MAP-IA all 0.091243
summary (trec_eval)
map all 0.0785
bpref all 0.1252
recip_rank all 0.4541
P_10 all 0.2420
P_100 all 0.1208
P_1000 all 0.0200
uwExpB¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.08603
ndcg all 0.09257
summary (ndeval)
ERR-IA@10 all 0.310491
alpha-nDCG@10 all 0.344657
P-IA@10 all 0.130733
MAP-IA all 0.042307
summary (trec_eval)
map all 0.0311
bpref all 0.0767
recip_rank all 0.3819
P_10 all 0.1300
P_100 all 0.0700
P_1000 all 0.0155
uwExpAa¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.09604
ndcg all 0.10094
summary (ndeval)
ERR-IA@10 all 0.323241
alpha-nDCG@10 all 0.357151
P-IA@10 all 0.1335
MAP-IA all 0.043044
summary (trec_eval)
map all 0.0320
bpref all 0.0810
recip_rank all 0.4053
P_10 all 0.1480
P_100 all 0.0682
P_1000 all 0.0157
uwExpAadhoc¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.09604
ndcg all 0.10094
summary (ndeval)
ERR-IA@10 all 0.323241
alpha-nDCG@10 all 0.357151
P-IA@10 all 0.1335
MAP-IA all 0.043044
summary (trec_eval)
map all 0.0320
bpref all 0.0810
recip_rank all 0.4053
P_10 all 0.1480
P_100 all 0.0682
P_1000 all 0.0157
uwBAadhoc¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.11854
ndcg all 0.17151
summary (ndeval)
ERR-IA@10 all 0.386714
alpha-nDCG@10 all 0.4496
P-IA@10 all 0.234867
MAP-IA all 0.091243
summary (trec_eval)
map all 0.0785
bpref all 0.1252
recip_rank all 0.4541
P_10 all 0.2420
P_100 all 0.1208
P_1000 all 0.0200
uwBBadhoc¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.11257
ndcg all 0.16802
summary (ndeval)
ERR-IA@10 all 0.373475
alpha-nDCG@10 all 0.438902
P-IA@10 all 0.2263
MAP-IA all 0.089289
summary (trec_eval)
map all 0.0763
bpref all 0.1220
recip_rank all 0.4396
P_10 all 0.2320
P_100 all 0.1150
P_1000 all 0.0199
ICTNET11ADR2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14701
ndcg all 0.28622
summary (ndeval)
ERR-IA@10 all 0.458915
alpha-nDCG@10 all 0.548331
P-IA@10 all 0.328633
MAP-IA all 0.170046
summary (trec_eval)
map all 0.1747
bpref all 0.2560
recip_rank all 0.5604
P_10 all 0.4000
P_100 all 0.1840
P_1000 all 0.0326
UAmsAnc05LS¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.10146
ndcg all 0.15642
summary (ndeval)
ERR-IA@10 all 0.36394
alpha-nDCG@10 all 0.426186
P-IA@10 all 0.2078
MAP-IA all 0.051209
summary (trec_eval)
map all 0.0533
bpref all 0.0874
recip_rank all 0.5016
P_10 all 0.2540
P_100 all 0.0724
P_1000 all 0.0108
UAmsM705tiLS¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.11948
ndcg all 0.20245
summary (ndeval)
ERR-IA@10 all 0.429399
alpha-nDCG@10 all 0.510727
P-IA@10 all 0.264833
MAP-IA all 0.079268
summary (trec_eval)
map all 0.0852
bpref all 0.1369
recip_rank all 0.5577
P_10 all 0.3260
P_100 all 0.1122
P_1000 all 0.0174
UAmsM7DirExS¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.10001
ndcg all 0.13769
summary (ndeval)
ERR-IA@10 all 0.331859
alpha-nDCG@10 all 0.386562
P-IA@10 all 0.186167
MAP-IA all 0.057754
summary (trec_eval)
map all 0.0513
bpref all 0.1032
recip_rank all 0.4397
P_10 all 0.2320
P_100 all 0.0784
P_1000 all 0.0192
CWIcIAt5b1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.10765
ndcg all 0.18148
summary (ndeval)
ERR-IA@10 all 0.3379
alpha-nDCG@10 all 0.40207
P-IA@10 all 0.246967
MAP-IA all 0.094917
summary (trec_eval)
map all 0.0978
bpref all 0.1674
recip_rank all 0.4281
P_10 all 0.2860
P_100 all 0.1374
P_1000 all 0.0297
CWIIAt5b5¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.10327
ndcg all 0.18145
summary (ndeval)
ERR-IA@10 all 0.329026
alpha-nDCG@10 all 0.395154
P-IA@10 all 0.248367
MAP-IA all 0.097004
summary (trec_eval)
map all 0.0975
bpref all 0.1681
recip_rank all 0.4107
P_10 all 0.2760
P_100 all 0.1356
P_1000 all 0.0297
ICTNET11DVR1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14718
ndcg all 0.28107
summary (ndeval)
ERR-IA@10 all 0.462197
alpha-nDCG@10 all 0.54836
P-IA@10 all 0.3179
MAP-IA all 0.159952
summary (trec_eval)
map all 0.1663
bpref all 0.2477
recip_rank all 0.5469
P_10 all 0.3800
P_100 all 0.1780
P_1000 all 0.0327
ICTNET11DVR2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14119
ndcg all 0.25925
summary (ndeval)
ERR-IA@10 all 0.448955
alpha-nDCG@10 all 0.524578
P-IA@10 all 0.283167
MAP-IA all 0.141188
summary (trec_eval)
map all 0.1450
bpref all 0.2387
recip_rank all 0.5394
P_10 all 0.3500
P_100 all 0.1586
P_1000 all 0.0326
ICTNET11ADR3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.15681
ndcg all 0.28261
summary (ndeval)
ERR-IA@10 all 0.450796
alpha-nDCG@10 all 0.539385
P-IA@10 all 0.3113
MAP-IA all 0.16344
summary (trec_eval)
map all 0.1746
bpref all 0.2527
recip_rank all 0.5409
P_10 all 0.3740
P_100 all 0.1868
P_1000 all 0.0330
ICTNET11DVR3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.16656
ndcg all 0.27685
summary (ndeval)
ERR-IA@10 all 0.465112
alpha-nDCG@10 all 0.541025
P-IA@10 all 0.293
MAP-IA all 0.146826
summary (trec_eval)
map all 0.1539
bpref all 0.2427
recip_rank all 0.5781
P_10 all 0.3480
P_100 all 0.1682
P_1000 all 0.0326
CWIcIA2t5b1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.10804
ndcg all 0.18255
summary (ndeval)
ERR-IA@10 all 0.341591
alpha-nDCG@10 all 0.406987
P-IA@10 all 0.251033
MAP-IA all 0.098651
summary (trec_eval)
map all 0.1006
bpref all 0.1705
recip_rank all 0.4337
P_10 all 0.2800
P_100 all 0.1392
P_1000 all 0.0297
bpacad1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.07677
ndcg all 0.15749
summary (ndeval)
ERR-IA@10 all 0.28431
alpha-nDCG@10 all 0.32704
P-IA@10 all 0.2101
MAP-IA all 0.124428
summary (trec_eval)
map all 0.1270
bpref all 0.2125
recip_rank all 0.3393
P_10 all 0.2200
P_100 all 0.1186
P_1000 all 0.0350
UAmsM705FLS¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.11164
ndcg all 0.18157
summary (ndeval)
ERR-IA@10 all 0.411951
alpha-nDCG@10 all 0.481848
P-IA@10 all 0.252667
MAP-IA all 0.075246
summary (trec_eval)
map all 0.0778
bpref all 0.1300
recip_rank all 0.5559
P_10 all 0.3060
P_100 all 0.0978
P_1000 all 0.0195
UAmsT05FLS¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.08178
ndcg all 0.15235
summary (ndeval)
ERR-IA@10 all 0.294105
alpha-nDCG@10 all 0.365881
P-IA@10 all 0.2469
MAP-IA all 0.106005
summary (trec_eval)
map all 0.1026
bpref all 0.1779
recip_rank all 0.3254
P_10 all 0.2360
P_100 all 0.1408
P_1000 all 0.0267
bpacadspam1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.07794
ndcg all 0.16227
summary (ndeval)
ERR-IA@10 all 0.290036
alpha-nDCG@10 all 0.334997
P-IA@10 all 0.2191
MAP-IA all 0.12986
summary (trec_eval)
map all 0.1333
bpref all 0.2160
recip_rank all 0.3400
P_10 all 0.2300
P_100 all 0.1250
P_1000 all 0.0350
bpacadspam2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.07908
ndcg all 0.17761
summary (ndeval)
ERR-IA@10 all 0.28664
alpha-nDCG@10 all 0.333384
P-IA@10 all 0.217433
MAP-IA all 0.126731
summary (trec_eval)
map all 0.1413
bpref all 0.2138
recip_rank all 0.3496
P_10 all 0.2340
P_100 all 0.1232
P_1000 all 0.0340
ICTNET11ADR4¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.11532
ndcg all 0.23419
summary (ndeval)
ERR-IA@10 all 0.362965
alpha-nDCG@10 all 0.444371
P-IA@10 all 0.2446
MAP-IA all 0.089257
summary (trec_eval)
map all 0.0995
bpref all 0.1668
recip_rank all 0.4802
P_10 all 0.3060
P_100 all 0.1088
P_1000 all 0.0182
2011SiftR1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.1177
ndcg all 0.20214
summary (ndeval)
ERR-IA@10 all 0.445888
alpha-nDCG@10 all 0.51932
P-IA@10 all 0.269
MAP-IA all 0.114937
summary (trec_eval)
map all 0.1114
bpref all 0.1744
recip_rank all 0.5617
P_10 all 0.3200
P_100 all 0.1526
P_1000 all 0.0270
2011SiftR2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.1105
ndcg all 0.19532
summary (ndeval)
ERR-IA@10 all 0.430663
alpha-nDCG@10 all 0.504759
P-IA@10 all 0.260267
MAP-IA all 0.111566
summary (trec_eval)
map all 0.1062
bpref all 0.1713
recip_rank all 0.5211
P_10 all 0.3040
P_100 all 0.1522
P_1000 all 0.0268
2011SiftR3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.08183
ndcg all 0.13577
summary (ndeval)
ERR-IA@10 all 0.281206
alpha-nDCG@10 all 0.346761
P-IA@10 all 0.215033
MAP-IA all 0.077859
summary (trec_eval)
map all 0.0741
bpref all 0.1341
recip_rank all 0.3462
P_10 all 0.2300
P_100 all 0.1278
P_1000 all 0.0247
msrsv2011a1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.13966
ndcg all 0.26961
summary (ndeval)
ERR-IA@10 all 0.493292
alpha-nDCG@10 all 0.579804
P-IA@10 all 0.327633
MAP-IA all 0.191709
summary (trec_eval)
map all 0.1832
bpref all 0.2599
recip_rank all 0.5723
P_10 all 0.3720
P_100 all 0.1924
P_1000 all 0.0400
msrsv2011a2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14082
ndcg all 0.26965
summary (ndeval)
ERR-IA@10 all 0.489736
alpha-nDCG@10 all 0.575103
P-IA@10 all 0.327333
MAP-IA all 0.192808
summary (trec_eval)
map all 0.1839
bpref all 0.2585
recip_rank all 0.5725
P_10 all 0.3720
P_100 all 0.1856
P_1000 all 0.0394
msrsv2011a3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14297
ndcg all 0.27252
summary (ndeval)
ERR-IA@10 all 0.472114
alpha-nDCG@10 all 0.54986
P-IA@10 all 0.311133
MAP-IA all 0.174868
summary (trec_eval)
map all 0.1720
bpref all 0.2542
recip_rank all 0.5785
P_10 all 0.3600
P_100 all 0.1654
P_1000 all 0.0390
msrsv2011d1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14082
ndcg all 0.26965
summary (ndeval)
ERR-IA@10 all 0.489736
alpha-nDCG@10 all 0.575103
P-IA@10 all 0.327333
MAP-IA all 0.192808
summary (trec_eval)
map all 0.1839
bpref all 0.2585
recip_rank all 0.5725
P_10 all 0.3720
P_100 all 0.1856
P_1000 all 0.0394
msrsv2011d2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14352
ndcg all 0.25812
summary (ndeval)
ERR-IA@10 all 0.464057
alpha-nDCG@10 all 0.549315
P-IA@10 all 0.302267
MAP-IA all 0.159806
summary (trec_eval)
map all 0.1613
bpref all 0.2487
recip_rank all 0.5667
P_10 all 0.3620
P_100 all 0.1626
P_1000 all 0.0366
msrsv2011d3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.14297
ndcg all 0.27252
summary (ndeval)
ERR-IA@10 all 0.472114
alpha-nDCG@10 all 0.54986
P-IA@10 all 0.311133
MAP-IA all 0.174868
summary (trec_eval)
map all 0.1720
bpref all 0.2542
recip_rank all 0.5785
P_10 all 0.3600
P_100 all 0.1654
P_1000 all 0.0390
UAmsM705tFLS¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix
summary (gdeval)
err all 0.11427
ndcg all 0.18858
summary (ndeval)
ERR-IA@10 all 0.43268
alpha-nDCG@10 all 0.504932
P-IA@10 all 0.258667
MAP-IA all 0.075726
summary (trec_eval)
map all 0.0778
bpref all 0.1238
recip_rank all 0.5731
P_10 all 0.3080
P_100 all 0.0974
P_1000 all 0.0161