Skip to content

Results - Web 2012

DFalah121A

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.2992
ndcg        all 0.21353
summary (ndeval)
ERR-IA@10       all 0.422218
alpha-nDCG@10   all 0.491037
P-IA@10         all 0.341433
MAP-IA          all 0.105226
summary (trec_eval)
map             all 0.1203
bpref           all 0.1776
recip_rank      all 0.5617
P_10            all 0.4420
P_100           all 0.1394
P_1000          all 0.0160

DFalah121D

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.2992
ndcg        all 0.21353
summary (ndeval)
ERR-IA@10       all 0.422218
alpha-nDCG@10   all 0.491037
P-IA@10         all 0.341433
MAP-IA          all 0.105226
summary (trec_eval)
map             all 0.1203
bpref           all 0.1776
recip_rank      all 0.5617
P_10            all 0.4420
P_100           all 0.1394
P_1000          all 0.0160

DFalah120A

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.24222
ndcg        all 0.20221
summary (ndeval)
ERR-IA@10       all 0.396878
alpha-nDCG@10   all 0.485709
P-IA@10         all 0.359667
MAP-IA          all 0.103895
summary (trec_eval)
map             all 0.1149
bpref           all 0.1669
recip_rank      all 0.5126
P_10            all 0.4420
P_100           all 0.1318
P_1000          all 0.0154

DFalah120D

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.24222
ndcg        all 0.20221
summary (ndeval)
ERR-IA@10       all 0.396878
alpha-nDCG@10   all 0.485709
P-IA@10         all 0.359667
MAP-IA          all 0.103895
summary (trec_eval)
map             all 0.1149
bpref           all 0.1669
recip_rank      all 0.5126
P_10            all 0.4420
P_100           all 0.1318
P_1000          all 0.0154

ICTNET12ADR1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.20753
ndcg        all 0.1162
summary (ndeval)
ERR-IA@10       all 0.338516
alpha-nDCG@10   all 0.410339
P-IA@10         all 0.207933
MAP-IA          all 0.073817
summary (trec_eval)
map             all 0.0908
bpref           all 0.1842
recip_rank      all 0.4960
P_10            all 0.2860
P_100           all 0.1172
P_1000          all 0.0280

ICTNET12DVR1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.13662
ndcg        all 0.09446
summary (ndeval)
ERR-IA@10       all 0.313566
alpha-nDCG@10   all 0.379647
P-IA@10         all 0.192667
MAP-IA          all 0.078727
summary (trec_eval)
map             all 0.0957
bpref           all 0.1818
recip_rank      all 0.4727
P_10            all 0.2520
P_100           all 0.1300
P_1000          all 0.0293

UDInfoDivSt

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.11547
ndcg        all 0.08126
summary (ndeval)
ERR-IA@10       all 0.285043
alpha-nDCG@10   all 0.36705
P-IA@10         all 0.196467
MAP-IA          all 0.057844
summary (trec_eval)
map             all 0.0718
bpref           all 0.1364
recip_rank      all 0.4038
P_10            all 0.2780
P_100           all 0.1218
P_1000          all 0.0188

UDInfoDivC1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.12554
ndcg        all 0.0781
summary (ndeval)
ERR-IA@10       all 0.256354
alpha-nDCG@10   all 0.339767
P-IA@10         all 0.1783
MAP-IA          all 0.054036
summary (trec_eval)
map             all 0.0660
bpref           all 0.1327
recip_rank      all 0.3825
P_10            all 0.2440
P_100           all 0.1218
P_1000          all 0.0188

UDInfoDivC2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.1166
ndcg        all 0.07122
summary (ndeval)
ERR-IA@10       all 0.249926
alpha-nDCG@10   all 0.329026
P-IA@10         all 0.178467
MAP-IA          all 0.054472
summary (trec_eval)
map             all 0.0665
bpref           all 0.1328
recip_rank      all 0.3631
P_10            all 0.2460
P_100           all 0.1218
P_1000          all 0.0188

ICTNET12DVR2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.14514
ndcg        all 0.09319
summary (ndeval)
ERR-IA@10       all 0.307115
alpha-nDCG@10   all 0.37843
P-IA@10         all 0.189533
MAP-IA          all 0.077686
summary (trec_eval)
map             all 0.0946
bpref           all 0.1810
recip_rank      all 0.4663
P_10            all 0.2580
P_100           all 0.1302
P_1000          all 0.0294

QUTparaTQEg1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.24911
ndcg        all 0.19194
summary (ndeval)
ERR-IA@10       all 0.369575
alpha-nDCG@10   all 0.455452
P-IA@10         all 0.316533
MAP-IA          all 0.126207
summary (trec_eval)
map             all 0.1578
bpref           all 0.2356
recip_rank      all 0.4661
P_10            all 0.4240
P_100           all 0.1832
P_1000          all 0.0300

ICTNET12ADR2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.21491
ndcg        all 0.11013
summary (ndeval)
ERR-IA@10       all 0.334656
alpha-nDCG@10   all 0.399805
P-IA@10         all 0.206167
MAP-IA          all 0.068212
summary (trec_eval)
map             all 0.0783
bpref           all 0.1689
recip_rank      all 0.4738
P_10            all 0.2680
P_100           all 0.1138
P_1000          all 0.0267

srchvrs12c10

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.30467
ndcg        all 0.17626
summary (ndeval)
ERR-IA@10       all 0.374437
alpha-nDCG@10   all 0.454236
P-IA@10         all 0.243633
MAP-IA          all 0.092052
summary (trec_eval)
map             all 0.1298
bpref           all 0.2335
recip_rank      all 0.5895
P_10            all 0.3460
P_100           all 0.1580
P_1000          all 0.0339

srchvrs12c09

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.30488
ndcg        all 0.17556
summary (ndeval)
ERR-IA@10       all 0.377717
alpha-nDCG@10   all 0.453887
P-IA@10         all 0.240367
MAP-IA          all 0.088566
summary (trec_eval)
map             all 0.1256
bpref           all 0.2249
recip_rank      all 0.6001
P_10            all 0.3420
P_100           all 0.1562
P_1000          all 0.0321

srchvrs12c00

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.30666
ndcg        all 0.17475
summary (ndeval)
ERR-IA@10       all 0.37714
alpha-nDCG@10   all 0.453186
P-IA@10         all 0.240367
MAP-IA          all 0.087028
summary (trec_eval)
map             all 0.1229
bpref           all 0.2229
recip_rank      all 0.6035
P_10            all 0.3420
P_100           all 0.1540
P_1000          all 0.0311

QUTparaBline

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.29008
ndcg        all 0.167
summary (ndeval)
ERR-IA@10       all 0.408687
alpha-nDCG@10   all 0.494279
P-IA@10         all 0.2687
MAP-IA          all 0.094207
summary (trec_eval)
map             all 0.1173
bpref           all 0.1887
recip_rank      all 0.6049
P_10            all 0.3460
P_100           all 0.1616
P_1000          all 0.0278

ICTNET12DVR3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.14446
ndcg        all 0.09113
summary (ndeval)
ERR-IA@10       all 0.312451
alpha-nDCG@10   all 0.382483
P-IA@10         all 0.193433
MAP-IA          all 0.078448
summary (trec_eval)
map             all 0.0947
bpref           all 0.1816
recip_rank      all 0.4383
P_10            all 0.2560
P_100           all 0.1314
P_1000          all 0.0294

ICTNET12ADR3

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.19832
ndcg        all 0.09341
summary (ndeval)
ERR-IA@10       all 0.32301
alpha-nDCG@10   all 0.382504
P-IA@10         all 0.1769
MAP-IA          all 0.057248
summary (trec_eval)
map             all 0.0612
bpref           all 0.1470
recip_rank      all 0.4522
P_10            all 0.2280
P_100           all 0.1042
P_1000          all 0.0242

lcmweb

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.13344
ndcg        all 0.1306
summary (ndeval)
ERR-IA@10       all 0.307999
alpha-nDCG@10   all 0.376229
P-IA@10         all 0.261233
MAP-IA          all 0.12231
summary (trec_eval)
map             all 0.1653
bpref           all 0.2617
recip_rank      all 0.4344
P_10            all 0.3460
P_100           all 0.1754
P_1000          all 0.0340

lcmweb10p

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.13641
ndcg        all 0.13394
summary (ndeval)
ERR-IA@10       all 0.297512
alpha-nDCG@10   all 0.364331
P-IA@10         all 0.2497
MAP-IA          all 0.117613
summary (trec_eval)
map             all 0.1645
bpref           all 0.2606
recip_rank      all 0.4119
P_10            all 0.3440
P_100           all 0.1764
P_1000          all 0.0346

lcmwebnoW

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.13522
ndcg        all 0.13373
summary (ndeval)
ERR-IA@10       all 0.305527
alpha-nDCG@10   all 0.377328
P-IA@10         all 0.260467
MAP-IA          all 0.120432
summary (trec_eval)
map             all 0.1645
bpref           all 0.2614
recip_rank      all 0.4381
P_10            all 0.3380
P_100           all 0.1756
P_1000          all 0.0341

irra12a

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.16399
ndcg        all 0.13258
summary (ndeval)
ERR-IA@10       all 0.323188
alpha-nDCG@10   all 0.400994
P-IA@10         all 0.269067
MAP-IA          all 0.1227
summary (trec_eval)
map             all 0.1499
bpref           all 0.2265
recip_rank      all 0.4552
P_10            all 0.3580
P_100           all 0.1810
P_1000          all 0.0307

lcm4res

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.14277
ndcg        all 0.14007
summary (ndeval)
ERR-IA@10       all 0.30678
alpha-nDCG@10   all 0.38315
P-IA@10         all 0.2775
MAP-IA          all 0.129389
summary (trec_eval)
map             all 0.1732
bpref           all 0.2706
recip_rank      all 0.4382
P_10            all 0.3640
P_100           all 0.1906
P_1000          all 0.0355

irra12b

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.16502
ndcg        all 0.13252
summary (ndeval)
ERR-IA@10       all 0.324311
alpha-nDCG@10   all 0.4027
P-IA@10         all 0.2719
MAP-IA          all 0.123266
summary (trec_eval)
map             all 0.1506
bpref           all 0.2259
recip_rank      all 0.4548
P_10            all 0.3620
P_100           all 0.1824
P_1000          all 0.0306

irra12c

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.17251
ndcg        all 0.14323
summary (ndeval)
ERR-IA@10       all 0.334452
alpha-nDCG@10   all 0.417076
P-IA@10         all 0.280667
MAP-IA          all 0.121701
summary (trec_eval)
map             all 0.1528
bpref           all 0.2268
recip_rank      all 0.4880
P_10            all 0.3900
P_100           all 0.1780
P_1000          all 0.0288

utw2012lm09

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.21761
ndcg        all 0.12218
summary (ndeval)
ERR-IA@10       all 0.392322
alpha-nDCG@10   all 0.465871
P-IA@10         all 0.202
MAP-IA          all 0.062328
summary (trec_eval)
map             all 0.0705
bpref           all 0.1414
recip_rank      all 0.5321
P_10            all 0.2700
P_100           all 0.1220
P_1000          all 0.0198

utw2012lda

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.21505
ndcg        all 0.1105
summary (ndeval)
ERR-IA@10       all 0.390054
alpha-nDCG@10   all 0.459813
P-IA@10         all 0.188833
MAP-IA          all 0.056346
summary (trec_eval)
map             all 0.0620
bpref           all 0.1379
recip_rank      all 0.5386
P_10            all 0.2540
P_100           all 0.1110
P_1000          all 0.0198

utw2012c1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.2203
ndcg        all 0.12022
summary (ndeval)
ERR-IA@10       all 0.392593
alpha-nDCG@10   all 0.467151
P-IA@10         all 0.208667
MAP-IA          all 0.055495
summary (trec_eval)
map             all 0.0626
bpref           all 0.1404
recip_rank      all 0.5374
P_10            all 0.2820
P_100           all 0.1094
P_1000          all 0.0198

utw2012sc1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.20724
ndcg        all 0.10688
summary (ndeval)
ERR-IA@10       all 0.384633
alpha-nDCG@10   all 0.453746
P-IA@10         all 0.195867
MAP-IA          all 0.055439
summary (trec_eval)
map             all 0.0612
bpref           all 0.1396
recip_rank      all 0.5289
P_10            all 0.2600
P_100           all 0.1100
P_1000          all 0.0198

uogTrA44s9

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.26444
ndcg        all 0.19375
summary (ndeval)
ERR-IA@10       all 0.404198
alpha-nDCG@10   all 0.488697
P-IA@10         all 0.331733
MAP-IA          all 0.159105
summary (trec_eval)
map             all 0.1952
bpref           all 0.2802
recip_rank      all 0.5387
P_10            all 0.4500
P_100           all 0.1998
P_1000          all 0.0387

uogTrA44xi

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.31316
ndcg        all 0.23827
summary (ndeval)
ERR-IA@10       all 0.476514
alpha-nDCG@10   all 0.555626
P-IA@10         all 0.370933
MAP-IA          all 0.172942
summary (trec_eval)
map             all 0.2123
bpref           all 0.2915
recip_rank      all 0.6515
P_10            all 0.5020
P_100           all 0.2054
P_1000          all 0.0387

uogTrA44xu

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.34057
ndcg        all 0.25614
summary (ndeval)
ERR-IA@10       all 0.494441
alpha-nDCG@10   all 0.570116
P-IA@10         all 0.3921
MAP-IA          all 0.174386
summary (trec_eval)
map             all 0.2145
bpref           all 0.2976
recip_rank      all 0.6920
P_10            all 0.5200
P_100           all 0.2058
P_1000          all 0.0387

uogTrA44xl

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.27639
ndcg        all 0.19413
summary (ndeval)
ERR-IA@10       all 0.388502
alpha-nDCG@10   all 0.473708
P-IA@10         all 0.291567
MAP-IA          all 0.149727
summary (trec_eval)
map             all 0.1874
bpref           all 0.2681
recip_rank      all 0.5194
P_10            all 0.4000
P_100           all 0.1980
P_1000          all 0.0365

uogTrB44xu

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.31576
ndcg        all 0.22739
summary (ndeval)
ERR-IA@10       all 0.467213
alpha-nDCG@10   all 0.541544
P-IA@10         all 0.352767
MAP-IA          all 0.170152
summary (trec_eval)
map             all 0.2036
bpref           all 0.2796
recip_rank      all 0.6363
P_10            all 0.4560
P_100           all 0.2194
P_1000          all 0.0354

uogTrB45aIs

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.25543
ndcg        all 0.18312
summary (ndeval)
ERR-IA@10       all 0.413137
alpha-nDCG@10   all 0.488296
P-IA@10         all 0.301267
MAP-IA          all 0.145384
summary (trec_eval)
map             all 0.1757
bpref           all 0.2546
recip_rank      all 0.5241
P_10            all 0.4020
P_100           all 0.2064
P_1000          all 0.0354

utw2012c2

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.21917
ndcg        all 0.11694
summary (ndeval)
ERR-IA@10       all 0.388145
alpha-nDCG@10   all 0.462019
P-IA@10         all 0.197333
MAP-IA          all 0.055207
summary (trec_eval)
map             all 0.0618
bpref           all 0.1384
recip_rank      all 0.5324
P_10            all 0.2680
P_100           all 0.1106
P_1000          all 0.0198

DMthbCatB

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.14556
ndcg        all 0.11058
summary (ndeval)
ERR-IA@10       all 0.246645
alpha-nDCG@10   all 0.313023
P-IA@10         all 0.1858
MAP-IA          all 0.069165
summary (trec_eval)
map             all 0.0868
bpref           all 0.1725
recip_rank      all 0.3741
P_10            all 0.2480
P_100           all 0.1308
P_1000          all 0.0267

DMthbCatASP

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.12183
ndcg        all 0.09641
summary (ndeval)
ERR-IA@10       all 0.249263
alpha-nDCG@10   all 0.311809
P-IA@10         all 0.1884
MAP-IA          all 0.062292
summary (trec_eval)
map             all 0.0803
bpref           all 0.1551
recip_rank      all 0.3539
P_10            all 0.2360
P_100           all 0.1258
P_1000          all 0.0214

manualSTA

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.15548
ndcg        all 0.11271
summary (ndeval)
ERR-IA@10       all 0.288856
alpha-nDCG@10   all 0.360195
P-IA@10         all 0.222733
MAP-IA          all 0.070319
summary (trec_eval)
map             all 0.0922
bpref           all 0.1445
recip_rank      all 0.4001
P_10            all 0.3000
P_100           all 0.1384
P_1000          all 0.0158

autoSTA

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.17346
ndcg        all 0.12725
summary (ndeval)
ERR-IA@10       all 0.315269
alpha-nDCG@10   all 0.384152
P-IA@10         all 0.249633
MAP-IA          all 0.077305
summary (trec_eval)
map             all 0.1037
bpref           all 0.1527
recip_rank      all 0.4156
P_10            all 0.3460
P_100           all 0.1402
P_1000          all 0.0158

autoSTB

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.1729
ndcg        all 0.1317
summary (ndeval)
ERR-IA@10       all 0.302428
alpha-nDCG@10   all 0.365458
P-IA@10         all 0.235933
MAP-IA          all 0.074405
summary (trec_eval)
map             all 0.0918
bpref           all 0.1479
recip_rank      all 0.4427
P_10            all 0.3120
P_100           all 0.1400
P_1000          all 0.0172

qutwa

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.15358
ndcg        all 0.14304
summary (ndeval)
ERR-IA@10       all 0.290568
alpha-nDCG@10   all 0.3535
P-IA@10         all 0.2325
MAP-IA          all 0.104241
summary (trec_eval)
map             all 0.1285
bpref           all 0.2171
recip_rank      all 0.3741
P_10            all 0.3040
P_100           all 0.1416
P_1000          all 0.0273

utw2012fc1

Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.21947
ndcg        all 0.11284
summary (ndeval)
ERR-IA@10       all 0.389477
alpha-nDCG@10   all 0.460852
P-IA@10         all 0.2007
MAP-IA          all 0.053614
summary (trec_eval)
map             all 0.0610
bpref           all 0.1378
recip_rank      all 0.5374
P_10            all 0.2720
P_100           all 0.1096
P_1000          all 0.0198

combMNZCatB

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.13856
ndcg        all 0.11026
summary (ndeval)
ERR-IA@10       all 0.209254
alpha-nDCG@10   all 0.278829
P-IA@10         all 0.1849
MAP-IA          all 0.084446
summary (trec_eval)
map             all 0.1073
bpref           all 0.2062
recip_rank      all 0.2709
P_10            all 0.2380
P_100           all 0.1532
P_1000          all 0.0317

2012bpacad4

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.08914
ndcg        all 0.05677
summary (ndeval)
ERR-IA@10       all 0.118739
alpha-nDCG@10   all 0.167168
P-IA@10         all 0.080033
MAP-IA          all 0.034727
summary (trec_eval)
map             all 0.0433
bpref           all 0.1123
recip_rank      all 0.2110
P_10            all 0.1140
P_100           all 0.0572
P_1000          all 0.0187

2012bpacad8

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.09549
ndcg        all 0.06256
summary (ndeval)
ERR-IA@10       all 0.127099
alpha-nDCG@10   all 0.180399
P-IA@10         all 0.0887
MAP-IA          all 0.03619
summary (trec_eval)
map             all 0.0458
bpref           all 0.1154
recip_rank      all 0.2249
P_10            all 0.1280
P_100           all 0.0568
P_1000          all 0.0187

2012bpacad4h

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.0732
ndcg        all 0.05216
summary (ndeval)
ERR-IA@10       all 0.120223
alpha-nDCG@10   all 0.157451
P-IA@10         all 0.066433
MAP-IA          all 0.034315
summary (trec_eval)
map             all 0.0411
bpref           all 0.1110
recip_rank      all 0.2011
P_10            all 0.0980
P_100           all 0.0620
P_1000          all 0.0191

qutwb

Metadata | Participants| Input| Summary (trec_eval) | Summary (ndeval) | Summary (gdeval)| Appendix

summary (gdeval)
err         all 0.16592
ndcg        all 0.14644
summary (ndeval)
ERR-IA@10       all 0.293273
alpha-nDCG@10   all 0.356859
P-IA@10         all 0.2309
MAP-IA          all 0.103122
summary (trec_eval)
map             all 0.1307
bpref           all 0.2202
recip_rank      all 0.3876
P_10            all 0.3080
P_100           all 0.1422
P_1000          all 0.0273