Results - Web 2014

ICTNET14RSR1

Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-rm-a0-gd) | Summary (risk-rm-a0-nd) | Summary (risk-rm-a5-gd) | Summary (risk-rm-a5-nd) | Summary (risk-terrier-a0-gd) | Summary (risk-terrier-a0-nd) | Summary (risk-terrier-a5-gd) | Summary (risk-terrier-a5-nd)| Appendix

summary (risk-rm-a0-gd)

err         all 0.02951
ndcg        all 0.037

summary (risk-rm-a0-nd)

ERR-IA@10       all 0.05474
alpha-nDCG@10   all 0.070747
P-IA@10         all 0.01819
MAP-IA          all 0.032203

summary (risk-rm-a5-gd)

err         all -0.01702
ndcg        all -0.04349

summary (risk-rm-a5-nd)

ERR-IA@10       all -0.010302
alpha-nDCG@10   all 0.007101
P-IA@10         all -0.147
MAP-IA          all 0.019878

summary (risk-terrier-a0-gd)

err         all -0.00625
ndcg        all 0.02007

summary (risk-terrier-a0-nd)

ERR-IA@10       all 0.027115
alpha-nDCG@10   all 0.034905
P-IA@10         all 0.015357
MAP-IA          all 0.034133

summary (risk-terrier-a5-gd)

err         all -0.25635
ndcg        all -0.16977

summary (risk-terrier-a5-nd)

ERR-IA@10       all -0.249707
alpha-nDCG@10   all -0.22726
P-IA@10         all -0.258952
MAP-IA          all -0.016293

---

ICTNET14RSR2

Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-rm-a0-gd) | Summary (risk-rm-a0-nd) | Summary (risk-rm-a5-gd) | Summary (risk-rm-a5-nd) | Summary (risk-terrier-a0-gd) | Summary (risk-terrier-a0-nd) | Summary (risk-terrier-a5-gd) | Summary (risk-terrier-a5-nd)| Appendix

summary (risk-rm-a0-gd)

err         all 0.03566
ndcg        all 0.04212

summary (risk-rm-a0-nd)

ERR-IA@10       all 0.023702
alpha-nDCG@10   all 0.034995
P-IA@10         all 0.010267
MAP-IA          all 0.106817

summary (risk-rm-a5-gd)

err         all -0.11972
ndcg        all -0.19949

summary (risk-rm-a5-nd)

ERR-IA@10       all -0.528294
alpha-nDCG@10   all -0.447053
P-IA@10         all -0.3784
MAP-IA          all 0.071032

summary (risk-terrier-a0-gd)

err         all -0.00011
ndcg        all 0.02519

summary (risk-terrier-a0-nd)

ERR-IA@10       all -0.003923
alpha-nDCG@10   all -0.000847
P-IA@10         all 0.007433
MAP-IA          all 0.108747

summary (risk-terrier-a5-gd)

err         all -0.18145
ndcg        all -0.18356

summary (risk-terrier-a5-nd)

ERR-IA@10       all -0.471377
alpha-nDCG@10   all -0.409429
P-IA@10         all -0.312781
MAP-IA          all 0.101409

---

ICTNET14RSR3

Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-rm-a0-gd) | Summary (risk-rm-a0-nd) | Summary (risk-rm-a5-gd) | Summary (risk-rm-a5-nd) | Summary (risk-terrier-a0-gd) | Summary (risk-terrier-a0-nd) | Summary (risk-terrier-a5-gd) | Summary (risk-terrier-a5-nd)| Appendix

summary (risk-rm-a0-gd)

err         all 0.05511
ndcg        all 0.01951

summary (risk-rm-a0-nd)

ERR-IA@10       all 0.068302
alpha-nDCG@10   all 0.074431
P-IA@10         all 0.005619
MAP-IA          all -0.017121

summary (risk-rm-a5-gd)

err         all -0.15928
ndcg        all -0.2629

summary (risk-rm-a5-nd)

ERR-IA@10       all -0.370213
alpha-nDCG@10   all -0.312435
P-IA@10         all -0.397357
MAP-IA          all -0.204801

summary (risk-terrier-a0-gd)

err         all 0.01935
ndcg        all 0.00257

summary (risk-terrier-a0-nd)

ERR-IA@10       all 0.040677
alpha-nDCG@10   all 0.038588
P-IA@10         all 0.002786
MAP-IA          all -0.015191

summary (risk-terrier-a5-gd)

err         all -0.20986
ndcg        all -0.27064

summary (risk-terrier-a5-nd)

ERR-IA@10       all -0.342863
alpha-nDCG@10   all -0.303914
P-IA@10         all -0.336548
MAP-IA          all -0.180767

---

UDInfoWebRiskRM

Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-rm-a0-gd) | Summary (risk-rm-a0-nd) | Summary (risk-rm-a5-gd) | Summary (risk-rm-a5-nd) | Summary (risk-terrier-a0-gd) | Summary (risk-terrier-a0-nd) | Summary (risk-terrier-a5-gd) | Summary (risk-terrier-a5-nd)| Appendix

summary (risk-rm-a0-gd)

err         all 0.07439
ndcg        all 0.07331

summary (risk-rm-a0-nd)

ERR-IA@10       all 0.133489
alpha-nDCG@10   all 0.138314
P-IA@10         all 0.087186
MAP-IA          all 0.124138

summary (risk-rm-a5-gd)

err         all -0.07929
ndcg        all -0.15408

summary (risk-rm-a5-nd)

ERR-IA@10       all -0.196168
alpha-nDCG@10   all -0.120242
P-IA@10         all -0.147576
MAP-IA          all 0.110381

summary (risk-terrier-a0-gd)

err         all 0.03863
ndcg        all 0.05637

summary (risk-terrier-a0-nd)

ERR-IA@10       all 0.105864
alpha-nDCG@10   all 0.102472
P-IA@10         all 0.084352
MAP-IA          all 0.126068

summary (risk-terrier-a5-gd)

err         all -0.1273
ndcg        all -0.1743

summary (risk-terrier-a5-nd)

ERR-IA@10       all -0.244419
alpha-nDCG@10   all -0.211696
P-IA@10         all -0.101838
MAP-IA          all 0.090009

---

UDInfoWebRiskTR

Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-rm-a0-gd) | Summary (risk-rm-a0-nd) | Summary (risk-rm-a5-gd) | Summary (risk-rm-a5-nd) | Summary (risk-terrier-a0-gd) | Summary (risk-terrier-a0-nd) | Summary (risk-terrier-a5-gd) | Summary (risk-terrier-a5-nd)| Appendix

summary (risk-rm-a0-gd)

err         all 0.08032
ndcg        all 0.08216

summary (risk-rm-a0-nd)

ERR-IA@10       all 0.134068
alpha-nDCG@10   all 0.139698
P-IA@10         all 0.089433
MAP-IA          all 0.121507

summary (risk-rm-a5-gd)

err         all -0.05661
ndcg        all -0.11251

summary (risk-rm-a5-nd)

ERR-IA@10       all -0.234104
alpha-nDCG@10   all -0.145924
P-IA@10         all -0.159329
MAP-IA          all 0.102014

summary (risk-terrier-a0-gd)

err         all 0.04456
ndcg        all 0.06523

summary (risk-terrier-a0-nd)

ERR-IA@10       all 0.106444
alpha-nDCG@10   all 0.103856
P-IA@10         all 0.0866
MAP-IA          all 0.123437

summary (risk-terrier-a5-gd)

err         all -0.10552
ndcg        all -0.1539

summary (risk-terrier-a5-nd)

ERR-IA@10       all -0.258883
alpha-nDCG@10   all -0.189195
P-IA@10         all -0.09759
MAP-IA          all 0.115287

---

UDInfoWebRiskAX

Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-rm-a0-gd) | Summary (risk-rm-a0-nd) | Summary (risk-rm-a5-gd) | Summary (risk-rm-a5-nd) | Summary (risk-terrier-a0-gd) | Summary (risk-terrier-a0-nd) | Summary (risk-terrier-a5-gd) | Summary (risk-terrier-a5-nd)| Appendix

summary (risk-rm-a0-gd)

err         all 0.07639
ndcg        all 0.07875

summary (risk-rm-a0-nd)

ERR-IA@10       all 0.152873
alpha-nDCG@10   all 0.158601
P-IA@10         all 0.087986
MAP-IA          all 0.057444

summary (risk-rm-a5-gd)

err         all -0.09497
ndcg        all -0.16691

summary (risk-rm-a5-nd)

ERR-IA@10       all -0.181995
alpha-nDCG@10   all -0.102661
P-IA@10         all -0.146776
MAP-IA          all 0.011879

summary (risk-terrier-a0-gd)

err         all 0.04063
ndcg        all 0.06181

summary (risk-terrier-a0-nd)

ERR-IA@10       all 0.125248
alpha-nDCG@10   all 0.122759
P-IA@10         all 0.085152
MAP-IA          all 0.059374

summary (risk-terrier-a5-gd)

err         all -0.13282
ndcg        all -0.17203

summary (risk-terrier-a5-nd)

ERR-IA@10       all -0.202091
alpha-nDCG@10   all -0.142987
P-IA@10         all -0.085038
MAP-IA          all 0.010774

---

wistud.runD

Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-rm-a0-gd) | Summary (risk-rm-a0-nd) | Summary (risk-rm-a5-gd) | Summary (risk-rm-a5-nd) | Summary (risk-terrier-a0-gd) | Summary (risk-terrier-a0-nd) | Summary (risk-terrier-a5-gd) | Summary (risk-terrier-a5-nd)| Appendix

summary (risk-rm-a0-gd)

err         all 0.02034
ndcg        all 0.0113

summary (risk-rm-a0-nd)

ERR-IA@10       all 0.031014
alpha-nDCG@10   all 0.053639
P-IA@10         all 0.005124
MAP-IA          all -0.036589

summary (risk-rm-a5-gd)

err         all -0.15582
ndcg        all -0.22847

summary (risk-rm-a5-nd)

ERR-IA@10       all -0.471774
alpha-nDCG@10   all -0.314552
P-IA@10         all -0.356471
MAP-IA          all -0.296169

summary (risk-terrier-a0-gd)

err         all -0.01542
ndcg        all -0.00563

summary (risk-terrier-a0-nd)

ERR-IA@10       all 0.003389
alpha-nDCG@10   all 0.017797
P-IA@10         all 0.00229
MAP-IA          all -0.034659

summary (risk-terrier-a5-gd)

err         all -0.23495
ndcg        all -0.2567

summary (risk-terrier-a5-nd)

ERR-IA@10       all -0.438559
alpha-nDCG@10   all -0.340203
P-IA@10         all -0.283924
MAP-IA          all -0.274668

---

wistud.runE

Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-rm-a0-gd) | Summary (risk-rm-a0-nd) | Summary (risk-rm-a5-gd) | Summary (risk-rm-a5-nd) | Summary (risk-terrier-a0-gd) | Summary (risk-terrier-a0-nd) | Summary (risk-terrier-a5-gd) | Summary (risk-terrier-a5-nd)| Appendix

summary (risk-rm-a0-gd)

err         all 0.01966
ndcg        all 0.0185

summary (risk-rm-a0-nd)

ERR-IA@10       all 0.031104
alpha-nDCG@10   all 0.038828
P-IA@10         all 0.036186
MAP-IA          all 0.087523

summary (risk-rm-a5-gd)

err         all -0.17293
ndcg        all -0.28871

summary (risk-rm-a5-nd)

ERR-IA@10       all -0.488229
alpha-nDCG@10   all -0.395044
P-IA@10         all -0.2471
MAP-IA          all 0.031676

summary (risk-terrier-a0-gd)

err         all -0.01611
ndcg        all 0.00157

summary (risk-terrier-a0-nd)

ERR-IA@10       all 0.003479
alpha-nDCG@10   all 0.002985
P-IA@10         all 0.033352
MAP-IA          all 0.089453

summary (risk-terrier-a5-gd)

err         all -0.35354
ndcg        all -0.33259

summary (risk-terrier-a5-nd)

ERR-IA@10       all -0.561769
alpha-nDCG@10   all -0.533085
P-IA@10         all -0.367576
MAP-IA          all 0.001565

---

uogTrq1

Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-rm-a0-gd) | Summary (risk-rm-a0-nd) | Summary (risk-rm-a5-gd) | Summary (risk-rm-a5-nd) | Summary (risk-terrier-a0-gd) | Summary (risk-terrier-a0-nd) | Summary (risk-terrier-a5-gd) | Summary (risk-terrier-a5-nd)| Appendix

summary (risk-rm-a0-gd)

err         all 0.03334
ndcg        all 0.04592

summary (risk-rm-a0-nd)

ERR-IA@10       all 0.01864
alpha-nDCG@10   all 0.031647
P-IA@10         all 0.019214
MAP-IA          all 0.080519

summary (risk-rm-a5-gd)

err         all -0.12489
ndcg        all -0.15105

summary (risk-rm-a5-nd)

ERR-IA@10       all -0.494667
alpha-nDCG@10   all -0.409238
P-IA@10         all -0.332571
MAP-IA          all 0.040372

summary (risk-terrier-a0-gd)

err         all -0.00242
ndcg        all 0.02899

summary (risk-terrier-a0-nd)

ERR-IA@10       all -0.008985
alpha-nDCG@10   all -0.004196
P-IA@10         all 0.016381
MAP-IA          all 0.082449

summary (risk-terrier-a5-gd)

err         all -0.22741
ndcg        all -0.23967

summary (risk-terrier-a5-nd)

ERR-IA@10       all -0.475293
alpha-nDCG@10   all -0.423879
P-IA@10         all -0.348214
MAP-IA          all 0.030101

---

uogTrDwsts

Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-rm-a0-gd) | Summary (risk-rm-a0-nd) | Summary (risk-rm-a5-gd) | Summary (risk-rm-a5-nd) | Summary (risk-terrier-a0-gd) | Summary (risk-terrier-a0-nd) | Summary (risk-terrier-a5-gd) | Summary (risk-terrier-a5-nd)| Appendix

summary (risk-rm-a0-gd)

err         all 0.02178
ndcg        all 0.03199

summary (risk-rm-a0-nd)

ERR-IA@10       all 0.021016
alpha-nDCG@10   all 0.039264
P-IA@10         all 0.027924
MAP-IA          all 0.122259

summary (risk-rm-a5-gd)

err         all -0.12092
ndcg        all -0.18569

summary (risk-rm-a5-nd)

ERR-IA@10       all -0.478776
alpha-nDCG@10   all -0.383792
P-IA@10         all -0.275576
MAP-IA          all 0.10107

summary (risk-terrier-a0-gd)

err         all -0.01398
ndcg        all 0.01505

summary (risk-terrier-a0-nd)

ERR-IA@10       all -0.006608
alpha-nDCG@10   all 0.003421
P-IA@10         all 0.02509
MAP-IA          all 0.124189

summary (risk-terrier-a5-gd)

err         all -0.26885
ndcg        all -0.24192

summary (risk-terrier-a5-nd)

ERR-IA@10       all -0.531545
alpha-nDCG@10   all -0.461201
P-IA@10         all -0.327029
MAP-IA          all 0.105145

---

udelCombCAT2

Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-rm-a0-gd) | Summary (risk-rm-a0-nd) | Summary (risk-rm-a5-gd) | Summary (risk-rm-a5-nd) | Summary (risk-terrier-a0-gd) | Summary (risk-terrier-a0-nd) | Summary (risk-terrier-a5-gd) | Summary (risk-terrier-a5-nd)| Appendix

summary (risk-rm-a0-gd)

err         all 0.02584
ndcg        all 0.01849

summary (risk-rm-a0-nd)

ERR-IA@10       all 0.114457
alpha-nDCG@10   all 0.111181
P-IA@10         all 0.05209
MAP-IA          all 0.037277

summary (risk-rm-a5-gd)

err         all -0.11092
ndcg        all -0.16089

summary (risk-rm-a5-nd)

ERR-IA@10       all -0.076689
alpha-nDCG@10   all -0.054376
P-IA@10         all -0.1901
MAP-IA          all 0.009504

summary (risk-terrier-a0-gd)

err         all -0.00992
ndcg        all 0.00156

summary (risk-terrier-a0-nd)

ERR-IA@10       all 0.086832
alpha-nDCG@10   all 0.075338
P-IA@10         all 0.049257
MAP-IA          all 0.039207

summary (risk-terrier-a5-gd)

err         all -0.27713
ndcg        all -0.26068

summary (risk-terrier-a5-nd)

ERR-IA@10       all -0.154254
alpha-nDCG@10   all -0.150452
P-IA@10         all -0.177505
MAP-IA          all -0.015964

---

uogTrBwf

Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-rm-a0-gd) | Summary (risk-rm-a0-nd) | Summary (risk-rm-a5-gd) | Summary (risk-rm-a5-nd) | Summary (risk-terrier-a0-gd) | Summary (risk-terrier-a0-nd) | Summary (risk-terrier-a5-gd) | Summary (risk-terrier-a5-nd)| Appendix

summary (risk-rm-a0-gd)

err         all 0.03463
ndcg        all 0.04073

summary (risk-rm-a0-nd)

ERR-IA@10       all 0.017628
alpha-nDCG@10   all 0.035054
P-IA@10         all 0.014419
MAP-IA          all 0.115837

summary (risk-rm-a5-gd)

err         all -0.13225
ndcg        all -0.16642

summary (risk-rm-a5-nd)

ERR-IA@10       all -0.412694
alpha-nDCG@10   all -0.317774
P-IA@10         all -0.284867
MAP-IA          all 0.093214

summary (risk-terrier-a0-gd)

err         all -0.00113
ndcg        all 0.0238

summary (risk-terrier-a0-nd)

ERR-IA@10       all -0.009997
alpha-nDCG@10   all -0.000788
P-IA@10         all 0.011586
MAP-IA          all 0.117767

summary (risk-terrier-a5-gd)

err         all -0.22992
ndcg        all -0.21494

summary (risk-terrier-a5-nd)

ERR-IA@10       all -0.526194
alpha-nDCG@10   all -0.437724
P-IA@10         all -0.328819
MAP-IA          all 0.096698

---