Results - Web 2013¶
UJS13LCRAd1¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.00077
ndcg all -0.02416
summary (risk-a0-nd)
ERR-IA@10 all 0.0845
alpha-nDCG@10 all 0.080115
P-IA@10 all -1.2e-05
MAP-IA all -0.056197
summary (risk-a1-gd)
err all -0.04165
ndcg all -0.09604
summary (risk-a1-nd)
ERR-IA@10 all -0.017532
alpha-nDCG@10 all -0.023598
P-IA@10 all -0.095674
MAP-IA all -0.121931
summary (risk-a10-gd)
err all -0.42347
ndcg all -0.74289
summary (risk-a10-nd)
ERR-IA@10 all -0.935822
alpha-nDCG@10 all -0.95702
P-IA@10 all -0.956631
MAP-IA all -0.713541
summary (risk-a5-gd)
err all -0.21135
ndcg all -0.38353
summary (risk-a5-nd)
ERR-IA@10 all -0.425661
alpha-nDCG@10 all -0.438452
P-IA@10 all -0.478321
MAP-IA all -0.384869
UJS13LCRAd2¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.01031
ndcg all -0.01987
summary (risk-a0-nd)
ERR-IA@10 all 0.115997
alpha-nDCG@10 all 0.102098
P-IA@10 all 0.004
MAP-IA all -0.048183
summary (risk-a1-gd)
err all -0.0308
ndcg all -0.09149
summary (risk-a1-nd)
ERR-IA@10 all 0.012708
alpha-nDCG@10 all -0.004166
P-IA@10 all -0.0898
MAP-IA all -0.109988
summary (risk-a10-gd)
err all -0.40072
ndcg all -0.73609
summary (risk-a10-nd)
ERR-IA@10 all -0.916898
alpha-nDCG@10 all -0.960542
P-IA@10 all -0.934
MAP-IA all -0.666239
summary (risk-a5-gd)
err all -0.19521
ndcg all -0.37798
summary (risk-a5-nd)
ERR-IA@10 all -0.400451
alpha-nDCG@10 all -0.429222
P-IA@10 all -0.465
MAP-IA all -0.357211
UJS13Risk1¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.00652
ndcg all -0.02221
summary (risk-a0-nd)
ERR-IA@10 all 0.101467
alpha-nDCG@10 all 0.086521
P-IA@10 all -0.007912
MAP-IA all -0.050889
summary (risk-a1-gd)
err all -0.0348
ndcg all -0.09443
summary (risk-a1-nd)
ERR-IA@10 all -0.01774
alpha-nDCG@10 all -0.031381
P-IA@10 all -0.099826
MAP-IA all -0.11233
summary (risk-a10-gd)
err all -0.40671
ndcg all -0.7444
summary (risk-a10-nd)
ERR-IA@10 all -1.090604
alpha-nDCG@10 all -1.092498
P-IA@10 all -0.927055
MAP-IA all -0.665297
summary (risk-a5-gd)
err all -0.20009
ndcg all -0.3833
summary (risk-a5-nd)
ERR-IA@10 all -0.494568
alpha-nDCG@10 all -0.502988
P-IA@10 all -0.467483
MAP-IA all -0.358093
UJS13Risk2¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.01005
ndcg all -0.01415
summary (risk-a0-nd)
ERR-IA@10 all 0.118652
alpha-nDCG@10 all 0.100192
P-IA@10 all 0.017031
MAP-IA all -0.044346
summary (risk-a1-gd)
err all -0.03087
ndcg all -0.08233
summary (risk-a1-nd)
ERR-IA@10 all 0.006502
alpha-nDCG@10 all -0.012339
P-IA@10 all -0.065483
MAP-IA all -0.102725
summary (risk-a10-gd)
err all -0.39913
ndcg all -0.69587
summary (risk-a10-nd)
ERR-IA@10 all -1.002848
alpha-nDCG@10 all -1.025113
P-IA@10 all -0.808112
MAP-IA all -0.628138
summary (risk-a5-gd)
err all -0.19454
ndcg all -0.35501
summary (risk-a5-nd)
ERR-IA@10 all -0.442098
alpha-nDCG@10 all -0.462461
P-IA@10 all -0.39554
MAP-IA all -0.336242
ICTNET13ADR3¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.00031
ndcg all -0.01672
summary (risk-a0-nd)
ERR-IA@10 all 0.099532
alpha-nDCG@10 all 0.091885
P-IA@10 all 0.03795
MAP-IA all -0.017265
summary (risk-a1-gd)
err all -0.03662
ndcg all -0.07923
summary (risk-a1-nd)
ERR-IA@10 all 0.032457
alpha-nDCG@10 all 0.025781
P-IA@10 all -0.0259
MAP-IA all -0.048892
summary (risk-a10-gd)
err all -0.36349
ndcg all -0.64188
summary (risk-a10-nd)
ERR-IA@10 all -0.571212
alpha-nDCG@10 all -0.569151
P-IA@10 all -0.60055
MAP-IA all -0.33353
summary (risk-a5-gd)
err all -0.1819
ndcg all -0.3293
summary (risk-a5-nd)
ERR-IA@10 all -0.23584
alpha-nDCG@10 all -0.238633
P-IA@10 all -0.2813
MAP-IA all -0.175397
webishybrid¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.0036
ndcg all 0.0127
summary (risk-a0-nd)
ERR-IA@10 all 0.009569
alpha-nDCG@10 all 0.008147
P-IA@10 all 0.008374
MAP-IA all 0.02978
summary (risk-a1-gd)
err all -0.04723
ndcg all -0.04702
summary (risk-a1-nd)
ERR-IA@10 all -0.106084
alpha-nDCG@10 all -0.114421
P-IA@10 all -0.070852
MAP-IA all 0.002581
summary (risk-a10-gd)
err all -0.43983
ndcg all -0.58448
summary (risk-a10-nd)
ERR-IA@10 all -1.146968
alpha-nDCG@10 all -1.21753
P-IA@10 all -0.783888
MAP-IA all -0.242211
summary (risk-a5-gd)
err all -0.22172
ndcg all -0.28589
summary (risk-a5-nd)
ERR-IA@10 all -0.568699
alpha-nDCG@10 all -0.604691
P-IA@10 all -0.387757
MAP-IA all -0.106216
webiswikibased¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.00058
ndcg all 0.00998
summary (risk-a0-nd)
ERR-IA@10 all 0.039149
alpha-nDCG@10 all 0.032823
P-IA@10 all 0.00604
MAP-IA all 0.021751
summary (risk-a1-gd)
err all -0.04306
ndcg all -0.04715
summary (risk-a1-nd)
ERR-IA@10 all -0.066234
alpha-nDCG@10 all -0.079234
P-IA@10 all -0.071852
MAP-IA all -0.007094
summary (risk-a10-gd)
err all -0.42532
ndcg all -0.56136
summary (risk-a10-nd)
ERR-IA@10 all -1.014681
alpha-nDCG@10 all -1.087748
P-IA@10 all -0.772888
MAP-IA all -0.2667
summary (risk-a5-gd)
err all -0.21295
ndcg all -0.27569
summary (risk-a5-nd)
ERR-IA@10 all -0.487766
alpha-nDCG@10 all -0.527462
P-IA@10 all -0.383424
MAP-IA all -0.122475
webisnaive¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.00402
ndcg all 0.01038
summary (risk-a0-nd)
ERR-IA@10 all 0.023773
alpha-nDCG@10 all 0.019604
P-IA@10 all 0.009698
MAP-IA all 0.021355
summary (risk-a1-gd)
err all -0.04855
ndcg all -0.04801
summary (risk-a1-nd)
ERR-IA@10 all -0.083555
alpha-nDCG@10 all -0.093471
P-IA@10 all -0.064405
MAP-IA all -0.007967
summary (risk-a10-gd)
err all -0.44938
ndcg all -0.5735
summary (risk-a10-nd)
ERR-IA@10 all -1.049506
alpha-nDCG@10 all -1.111145
P-IA@10 all -0.731326
MAP-IA all -0.27186
summary (risk-a5-gd)
err all -0.2267
ndcg all -0.28156
summary (risk-a5-nd)
ERR-IA@10 all -0.512866
alpha-nDCG@10 all -0.54577
P-IA@10 all -0.360814
MAP-IA all -0.125253
webismixed¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.00104
ndcg all 0.01348
summary (risk-a0-nd)
ERR-IA@10 all 0.067154
alpha-nDCG@10 all 0.052378
P-IA@10 all 0.028317
MAP-IA all 0.028523
summary (risk-a1-gd)
err all -0.03928
ndcg all -0.03926
summary (risk-a1-nd)
ERR-IA@10 all -0.017371
alpha-nDCG@10 all -0.039695
P-IA@10 all -0.0355
MAP-IA all 0.011301
summary (risk-a10-gd)
err all -0.40216
ndcg all -0.51391
summary (risk-a10-nd)
ERR-IA@10 all -0.778097
alpha-nDCG@10 all -0.868354
P-IA@10 all -0.60985
MAP-IA all -0.143701
summary (risk-a5-gd)
err all -0.20056
ndcg all -0.25021
summary (risk-a5-nd)
ERR-IA@10 all -0.355472
alpha-nDCG@10 all -0.407988
P-IA@10 all -0.290767
MAP-IA all -0.057589
webiswtbaseline¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.00396
ndcg all 0.00501
summary (risk-a0-nd)
ERR-IA@10 all 0.031291
alpha-nDCG@10 all 0.022021
P-IA@10 all 0.020417
MAP-IA all 0.020536
summary (risk-a1-gd)
err all -0.04859
ndcg all -0.05459
summary (risk-a1-nd)
ERR-IA@10 all -0.069282
alpha-nDCG@10 all -0.087592
P-IA@10 all -0.046667
MAP-IA all 0.000473
summary (risk-a10-gd)
err all -0.45025
ndcg all -0.59106
summary (risk-a10-nd)
ERR-IA@10 all -0.974438
alpha-nDCG@10 all -1.074107
P-IA@10 all -0.650417
MAP-IA all -0.180102
summary (risk-a5-gd)
err all -0.2271
ndcg all -0.29303
summary (risk-a5-nd)
ERR-IA@10 all -0.471574
alpha-nDCG@10 all -0.526043
P-IA@10 all -0.315
MAP-IA all -0.079783
webisrandom¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.00494
ndcg all 0.01245
summary (risk-a0-nd)
ERR-IA@10 all 0.034622
alpha-nDCG@10 all 0.030852
P-IA@10 all 0.029476
MAP-IA all 0.00687
summary (risk-a1-gd)
err all -0.02907
ndcg all -0.04414
summary (risk-a1-nd)
ERR-IA@10 all -0.057936
alpha-nDCG@10 all -0.060894
P-IA@10 all -0.022981
MAP-IA all -0.01278
summary (risk-a10-gd)
err all -0.33516
ndcg all -0.55343
summary (risk-a10-nd)
ERR-IA@10 all -0.89096
alpha-nDCG@10 all -0.886602
P-IA@10 all -0.495095
MAP-IA all -0.189625
summary (risk-a5-gd)
err all -0.16511
ndcg all -0.27049
summary (risk-a5-nd)
ERR-IA@10 all -0.428169
alpha-nDCG@10 all -0.427875
P-IA@10 all -0.23281
MAP-IA all -0.091378
ICTNET13RSR3¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.0514
ndcg all 0.05414
summary (risk-a0-nd)
ERR-IA@10 all 0.200026
alpha-nDCG@10 all 0.181976
P-IA@10 all 0.100314
MAP-IA all 0.010342
summary (risk-a1-gd)
err all 0.02448
ndcg all 0.00135
summary (risk-a1-nd)
ERR-IA@10 all 0.132341
alpha-nDCG@10 all 0.113806
P-IA@10 all 0.047862
MAP-IA all -0.016154
summary (risk-a10-gd)
err all -0.21781
ndcg all -0.47381
summary (risk-a10-nd)
ERR-IA@10 all -0.476824
alpha-nDCG@10 all -0.499729
P-IA@10 all -0.42421
MAP-IA all -0.254619
summary (risk-a5-gd)
err all -0.0832
ndcg all -0.20983
summary (risk-a5-nd)
ERR-IA@10 all -0.138399
alpha-nDCG@10 all -0.158876
P-IA@10 all -0.161948
MAP-IA all -0.122139
ICTNET13RSR2¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.06174
ndcg all 0.06769
summary (risk-a0-nd)
ERR-IA@10 all 0.142715
alpha-nDCG@10 all 0.124903
P-IA@10 all 0.034069
MAP-IA all -0.002235
summary (risk-a1-gd)
err all 0.02915
ndcg all 0.01123
summary (risk-a1-nd)
ERR-IA@10 all 0.03721
alpha-nDCG@10 all 0.017573
P-IA@10 all -0.057779
MAP-IA all -0.041082
summary (risk-a10-gd)
err all -0.26422
ndcg all -0.49694
summary (risk-a10-nd)
ERR-IA@10 all -0.912331
alpha-nDCG@10 all -0.948398
P-IA@10 all -0.884407
MAP-IA all -0.3907
summary (risk-a5-gd)
err all -0.10124
ndcg all -0.21462
summary (risk-a5-nd)
ERR-IA@10 all -0.384808
alpha-nDCG@10 all -0.411748
P-IA@10 all -0.425169
MAP-IA all -0.196468
ICTNET13ADR2¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.0355
ndcg all 0.06253
summary (risk-a0-nd)
ERR-IA@10 all 0.150549
alpha-nDCG@10 all 0.150322
P-IA@10 all 0.090174
MAP-IA all 0.007732
summary (risk-a1-gd)
err all 0.00755
ndcg all 0.01729
summary (risk-a1-nd)
ERR-IA@10 all 0.091315
alpha-nDCG@10 all 0.090469
P-IA@10 all 0.046464
MAP-IA all -0.019916
summary (risk-a10-gd)
err all -0.24408
ndcg all -0.38983
summary (risk-a10-nd)
ERR-IA@10 all -0.441784
alpha-nDCG@10 all -0.448205
P-IA@10 all -0.346921
MAP-IA all -0.268743
summary (risk-a5-gd)
err all -0.10429
ndcg all -0.16365
summary (risk-a5-nd)
ERR-IA@10 all -0.145618
alpha-nDCG@10 all -0.148942
P-IA@10 all -0.128374
MAP-IA all -0.130506
ICTNET13ADR1¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.03216
ndcg all 0.06033
summary (risk-a0-nd)
ERR-IA@10 all 0.132272
alpha-nDCG@10 all 0.128682
P-IA@10 all 0.077312
MAP-IA all 0.005029
summary (risk-a1-gd)
err all 0.00529
ndcg all 0.0164
summary (risk-a1-nd)
ERR-IA@10 all 0.065739
alpha-nDCG@10 all 0.064331
P-IA@10 all 0.03194
MAP-IA all -0.019462
summary (risk-a10-gd)
err all -0.23661
ndcg all -0.37898
summary (risk-a10-nd)
ERR-IA@10 all -0.533051
alpha-nDCG@10 all -0.514828
P-IA@10 all -0.376402
MAP-IA all -0.239884
summary (risk-a5-gd)
err all -0.10223
ndcg all -0.15933
summary (risk-a5-nd)
ERR-IA@10 all -0.20039
alpha-nDCG@10 all -0.193073
P-IA@10 all -0.149545
MAP-IA all -0.117427
ICTNET13RSR1¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.04819
ndcg all 0.08331
summary (risk-a0-nd)
ERR-IA@10 all 0.176481
alpha-nDCG@10 all 0.173859
P-IA@10 all 0.112117
MAP-IA all 0.009456
summary (risk-a1-gd)
err all 0.01842
ndcg all 0.03855
summary (risk-a1-nd)
ERR-IA@10 all 0.101921
alpha-nDCG@10 all 0.101354
P-IA@10 all 0.057817
MAP-IA all -0.022164
summary (risk-a10-gd)
err all -0.24948
ndcg all -0.36435
summary (risk-a10-nd)
ERR-IA@10 all -0.569114
alpha-nDCG@10 all -0.551191
P-IA@10 all -0.430883
MAP-IA all -0.306745
summary (risk-a5-gd)
err all -0.10065
ndcg all -0.14052
summary (risk-a5-nd)
ERR-IA@10 all -0.196317
alpha-nDCG@10 all -0.188666
P-IA@10 all -0.159383
MAP-IA all -0.148645
cwiwt13cps¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.03218
ndcg all 0.04995
summary (risk-a0-nd)
ERR-IA@10 all 0.130514
alpha-nDCG@10 all 0.115118
P-IA@10 all 0.068557
MAP-IA all 0.073196
summary (risk-a1-gd)
err all 0.00259
ndcg all 0.00425
summary (risk-a1-nd)
ERR-IA@10 all 0.051763
alpha-nDCG@10 all 0.036289
P-IA@10 all 0.010814
MAP-IA all 0.06379
summary (risk-a10-gd)
err all -0.26368
ndcg all -0.40704
summary (risk-a10-nd)
ERR-IA@10 all -0.656992
alpha-nDCG@10 all -0.673167
P-IA@10 all -0.508871
MAP-IA all -0.020864
summary (risk-a5-gd)
err all -0.11575
ndcg all -0.17855
summary (risk-a5-nd)
ERR-IA@10 all -0.263239
alpha-nDCG@10 all -0.279024
P-IA@10 all -0.220157
MAP-IA all 0.026166
cwiwt13cpe¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.0127
ndcg all 0.0228
summary (risk-a0-nd)
ERR-IA@10 all 0.066062
alpha-nDCG@10 all 0.055515
P-IA@10 all 0.022424
MAP-IA all 0.053714
summary (risk-a1-gd)
err all -0.01988
ndcg all -0.02725
summary (risk-a1-nd)
ERR-IA@10 all -0.021668
alpha-nDCG@10 all -0.041159
P-IA@10 all -0.054652
MAP-IA all 0.041623
summary (risk-a10-gd)
err all -0.31315
ndcg all -0.4777
summary (risk-a10-nd)
ERR-IA@10 all -0.811236
alpha-nDCG@10 all -0.91122
P-IA@10 all -0.748338
MAP-IA all -0.067197
summary (risk-a5-gd)
err all -0.15022
ndcg all -0.22745
summary (risk-a5-nd)
ERR-IA@10 all -0.372587
alpha-nDCG@10 all -0.427853
P-IA@10 all -0.362957
MAP-IA all -0.006741
cwiwt13kld¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.01124
ndcg all -0.00341
summary (risk-a0-nd)
ERR-IA@10 all -0.014889
alpha-nDCG@10 all -0.018794
P-IA@10 all -0.002505
MAP-IA all 0.030411
summary (risk-a1-gd)
err all -0.05373
ndcg all -0.06467
summary (risk-a1-nd)
ERR-IA@10 all -0.131776
alpha-nDCG@10 all -0.135814
P-IA@10 all -0.093143
MAP-IA all 0.012388
summary (risk-a10-gd)
err all -0.43609
ndcg all -0.616
summary (risk-a10-nd)
ERR-IA@10 all -1.183764
alpha-nDCG@10 all -1.188989
P-IA@10 all -0.908886
MAP-IA all -0.14982
summary (risk-a5-gd)
err all -0.22367
ndcg all -0.3097
summary (risk-a5-nd)
ERR-IA@10 all -0.599327
alpha-nDCG@10 all -0.603892
P-IA@10 all -0.455695
MAP-IA all -0.059704
clustmrfbf¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.02683
ndcg all 0.03018
summary (risk-a0-nd)
ERR-IA@10 all 0.146777
alpha-nDCG@10 all 0.128339
P-IA@10 all 0.071295
MAP-IA all -0.043683
summary (risk-a1-gd)
err all 0.00016
ndcg all -0.00762
summary (risk-a1-nd)
ERR-IA@10 all 0.08885
alpha-nDCG@10 all 0.061074
P-IA@10 all 0.007243
MAP-IA all -0.096569
summary (risk-a10-gd)
err all -0.23993
ndcg all -0.34782
summary (risk-a10-nd)
ERR-IA@10 all -0.432493
alpha-nDCG@10 all -0.544313
P-IA@10 all -0.569229
MAP-IA all -0.572543
summary (risk-a5-gd)
err all -0.10655
ndcg all -0.15882
summary (risk-a5-nd)
ERR-IA@10 all -0.142858
alpha-nDCG@10 all -0.207987
P-IA@10 all -0.248967
MAP-IA all -0.308113
clustmrfaf¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.08801
ndcg all 0.14186
summary (risk-a0-nd)
ERR-IA@10 all 0.212022
alpha-nDCG@10 all 0.20459
P-IA@10 all 0.18821
MAP-IA all 0.084196
summary (risk-a1-gd)
err all 0.07797
ndcg all 0.12731
summary (risk-a1-nd)
ERR-IA@10 all 0.179219
alpha-nDCG@10 all 0.173171
P-IA@10 all 0.164976
MAP-IA all 0.075651
summary (risk-a10-gd)
err all -0.0124
ndcg all -0.0037
summary (risk-a10-nd)
ERR-IA@10 all -0.116004
alpha-nDCG@10 all -0.109602
P-IA@10 all -0.044124
MAP-IA all -0.001254
summary (risk-a5-gd)
err all 0.03781
ndcg all 0.06908
summary (risk-a5-nd)
ERR-IA@10 all 0.048009
alpha-nDCG@10 all 0.047494
P-IA@10 all 0.072043
MAP-IA all 0.041471
mmrbf¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.02743
ndcg all 0.02617
summary (risk-a0-nd)
ERR-IA@10 all 0.155998
alpha-nDCG@10 all 0.149658
P-IA@10 all 0.074181
MAP-IA all -0.046168
summary (risk-a1-gd)
err all 0.00121
ndcg all -0.01295
summary (risk-a1-nd)
ERR-IA@10 all 0.10486
alpha-nDCG@10 all 0.098126
P-IA@10 all 0.019071
MAP-IA all -0.100742
summary (risk-a10-gd)
err all -0.23481
ndcg all -0.36494
summary (risk-a10-nd)
ERR-IA@10 all -0.355385
alpha-nDCG@10 all -0.365665
P-IA@10 all -0.476914
MAP-IA all -0.591906
summary (risk-a5-gd)
err all -0.10369
ndcg all -0.16939
summary (risk-a5-nd)
ERR-IA@10 all -0.099694
alpha-nDCG@10 all -0.108004
P-IA@10 all -0.201367
MAP-IA all -0.319037
udemQlm1l¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.0349
ndcg all 0.06047
summary (risk-a0-nd)
ERR-IA@10 all 0.117751
alpha-nDCG@10 all 0.101232
P-IA@10 all 0.050257
MAP-IA all 0.040168
summary (risk-a1-gd)
err all 0.00904
ndcg all 0.02919
summary (risk-a1-nd)
ERR-IA@10 all 0.051971
alpha-nDCG@10 all 0.038657
P-IA@10 all 0.008448
MAP-IA all 0.03002
summary (risk-a10-gd)
err all -0.22369
ndcg all -0.25232
summary (risk-a10-nd)
ERR-IA@10 all -0.540049
alpha-nDCG@10 all -0.524525
P-IA@10 all -0.367838
MAP-IA all -0.061319
summary (risk-a5-gd)
err all -0.09439
ndcg all -0.09592
summary (risk-a5-nd)
ERR-IA@10 all -0.211149
alpha-nDCG@10 all -0.211646
P-IA@10 all -0.15879
MAP-IA all -0.010575
udemQlm1lFb¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.01818
ndcg all 0.03926
summary (risk-a0-nd)
ERR-IA@10 all 0.05942
alpha-nDCG@10 all 0.044484
P-IA@10 all 0.037493
MAP-IA all 0.042104
summary (risk-a1-gd)
err all -0.00858
ndcg all 0.00185
summary (risk-a1-nd)
ERR-IA@10 all -0.009626
alpha-nDCG@10 all -0.030696
P-IA@10 all -0.018414
MAP-IA all 0.033439
summary (risk-a10-gd)
err all -0.24944
ndcg all -0.33483
summary (risk-a10-nd)
ERR-IA@10 all -0.631048
alpha-nDCG@10 all -0.707315
P-IA@10 all -0.521579
MAP-IA all -0.044545
summary (risk-a5-gd)
err all -0.11563
ndcg all -0.14779
summary (risk-a5-nd)
ERR-IA@10 all -0.285814
alpha-nDCG@10 all -0.331416
P-IA@10 all -0.242043
MAP-IA all -0.00122
udemQlm1lFbWiki¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.05523
ndcg all 0.08591
summary (risk-a0-nd)
ERR-IA@10 all 0.132587
alpha-nDCG@10 all 0.141284
P-IA@10 all 0.13266
MAP-IA all 0.044093
summary (risk-a1-gd)
err all 0.03428
ndcg all 0.05222
summary (risk-a1-nd)
ERR-IA@10 all 0.073623
alpha-nDCG@10 all 0.084523
P-IA@10 all 0.09626
MAP-IA all 0.026418
summary (risk-a10-gd)
err all -0.15435
ndcg all -0.25102
summary (risk-a10-nd)
ERR-IA@10 all -0.457055
alpha-nDCG@10 all -0.426329
P-IA@10 all -0.23134
MAP-IA all -0.132655
summary (risk-a5-gd)
err all -0.04956
ndcg all -0.08255
summary (risk-a5-nd)
ERR-IA@10 all -0.162234
alpha-nDCG@10 all -0.142522
P-IA@10 all -0.04934
MAP-IA all -0.044281
UDInfolabWEB1¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.01862
ndcg all 0.03667
summary (risk-a0-nd)
ERR-IA@10 all 0.143691
alpha-nDCG@10 all 0.122002
P-IA@10 all 0.104562
MAP-IA all 0.00625
summary (risk-a1-gd)
err all -0.01723
ndcg all -0.01581
summary (risk-a1-nd)
ERR-IA@10 all 0.048471
alpha-nDCG@10 all 0.025398
P-IA@10 all 0.044376
MAP-IA all -0.024151
summary (risk-a10-gd)
err all -0.33988
ndcg all -0.4881
summary (risk-a10-nd)
ERR-IA@10 all -0.80851
alpha-nDCG@10 all -0.844044
P-IA@10 all -0.497295
MAP-IA all -0.297768
summary (risk-a5-gd)
err all -0.16063
ndcg all -0.22572
summary (risk-a5-nd)
ERR-IA@10 all -0.33241
alpha-nDCG@10 all -0.361021
P-IA@10 all -0.196367
MAP-IA all -0.145759
UDInfolabWEB1R¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.01862
ndcg all 0.03667
summary (risk-a0-nd)
ERR-IA@10 all 0.143691
alpha-nDCG@10 all 0.122002
P-IA@10 all 0.104562
MAP-IA all 0.00625
summary (risk-a1-gd)
err all -0.01723
ndcg all -0.01581
summary (risk-a1-nd)
ERR-IA@10 all 0.048471
alpha-nDCG@10 all 0.025398
P-IA@10 all 0.044376
MAP-IA all -0.024151
summary (risk-a10-gd)
err all -0.33988
ndcg all -0.4881
summary (risk-a10-nd)
ERR-IA@10 all -0.80851
alpha-nDCG@10 all -0.844044
P-IA@10 all -0.497295
MAP-IA all -0.297768
summary (risk-a5-gd)
err all -0.16063
ndcg all -0.22572
summary (risk-a5-nd)
ERR-IA@10 all -0.33241
alpha-nDCG@10 all -0.361021
P-IA@10 all -0.196367
MAP-IA all -0.145759
UDInfolabWEB2¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.07926
ndcg all 0.11388
summary (risk-a0-nd)
ERR-IA@10 all 0.232301
alpha-nDCG@10 all 0.211785
P-IA@10 all 0.161121
MAP-IA all 0.023152
summary (risk-a1-gd)
err all 0.06044
ndcg all 0.0891
summary (risk-a1-nd)
ERR-IA@10 all 0.169574
alpha-nDCG@10 all 0.152331
P-IA@10 all 0.122988
MAP-IA all 0.00053
summary (risk-a10-gd)
err all -0.10899
ndcg all -0.13386
summary (risk-a10-nd)
ERR-IA@10 all -0.394967
alpha-nDCG@10 all -0.382762
P-IA@10 all -0.220212
MAP-IA all -0.203067
summary (risk-a5-gd)
err all -0.01486
ndcg all -0.00999
summary (risk-a5-nd)
ERR-IA@10 all -0.081333
alpha-nDCG@10 all -0.085488
P-IA@10 all -0.029545
MAP-IA all -0.089958
UDInfolabWEB2R¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.07926
ndcg all 0.11388
summary (risk-a0-nd)
ERR-IA@10 all 0.232301
alpha-nDCG@10 all 0.211785
P-IA@10 all 0.161121
MAP-IA all 0.023152
summary (risk-a1-gd)
err all 0.06044
ndcg all 0.0891
summary (risk-a1-nd)
ERR-IA@10 all 0.169574
alpha-nDCG@10 all 0.152331
P-IA@10 all 0.122988
MAP-IA all 0.00053
summary (risk-a10-gd)
err all -0.10899
ndcg all -0.13386
summary (risk-a10-nd)
ERR-IA@10 all -0.394967
alpha-nDCG@10 all -0.382762
P-IA@10 all -0.220212
MAP-IA all -0.203067
summary (risk-a5-gd)
err all -0.01486
ndcg all -0.00999
summary (risk-a5-nd)
ERR-IA@10 all -0.081333
alpha-nDCG@10 all -0.085488
P-IA@10 all -0.029545
MAP-IA all -0.089958
UWCWEB13RISK01¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.02192
ndcg all -0.03207
summary (risk-a0-nd)
ERR-IA@10 all -0.054806
alpha-nDCG@10 all -0.055607
P-IA@10 all -0.004636
MAP-IA all -0.015993
summary (risk-a1-gd)
err all -0.06184
ndcg all -0.09286
summary (risk-a1-nd)
ERR-IA@10 all -0.196026
alpha-nDCG@10 all -0.18539
P-IA@10 all -0.079452
MAP-IA all -0.04743
summary (risk-a10-gd)
err all -0.42111
ndcg all -0.64006
summary (risk-a10-nd)
ERR-IA@10 all -1.467007
alpha-nDCG@10 all -1.353436
P-IA@10 all -0.752802
MAP-IA all -0.330366
summary (risk-a5-gd)
err all -0.22152
ndcg all -0.33606
summary (risk-a5-nd)
ERR-IA@10 all -0.760907
alpha-nDCG@10 all -0.704521
P-IA@10 all -0.378719
MAP-IA all -0.173179
dlde¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.08842
ndcg all -0.16095
summary (risk-a0-nd)
ERR-IA@10 all -0.296763
alpha-nDCG@10 all -0.358092
P-IA@10 all -0.25565
MAP-IA all -0.100346
summary (risk-a1-gd)
err all -0.17707
ndcg all -0.3221
summary (risk-a1-nd)
ERR-IA@10 all -0.599137
alpha-nDCG@10 all -0.722717
P-IA@10 all -0.5133
MAP-IA all -0.200692
summary (risk-a10-gd)
err all -0.97496
ndcg all -1.77245
summary (risk-a10-nd)
ERR-IA@10 all -3.320501
alpha-nDCG@10 all -4.004339
P-IA@10 all -2.83215
MAP-IA all -1.103806
summary (risk-a5-gd)
err all -0.53169
ndcg all -0.9667
summary (risk-a5-nd)
ERR-IA@10 all -1.808632
alpha-nDCG@10 all -2.181216
P-IA@10 all -1.5439
MAP-IA all -0.602076
wistud.runA¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.02078
ndcg all 0.02541
summary (risk-a0-nd)
ERR-IA@10 all 0.095883
alpha-nDCG@10 all 0.107061
P-IA@10 all 0.042588
MAP-IA all -0.023017
summary (risk-a1-gd)
err all 0.00567
ndcg all 0.00044
summary (risk-a1-nd)
ERR-IA@10 all 0.060811
alpha-nDCG@10 all 0.075821
P-IA@10 all -0.002067
MAP-IA all -0.058239
summary (risk-a10-gd)
err all -0.1303
ndcg all -0.22431
summary (risk-a10-nd)
ERR-IA@10 all -0.254837
alpha-nDCG@10 all -0.205345
P-IA@10 all -0.40396
MAP-IA all -0.375234
summary (risk-a5-gd)
err all -0.05476
ndcg all -0.09945
summary (risk-a5-nd)
ERR-IA@10 all -0.079477
alpha-nDCG@10 all -0.049142
P-IA@10 all -0.180686
MAP-IA all -0.199126
wistud.runB¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.01044
ndcg all 0.01355
summary (risk-a0-nd)
ERR-IA@10 all 0.110333
alpha-nDCG@10 all 0.112198
P-IA@10 all 0.055119
MAP-IA all -0.024216
summary (risk-a1-gd)
err all -0.00776
ndcg all -0.02117
summary (risk-a1-nd)
ERR-IA@10 all 0.073103
alpha-nDCG@10 all 0.076689
P-IA@10 all 0.007905
MAP-IA all -0.06369
summary (risk-a10-gd)
err all -0.1716
ndcg all -0.33366
summary (risk-a10-nd)
ERR-IA@10 all -0.261972
alpha-nDCG@10 all -0.242894
P-IA@10 all -0.417024
MAP-IA all -0.418951
summary (risk-a5-gd)
err all -0.08058
ndcg all -0.16005
summary (risk-a5-nd)
ERR-IA@10 all -0.075819
alpha-nDCG@10 all -0.065348
P-IA@10 all -0.180952
MAP-IA all -0.221584
UWCWEB13RISK02¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.01148
ndcg all -0.03631
summary (risk-a0-nd)
ERR-IA@10 all -0.026786
alpha-nDCG@10 all -0.042935
P-IA@10 all -0.029879
MAP-IA all -0.032303
summary (risk-a1-gd)
err all -0.04436
ndcg all -0.09332
summary (risk-a1-nd)
ERR-IA@10 all -0.126919
alpha-nDCG@10 all -0.142676
P-IA@10 all -0.105529
MAP-IA all -0.072303
summary (risk-a10-gd)
err all -0.3403
ndcg all -0.60646
summary (risk-a10-nd)
ERR-IA@10 all -1.028113
alpha-nDCG@10 all -1.040348
P-IA@10 all -0.786379
MAP-IA all -0.432301
summary (risk-a5-gd)
err all -0.17589
ndcg all -0.32138
summary (risk-a5-nd)
ERR-IA@10 all -0.52745
alpha-nDCG@10 all -0.541641
P-IA@10 all -0.408129
MAP-IA all -0.232302
wistud.runC¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.00516
ndcg all -0.0136
summary (risk-a0-nd)
ERR-IA@10 all 0.043233
alpha-nDCG@10 all 0.026792
P-IA@10 all 0.018407
MAP-IA all -0.059697
summary (risk-a1-gd)
err all -0.03891
ndcg all -0.08059
summary (risk-a1-nd)
ERR-IA@10 all -0.074265
alpha-nDCG@10 all -0.094872
P-IA@10 all -0.055374
MAP-IA all -0.123293
summary (risk-a10-gd)
err all -0.43558
ndcg all -0.68357
summary (risk-a10-nd)
ERR-IA@10 all -1.131746
alpha-nDCG@10 all -1.18985
P-IA@10 all -0.719402
MAP-IA all -0.695652
summary (risk-a5-gd)
err all -0.21521
ndcg all -0.34858
summary (risk-a5-nd)
ERR-IA@10 all -0.544256
alpha-nDCG@10 all -0.581529
P-IA@10 all -0.350498
MAP-IA all -0.377675
ut22base¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.05146
ndcg all 0.06477
summary (risk-a0-nd)
ERR-IA@10 all 0.16422
alpha-nDCG@10 all 0.158079
P-IA@10 all 0.085279
MAP-IA all 0.003756
summary (risk-a1-gd)
err all 0.02078
ndcg all 0.014
summary (risk-a1-nd)
ERR-IA@10 all 0.07163
alpha-nDCG@10 all 0.067872
P-IA@10 all -0.005043
MAP-IA all -0.038156
summary (risk-a10-gd)
err all -0.25542
ndcg all -0.44301
summary (risk-a10-nd)
ERR-IA@10 all -0.761676
alpha-nDCG@10 all -0.743992
P-IA@10 all -0.817936
MAP-IA all -0.415371
summary (risk-a5-gd)
err all -0.10198
ndcg all -0.18912
summary (risk-a5-nd)
ERR-IA@10 all -0.298728
alpha-nDCG@10 all -0.292956
P-IA@10 all -0.366329
MAP-IA all -0.205807
ut22spam¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.0233
ndcg all 0.02337
summary (risk-a0-nd)
ERR-IA@10 all 0.094862
alpha-nDCG@10 all 0.085427
P-IA@10 all 0.04146
MAP-IA all -0.035833
summary (risk-a1-gd)
err all -0.0131
ndcg all -0.03331
summary (risk-a1-nd)
ERR-IA@10 all -0.031595
alpha-nDCG@10 all -0.042297
P-IA@10 all -0.045798
MAP-IA all -0.090352
summary (risk-a10-gd)
err all -0.3407
ndcg all -0.54345
summary (risk-a10-nd)
ERR-IA@10 all -1.169712
alpha-nDCG@10 all -1.191815
P-IA@10 all -0.831112
MAP-IA all -0.581025
summary (risk-a5-gd)
err all -0.1587
ndcg all -0.26004
summary (risk-a5-nd)
ERR-IA@10 all -0.537425
alpha-nDCG@10 all -0.553194
P-IA@10 all -0.394826
MAP-IA all -0.308429
ut22xact¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.05588
ndcg all 0.05962
summary (risk-a0-nd)
ERR-IA@10 all 0.157039
alpha-nDCG@10 all 0.143959
P-IA@10 all 0.071726
MAP-IA all 0.000442
summary (risk-a1-gd)
err all 0.02299
ndcg all 0.00375
summary (risk-a1-nd)
ERR-IA@10 all 0.063193
alpha-nDCG@10 all 0.046294
P-IA@10 all -0.014048
MAP-IA all -0.044719
summary (risk-a10-gd)
err all -0.27302
ndcg all -0.49906
summary (risk-a10-nd)
ERR-IA@10 all -0.781416
alpha-nDCG@10 all -0.832688
P-IA@10 all -0.786012
MAP-IA all -0.451169
summary (risk-a5-gd)
err all -0.10857
ndcg all -0.21972
summary (risk-a5-nd)
ERR-IA@10 all -0.312189
alpha-nDCG@10 all -0.344365
P-IA@10 all -0.357143
MAP-IA all -0.225364
udemQlml1FbR¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.0187
ndcg all 0.02093
summary (risk-a0-nd)
ERR-IA@10 all 0.120009
alpha-nDCG@10 all 0.098824
P-IA@10 all 0.059871
MAP-IA all 0.010922
summary (risk-a1-gd)
err all 0.00084
ndcg all -0.00757
summary (risk-a1-nd)
ERR-IA@10 all 0.087094
alpha-nDCG@10 all 0.060252
P-IA@10 all 0.030571
MAP-IA all -0.000773
summary (risk-a10-gd)
err all -0.15994
ndcg all -0.26408
summary (risk-a10-nd)
ERR-IA@10 all -0.209146
alpha-nDCG@10 all -0.2869
P-IA@10 all -0.233129
MAP-IA all -0.106025
summary (risk-a5-gd)
err all -0.07062
ndcg all -0.12157
summary (risk-a5-nd)
ERR-IA@10 all -0.044568
alpha-nDCG@10 all -0.094038
P-IA@10 all -0.086629
MAP-IA all -0.047551
udemQlml1R¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.0349
ndcg all 0.06047
summary (risk-a0-nd)
ERR-IA@10 all 0.117751
alpha-nDCG@10 all 0.101232
P-IA@10 all 0.050257
MAP-IA all 0.040168
summary (risk-a1-gd)
err all 0.00904
ndcg all 0.02919
summary (risk-a1-nd)
ERR-IA@10 all 0.051971
alpha-nDCG@10 all 0.038657
P-IA@10 all 0.008448
MAP-IA all 0.03002
summary (risk-a10-gd)
err all -0.22369
ndcg all -0.25232
summary (risk-a10-nd)
ERR-IA@10 all -0.540049
alpha-nDCG@10 all -0.524525
P-IA@10 all -0.367838
MAP-IA all -0.061319
summary (risk-a5-gd)
err all -0.09439
ndcg all -0.09592
summary (risk-a5-nd)
ERR-IA@10 all -0.211149
alpha-nDCG@10 all -0.211646
P-IA@10 all -0.15879
MAP-IA all -0.010575
udemFbWikiR¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.05523
ndcg all 0.08591
summary (risk-a0-nd)
ERR-IA@10 all 0.132587
alpha-nDCG@10 all 0.141284
P-IA@10 all 0.13266
MAP-IA all 0.044093
summary (risk-a1-gd)
err all 0.03428
ndcg all 0.05222
summary (risk-a1-nd)
ERR-IA@10 all 0.073623
alpha-nDCG@10 all 0.084523
P-IA@10 all 0.09626
MAP-IA all 0.026418
summary (risk-a10-gd)
err all -0.15435
ndcg all -0.25102
summary (risk-a10-nd)
ERR-IA@10 all -0.457055
alpha-nDCG@10 all -0.426329
P-IA@10 all -0.23134
MAP-IA all -0.132655
summary (risk-a5-gd)
err all -0.04956
ndcg all -0.08255
summary (risk-a5-nd)
ERR-IA@10 all -0.162234
alpha-nDCG@10 all -0.142522
P-IA@10 all -0.04934
MAP-IA all -0.044281
uogTrAIwLmb¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.06415
ndcg all 0.09125
summary (risk-a0-nd)
ERR-IA@10 all 0.197093
alpha-nDCG@10 all 0.189797
P-IA@10 all 0.106986
MAP-IA all 0.075173
summary (risk-a1-gd)
err all 0.03165
ndcg all 0.04914
summary (risk-a1-nd)
ERR-IA@10 all 0.109761
alpha-nDCG@10 all 0.108263
P-IA@10 all 0.041686
MAP-IA all 0.055949
summary (risk-a10-gd)
err all -0.26086
ndcg all -0.32987
summary (risk-a10-nd)
ERR-IA@10 all -0.676227
alpha-nDCG@10 all -0.625542
P-IA@10 all -0.546014
MAP-IA all -0.117062
summary (risk-a5-gd)
err all -0.09835
ndcg all -0.11931
summary (risk-a5-nd)
ERR-IA@10 all -0.239567
alpha-nDCG@10 all -0.217872
P-IA@10 all -0.219514
MAP-IA all -0.020945
udelCombUD¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.03221
ndcg all 0.04031
summary (risk-a0-nd)
ERR-IA@10 all 0.132014
alpha-nDCG@10 all 0.121
P-IA@10 all 0.078512
MAP-IA all 0.014012
summary (risk-a1-gd)
err all 0.00354
ndcg all -0.00599
summary (risk-a1-nd)
ERR-IA@10 all 0.062746
alpha-nDCG@10 all 0.052912
P-IA@10 all 0.028607
MAP-IA all -0.00728
summary (risk-a10-gd)
err all -0.25447
ndcg all -0.42275
summary (risk-a10-nd)
ERR-IA@10 all -0.560669
alpha-nDCG@10 all -0.559885
P-IA@10 all -0.420536
MAP-IA all -0.1989
summary (risk-a5-gd)
err all -0.11113
ndcg all -0.19122
summary (risk-a5-nd)
ERR-IA@10 all -0.214327
alpha-nDCG@10 all -0.219442
P-IA@10 all -0.171012
MAP-IA all -0.092444
msr_alpha10¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.00166
ndcg all 0.00336
summary (risk-a0-nd)
ERR-IA@10 all 0.00901
alpha-nDCG@10 all 0.017729
P-IA@10 all 0.018998
MAP-IA all -0.007469
summary (risk-a1-gd)
err all -0.01139
ndcg all -0.01366
summary (risk-a1-nd)
ERR-IA@10 all -0.01935
alpha-nDCG@10 all -0.013883
P-IA@10 all -0.007286
MAP-IA all -0.020897
summary (risk-a10-gd)
err all -0.09894
ndcg all -0.16684
summary (risk-a10-nd)
ERR-IA@10 all -0.274591
alpha-nDCG@10 all -0.298392
P-IA@10 all -0.243836
MAP-IA all -0.141748
summary (risk-a5-gd)
err all -0.0503
ndcg all -0.08174
summary (risk-a5-nd)
ERR-IA@10 all -0.132791
alpha-nDCG@10 all -0.140331
P-IA@10 all -0.112419
MAP-IA all -0.074608
msr_alpha5¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.00267
ndcg all 0.00351
summary (risk-a0-nd)
ERR-IA@10 all 0.009515
alpha-nDCG@10 all 0.020694
P-IA@10 all 0.018198
MAP-IA all -0.007979
summary (risk-a1-gd)
err all -0.01337
ndcg all -0.01303
summary (risk-a1-nd)
ERR-IA@10 all -0.020219
alpha-nDCG@10 all -0.01213
P-IA@10 all -0.010886
MAP-IA all -0.021952
summary (risk-a10-gd)
err all -0.10967
ndcg all -0.16191
summary (risk-a10-nd)
ERR-IA@10 all -0.287827
alpha-nDCG@10 all -0.307544
P-IA@10 all -0.272636
MAP-IA all -0.147711
summary (risk-a5-gd)
err all -0.05617
ndcg all -0.0792
summary (risk-a5-nd)
ERR-IA@10 all -0.139156
alpha-nDCG@10 all -0.143425
P-IA@10 all -0.127219
MAP-IA all -0.077845
msr_alpha1¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.00026
ndcg all 0.00576
summary (risk-a0-nd)
ERR-IA@10 all 0.014511
alpha-nDCG@10 all 0.022763
P-IA@10 all 0.019331
MAP-IA all -0.007143
summary (risk-a1-gd)
err all -0.00926
ndcg all -0.01105
summary (risk-a1-nd)
ERR-IA@10 all -0.012706
alpha-nDCG@10 all -0.007578
P-IA@10 all -0.005952
MAP-IA all -0.020555
summary (risk-a10-gd)
err all -0.09019
ndcg all -0.16232
summary (risk-a10-nd)
ERR-IA@10 all -0.25766
alpha-nDCG@10 all -0.28065
P-IA@10 all -0.233502
MAP-IA all -0.141265
summary (risk-a5-gd)
err all -0.04523
ndcg all -0.07828
summary (risk-a5-nd)
ERR-IA@10 all -0.121574
alpha-nDCG@10 all -0.128943
P-IA@10 all -0.107086
MAP-IA all -0.074204
msr_alpha0¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.00169
ndcg all -0.00258
summary (risk-a0-nd)
ERR-IA@10 all -0.001159
alpha-nDCG@10 all 0.003726
P-IA@10 all -0.003983
MAP-IA all -0.015442
summary (risk-a1-gd)
err all -0.01589
ndcg all -0.02647
summary (risk-a1-nd)
ERR-IA@10 all -0.044394
alpha-nDCG@10 all -0.041149
P-IA@10 all -0.045614
MAP-IA all -0.035959
summary (risk-a10-gd)
err all -0.14362
ndcg all -0.24151
summary (risk-a10-nd)
ERR-IA@10 all -0.43351
alpha-nDCG@10 all -0.44502
P-IA@10 all -0.420293
MAP-IA all -0.220619
summary (risk-a5-gd)
err all -0.07266
ndcg all -0.12204
summary (risk-a5-nd)
ERR-IA@10 all -0.217335
alpha-nDCG@10 all -0.220647
P-IA@10 all -0.212138
MAP-IA all -0.11803
udelPseudo1¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.01142
ndcg all 0.01889
summary (risk-a0-nd)
ERR-IA@10 all 0.077027
alpha-nDCG@10 all 0.070585
P-IA@10 all 0.032995
MAP-IA all 0.012328
summary (risk-a1-gd)
err all -0.02047
ndcg all -0.03228
summary (risk-a1-nd)
ERR-IA@10 all -0.024149
alpha-nDCG@10 all -0.033922
P-IA@10 all -0.04299
MAP-IA all -0.011653
summary (risk-a10-gd)
err all -0.30754
ndcg all -0.49286
summary (risk-a10-nd)
ERR-IA@10 all -0.934735
alpha-nDCG@10 all -0.974488
P-IA@10 all -0.726862
MAP-IA all -0.227484
summary (risk-a5-gd)
err all -0.14806
ndcg all -0.23699
summary (risk-a5-nd)
ERR-IA@10 all -0.428854
alpha-nDCG@10 all -0.451952
P-IA@10 all -0.346933
MAP-IA all -0.107578
udelPseudo2¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.05277
ndcg all 0.0762
summary (risk-a0-nd)
ERR-IA@10 all 0.189085
alpha-nDCG@10 all 0.195887
P-IA@10 all 0.107855
MAP-IA all 0.031863
summary (risk-a1-gd)
err all 0.02689
ndcg all 0.03872
summary (risk-a1-nd)
ERR-IA@10 all 0.108352
alpha-nDCG@10 all 0.133199
P-IA@10 all 0.053521
MAP-IA all 0.011852
summary (risk-a10-gd)
err all -0.20603
ndcg all -0.29857
summary (risk-a10-nd)
ERR-IA@10 all -0.618242
alpha-nDCG@10 all -0.430997
P-IA@10 all -0.435479
MAP-IA all -0.168245
summary (risk-a5-gd)
err all -0.07663
ndcg all -0.11119
summary (risk-a5-nd)
ERR-IA@10 all -0.214578
alpha-nDCG@10 all -0.117555
P-IA@10 all -0.163812
MAP-IA all -0.068191
msr_alpha0_95_4¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.00034
ndcg all 0.00687
summary (risk-a0-nd)
ERR-IA@10 all 0.015577
alpha-nDCG@10 all 0.027936
P-IA@10 all 0.026531
MAP-IA all -0.007302
summary (risk-a1-gd)
err all -0.00833
ndcg all -0.00794
summary (risk-a1-nd)
ERR-IA@10 all -0.01221
alpha-nDCG@10 all -0.000178
P-IA@10 all 0.006448
MAP-IA all -0.020985
summary (risk-a10-gd)
err all -0.08643
ndcg all -0.14124
summary (risk-a10-nd)
ERR-IA@10 all -0.262299
alpha-nDCG@10 all -0.253205
P-IA@10 all -0.174302
MAP-IA all -0.144138
summary (risk-a5-gd)
err all -0.04304
ndcg all -0.06718
summary (risk-a5-nd)
ERR-IA@10 all -0.123361
alpha-nDCG@10 all -0.112635
P-IA@10 all -0.073886
MAP-IA all -0.07572
udelManExp¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.06112
ndcg all 0.07753
summary (risk-a0-nd)
ERR-IA@10 all 0.167838
alpha-nDCG@10 all 0.156665
P-IA@10 all 0.101807
MAP-IA all 0.033625
summary (risk-a1-gd)
err all 0.04668
ndcg all 0.05234
summary (risk-a1-nd)
ERR-IA@10 all 0.133634
alpha-nDCG@10 all 0.118592
P-IA@10 all 0.055736
MAP-IA all 0.018369
summary (risk-a10-gd)
err all -0.08328
ndcg all -0.17435
summary (risk-a10-nd)
ERR-IA@10 all -0.1742
alpha-nDCG@10 all -0.224065
P-IA@10 all -0.358907
MAP-IA all -0.118934
summary (risk-a5-gd)
err all -0.01108
ndcg all -0.04841
summary (risk-a5-nd)
ERR-IA@10 all -0.003181
alpha-nDCG@10 all -0.0337
P-IA@10 all -0.12855
MAP-IA all -0.042654
uogTrBDnLmxw¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.02405
ndcg all 0.00268
summary (risk-a0-nd)
ERR-IA@10 all 0.183254
alpha-nDCG@10 all 0.171429
P-IA@10 all 0.051569
MAP-IA all -0.039165
summary (risk-a1-gd)
err all -0.01016
ndcg all -0.05409
summary (risk-a1-nd)
ERR-IA@10 all 0.109839
alpha-nDCG@10 all 0.102277
P-IA@10 all -0.011745
MAP-IA all -0.095606
summary (risk-a10-gd)
err all -0.31808
ndcg all -0.56505
summary (risk-a10-nd)
ERR-IA@10 all -0.550901
alpha-nDCG@10 all -0.520094
P-IA@10 all -0.581574
MAP-IA all -0.603579
summary (risk-a5-gd)
err all -0.14701
ndcg all -0.28118
summary (risk-a5-nd)
ERR-IA@10 all -0.183823
alpha-nDCG@10 all -0.174332
P-IA@10 all -0.265002
MAP-IA all -0.321372
uogTrAS2Lb¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.05066
ndcg all 0.07107
summary (risk-a0-nd)
ERR-IA@10 all 0.164415
alpha-nDCG@10 all 0.158846
P-IA@10 all 0.100179
MAP-IA all 0.060422
summary (risk-a1-gd)
err all 0.01505
ndcg all 0.02003
summary (risk-a1-nd)
ERR-IA@10 all 0.067309
alpha-nDCG@10 all 0.067351
P-IA@10 all 0.026905
MAP-IA all 0.038425
summary (risk-a10-gd)
err all -0.30543
ndcg all -0.4393
summary (risk-a10-nd)
ERR-IA@10 all -0.806648
alpha-nDCG@10 all -0.75611
P-IA@10 all -0.63256
MAP-IA all -0.159544
summary (risk-a5-gd)
err all -0.12738
ndcg all -0.18411
summary (risk-a5-nd)
ERR-IA@10 all -0.321116
alpha-nDCG@10 all -0.298632
P-IA@10 all -0.26619
MAP-IA all -0.049561
uogTrBDnLaxw¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.01681
ndcg all 0.00903
summary (risk-a0-nd)
ERR-IA@10 all 0.18773
alpha-nDCG@10 all 0.183352
P-IA@10 all 0.071129
MAP-IA all -0.03746
summary (risk-a1-gd)
err all -0.01875
ndcg all -0.0483
summary (risk-a1-nd)
ERR-IA@10 all 0.115062
alpha-nDCG@10 all 0.118806
P-IA@10 all 0.011824
MAP-IA all -0.094442
summary (risk-a10-gd)
err all -0.33877
ndcg all -0.56424
summary (risk-a10-nd)
ERR-IA@10 all -0.53895
alpha-nDCG@10 all -0.462112
P-IA@10 all -0.521919
MAP-IA all -0.607278
summary (risk-a5-gd)
err all -0.16098
ndcg all -0.27761
summary (risk-a5-nd)
ERR-IA@10 all -0.17561
alpha-nDCG@10 all -0.13938
P-IA@10 all -0.225395
MAP-IA all -0.322369
wistud.runD¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.03778
ndcg all 0.05676
summary (risk-a0-nd)
ERR-IA@10 all 0.161118
alpha-nDCG@10 all 0.14202
P-IA@10 all 0.093195
MAP-IA all 0.036946
summary (risk-a1-gd)
err all 0.00475
ndcg all 0.01034
summary (risk-a1-nd)
ERR-IA@10 all 0.089461
alpha-nDCG@10 all 0.067347
P-IA@10 all 0.038276
MAP-IA all 0.015083
summary (risk-a10-gd)
err all -0.29254
ndcg all -0.40744
summary (risk-a10-nd)
ERR-IA@10 all -0.55545
alpha-nDCG@10 all -0.604706
P-IA@10 all -0.455995
MAP-IA all -0.181687
summary (risk-a5-gd)
err all -0.12738
ndcg all -0.17534
summary (risk-a5-nd)
ERR-IA@10 all -0.197166
alpha-nDCG@10 all -0.231343
P-IA@10 all -0.1814
MAP-IA all -0.07237
uogTrADnLrb¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.04523
ndcg all 0.07897
summary (risk-a0-nd)
ERR-IA@10 all 0.17027
alpha-nDCG@10 all 0.162731
P-IA@10 all 0.107476
MAP-IA all 0.071346
summary (risk-a1-gd)
err all 0.01349
ndcg all 0.02997
summary (risk-a1-nd)
ERR-IA@10 all 0.087376
alpha-nDCG@10 all 0.079855
P-IA@10 all 0.040786
MAP-IA all 0.05348
summary (risk-a10-gd)
err all -0.27217
ndcg all -0.41105
summary (risk-a10-nd)
ERR-IA@10 all -0.658667
alpha-nDCG@10 all -0.666028
P-IA@10 all -0.559429
MAP-IA all -0.10732
summary (risk-a5-gd)
err all -0.11347
ndcg all -0.16604
summary (risk-a5-nd)
ERR-IA@10 all -0.244198
alpha-nDCG@10 all -0.251648
P-IA@10 all -0.225976
MAP-IA all -0.017987
uogTrAS1Lb¶
Metadata | Participants | Proceedings| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.05119
ndcg all 0.06422
summary (risk-a0-nd)
ERR-IA@10 all 0.162079
alpha-nDCG@10 all 0.150932
P-IA@10 all 0.090012
MAP-IA all 0.059208
summary (risk-a1-gd)
err all 0.01679
ndcg all 0.01008
summary (risk-a1-nd)
ERR-IA@10 all 0.057552
alpha-nDCG@10 all 0.045694
P-IA@10 all 0.014171
MAP-IA all 0.037377
summary (risk-a10-gd)
err all -0.29284
ndcg all -0.47718
summary (risk-a10-nd)
ERR-IA@10 all -0.883198
alpha-nDCG@10 all -0.901449
P-IA@10 all -0.668393
MAP-IA all -0.159103
summary (risk-a5-gd)
err all -0.12082
ndcg all -0.20648
summary (risk-a5-nd)
ERR-IA@10 all -0.360559
alpha-nDCG@10 all -0.375258
P-IA@10 all -0.28919
MAP-IA all -0.049948
RMITSC¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.00549
ndcg all 0.00974
summary (risk-a0-nd)
ERR-IA@10 all 0.033669
alpha-nDCG@10 all 0.032387
P-IA@10 all 0.01581
MAP-IA all -0.015924
summary (risk-a1-gd)
err all -0.02686
ndcg all -0.03816
summary (risk-a1-nd)
ERR-IA@10 all -0.051019
alpha-nDCG@10 all -0.04873
P-IA@10 all -0.050881
MAP-IA all -0.051987
summary (risk-a10-gd)
err all -0.31797
ndcg all -0.4693
summary (risk-a10-nd)
ERR-IA@10 all -0.813213
alpha-nDCG@10 all -0.778783
P-IA@10 all -0.651095
MAP-IA all -0.376557
summary (risk-a5-gd)
err all -0.15624
ndcg all -0.22978
summary (risk-a5-nd)
ERR-IA@10 all -0.389772
alpha-nDCG@10 all -0.373198
P-IA@10 all -0.317643
MAP-IA all -0.19624
RMITSC75¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.00528
ndcg all 0.00953
summary (risk-a0-nd)
ERR-IA@10 all 0.034061
alpha-nDCG@10 all 0.032707
P-IA@10 all 0.017114
MAP-IA all -0.022132
summary (risk-a1-gd)
err all -0.02712
ndcg all -0.03887
summary (risk-a1-nd)
ERR-IA@10 all -0.050716
alpha-nDCG@10 all -0.048596
P-IA@10 all -0.048671
MAP-IA all -0.062258
summary (risk-a10-gd)
err all -0.31878
ndcg all -0.47444
summary (risk-a10-nd)
ERR-IA@10 all -0.813709
alpha-nDCG@10 all -0.780332
P-IA@10 all -0.640743
MAP-IA all -0.423392
summary (risk-a5-gd)
err all -0.15675
ndcg all -0.23246
summary (risk-a5-nd)
ERR-IA@10 all -0.389824
alpha-nDCG@10 all -0.373812
P-IA@10 all -0.311814
MAP-IA all -0.222762
RMITSCTh¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all 0.00576
ndcg all 0.01058
summary (risk-a0-nd)
ERR-IA@10 all 0.033643
alpha-nDCG@10 all 0.032378
P-IA@10 all 0.014095
MAP-IA all 0.019807
summary (risk-a1-gd)
err all -0.02631
ndcg all -0.03624
summary (risk-a1-nd)
ERR-IA@10 all -0.051043
alpha-nDCG@10 all -0.048714
P-IA@10 all -0.05231
MAP-IA all 0.003162
summary (risk-a10-gd)
err all -0.31499
ndcg all -0.45762
summary (risk-a10-nd)
ERR-IA@10 all -0.813214
alpha-nDCG@10 all -0.778544
P-IA@10 all -0.649952
MAP-IA all -0.146641
summary (risk-a5-gd)
err all -0.15461
ndcg all -0.22352
summary (risk-a5-nd)
ERR-IA@10 all -0.389786
alpha-nDCG@10 all -0.373083
P-IA@10 all -0.317929
MAP-IA all -0.063417
udelPseudo1LM¶
Metadata | Participants| Input| Summary (std-gd) | Summary (std-nd) | Summary (risk-risk-a0-gd) | Summary (risk-risk-a0-nd) | Summary (risk-risk-a1-gd) | Summary (risk-risk-a1-nd) | Summary (risk-risk-a5-nd) | Summary (risk-risk-a10-gd) | Summary (risk-risk-a10-nd)| Appendix
summary (risk-a0-gd)
err all -0.00628
ndcg all -0.01058
summary (risk-a0-nd)
ERR-IA@10 all 0.006112
alpha-nDCG@10 all 0.002433
P-IA@10 all 0.019352
MAP-IA all 0.019244
summary (risk-a1-gd)
err all -0.03788
ndcg all -0.06255
summary (risk-a1-nd)
ERR-IA@10 all -0.080717
alpha-nDCG@10 all -0.090496
P-IA@10 all -0.043705
MAP-IA all 0.00965
summary (risk-a10-gd)
err all -0.32229
ndcg all -0.53026
summary (risk-a10-nd)
ERR-IA@10 all -0.862183
alpha-nDCG@10 all -0.926856
P-IA@10 all -0.611219
MAP-IA all -0.076703
summary (risk-a5-gd)
err all -0.16428
ndcg all -0.27042
summary (risk-a5-nd)
ERR-IA@10 all -0.428035
alpha-nDCG@10 all -0.462211
P-IA@10 all -0.295933
MAP-IA all -0.028729