Results - Session 2012¶
essexSAnchor¶
Metadata | Participants| Input| Summary| Appendix
summary (RL1)
map all 0.1102
err all 0.1522
ndcg all 0.2229
P_k all 0.3908
summary (RL2)
map all 0.1134
err all 0.1675
ndcg all 0.2167
P_k all 0.4429
summary (RL3)
map all 0.1276
err all 0.1740
ndcg all 0.2393
P_k all 0.4643
summary (RL4)
map all 0.1223
err all 0.1762
ndcg all 0.2394
P_k all 0.4459
gurelaxphr¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1223
err all 0.1782
ndcg all 0.2484
P_k all 0.4592
summary (RL2)
map all 0.1455
err all 0.2015
ndcg all 0.2783
P_k all 0.5255
summary (RL3)
map all 0.1482
err all 0.2119
ndcg all 0.2856
P_k all 0.5469
summary (RL4)
map all 0.1467
err all 0.2013
ndcg all 0.2785
P_k all 0.5378
UAlbany¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1153
err all 0.1016
ndcg all 0.2796
P_k all 0.2296
summary (RL2)
map all 0.1151
err all 0.1019
ndcg all 0.2893
P_k all 0.2327
summary (RL3)
map all 0.1254
err all 0.1275
ndcg all 0.2655
P_k all 0.3357
summary (RL4)
map all 0.1070
err all 0.1085
ndcg all 0.2603
P_k all 0.2398
webis12cnqe¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.0368
err all 0.0845
ndcg all 0.1141
P_k all 0.2173
summary (RL2)
map all 0.0391
err all 0.1265
ndcg all 0.1214
P_k all 0.2551
summary (RL3)
map all 0.0393
err all 0.1286
ndcg all 0.1174
P_k all 0.2673
summary (RL4)
map all 0.0369
err all 0.1266
ndcg all 0.1130
P_k all 0.2684
wildcat1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1181
err all 0.1645
ndcg all 0.2208
P_k all 0.4398
summary (RL2)
map all 0.1064
err all 0.1590
ndcg all 0.2001
P_k all 0.4378
summary (RL3)
map all 0.1472
err all 0.1979
ndcg all 0.2544
P_k all 0.5184
summary (RL4)
map all 0.1302
err all 0.1941
ndcg all 0.2452
P_k all 0.4643
PITTSHQMnov¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1215
err all 0.1905
ndcg all 0.2487
P_k all 0.4847
summary (RL2)
map all 0.1440
err all 0.2145
ndcg all 0.2736
P_k all 0.5735
summary (RL3)
map all 0.1478
err all 0.2199
ndcg all 0.2777
P_k all 0.5898
summary (RL4)
map all 0.1500
err all 0.2163
ndcg all 0.2777
P_k all 0.5806
ICTNET12SER1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.0901
err all 0.1412
ndcg all 0.2267
P_k all 0.3612
summary (RL2)
map all 0.1124
err all 0.1664
ndcg all 0.2517
P_k all 0.3908
summary (RL3)
map all 0.1151
err all 0.1514
ndcg all 0.2468
P_k all 0.4429
summary (RL4)
map all 0.1297
err all 0.1734
ndcg all 0.2658
P_k all 0.4888
wildcat3¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1103
err all 0.1574
ndcg all 0.2138
P_k all 0.4204
summary (RL2)
map all 0.0955
err all 0.1495
ndcg all 0.1884
P_k all 0.4051
summary (RL3)
map all 0.1461
err all 0.1986
ndcg all 0.2578
P_k all 0.5571
summary (RL4)
map all 0.1440
err all 0.1921
ndcg all 0.2522
P_k all 0.5010
CWIrun3¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1289
err all 0.1693
ndcg all 0.2402
P_k all 0.4469
summary (RL2)
map all 0.1356
err all 0.1734
ndcg all 0.2397
P_k all 0.4878
summary (RL3)
map all 0.1215
err all 0.1644
ndcg all 0.2240
P_k all 0.4551
summary (RL4)
map all 0.1213
err all 0.1653
ndcg all 0.2240
P_k all 0.4551
ICTNET12SER2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1162
err all 0.1562
ndcg all 0.2496
P_k all 0.4286
summary (RL2)
map all 0.1279
err all 0.1711
ndcg all 0.2625
P_k all 0.4429
summary (RL3)
map all 0.1510
err all 0.2127
ndcg all 0.2856
P_k all 0.5122
summary (RL4)
map all 0.1582
err all 0.2125
ndcg all 0.2902
P_k all 0.5408
webis12indqe¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1028
err all 0.1876
ndcg all 0.2803
P_k all 0.3980
summary (RL2)
map all 0.1070
err all 0.1889
ndcg all 0.2854
P_k all 0.4102
summary (RL3)
map all 0.1076
err all 0.1895
ndcg all 0.2865
P_k all 0.4112
summary (RL4)
map all 0.1067
err all 0.1892
ndcg all 0.2853
P_k all 0.4092
essexSWiki¶
Metadata | Participants| Input| Summary| Appendix
summary (RL1)
map all 0.1102
err all 0.1522
ndcg all 0.2229
P_k all 0.3908
summary (RL2)
map all 0.0993
err all 0.1501
ndcg all 0.2156
P_k all 0.3816
summary (RL3)
map all 0.0993
err all 0.1501
ndcg all 0.2156
P_k all 0.3816
summary (RL4)
map all 0.0993
err all 0.1501
ndcg all 0.2156
P_k all 0.3816
TUDrun¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.0180
err all 0.0468
ndcg all 0.0532
P_k all 0.0918
summary (RL2)
map all 0.0064
err all 0.0285
ndcg all 0.0224
P_k all 0.0469
summary (RL3)
map all 0.0064
err all 0.0285
ndcg all 0.0224
P_k all 0.0469
summary (RL4)
map all 0.0064
err all 0.0285
ndcg all 0.0224
P_k all 0.0469
RutgersHu¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1141
err all 0.1069
ndcg all 0.2958
P_k all 0.2459
summary (RL2)
map all 0.0000
err all 0.0000
ndcg all 0.0000
P_k all 0.0000
summary (RL3)
map all 0.0000
err all 0.0000
ndcg all 0.0000
P_k all 0.0000
summary (RL4)
map all 0.1010
err all 0.1400
ndcg all 0.2674
P_k all 0.3480
WQExpFqDSnip¶
Metadata | Participants| Input| Summary| Appendix
summary (RL1)
map all 0.0613
err all 0.1197
ndcg all 0.1417
P_k all 0.2898
summary (RL2)
map all 0.1016
err all 0.1335
ndcg all 0.2141
P_k all 0.3224
summary (RL3)
map all 0.1096
err all 0.1361
ndcg all 0.2252
P_k all 0.3500
summary (RL4)
map all 0.1073
err all 0.1336
ndcg all 0.2214
P_k all 0.3500
ACombSnip¶
Metadata | Participants| Input| Summary| Appendix
summary (RL1)
map all 0.0711
err all 0.1058
ndcg all 0.1391
P_k all 0.2776
summary (RL2)
map all 0.0827
err all 0.0876
ndcg all 0.2116
P_k all 0.2602
summary (RL3)
map all 0.1094
err all 0.1357
ndcg all 0.2248
P_k all 0.3510
summary (RL4)
map all 0.1068
err all 0.1335
ndcg all 0.2209
P_k all 0.3490
PITTSHQMsnov¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1222
err all 0.1930
ndcg all 0.2518
P_k all 0.4765
summary (RL2)
map all 0.1417
err all 0.2083
ndcg all 0.2723
P_k all 0.5704
summary (RL3)
map all 0.1460
err all 0.2111
ndcg all 0.2754
P_k all 0.5796
summary (RL4)
map all 0.1465
err all 0.2115
ndcg all 0.2759
P_k all 0.5745
guphrase1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1185
err all 0.1767
ndcg all 0.2454
P_k all 0.4571
summary (RL2)
map all 0.1466
err all 0.2090
ndcg all 0.2825
P_k all 0.5398
summary (RL3)
map all 0.1490
err all 0.2116
ndcg all 0.2862
P_k all 0.5500
summary (RL4)
map all 0.1490
err all 0.2116
ndcg all 0.2862
P_k all 0.5500
webis12cnse¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.0355
err all 0.1218
ndcg all 0.1168
P_k all 0.2449
summary (RL2)
map all 0.0482
err all 0.1114
ndcg all 0.1163
P_k all 0.2959
summary (RL3)
map all 0.0396
err all 0.1443
ndcg all 0.1087
P_k all 0.3153
summary (RL4)
map all 0.0504
err all 0.1644
ndcg all 0.1331
P_k all 0.3918
ICTNET12SER3¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1412
err all 0.1863
ndcg all 0.2711
P_k all 0.4837
summary (RL2)
map all 0.1447
err all 0.1834
ndcg all 0.2741
P_k all 0.4949
summary (RL3)
map all 0.1524
err all 0.1965
ndcg all 0.2822
P_k all 0.5071
summary (RL4)
map all 0.1617
err all 0.2106
ndcg all 0.2912
P_k all 0.5327
BDocExpDoc¶
Metadata | Participants| Input| Summary| Appendix
summary (RL1)
map all 0.0863
err all 0.1137
ndcg all 0.1929
P_k all 0.2878
summary (RL2)
map all 0.1018
err all 0.1243
ndcg all 0.2124
P_k all 0.3296
summary (RL3)
map all 0.1158
err all 0.1488
ndcg all 0.2427
P_k all 0.3827
summary (RL4)
map all 0.1148
err all 0.1438
ndcg all 0.2394
P_k all 0.3816
CWIrun1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1289
err all 0.1693
ndcg all 0.2402
P_k all 0.4469
summary (RL2)
map all 0.1356
err all 0.1734
ndcg all 0.2397
P_k all 0.4878
summary (RL3)
map all 0.1236
err all 0.1648
ndcg all 0.2261
P_k all 0.4541
summary (RL4)
map all 0.1236
err all 0.1648
ndcg all 0.2261
P_k all 0.4541
PITTSHQMsdm¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1286
err all 0.1984
ndcg all 0.2573
P_k all 0.4878
summary (RL2)
map all 0.1496
err all 0.2194
ndcg all 0.2810
P_k all 0.5806
summary (RL3)
map all 0.1538
err all 0.2207
ndcg all 0.2834
P_k all 0.5888
summary (RL4)
map all 0.1542
err all 0.2209
ndcg all 0.2838
P_k all 0.5847
PITTSHQM¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1280
err all 0.1915
ndcg all 0.2538
P_k all 0.4949
summary (RL2)
map all 0.1526
err all 0.2161
ndcg all 0.2808
P_k all 0.5867
summary (RL3)
map all 0.1559
err all 0.2205
ndcg all 0.2844
P_k all 0.5990
summary (RL4)
map all 0.1587
err all 0.2177
ndcg all 0.2848
P_k all 0.5959
RutgersM¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1141
err all 0.1069
ndcg all 0.2958
P_k all 0.2459
summary (RL2)
map all 0.0000
err all 0.0000
ndcg all 0.0000
P_k all 0.0000
summary (RL3)
map all 0.0000
err all 0.0000
ndcg all 0.0000
P_k all 0.0000
summary (RL4)
map all 0.1048
err all 0.1382
ndcg all 0.2701
P_k all 0.3316
guphrase2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.1186
err all 0.1735
ndcg all 0.2439
P_k all 0.4469
summary (RL2)
map all 0.1457
err all 0.2018
ndcg all 0.2790
P_k all 0.5224
summary (RL3)
map all 0.1483
err all 0.2113
ndcg all 0.2849
P_k all 0.5480
summary (RL4)
map all 0.1483
err all 0.2113
ndcg all 0.2849
P_k all 0.5480
wildcat2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (RL1)
map all 0.0670
err all 0.0887
ndcg all 0.1690
P_k all 0.2204
summary (RL2)
map all 0.0802
err all 0.1170
ndcg all 0.1708
P_k all 0.2990
summary (RL3)
map all 0.1051
err all 0.1583
ndcg all 0.1989
P_k all 0.4357
summary (RL4)
map all 0.1557
err all 0.1960
ndcg all 0.2613
P_k all 0.5163