Results - Session 2011¶
udelBe2¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2466
ndcg all 0.3265
map all 0.1269
summary (RL2 [allsubtopics])
err all 0.2440
ndcg all 0.2895
map all 0.1085
summary (RL3 [allsubtopics])
err all 0.2421
ndcg all 0.3090
map all 0.1182
summary (RL4 [allsubtopics])
err all 0.3082
ndcg all 0.3179
map all 0.1575
summary (RL1 [lastquerysubtopics])
err all 0.1598
ndcg all 0.2900
map all 0.1141
summary (RL2 [lastquerysubtopics])
err all 0.1687
ndcg all 0.2598
map all 0.1027
summary (RL3 [lastquerysubtopics])
err all 0.1545
ndcg all 0.2749
map all 0.1060
summary (RL4 [lastquerysubtopics])
err all 0.2147
ndcg all 0.2909
map all 0.1398
webis11cnb¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2190
ndcg all 0.1069
map all 0.0391
summary (RL2 [allsubtopics])
err all 0.1809
ndcg all 0.0852
map all 0.0321
summary (RL3 [allsubtopics])
err all 0.1690
ndcg all 0.0776
map all 0.0278
summary (RL4 [allsubtopics])
err all 0.1497
ndcg all 0.0576
map all 0.0226
summary (RL1 [lastquerysubtopics])
err all 0.1400
ndcg all 0.1049
map all 0.0389
summary (RL2 [lastquerysubtopics])
err all 0.1228
ndcg all 0.0746
map all 0.0272
summary (RL3 [lastquerysubtopics])
err all 0.1075
ndcg all 0.0730
map all 0.0256
summary (RL4 [lastquerysubtopics])
err all 0.0925
ndcg all 0.0507
map all 0.0203
webis11ind¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2883
ndcg all 0.2181
map all 0.1110
summary (RL2 [allsubtopics])
err all 0.2208
ndcg all 0.1326
map all 0.0558
summary (RL3 [allsubtopics])
err all 0.2202
ndcg all 0.1322
map all 0.0557
summary (RL4 [allsubtopics])
err all 0.2387
ndcg all 0.1251
map all 0.0524
summary (RL1 [lastquerysubtopics])
err all 0.2005
ndcg all 0.2059
map all 0.0994
summary (RL2 [lastquerysubtopics])
err all 0.1616
ndcg all 0.1293
map all 0.0535
summary (RL3 [lastquerysubtopics])
err all 0.1619
ndcg all 0.1295
map all 0.0535
summary (RL4 [lastquerysubtopics])
err all 0.1726
ndcg all 0.1216
map all 0.0502
UvAlearning¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2678
ndcg all 0.3340
map all 0.1323
summary (RL2 [allsubtopics])
err all 0.2678
ndcg all 0.3340
map all 0.1323
summary (RL3 [allsubtopics])
err all 0.2975
ndcg all 0.3993
map all 0.1780
summary (RL4 [allsubtopics])
err all 0.2543
ndcg all 0.3540
map all 0.1332
summary (RL1 [lastquerysubtopics])
err all 0.1850
ndcg all 0.3047
map all 0.1168
summary (RL2 [lastquerysubtopics])
err all 0.1850
ndcg all 0.3047
map all 0.1168
summary (RL3 [lastquerysubtopics])
err all 0.1943
ndcg all 0.3458
map all 0.1398
summary (RL4 [lastquerysubtopics])
err all 0.1618
ndcg all 0.3009
map all 0.1012
RMIT1¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.3017
ndcg all 0.2831
map all 0.1067
summary (RL2 [allsubtopics])
err all 0.2873
ndcg all 0.2932
map all 0.1203
summary (RL3 [allsubtopics])
err all 0.1584
ndcg all 0.1234
map all 0.0439
summary (RL4 [allsubtopics])
err all 0.2085
ndcg all 0.1655
map all 0.0645
summary (RL1 [lastquerysubtopics])
err all 0.1894
ndcg all 0.2562
map all 0.0941
summary (RL2 [lastquerysubtopics])
err all 0.1597
ndcg all 0.2463
map all 0.0877
summary (RL3 [lastquerysubtopics])
err all 0.1022
ndcg all 0.0991
map all 0.0364
summary (RL4 [lastquerysubtopics])
err all 0.1050
ndcg all 0.1123
map all 0.0454
rguPisaSST¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2968
ndcg all 0.2669
map all 0.1264
summary (RL2 [allsubtopics])
err all 0.2720
ndcg all 0.2528
map all 0.1158
summary (RL3 [allsubtopics])
err all 0.2904
ndcg all 0.2561
map all 0.1167
summary (RL4 [allsubtopics])
err all 0.2926
ndcg all 0.2592
map all 0.1198
summary (RL1 [lastquerysubtopics])
err all 0.2014
ndcg all 0.2432
map all 0.1209
summary (RL2 [lastquerysubtopics])
err all 0.1609
ndcg all 0.2244
map all 0.1059
summary (RL3 [lastquerysubtopics])
err all 0.1691
ndcg all 0.2223
map all 0.1037
summary (RL4 [lastquerysubtopics])
err all 0.1728
ndcg all 0.2261
map all 0.1090
umasscontext¶
Metadata | Participants| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2983
ndcg all 0.3433
map all 0.1526
summary (RL2 [allsubtopics])
err all 0.3067
ndcg all 0.2918
map all 0.1193
summary (RL3 [allsubtopics])
err all 0.3067
ndcg all 0.2918
map all 0.1193
summary (RL4 [allsubtopics])
err all 0.3395
ndcg all 0.3778
map all 0.1732
summary (RL1 [lastquerysubtopics])
err all 0.2142
ndcg all 0.3249
map all 0.1425
summary (RL2 [lastquerysubtopics])
err all 0.2025
ndcg all 0.2446
map all 0.0903
summary (RL3 [lastquerysubtopics])
err all 0.2025
ndcg all 0.2446
map all 0.0903
summary (RL4 [lastquerysubtopics])
err all 0.2074
ndcg all 0.3027
map all 0.1213
UvAsemantic¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2319
ndcg all 0.2655
map all 0.1018
summary (RL2 [allsubtopics])
err all 0.2531
ndcg all 0.2931
map all 0.1101
summary (RL3 [allsubtopics])
err all 0.2807
ndcg all 0.3589
map all 0.1413
summary (RL4 [allsubtopics])
err all 0.2566
ndcg all 0.3219
map all 0.1227
summary (RL1 [lastquerysubtopics])
err all 0.1655
ndcg all 0.2377
map all 0.0937
summary (RL2 [lastquerysubtopics])
err all 0.1652
ndcg all 0.2541
map all 0.0917
summary (RL3 [lastquerysubtopics])
err all 0.1774
ndcg all 0.3023
map all 0.1124
summary (RL4 [lastquerysubtopics])
err all 0.1610
ndcg all 0.2724
map all 0.0990
wildcat1¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2711
ndcg all 0.2119
map all 0.1034
summary (RL2 [allsubtopics])
err all 0.2814
ndcg all 0.2537
map all 0.1279
summary (RL3 [allsubtopics])
err all 0.3017
ndcg all 0.1715
map all 0.0785
summary (RL4 [allsubtopics])
err all 0.2928
ndcg all 0.2246
map all 0.1143
summary (RL1 [lastquerysubtopics])
err all 0.1819
ndcg all 0.1967
map all 0.0910
summary (RL2 [lastquerysubtopics])
err all 0.1800
ndcg all 0.2208
map all 0.0969
summary (RL3 [lastquerysubtopics])
err all 0.2015
ndcg all 0.1521
map all 0.0675
summary (RL4 [lastquerysubtopics])
err all 0.1863
ndcg all 0.1951
map all 0.0903
wildcat3¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2425
ndcg all 0.1978
map all 0.0819
summary (RL2 [allsubtopics])
err all 0.3416
ndcg all 0.1526
map all 0.0673
summary (RL3 [allsubtopics])
err all 0.3444
ndcg all 0.1661
map all 0.0713
summary (RL4 [allsubtopics])
err all 0.3551
ndcg all 0.2341
map all 0.1209
summary (RL1 [lastquerysubtopics])
err all 0.1561
ndcg all 0.1794
map all 0.0638
summary (RL2 [lastquerysubtopics])
err all 0.2040
ndcg all 0.1374
map all 0.0667
summary (RL3 [lastquerysubtopics])
err all 0.2075
ndcg all 0.1583
map all 0.0758
summary (RL4 [lastquerysubtopics])
err all 0.2151
ndcg all 0.2074
map all 0.1057
umassqdist¶
Metadata | Participants| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2973
ndcg all 0.3067
map all 0.1280
summary (RL2 [allsubtopics])
err all 0.3140
ndcg all 0.3298
map all 0.1463
summary (RL3 [allsubtopics])
err all 0.3140
ndcg all 0.3298
map all 0.1463
summary (RL4 [allsubtopics])
err all 0.3193
ndcg all 0.3427
map all 0.1515
summary (RL1 [lastquerysubtopics])
err all 0.2276
ndcg all 0.3046
map all 0.1267
summary (RL2 [lastquerysubtopics])
err all 0.2336
ndcg all 0.3170
map all 0.1361
summary (RL3 [lastquerysubtopics])
err all 0.2336
ndcg all 0.3170
map all 0.1361
summary (RL4 [lastquerysubtopics])
err all 0.2372
ndcg all 0.3237
map all 0.1369
ICTNET11SER2¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.1286
ndcg all 0.0937
map all 0.0288
summary (RL2 [allsubtopics])
err all 0.1163
ndcg all 0.0884
map all 0.0251
summary (RL3 [allsubtopics])
err all 0.1286
ndcg all 0.0937
map all 0.0288
summary (RL4 [allsubtopics])
err all 0.1286
ndcg all 0.0937
map all 0.0288
summary (RL1 [lastquerysubtopics])
err all 0.0704
ndcg all 0.0828
map all 0.0229
summary (RL2 [lastquerysubtopics])
err all 0.0518
ndcg all 0.0737
map all 0.0182
summary (RL3 [lastquerysubtopics])
err all 0.0704
ndcg all 0.0828
map all 0.0229
summary (RL4 [lastquerysubtopics])
err all 0.0704
ndcg all 0.0828
map all 0.0229
rguPisaSS¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2968
ndcg all 0.2669
map all 0.1264
summary (RL2 [allsubtopics])
err all 0.2720
ndcg all 0.2528
map all 0.1158
summary (RL3 [allsubtopics])
err all 0.2904
ndcg all 0.2561
map all 0.1167
summary (RL4 [allsubtopics])
err all 0.2908
ndcg all 0.2577
map all 0.1189
summary (RL1 [lastquerysubtopics])
err all 0.2014
ndcg all 0.2432
map all 0.1209
summary (RL2 [lastquerysubtopics])
err all 0.1609
ndcg all 0.2244
map all 0.1059
summary (RL3 [lastquerysubtopics])
err all 0.1691
ndcg all 0.2223
map all 0.1037
summary (RL4 [lastquerysubtopics])
err all 0.1715
ndcg all 0.2248
map all 0.1073
essexNooNeg¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2968
ndcg all 0.2669
map all 0.1264
summary (RL2 [allsubtopics])
err all 0.3181
ndcg all 0.2956
map all 0.1518
summary (RL3 [allsubtopics])
err all 0.2512
ndcg all 0.2200
map all 0.0777
summary (RL4 [allsubtopics])
err all 0.2442
ndcg all 0.2172
map all 0.0736
summary (RL1 [lastquerysubtopics])
err all 0.2014
ndcg all 0.2432
map all 0.1209
summary (RL2 [lastquerysubtopics])
err all 0.1871
ndcg all 0.2493
map all 0.1252
summary (RL3 [lastquerysubtopics])
err all 0.1420
ndcg all 0.1810
map all 0.0573
summary (RL4 [lastquerysubtopics])
err all 0.1330
ndcg all 0.1788
map all 0.0550
udelASFe1new¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2581
ndcg all 0.2804
map all 0.1346
summary (RL2 [allsubtopics])
err all 0.2609
ndcg all 0.2431
map all 0.1086
summary (RL3 [allsubtopics])
err all 0.2597
ndcg all 0.2673
map all 0.1268
summary (RL4 [allsubtopics])
err all 0.3040
ndcg all 0.3191
map all 0.1575
summary (RL1 [lastquerysubtopics])
err all 0.1865
ndcg all 0.2653
map all 0.1213
summary (RL2 [lastquerysubtopics])
err all 0.2006
ndcg all 0.2364
map all 0.1038
summary (RL3 [lastquerysubtopics])
err all 0.1879
ndcg all 0.2557
map all 0.1156
summary (RL4 [lastquerysubtopics])
err all 0.2124
ndcg all 0.2885
map all 0.1359
ICTNET11SER1¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.1286
ndcg all 0.0937
map all 0.0288
summary (RL2 [allsubtopics])
err all 0.1173
ndcg all 0.0890
map all 0.0257
summary (RL3 [allsubtopics])
err all 0.0715
ndcg all 0.0707
map all 0.0131
summary (RL4 [allsubtopics])
err all 0.0715
ndcg all 0.0707
map all 0.0131
summary (RL1 [lastquerysubtopics])
err all 0.0704
ndcg all 0.0828
map all 0.0229
summary (RL2 [lastquerysubtopics])
err all 0.0543
ndcg all 0.0759
map all 0.0195
summary (RL3 [lastquerysubtopics])
err all 0.0413
ndcg all 0.0606
map all 0.0084
summary (RL4 [lastquerysubtopics])
err all 0.0413
ndcg all 0.0606
map all 0.0084
rguBase¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2968
ndcg all 0.2669
map all 0.1264
summary (RL2 [allsubtopics])
err all 0.3287
ndcg all 0.2594
map all 0.1178
summary (RL3 [allsubtopics])
err all 0.0000
ndcg all 0.0000
map all 0.0000
summary (RL4 [allsubtopics])
err all 0.0000
ndcg all 0.0000
map all 0.0000
summary (RL1 [lastquerysubtopics])
err all 0.2014
ndcg all 0.2432
map all 0.1209
summary (RL2 [lastquerysubtopics])
err all 0.2175
ndcg all 0.2348
map all 0.1148
summary (RL3 [lastquerysubtopics])
err all 0.0000
ndcg all 0.0000
map all 0.0000
summary (RL4 [lastquerysubtopics])
err all 0.0000
ndcg all 0.0000
map all 0.0000
CWIpostRW¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2629
ndcg all 0.2981
map all 0.1250
summary (RL2 [allsubtopics])
err all 0.2792
ndcg all 0.3050
map all 0.1314
summary (RL3 [allsubtopics])
err all 0.2792
ndcg all 0.3050
map all 0.1314
summary (RL4 [allsubtopics])
err all 0.2716
ndcg all 0.3071
map all 0.1339
summary (RL1 [lastquerysubtopics])
err all 0.1966
ndcg all 0.2820
map all 0.1181
summary (RL2 [lastquerysubtopics])
err all 0.2059
ndcg all 0.2839
map all 0.1184
summary (RL3 [lastquerysubtopics])
err all 0.2059
ndcg all 0.2839
map all 0.1184
summary (RL4 [lastquerysubtopics])
err all 0.1994
ndcg all 0.2863
map all 0.1209
webis11cnw¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2228
ndcg all 0.1090
map all 0.0413
summary (RL2 [allsubtopics])
err all 0.1830
ndcg all 0.0927
map all 0.0343
summary (RL3 [allsubtopics])
err all 0.1731
ndcg all 0.0847
map all 0.0316
summary (RL4 [allsubtopics])
err all 0.1627
ndcg all 0.0633
map all 0.0230
summary (RL1 [lastquerysubtopics])
err all 0.1447
ndcg all 0.1099
map all 0.0417
summary (RL2 [lastquerysubtopics])
err all 0.1196
ndcg all 0.0895
map all 0.0323
summary (RL3 [lastquerysubtopics])
err all 0.1128
ndcg all 0.0830
map all 0.0308
summary (RL4 [lastquerysubtopics])
err all 0.1034
ndcg all 0.0625
map all 0.0236
Rspos¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2044
ndcg all 0.3014
map all 0.0868
summary (RL2 [allsubtopics])
err all 0.2289
ndcg all 0.3295
map all 0.1002
summary (RL3 [allsubtopics])
err all 0.2715
ndcg all 0.2245
map all 0.0778
summary (RL4 [allsubtopics])
err all 0.2823
ndcg all 0.2533
map all 0.0858
summary (RL1 [lastquerysubtopics])
err all 0.1105
ndcg all 0.2749
map all 0.0712
summary (RL2 [lastquerysubtopics])
err all 0.1290
ndcg all 0.2875
map all 0.0715
summary (RL3 [lastquerysubtopics])
err all 0.1370
ndcg all 0.1609
map all 0.0606
summary (RL4 [lastquerysubtopics])
err all 0.1686
ndcg all 0.1990
map all 0.0682
Rsposneg¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2044
ndcg all 0.3014
map all 0.0868
summary (RL2 [allsubtopics])
err all 0.2289
ndcg all 0.3295
map all 0.1002
summary (RL3 [allsubtopics])
err all 0.2715
ndcg all 0.2245
map all 0.0778
summary (RL4 [allsubtopics])
err all 0.2701
ndcg all 0.2440
map all 0.0833
summary (RL1 [lastquerysubtopics])
err all 0.1105
ndcg all 0.2749
map all 0.0712
summary (RL2 [lastquerysubtopics])
err all 0.1290
ndcg all 0.2875
map all 0.0715
summary (RL3 [lastquerysubtopics])
err all 0.1370
ndcg all 0.1609
map all 0.0606
summary (RL4 [lastquerysubtopics])
err all 0.1620
ndcg all 0.1903
map all 0.0656
RMIT2¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.3017
ndcg all 0.2831
map all 0.1067
summary (RL2 [allsubtopics])
err all 0.2598
ndcg all 0.2722
map all 0.1105
summary (RL3 [allsubtopics])
err all 0.1584
ndcg all 0.1234
map all 0.0439
summary (RL4 [allsubtopics])
err all 0.1524
ndcg all 0.1207
map all 0.0423
summary (RL1 [lastquerysubtopics])
err all 0.1894
ndcg all 0.2562
map all 0.0941
summary (RL2 [lastquerysubtopics])
err all 0.1378
ndcg all 0.2145
map all 0.0775
summary (RL3 [lastquerysubtopics])
err all 0.1022
ndcg all 0.0991
map all 0.0364
summary (RL4 [lastquerysubtopics])
err all 0.0794
ndcg all 0.0815
map all 0.0279
essexNooPos¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2968
ndcg all 0.2669
map all 0.1264
summary (RL2 [allsubtopics])
err all 0.3181
ndcg all 0.2956
map all 0.1518
summary (RL3 [allsubtopics])
err all 0.2980
ndcg all 0.2534
map all 0.1074
summary (RL4 [allsubtopics])
err all 0.2952
ndcg all 0.2622
map all 0.1180
summary (RL1 [lastquerysubtopics])
err all 0.2014
ndcg all 0.2432
map all 0.1209
summary (RL2 [lastquerysubtopics])
err all 0.1871
ndcg all 0.2493
map all 0.1252
summary (RL3 [lastquerysubtopics])
err all 0.1845
ndcg all 0.2140
map all 0.0862
summary (RL4 [lastquerysubtopics])
err all 0.1776
ndcg all 0.2169
map all 0.0864
PITTSIS¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.3050
ndcg all 0.2848
map all 0.1206
summary (RL2 [allsubtopics])
err all 0.3296
ndcg all 0.3112
map all 0.1446
summary (RL3 [allsubtopics])
err all 0.3298
ndcg all 0.3129
map all 0.1452
summary (RL4 [allsubtopics])
err all 0.3329
ndcg all 0.3187
map all 0.1508
summary (RL1 [lastquerysubtopics])
err all 0.2212
ndcg all 0.2642
map all 0.1239
summary (RL2 [lastquerysubtopics])
err all 0.2332
ndcg all 0.2842
map all 0.1391
summary (RL3 [lastquerysubtopics])
err all 0.2362
ndcg all 0.2853
map all 0.1399
summary (RL4 [lastquerysubtopics])
err all 0.2408
ndcg all 0.2883
map all 0.1428
udelWPmnz¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2690
ndcg all 0.1990
map all 0.0957
summary (RL2 [allsubtopics])
err all 0.2168
ndcg all 0.1271
map all 0.0570
summary (RL3 [allsubtopics])
err all 0.2652
ndcg all 0.1917
map all 0.0917
summary (RL4 [allsubtopics])
err all 0.3040
ndcg all 0.3189
map all 0.1583
summary (RL1 [lastquerysubtopics])
err all 0.1948
ndcg all 0.1955
map all 0.1159
summary (RL2 [lastquerysubtopics])
err all 0.1466
ndcg all 0.1176
map all 0.0617
summary (RL3 [lastquerysubtopics])
err all 0.1921
ndcg all 0.1882
map all 0.1098
summary (RL4 [lastquerysubtopics])
err all 0.2114
ndcg all 0.2924
map all 0.1412
DUTIR2011A¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2837
ndcg all 0.3165
map all 0.1474
summary (RL2 [allsubtopics])
err all 0.2842
ndcg all 0.3143
map all 0.1487
summary (RL3 [allsubtopics])
err all 0.2765
ndcg all 0.2955
map all 0.1371
summary (RL4 [allsubtopics])
err all 0.2775
ndcg all 0.2931
map all 0.1348
summary (RL1 [lastquerysubtopics])
err all 0.2006
ndcg all 0.2839
map all 0.1415
summary (RL2 [lastquerysubtopics])
err all 0.1975
ndcg all 0.2817
map all 0.1416
summary (RL3 [lastquerysubtopics])
err all 0.1910
ndcg all 0.2656
map all 0.1307
summary (RL4 [lastquerysubtopics])
err all 0.1924
ndcg all 0.2634
map all 0.1292
CWIrun2¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2622
ndcg all 0.3019
map all 0.1260
summary (RL2 [allsubtopics])
err all 0.2603
ndcg all 0.3298
map all 0.1440
summary (RL3 [allsubtopics])
err all 0.2652
ndcg all 0.3308
map all 0.1444
summary (RL4 [allsubtopics])
err all 0.3214
ndcg all 0.3713
map all 0.1722
summary (RL1 [lastquerysubtopics])
err all 0.1959
ndcg all 0.2858
map all 0.1191
summary (RL2 [lastquerysubtopics])
err all 0.1575
ndcg all 0.2762
map all 0.1039
summary (RL3 [lastquerysubtopics])
err all 0.1633
ndcg all 0.2761
map all 0.1038
summary (RL4 [lastquerysubtopics])
err all 0.1944
ndcg all 0.3050
map all 0.1286
ICTNET11SER3¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.1286
ndcg all 0.0937
map all 0.0288
summary (RL2 [allsubtopics])
err all 0.1163
ndcg all 0.0884
map all 0.0251
summary (RL3 [allsubtopics])
err all 0.1286
ndcg all 0.0937
map all 0.0288
summary (RL4 [allsubtopics])
err all 0.1286
ndcg all 0.0937
map all 0.0288
summary (RL1 [lastquerysubtopics])
err all 0.0704
ndcg all 0.0828
map all 0.0229
summary (RL2 [lastquerysubtopics])
err all 0.0518
ndcg all 0.0737
map all 0.0182
summary (RL3 [lastquerysubtopics])
err all 0.0704
ndcg all 0.0828
map all 0.0229
summary (RL4 [lastquerysubtopics])
err all 0.0704
ndcg all 0.0828
map all 0.0229
CWIrun1¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2656
ndcg all 0.3015
map all 0.1267
summary (RL2 [allsubtopics])
err all 0.2618
ndcg all 0.3306
map all 0.1442
summary (RL3 [allsubtopics])
err all 0.2652
ndcg all 0.3308
map all 0.1444
summary (RL4 [allsubtopics])
err all 0.2652
ndcg all 0.3308
map all 0.1444
summary (RL1 [lastquerysubtopics])
err all 0.1993
ndcg all 0.2855
map all 0.1198
summary (RL2 [lastquerysubtopics])
err all 0.1590
ndcg all 0.2772
map all 0.1047
summary (RL3 [lastquerysubtopics])
err all 0.1633
ndcg all 0.2761
map all 0.1038
summary (RL4 [lastquerysubtopics])
err all 0.1633
ndcg all 0.2761
map all 0.1038
Rgposneg¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2044
ndcg all 0.3014
map all 0.0868
summary (RL2 [allsubtopics])
err all 0.2289
ndcg all 0.3295
map all 0.1002
summary (RL3 [allsubtopics])
err all 0.2715
ndcg all 0.2245
map all 0.0778
summary (RL4 [allsubtopics])
err all 0.2828
ndcg all 0.2421
map all 0.0865
summary (RL1 [lastquerysubtopics])
err all 0.1105
ndcg all 0.2749
map all 0.0712
summary (RL2 [lastquerysubtopics])
err all 0.1290
ndcg all 0.2875
map all 0.0715
summary (RL3 [lastquerysubtopics])
err all 0.1370
ndcg all 0.1609
map all 0.0606
summary (RL4 [lastquerysubtopics])
err all 0.1393
ndcg all 0.1815
map all 0.0683
RMIT3¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.3017
ndcg all 0.2831
map all 0.1067
summary (RL2 [allsubtopics])
err all 0.2873
ndcg all 0.2932
map all 0.1203
summary (RL3 [allsubtopics])
err all 0.1584
ndcg all 0.1234
map all 0.0439
summary (RL4 [allsubtopics])
err all 0.1519
ndcg all 0.1196
map all 0.0408
summary (RL1 [lastquerysubtopics])
err all 0.1894
ndcg all 0.2562
map all 0.0941
summary (RL2 [lastquerysubtopics])
err all 0.1597
ndcg all 0.2463
map all 0.0877
summary (RL3 [lastquerysubtopics])
err all 0.1022
ndcg all 0.0991
map all 0.0364
summary (RL4 [lastquerysubtopics])
err all 0.0782
ndcg all 0.0819
map all 0.0296
essexAnchor¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2968
ndcg all 0.2669
map all 0.1264
summary (RL2 [allsubtopics])
err all 0.3274
ndcg all 0.2595
map all 0.1236
summary (RL3 [allsubtopics])
err all 0.3445
ndcg all 0.2923
map all 0.1427
summary (RL4 [allsubtopics])
err all 0.3434
ndcg all 0.2866
map all 0.1385
summary (RL1 [lastquerysubtopics])
err all 0.2014
ndcg all 0.2432
map all 0.1209
summary (RL2 [lastquerysubtopics])
err all 0.2043
ndcg all 0.2211
map all 0.1089
summary (RL3 [lastquerysubtopics])
err all 0.2273
ndcg all 0.2580
map all 0.1267
summary (RL4 [lastquerysubtopics])
err all 0.2221
ndcg all 0.2546
map all 0.1302
UvAmodeling¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.2634
ndcg all 0.3328
map all 0.1422
summary (RL2 [allsubtopics])
err all 0.2634
ndcg all 0.3353
map all 0.1427
summary (RL3 [allsubtopics])
err all 0.2876
ndcg all 0.3840
map all 0.1694
summary (RL4 [allsubtopics])
err all 0.3217
ndcg all 0.4118
map all 0.1909
summary (RL1 [lastquerysubtopics])
err all 0.1931
ndcg all 0.3120
map all 0.1332
summary (RL2 [lastquerysubtopics])
err all 0.1931
ndcg all 0.3145
map all 0.1337
summary (RL3 [lastquerysubtopics])
err all 0.2009
ndcg all 0.3461
map all 0.1429
summary (RL4 [lastquerysubtopics])
err all 0.2075
ndcg all 0.3565
map all 0.1539
wildcat2¶
Metadata | Participants | Proceedings| Input| Summary (allsubtopics) | Summary (lastquerysubtopics)| Appendix
summary (RL1 [allsubtopics])
err all 0.3321
ndcg all 0.2347
map all 0.1214
summary (RL2 [allsubtopics])
err all 0.3080
ndcg all 0.1653
map all 0.0783
summary (RL3 [allsubtopics])
err all 0.3447
ndcg all 0.2363
map all 0.1232
summary (RL4 [allsubtopics])
err all 0.3701
ndcg all 0.2405
map all 0.1253
summary (RL1 [lastquerysubtopics])
err all 0.2237
ndcg all 0.2305
map all 0.1205
summary (RL2 [lastquerysubtopics])
err all 0.1857
ndcg all 0.1395
map all 0.0618
summary (RL3 [lastquerysubtopics])
err all 0.2079
ndcg all 0.2077
map all 0.1076
summary (RL4 [lastquerysubtopics])
err all 0.2200
ndcg all 0.2123
map all 0.1134