Results - News 2018¶
htwsaar1¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.2528
bpref all 0.3176
recip_rank all 0.7930
P_10 all 0.5200
P_100 all 0.1614
P_1000 all 0.0161
recall_10 all 0.1848
recall_100 all 0.4421
recall_1000 all 0.4421
ndcg all 0.4121
ndcg_cut_10 all 0.3859
ndcg_cut_100 all 0.4178
ndcg_cut_1000 all 0.4121
htwsaar2¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1072
bpref all 0.1518
recip_rank all 0.4191
P_10 all 0.2580
P_100 all 0.0812
P_1000 all 0.0081
recall_10 all 0.0755
recall_100 all 0.2201
recall_1000 all 0.2201
ndcg all 0.1809
ndcg_cut_10 all 0.1537
ndcg_cut_100 all 0.1826
ndcg_cut_1000 all 0.1809
htwsaar3¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1160
bpref all 0.1234
recip_rank all 0.7983
P_10 all 0.3240
P_100 all 0.0324
P_1000 all 0.0032
recall_10 all 0.1347
recall_100 all 0.1347
recall_1000 all 0.1347
ndcg all 0.2335
ndcg_cut_10 all 0.3192
ndcg_cut_100 all 0.2347
ndcg_cut_1000 all 0.2335
htwsaar4¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1136
bpref all 0.1196
recip_rank all 0.7717
P_10 all 0.3240
P_100 all 0.0324
P_1000 all 0.0032
recall_10 all 0.1347
recall_100 all 0.1347
recall_1000 all 0.1347
ndcg all 0.2346
ndcg_cut_10 all 0.3185
ndcg_cut_100 all 0.2358
ndcg_cut_1000 all 0.2346
anserini_1000w¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.2923
bpref all 0.3457
recip_rank all 0.6968
P_10 all 0.5220
P_100 all 0.1782
P_1000 all 0.0178
recall_10 all 0.2348
recall_100 all 0.5690
recall_1000 all 0.5690
ndcg all 0.4692
ndcg_cut_10 all 0.3980
ndcg_cut_100 all 0.4742
ndcg_cut_1000 all 0.4692
anserini_nsdm¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.2523
bpref all 0.3097
recip_rank all 0.7045
P_10 all 0.4960
P_100 all 0.1564
P_1000 all 0.0156
recall_10 all 0.2005
recall_100 all 0.4891
recall_1000 all 0.4891
ndcg all 0.4287
ndcg_cut_10 all 0.3769
ndcg_cut_100 all 0.4334
ndcg_cut_1000 all 0.4287
anserini_nax¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1989
bpref all 0.2643
recip_rank all 0.6600
P_10 all 0.4240
P_100 all 0.1214
P_1000 all 0.0121
recall_10 all 0.1693
recall_100 all 0.4047
recall_1000 all 0.4047
ndcg all 0.3518
ndcg_cut_10 all 0.3139
ndcg_cut_100 all 0.3552
ndcg_cut_1000 all 0.3518
anserini_sdmp¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1940
bpref all 0.2482
recip_rank all 0.7582
P_10 all 0.4280
P_100 all 0.1138
P_1000 all 0.0114
recall_10 all 0.1745
recall_100 all 0.4007
recall_1000 all 0.4007
ndcg all 0.3713
ndcg_cut_10 all 0.3343
ndcg_cut_100 all 0.3742
ndcg_cut_1000 all 0.3713
anserini_axp¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.2030
bpref all 0.2672
recip_rank all 0.6692
P_10 all 0.4240
P_100 all 0.1178
P_1000 all 0.0118
recall_10 all 0.1732
recall_100 all 0.4023
recall_1000 all 0.4023
ndcg all 0.3627
ndcg_cut_10 all 0.3184
ndcg_cut_100 all 0.3658
ndcg_cut_1000 all 0.3627
UDInfolab_kweh¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1403
bpref all 0.1917
recip_rank all 0.6208
P_10 all 0.3300
P_100 all 0.0836
P_1000 all 0.0084
recall_10 all 0.1335
recall_100 all 0.2981
recall_1000 all 0.2981
ndcg all 0.2747
ndcg_cut_10 all 0.2466
ndcg_cut_100 all 0.2763
ndcg_cut_1000 all 0.2747
UDInfolab_kwh¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1220
bpref all 0.1757
recip_rank all 0.4928
P_10 all 0.3000
P_100 all 0.0830
P_1000 all 0.0083
recall_10 all 0.1139
recall_100 all 0.2562
recall_1000 all 0.2562
ndcg all 0.2242
ndcg_cut_10 all 0.1871
ndcg_cut_100 all 0.2260
ndcg_cut_1000 all 0.2242
UDInfolab_kwef¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1075
bpref all 0.1678
recip_rank all 0.5867
P_10 all 0.2600
P_100 all 0.0824
P_1000 all 0.0082
recall_10 all 0.1099
recall_100 all 0.2944
recall_1000 all 0.2944
ndcg all 0.2474
ndcg_cut_10 all 0.1927
ndcg_cut_100 all 0.2491
ndcg_cut_1000 all 0.2474
UDInfolab_kwf¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.0924
bpref all 0.1578
recip_rank all 0.4675
P_10 all 0.2540
P_100 all 0.0818
P_1000 all 0.0082
recall_10 all 0.0976
recall_100 all 0.2550
recall_1000 all 0.2550
ndcg all 0.2104
ndcg_cut_10 all 0.1594
ndcg_cut_100 all 0.2122
ndcg_cut_1000 all 0.2104
UDInfolab_kwev¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1470
bpref all 0.1956
recip_rank all 0.6935
P_10 all 0.3900
P_100 all 0.0836
P_1000 all 0.0084
recall_10 all 0.1524
recall_100 all 0.2981
recall_1000 all 0.2981
ndcg all 0.2782
ndcg_cut_10 all 0.2771
ndcg_cut_100 all 0.2800
ndcg_cut_1000 all 0.2782
umass_cbrdm¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.3227
bpref all 0.3831
recip_rank all 0.7851
P_10 all 0.5880
P_100 all 0.1830
P_1000 all 0.0183
recall_10 all 0.2334
recall_100 all 0.5117
recall_1000 all 0.5117
ndcg all 0.4688
ndcg_cut_10 all 0.4411
ndcg_cut_100 all 0.4748
ndcg_cut_1000 all 0.4688
umass_rdm¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.3077
bpref all 0.3720
recip_rank all 0.7957
P_10 all 0.5780
P_100 all 0.1770
P_1000 all 0.0177
recall_10 all 0.2395
recall_100 all 0.5003
recall_1000 all 0.5003
ndcg all 0.4658
ndcg_cut_10 all 0.4442
ndcg_cut_100 all 0.4719
ndcg_cut_1000 all 0.4658
umass_rm¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.3077
bpref all 0.3720
recip_rank all 0.7957
P_10 all 0.5780
P_100 all 0.1770
P_1000 all 0.0177
recall_10 all 0.2395
recall_100 all 0.5003
recall_1000 all 0.5003
ndcg all 0.4658
ndcg_cut_10 all 0.4442
ndcg_cut_100 all 0.4719
ndcg_cut_1000 all 0.4658
signal-ucl-slst¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.6894
bpref all 0.4889
recip_rank all 0.7694
P_10 all 0.5520
P_100 all 0.1012
P_1000 all 0.0101
recall_10 all 0.6502
recall_100 all 0.9600
recall_1000 all 0.9600
ndcg all 0.7417
ndcg_cut_10 all 0.6317
ndcg_cut_100 all 0.7417
ndcg_cut_1000 all 0.7417
signal-ucl-sel¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.7158
bpref all 0.5252
recip_rank all 0.8321
P_10 all 0.5700
P_100 all 0.1012
P_1000 all 0.0101
recall_10 all 0.6738
recall_100 all 0.9600
recall_1000 all 0.9600
ndcg all 0.7594
ndcg_cut_10 all 0.6667
ndcg_cut_100 all 0.7594
ndcg_cut_1000 all 0.7594
signal-ucl-eff¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.7144
bpref all 0.5142
recip_rank all 0.8016
P_10 all 0.5740
P_100 all 0.1012
P_1000 all 0.0101
recall_10 all 0.6709
recall_100 all 0.9600
recall_1000 all 0.9600
ndcg all 0.7589
ndcg_cut_10 all 0.6631
ndcg_cut_100 all 0.7589
ndcg_cut_1000 all 0.7589
UNH-ParaBm25Ecm¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.6828
bpref all 0.5049
recip_rank all 0.7259
P_10 all 0.5500
P_100 all 0.1012
P_1000 all 0.0101
recall_10 all 0.6583
recall_100 all 0.9600
recall_1000 all 0.9600
ndcg all 0.7157
ndcg_cut_10 all 0.6090
ndcg_cut_100 all 0.7157
ndcg_cut_1000 all 0.7157
UNH-ParaBm25¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.7859
bpref all 0.6113
recip_rank all 0.9033
P_10 all 0.6320
P_100 all 0.1012
P_1000 all 0.0101
recall_10 all 0.7312
recall_100 all 0.9600
recall_1000 all 0.9600
ndcg all 0.8214
ndcg_cut_10 all 0.7590
ndcg_cut_100 all 0.8214
ndcg_cut_1000 all 0.8214
UNH-TitleBm25¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.7741
bpref all 0.5852
recip_rank all 0.9073
P_10 all 0.6080
P_100 all 0.1012
P_1000 all 0.0101
recall_10 all 0.7091
recall_100 all 0.9600
recall_1000 all 0.9600
ndcg all 0.8119
ndcg_cut_10 all 0.7366
ndcg_cut_100 all 0.8119
ndcg_cut_1000 all 0.8119
SINAI_base_A¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.2220
bpref all 0.3068
recip_rank all 0.5693
P_10 all 0.4060
P_100 all 0.1528
P_1000 all 0.0153
recall_10 all 0.1479
recall_100 all 0.4364
recall_1000 all 0.4364
ndcg all 0.3997
ndcg_cut_10 all 0.3214
ndcg_cut_100 all 0.4045
ndcg_cut_1000 all 0.3997
SINAI_base_T¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1455
bpref all 0.2345
recip_rank all 0.3806
P_10 all 0.2660
P_100 all 0.1176
P_1000 all 0.0118
recall_10 all 0.1105
recall_100 all 0.3576
recall_1000 all 0.3576
ndcg all 0.2840
ndcg_cut_10 all 0.1952
ndcg_cut_100 all 0.2865
ndcg_cut_1000 all 0.2840
SINAI_base_TA¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.2228
bpref all 0.3067
recip_rank all 0.5595
P_10 all 0.4160
P_100 all 0.1546
P_1000 all 0.0155
recall_10 all 0.1535
recall_100 all 0.4460
recall_1000 all 0.4460
ndcg all 0.3993
ndcg_cut_10 all 0.3195
ndcg_cut_100 all 0.4041
ndcg_cut_1000 all 0.3993
SINAI_cluster_A¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1276
bpref all 0.1757
recip_rank all 0.5662
P_10 all 0.4060
P_100 all 0.0664
P_1000 all 0.0066
recall_10 all 0.1479
recall_100 all 0.2048
recall_1000 all 0.2048
ndcg all 0.2715
ndcg_cut_10 all 0.3214
ndcg_cut_100 all 0.2743
ndcg_cut_1000 all 0.2715
SINAI_cluster_T¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1046
bpref all 0.1750
recip_rank all 0.3815
P_10 all 0.2660
P_100 all 0.0712
P_1000 all 0.0071
recall_10 all 0.1105
recall_100 all 0.2433
recall_1000 all 0.2433
ndcg all 0.2243
ndcg_cut_10 all 0.1952
ndcg_cut_100 all 0.2255
ndcg_cut_1000 all 0.2243
SINAI_clusterTA¶
Metadata | Participants | Proceedings| Input| Summary
summary (trec_eval)
map all 0.1322
bpref all 0.1879
recip_rank all 0.5585
P_10 all 0.4160
P_100 all 0.0732
P_1000 all 0.0073
recall_10 all 0.1535
recall_100 all 0.2126
recall_1000 all 0.2126
ndcg all 0.2731
ndcg_cut_10 all 0.3195
ndcg_cut_100 all 0.2758
ndcg_cut_1000 all 0.2731