Results - News 2021¶
FUH_News_BG¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1023
bpref all 0.1500
recip_rank all 0.5864
P_10 all 0.3176
P_100 all 0.1100
P_1000 all 0.0110
recall_10 all 0.0767
recall_100 all 0.2167
recall_1000 all 0.2167
ndcg all 0.2183
ndcg_cut_10 all 0.2021
ndcg_cut_100 all 0.2193
ndcg_cut_1000 all 0.2183
FUH_News_ST¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0542
bpref all 0.2199
recip_rank all 0.1774
P_10 all 0.0881
P_100 all 0.0244
P_1000 all 0.0024
recall_10 all 0.0915
recall_100 all 0.2218
recall_1000 all 0.2218
ndcg all 0.1285
ndcg_cut_10 all 0.0891
ndcg_cut_100 all 0.1285
ndcg_cut_1000 all 0.1285
TKB48_Run1_DTQ¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2340
bpref all 0.2892
recip_rank all 0.7293
P_10 all 0.4255
P_100 all 0.2408
P_1000 all 0.0241
recall_10 all 0.1132
recall_100 all 0.5416
recall_1000 all 0.5416
ndcg all 0.4196
ndcg_cut_10 all 0.2863
ndcg_cut_100 all 0.4234
ndcg_cut_1000 all 0.4196
TKB48_Run3_skw¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2502
bpref all 0.3025
recip_rank all 0.6633
P_10 all 0.4431
P_100 all 0.2455
P_1000 all 0.0245
recall_10 all 0.1216
recall_100 all 0.5539
recall_1000 all 0.5539
ndcg all 0.4217
ndcg_cut_10 all 0.2738
ndcg_cut_100 all 0.4250
ndcg_cut_1000 all 0.4217
TKB48_Run4_tlkw¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2749
bpref all 0.3306
recip_rank all 0.6953
P_10 all 0.4725
P_100 all 0.2624
P_1000 all 0.0262
recall_10 all 0.1303
recall_100 all 0.5903
recall_1000 all 0.5903
ndcg all 0.4442
ndcg_cut_10 all 0.2820
ndcg_cut_100 all 0.4477
ndcg_cut_1000 all 0.4442
TKB48_Run2_Tep¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2424
bpref all 0.2963
recip_rank all 0.6779
P_10 all 0.4255
P_100 all 0.2455
P_1000 all 0.0245
recall_10 all 0.1185
recall_100 all 0.5486
recall_1000 all 0.5486
ndcg all 0.4164
ndcg_cut_10 all 0.2691
ndcg_cut_100 all 0.4197
ndcg_cut_1000 all 0.4164
TKB48_SRun1_DS¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1930
bpref all 0.7250
recip_rank all 0.3751
P_10 all 0.1867
P_100 all 0.0665
P_1000 all 0.0067
recall_10 all 0.2563
recall_100 all 0.7308
recall_1000 all 0.7308
ndcg all 0.3749
ndcg_cut_10 all 0.2302
ndcg_cut_100 all 0.3749
ndcg_cut_1000 all 0.3749
TKB48_SRun2_Tep¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1765
bpref all 0.7040
recip_rank all 0.3323
P_10 all 0.1548
P_100 all 0.0653
P_1000 all 0.0065
recall_10 all 0.1794
recall_100 all 0.7107
recall_1000 all 0.7107
ndcg all 0.3463
ndcg_cut_10 all 0.1814
ndcg_cut_100 all 0.3463
ndcg_cut_1000 all 0.3463
TKB48_SRun3_DTQ¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1760
bpref all 0.7218
recip_rank all 0.3186
P_10 all 0.1496
P_100 all 0.0662
P_1000 all 0.0066
recall_10 all 0.1797
recall_100 all 0.7285
recall_1000 all 0.7285
ndcg all 0.3454
ndcg_cut_10 all 0.1741
ndcg_cut_100 all 0.3454
ndcg_cut_1000 all 0.3454
TKB48_SRun4_ST¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1914
bpref all 0.7404
recip_rank all 0.3487
P_10 all 0.1748
P_100 all 0.0677
P_1000 all 0.0068
recall_10 all 0.2210
recall_100 all 0.7481
recall_1000 all 0.7481
ndcg all 0.3696
ndcg_cut_10 all 0.2028
ndcg_cut_100 all 0.3696
ndcg_cut_1000 all 0.3696
base¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4285
bpref all 0.4489
recip_rank all 0.8697
P_10 all 0.7000
P_100 all 0.2996
P_1000 all 0.0300
recall_10 all 0.1909
recall_100 all 0.6510
recall_1000 all 0.6510
ndcg all 0.5568
ndcg_cut_10 all 0.4495
ndcg_cut_100 all 0.5605
ndcg_cut_1000 all 0.5568
rel00_ent07¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4253
bpref all 0.4471
recip_rank all 0.8676
P_10 all 0.6863
P_100 all 0.2963
P_1000 all 0.0296
recall_10 all 0.1880
recall_100 all 0.6427
recall_1000 all 0.6427
ndcg all 0.5532
ndcg_cut_10 all 0.4505
ndcg_cut_100 all 0.5569
ndcg_cut_1000 all 0.5532
rel02_ent05¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4290
bpref all 0.4496
recip_rank all 0.8680
P_10 all 0.6902
P_100 all 0.2980
P_1000 all 0.0298
recall_10 all 0.1900
recall_100 all 0.6472
recall_1000 all 0.6472
ndcg all 0.5576
ndcg_cut_10 all 0.4543
ndcg_cut_100 all 0.5613
ndcg_cut_1000 all 0.5576
rel05_ent02¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4319
bpref all 0.4520
recip_rank all 0.8680
P_10 all 0.6941
P_100 all 0.3006
P_1000 all 0.0301
recall_10 all 0.1902
recall_100 all 0.6525
recall_1000 all 0.6525
ndcg all 0.5622
ndcg_cut_10 all 0.4561
ndcg_cut_100 all 0.5659
ndcg_cut_1000 all 0.5622
rel07_ent00¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4303
bpref all 0.4514
recip_rank all 0.8670
P_10 all 0.6922
P_100 all 0.2994
P_1000 all 0.0299
recall_10 all 0.1889
recall_100 all 0.6491
recall_1000 all 0.6491
ndcg all 0.5620
ndcg_cut_10 all 0.4539
ndcg_cut_100 all 0.5657
ndcg_cut_1000 all 0.5620
bm25_sub_0.25¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2388
bpref all 0.7282
recip_rank all 0.3648
P_10 all 0.2244
P_100 all 0.0659
P_1000 all 0.0066
recall_10 all 0.2650
recall_100 all 0.7294
recall_1000 all 0.7294
ndcg all 0.3892
ndcg_cut_10 all 0.2553
ndcg_cut_100 all 0.3892
ndcg_cut_1000 all 0.3892
bm25_sub_0.5¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2518
bpref all 0.7278
recip_rank all 0.3801
P_10 all 0.2370
P_100 all 0.0659
P_1000 all 0.0066
recall_10 all 0.2790
recall_100 all 0.7294
recall_1000 all 0.7294
ndcg all 0.4000
ndcg_cut_10 all 0.2698
ndcg_cut_100 all 0.4000
ndcg_cut_1000 all 0.4000
bm25_sub_1.0¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2678
bpref all 0.7269
recip_rank all 0.4086
P_10 all 0.2541
P_100 all 0.0659
P_1000 all 0.0066
recall_10 all 0.2958
recall_100 all 0.7294
recall_1000 all 0.7294
ndcg all 0.4174
ndcg_cut_10 all 0.2930
ndcg_cut_100 all 0.4174
ndcg_cut_1000 all 0.4174
bm25_sub_2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2810
bpref all 0.7261
recip_rank all 0.4482
P_10 all 0.2689
P_100 all 0.0659
P_1000 all 0.0066
recall_10 all 0.3065
recall_100 all 0.7294
recall_1000 all 0.7294
ndcg all 0.4351
ndcg_cut_10 all 0.3157
ndcg_cut_100 all 0.4351
ndcg_cut_1000 all 0.4351
bm25_sub_4¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2921
bpref all 0.7249
recip_rank all 0.4700
P_10 all 0.2696
P_100 all 0.0659
P_1000 all 0.0066
recall_10 all 0.3264
recall_100 all 0.7294
recall_1000 all 0.7294
ndcg all 0.4471
ndcg_cut_10 all 0.3343
ndcg_cut_100 all 0.4471
ndcg_cut_1000 all 0.4471
300K_ENT_PH¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4256
bpref all 0.4477
recip_rank all 0.8710
P_10 all 0.7059
P_100 all 0.3006
P_1000 all 0.0301
recall_10 all 0.1894
recall_100 all 0.6604
recall_1000 all 0.6604
ndcg all 0.5703
ndcg_cut_10 all 0.4601
ndcg_cut_100 all 0.5739
ndcg_cut_1000 all 0.5703
midd-rf¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0036
bpref all 0.0051
recip_rank all 0.0204
P_10 all 0.0137
P_100 all 0.0045
P_1000 all 0.0005
recall_10 all 0.0022
recall_100 all 0.0070
recall_1000 all 0.0070
ndcg all 0.0060
ndcg_cut_10 all 0.0040
ndcg_cut_100 all 0.0060
ndcg_cut_1000 all 0.0060
midd-direct¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0032
bpref all 0.0048
recip_rank all 0.0206
P_10 all 0.0078
P_100 all 0.0047
P_1000 all 0.0005
recall_10 all 0.0012
recall_100 all 0.0073
recall_1000 all 0.0073
ndcg all 0.0051
ndcg_cut_10 all 0.0027
ndcg_cut_100 all 0.0052
ndcg_cut_1000 all 0.0051
midd-twostage¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0025
bpref all 0.0043
recip_rank all 0.0204
P_10 all 0.0078
P_100 all 0.0035
P_1000 all 0.0004
recall_10 all 0.0012
recall_100 all 0.0055
recall_1000 all 0.0055
ndcg all 0.0039
ndcg_cut_10 all 0.0027
ndcg_cut_100 all 0.0040
ndcg_cut_1000 all 0.0039
midd-transfer¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0013
bpref all 0.0029
recip_rank all 0.0210
P_10 all 0.0059
P_100 all 0.0025
P_1000 all 0.0003
recall_10 all 0.0009
recall_100 all 0.0039
recall_1000 all 0.0039
ndcg all 0.0033
ndcg_cut_10 all 0.0021
ndcg_cut_100 all 0.0033
ndcg_cut_1000 all 0.0033
SU_BiEnc¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.6462
bpref all 0.6159
recip_rank all 0.8922
P_10 all 0.6294
P_100 all 0.0992
P_1000 all 0.0099
recall_10 all 0.6236
recall_100 all 0.9458
recall_1000 all 0.9458
ndcg all 0.7832
ndcg_cut_10 all 0.6568
ndcg_cut_100 all 0.7832
ndcg_cut_1000 all 0.7832
SU_BiEnc_CrsEnc¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.7091
bpref all 0.6915
recip_rank all 0.9183
P_10 all 0.6569
P_100 all 0.0990
P_1000 all 0.0099
recall_10 all 0.6623
recall_100 all 0.9566
recall_1000 all 0.9566
ndcg all 0.8475
ndcg_cut_10 all 0.7525
ndcg_cut_100 all 0.8475
ndcg_cut_1000 all 0.8475
UW_UDHAVSETHI¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2252
bpref all 0.2589
recip_rank all 0.7692
P_10 all 0.5490
P_100 all 0.1812
P_1000 all 0.0181
recall_10 all 0.1353
recall_100 all 0.3507
recall_1000 all 0.3507
ndcg all 0.3431
ndcg_cut_10 all 0.3450
ndcg_cut_100 all 0.3457
ndcg_cut_1000 all 0.3431
SU_ES_CrsEnc¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.6738
bpref all 0.6761
recip_rank all 0.9281
P_10 all 0.6647
P_100 all 0.0912
P_1000 all 0.0091
recall_10 all 0.6558
recall_100 all 0.8651
recall_1000 all 0.8651
ndcg all 0.7967
ndcg_cut_10 all 0.7406
ndcg_cut_100 all 0.7967
ndcg_cut_1000 all 0.7967
SU_ES¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4965
bpref all 0.5002
recip_rank all 0.8639
P_10 all 0.5314
P_100 all 0.0757
P_1000 all 0.0076
recall_10 all 0.5208
recall_100 all 0.7087
recall_1000 all 0.7087
ndcg all 0.6731
ndcg_cut_10 all 0.6291
ndcg_cut_100 all 0.6731
ndcg_cut_1000 all 0.6731
UW_UDHAVSETHI_S¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1037
bpref all 0.3072
recip_rank all 0.2929
P_10 all 0.1378
P_100 all 0.0337
P_1000 all 0.0034
recall_10 all 0.1213
recall_100 all 0.3072
recall_1000 all 0.3072
ndcg all 0.1855
ndcg_cut_10 all 0.1379
ndcg_cut_100 all 0.1855
ndcg_cut_1000 all 0.1855
SU_ES_CrsEnc_NF¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.6743
bpref all 0.6759
recip_rank all 0.9379
P_10 all 0.6608
P_100 all 0.0918
P_1000 all 0.0092
recall_10 all 0.6530
recall_100 all 0.8693
recall_1000 all 0.8693
ndcg all 0.7997
ndcg_cut_10 all 0.7403
ndcg_cut_100 all 0.7997
ndcg_cut_1000 all 0.7997
UW_UDHAV_S100¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0359
bpref all 0.0918
recip_rank all 0.1955
P_10 all 0.0630
P_100 all 0.0110
P_1000 all 0.0011
recall_10 all 0.0536
recall_100 all 0.0918
recall_1000 all 0.0918
ndcg all 0.0753
ndcg_cut_10 all 0.0675
ndcg_cut_100 all 0.0753
ndcg_cut_1000 all 0.0753
300K_ENT_PH_DN¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4081
bpref all 0.4306
recip_rank all 0.8164
P_10 all 0.7000
P_100 all 0.2802
P_1000 all 0.0280
recall_10 all 0.1884
recall_100 all 0.5987
recall_1000 all 0.5987
ndcg all 0.5377
ndcg_cut_10 all 0.4522
ndcg_cut_100 all 0.5413
ndcg_cut_1000 all 0.5377
QU_SP_MBERT¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1804
bpref all 0.4142
recip_rank all 0.4456
P_10 all 0.1956
P_100 all 0.0416
P_1000 all 0.0042
recall_10 all 0.2216
recall_100 all 0.4142
recall_1000 all 0.4142
ndcg all 0.2847
ndcg_cut_10 all 0.2336
ndcg_cut_100 all 0.2847
ndcg_cut_1000 all 0.2847
QU_SP_MSM¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1601
bpref all 0.4142
recip_rank all 0.3932
P_10 all 0.1674
P_100 all 0.0416
P_1000 all 0.0042
recall_10 all 0.1848
recall_100 all 0.4142
recall_1000 all 0.4142
ndcg all 0.2616
ndcg_cut_10 all 0.1983
ndcg_cut_100 all 0.2616
ndcg_cut_1000 all 0.2616
QU_SS_MSM¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1641
bpref all 0.4022
recip_rank all 0.4077
P_10 all 0.1815
P_100 all 0.0407
P_1000 all 0.0041
recall_10 all 0.1982
recall_100 all 0.4022
recall_1000 all 0.4022
ndcg all 0.2598
ndcg_cut_10 all 0.2019
ndcg_cut_100 all 0.2598
ndcg_cut_1000 all 0.2598
KWVec¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4237
bpref all 0.4468
recip_rank all 0.8452
P_10 all 0.6980
P_100 all 0.3075
P_1000 all 0.0307
recall_10 all 0.1883
recall_100 all 0.6470
recall_1000 all 0.6470
ndcg all 0.5655
ndcg_cut_10 all 0.4469
ndcg_cut_100 all 0.5693
ndcg_cut_1000 all 0.5655
KWVec_sub¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2700
bpref all 0.7396
recip_rank all 0.4904
P_10 all 0.2407
P_100 all 0.0687
P_1000 all 0.0069
recall_10 all 0.2934
recall_100 all 0.7476
recall_1000 all 0.7476
ndcg all 0.4461
ndcg_cut_10 all 0.3118
ndcg_cut_100 all 0.4461
ndcg_cut_1000 all 0.4461
Lambda¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3961
bpref all 0.4222
recip_rank all 0.8370
P_10 all 0.6725
P_100 all 0.2812
P_1000 all 0.0281
recall_10 all 0.1727
recall_100 all 0.5878
recall_1000 all 0.5878
ndcg all 0.5284
ndcg_cut_10 all 0.4282
ndcg_cut_100 all 0.5321
ndcg_cut_1000 all 0.5284
Lambda_narr¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4265
bpref all 0.4607
recip_rank all 0.9219
P_10 all 0.7098
P_100 all 0.2898
P_1000 all 0.0290
recall_10 all 0.1958
recall_100 all 0.6402
recall_1000 all 0.6402
ndcg all 0.5831
ndcg_cut_10 all 0.4859
ndcg_cut_100 all 0.5865
ndcg_cut_1000 all 0.5831
Lambda_sub¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2591
bpref all 0.7026
recip_rank all 0.4913
P_10 all 0.2356
P_100 all 0.0659
P_1000 all 0.0066
recall_10 all 0.2877
recall_100 all 0.7026
recall_1000 all 0.7026
ndcg all 0.4272
ndcg_cut_10 all 0.3020
ndcg_cut_100 all 0.4272
ndcg_cut_1000 all 0.4272
QU_LeadPar¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3105
bpref all 0.3452
recip_rank all 0.7968
P_10 all 0.6314
P_100 all 0.2398
P_1000 all 0.0240
recall_10 all 0.1519
recall_100 all 0.4607
recall_1000 all 0.4607
ndcg all 0.4036
ndcg_cut_10 all 0.3631
ndcg_cut_100 all 0.4067
ndcg_cut_1000 all 0.4036
QU_YakeTruss¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2911
bpref all 0.3221
recip_rank all 0.7612
P_10 all 0.5863
P_100 all 0.2231
P_1000 all 0.0223
recall_10 all 0.1385
recall_100 all 0.4229
recall_1000 all 0.4229
ndcg all 0.3690
ndcg_cut_10 all 0.3348
ndcg_cut_100 all 0.3720
ndcg_cut_1000 all 0.3690
S300K_PH_DN¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2262
bpref all 0.6836
recip_rank all 0.3789
P_10 all 0.2237
P_100 all 0.0642
P_1000 all 0.0064
recall_10 all 0.2379
recall_100 all 0.6869
recall_1000 all 0.6869
ndcg all 0.3779
ndcg_cut_10 all 0.2414
ndcg_cut_100 all 0.3779
ndcg_cut_1000 all 0.3779
S300K_ENT_PH_DN¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2206
bpref all 0.6618
recip_rank all 0.3884
P_10 all 0.2222
P_100 all 0.0622
P_1000 all 0.0062
recall_10 all 0.2337
recall_100 all 0.6659
recall_1000 all 0.6659
ndcg all 0.3755
ndcg_cut_10 all 0.2450
ndcg_cut_100 all 0.3755
ndcg_cut_1000 all 0.3755
S300K_ENT_P_DN2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2226
bpref all 0.6628
recip_rank all 0.3832
P_10 all 0.2215
P_100 all 0.0622
P_1000 all 0.0062
recall_10 all 0.2311
recall_100 all 0.6666
recall_1000 all 0.6666
ndcg all 0.3785
ndcg_cut_10 all 0.2460
ndcg_cut_100 all 0.3785
ndcg_cut_1000 all 0.3785