Results - Deep Learning 2019¶
TUA1-1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4571
bpref all 0.4858
recip_rank all 0.8702
P_10 all 0.6372
P_100 all 0.2544
P_1000 all 0.0375
recall_10 all 0.2706
recall_100 all 0.5836
recall_1000 all 0.6943
ndcg all 0.6629
ndcg_cut_10 all 0.7314
ndcg_cut_100 all 0.6348
ndcg_cut_1000 all 0.6629
summary (trec_eval)
map all 0.4723
bpref all 0.5668
recip_rank all 0.9690
P_10 all 0.8279
P_100 all 0.3777
P_1000 all 0.0603
recall_10 all 0.1756
recall_100 all 0.5204
recall_1000 all 0.6778
ndcg all 0.6629
ndcg_cut_10 all 0.7314
ndcg_cut_100 all 0.6348
ndcg_cut_1000 all 0.6629
idst_bert_v1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3825
bpref all 0.4612
recip_rank all 0.9729
P_10 all 0.8000
P_100 all 0.3563
P_1000 all 0.0746
recall_10 all 0.1688
recall_100 all 0.4191
recall_1000 all 0.6182
ndcg all 0.6255
ndcg_cut_10 all 0.7175
ndcg_cut_100 all 0.6073
ndcg_cut_1000 all 0.6255
idst_bert_v2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3853
bpref all 0.4627
recip_rank all 0.9612
P_10 all 0.8000
P_100 all 0.3663
P_1000 all 0.0749
recall_10 all 0.1641
recall_100 all 0.4298
recall_1000 all 0.6214
ndcg all 0.6276
ndcg_cut_10 all 0.7181
ndcg_cut_100 all 0.6152
ndcg_cut_1000 all 0.6276
TUW19-p2-f¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4157
bpref all 0.4479
recip_rank all 0.8487
P_10 all 0.5767
P_100 all 0.2519
P_1000 all 0.0401
recall_10 all 0.2441
recall_100 all 0.5818
recall_1000 all 0.7390
ndcg all 0.6714
ndcg_cut_10 all 0.6709
ndcg_cut_100 all 0.6168
ndcg_cut_1000 all 0.6714
summary (trec_eval)
map all 0.4682
bpref all 0.5768
recip_rank all 0.9360
P_10 all 0.7837
P_100 all 0.3735
P_1000 all 0.0648
recall_10 all 0.1688
recall_100 all 0.5236
recall_1000 all 0.7343
ndcg all 0.6714
ndcg_cut_10 all 0.6709
ndcg_cut_100 all 0.6168
ndcg_cut_1000 all 0.6714
TUW19-p2-re¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.3963
bpref all 0.4211
recip_rank all 0.8611
P_10 all 0.5651
P_100 all 0.2407
P_1000 all 0.0375
recall_10 all 0.2400
recall_100 all 0.5595
recall_1000 all 0.6943
ndcg all 0.6361
ndcg_cut_10 all 0.6615
ndcg_cut_100 all 0.5919
ndcg_cut_1000 all 0.6361
summary (trec_eval)
map all 0.4395
bpref all 0.5377
recip_rank all 0.9477
P_10 all 0.7674
P_100 all 0.3570
P_1000 all 0.0603
recall_10 all 0.1606
recall_100 all 0.4919
recall_1000 all 0.6778
ndcg all 0.6361
ndcg_cut_10 all 0.6615
ndcg_cut_100 all 0.5919
ndcg_cut_1000 all 0.6361
TUW19-d1-f¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1647
bpref all 0.1796
recip_rank all 0.8465
P_10 all 0.6256
P_100 all 0.1219
P_1000 all 0.0122
recall_10 all 0.1301
recall_100 all 0.2297
recall_1000 all 0.2297
ndcg all 0.3143
ndcg_cut_10 all 0.5383
ndcg_cut_100 all 0.3490
ndcg_cut_1000 all 0.3143
TUW19-d1-re¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2524
bpref all 0.2954
recip_rank all 0.8915
P_10 all 0.6884
P_100 all 0.3056
P_1000 all 0.0306
recall_10 all 0.1359
recall_100 all 0.3871
recall_1000 all 0.3871
ndcg all 0.4445
ndcg_cut_10 all 0.5930
ndcg_cut_100 all 0.5147
ndcg_cut_1000 all 0.4445
TUW19-p1-f¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4125
bpref all 0.4484
recip_rank all 0.8360
P_10 all 0.5744
P_100 all 0.2412
P_1000 all 0.0401
recall_10 all 0.2490
recall_100 all 0.5510
recall_1000 all 0.7391
ndcg all 0.6669
ndcg_cut_10 all 0.6756
ndcg_cut_100 all 0.6036
ndcg_cut_1000 all 0.6669
summary (trec_eval)
map all 0.4607
bpref all 0.5681
recip_rank all 0.9399
P_10 all 0.7721
P_100 all 0.3628
P_1000 all 0.0649
recall_10 all 0.1681
recall_100 all 0.5105
recall_1000 all 0.7348
ndcg all 0.6669
ndcg_cut_10 all 0.6756
ndcg_cut_100 all 0.6036
ndcg_cut_1000 all 0.6669
TUW19-p1-re¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4073
bpref all 0.4395
recip_rank all 0.8516
P_10 all 0.5698
P_100 all 0.2309
P_1000 all 0.0375
recall_10 all 0.2495
recall_100 all 0.5419
recall_1000 all 0.6943
ndcg all 0.6399
ndcg_cut_10 all 0.6746
ndcg_cut_100 all 0.5927
ndcg_cut_1000 all 0.6399
summary (trec_eval)
map all 0.4431
bpref all 0.5406
recip_rank all 0.9471
P_10 all 0.7698
P_100 all 0.3512
P_1000 all 0.0603
recall_10 all 0.1661
recall_100 all 0.4944
recall_1000 all 0.6778
ndcg all 0.6399
ndcg_cut_10 all 0.6746
ndcg_cut_100 all 0.5927
ndcg_cut_1000 all 0.6399
TUW19-p3-f¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4196
bpref all 0.4483
recip_rank all 0.8407
P_10 all 0.5977
P_100 all 0.2507
P_1000 all 0.0401
recall_10 all 0.2584
recall_100 all 0.5663
recall_1000 all 0.7391
ndcg all 0.6714
ndcg_cut_10 all 0.6884
ndcg_cut_100 all 0.6168
ndcg_cut_1000 all 0.6714
summary (trec_eval)
map all 0.4739
bpref all 0.5744
recip_rank all 0.9523
P_10 all 0.7884
P_100 all 0.3744
P_1000 all 0.0649
recall_10 all 0.1696
recall_100 all 0.5271
recall_1000 all 0.7348
ndcg all 0.6714
ndcg_cut_10 all 0.6884
ndcg_cut_100 all 0.6168
ndcg_cut_1000 all 0.6714
TUW19-p3-re¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4113
bpref all 0.4341
recip_rank all 0.8568
P_10 all 0.5767
P_100 all 0.2391
P_1000 all 0.0375
recall_10 all 0.2568
recall_100 all 0.5558
recall_1000 all 0.6943
ndcg all 0.6413
ndcg_cut_10 all 0.6746
ndcg_cut_100 all 0.6001
ndcg_cut_1000 all 0.6413
summary (trec_eval)
map all 0.4522
bpref all 0.5420
recip_rank all 0.9583
P_10 all 0.7651
P_100 all 0.3612
P_1000 all 0.0603
recall_10 all 0.1640
recall_100 all 0.5026
recall_1000 all 0.6778
ndcg all 0.6413
ndcg_cut_10 all 0.6746
ndcg_cut_100 all 0.6001
ndcg_cut_1000 all 0.6413
idst_bert_r1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2915
bpref all 0.3191
recip_rank all 0.9729
P_10 all 0.7977
P_100 all 0.3056
P_1000 all 0.0306
recall_10 all 0.1741
recall_100 all 0.3871
recall_1000 all 0.3871
ndcg all 0.4824
ndcg_cut_10 all 0.7189
ndcg_cut_100 all 0.5575
ndcg_cut_1000 all 0.4824
idst_bert_r2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2910
bpref all 0.3188
recip_rank all 0.9729
P_10 all 0.7930
P_100 all 0.3056
P_1000 all 0.0306
recall_10 all 0.1742
recall_100 all 0.3871
recall_1000 all 0.3871
ndcg all 0.4809
ndcg_cut_10 all 0.7135
ndcg_cut_100 all 0.5560
ndcg_cut_1000 all 0.4809
idst_bert_v3¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3678
bpref all 0.4300
recip_rank all 0.9612
P_10 all 0.8093
P_100 all 0.3577
P_1000 all 0.0615
recall_10 all 0.1734
recall_100 all 0.4221
recall_1000 all 0.5564
ndcg all 0.5922
ndcg_cut_10 all 0.7257
ndcg_cut_100 all 0.6059
ndcg_cut_1000 all 0.5922
runid1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2366
bpref all 0.2810
recip_rank all 0.7811
P_10 all 0.5977
P_100 all 0.3056
P_1000 all 0.0306
recall_10 all 0.1436
recall_100 all 0.3871
recall_1000 all 0.3871
ndcg all 0.4299
ndcg_cut_10 all 0.5164
ndcg_cut_100 all 0.4951
ndcg_cut_1000 all 0.4299
ucas_runid1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2642
bpref all 0.3063
recip_rank all 0.9109
P_10 all 0.7023
P_100 all 0.3056
P_1000 all 0.0306
recall_10 all 0.1556
recall_100 all 0.3871
recall_1000 all 0.3871
ndcg all 0.4650
ndcg_cut_10 all 0.6437
ndcg_cut_100 all 0.5363
ndcg_cut_1000 all 0.4650
ucas_runid2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2526
bpref all 0.3011
recip_rank all 0.9496
P_10 all 0.6837
P_100 all 0.3056
P_1000 all 0.0306
recall_10 all 0.1389
recall_100 all 0.3871
recall_1000 all 0.3871
ndcg all 0.4607
ndcg_cut_10 all 0.6350
ndcg_cut_100 all 0.5319
ndcg_cut_1000 all 0.4607
idst_bert_p1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.5030
bpref all 0.5444
recip_rank all 0.9283
P_10 all 0.6721
P_100 all 0.2807
P_1000 all 0.0456
recall_10 all 0.2888
recall_100 all 0.6357
recall_1000 all 0.8352
ndcg all 0.7477
ndcg_cut_10 all 0.7645
ndcg_cut_100 all 0.6848
ndcg_cut_1000 all 0.7477
summary (trec_eval)
map all 0.5290
bpref all 0.6668
recip_rank all 0.9729
P_10 all 0.8721
P_100 all 0.4037
P_1000 all 0.0716
recall_10 all 0.1873
recall_100 all 0.5621
recall_1000 all 0.8029
ndcg all 0.7477
ndcg_cut_10 all 0.7645
ndcg_cut_100 all 0.6848
ndcg_cut_1000 all 0.7477
ucas_runid3¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2677
bpref all 0.3104
recip_rank all 0.8992
P_10 all 0.7000
P_100 all 0.3056
P_1000 all 0.0306
recall_10 all 0.1550
recall_100 all 0.3871
recall_1000 all 0.3871
ndcg all 0.4667
ndcg_cut_10 all 0.6418
ndcg_cut_100 all 0.5379
ndcg_cut_1000 all 0.4667
baseline¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2892
bpref all 0.3981
recip_rank all 0.8037
P_10 all 0.5512
P_100 all 0.2951
P_1000 all 0.0790
recall_10 all 0.1230
recall_100 all 0.3815
recall_1000 all 0.6383
ndcg all 0.5563
ndcg_cut_10 all 0.4823
ndcg_cut_100 all 0.4834
ndcg_cut_1000 all 0.5563
idst_bert_p2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.5039
bpref all 0.5509
recip_rank all 0.9283
P_10 all 0.6744
P_100 all 0.2772
P_1000 all 0.0453
recall_10 all 0.2965
recall_100 all 0.6402
recall_1000 all 0.8439
ndcg all 0.7457
ndcg_cut_10 all 0.7632
ndcg_cut_100 all 0.6828
ndcg_cut_1000 all 0.7457
summary (trec_eval)
map all 0.5193
bpref all 0.6665
recip_rank all 0.9729
P_10 all 0.8651
P_100 all 0.3972
P_1000 all 0.0709
recall_10 all 0.1847
recall_100 all 0.5603
recall_1000 all 0.7983
ndcg all 0.7457
ndcg_cut_10 all 0.7632
ndcg_cut_100 all 0.6828
ndcg_cut_1000 all 0.7457
idst_bert_p3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.5046
bpref all 0.5467
recip_rank all 0.9167
P_10 all 0.6581
P_100 all 0.2807
P_1000 all 0.0460
recall_10 all 0.2791
recall_100 all 0.6362
recall_1000 all 0.8443
ndcg all 0.7516
ndcg_cut_10 all 0.7594
ndcg_cut_100 all 0.6862
ndcg_cut_1000 all 0.7516
summary (trec_eval)
map all 0.5307
bpref all 0.6677
recip_rank all 0.9709
P_10 all 0.8674
P_100 all 0.4060
P_1000 all 0.0722
recall_10 all 0.1858
recall_100 all 0.5666
recall_1000 all 0.8122
ndcg all 0.7516
ndcg_cut_10 all 0.7594
ndcg_cut_100 all 0.6862
ndcg_cut_1000 all 0.7516
TUW19-d2-f¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2050
bpref all 0.2385
recip_rank all 0.8711
P_10 all 0.6326
P_100 all 0.2086
P_1000 all 0.0209
recall_10 all 0.1215
recall_100 all 0.3205
recall_1000 all 0.3205
ndcg all 0.3819
ndcg_cut_10 all 0.5596
ndcg_cut_100 all 0.4329
ndcg_cut_1000 all 0.3819
TUW19-d2-re¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2391
bpref all 0.2881
recip_rank all 0.9147
P_10 all 0.6814
P_100 all 0.3056
P_1000 all 0.0306
recall_10 all 0.1285
recall_100 all 0.3871
recall_1000 all 0.3871
ndcg all 0.4447
ndcg_cut_10 all 0.6053
ndcg_cut_100 all 0.5158
ndcg_cut_1000 all 0.4447
idst_bert_pr1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4571
bpref all 0.4830
recip_rank all 0.9070
P_10 all 0.6349
P_100 all 0.2519
P_1000 all 0.0375
recall_10 all 0.2700
recall_100 all 0.5747
recall_1000 all 0.6943
ndcg all 0.6653
ndcg_cut_10 all 0.7378
ndcg_cut_100 all 0.6354
ndcg_cut_1000 all 0.6653
summary (trec_eval)
map all 0.4765
bpref all 0.5688
recip_rank all 0.9767
P_10 all 0.8372
P_100 all 0.3740
P_1000 all 0.0603
recall_10 all 0.1767
recall_100 all 0.5131
recall_1000 all 0.6778
ndcg all 0.6653
ndcg_cut_10 all 0.7378
ndcg_cut_100 all 0.6354
ndcg_cut_1000 all 0.6653
TUW19-d3-f¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1843
bpref all 0.2009
recip_rank all 0.8929
P_10 all 0.6256
P_100 all 0.1291
P_1000 all 0.0129
recall_10 all 0.1430
recall_100 all 0.2385
recall_1000 all 0.2385
ndcg all 0.3329
ndcg_cut_10 all 0.5576
ndcg_cut_100 all 0.3691
ndcg_cut_1000 all 0.3329
TUW19-d3-re¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2709
bpref all 0.3037
recip_rank all 0.9457
P_10 all 0.7302
P_100 all 0.3056
P_1000 all 0.0306
recall_10 all 0.1563
recall_100 all 0.3871
recall_1000 all 0.3871
ndcg all 0.4649
ndcg_cut_10 all 0.6443
ndcg_cut_100 all 0.5358
ndcg_cut_1000 all 0.4649
idst_bert_pr2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4565
bpref all 0.4822
recip_rank all 0.8818
P_10 all 0.6372
P_100 all 0.2523
P_1000 all 0.0375
recall_10 all 0.2705
recall_100 all 0.5789
recall_1000 all 0.6943
ndcg all 0.6644
ndcg_cut_10 all 0.7379
ndcg_cut_100 all 0.6357
ndcg_cut_1000 all 0.6644
summary (trec_eval)
map all 0.4776
bpref all 0.5683
recip_rank all 0.9729
P_10 all 0.8395
P_100 all 0.3749
P_1000 all 0.0603
recall_10 all 0.1783
recall_100 all 0.5199
recall_1000 all 0.6778
ndcg all 0.6644
ndcg_cut_10 all 0.7379
ndcg_cut_100 all 0.6357
ndcg_cut_1000 all 0.6644
bm25base¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3309
bpref all 0.4327
recip_rank all 0.8046
P_10 all 0.5884
P_100 all 0.3109
P_1000 all 0.0865
recall_10 all 0.1462
recall_100 all 0.3948
recall_1000 all 0.6966
ndcg all 0.5941
ndcg_cut_10 all 0.5190
ndcg_cut_100 all 0.4974
ndcg_cut_1000 all 0.5941
bm25base_rm3¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3870
bpref all 0.4776
recip_rank all 0.7718
P_10 all 0.6023
P_100 all 0.3519
P_1000 all 0.0992
recall_10 all 0.1474
recall_100 all 0.4189
recall_1000 all 0.7504
ndcg all 0.6251
ndcg_cut_10 all 0.5169
ndcg_cut_100 all 0.5215
ndcg_cut_1000 all 0.6251
bm25base_ax¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3516
bpref all 0.4417
recip_rank all 0.7428
P_10 all 0.5930
P_100 all 0.3305
P_1000 all 0.0969
recall_10 all 0.1346
recall_100 all 0.3945
recall_1000 all 0.7323
ndcg all 0.5896
ndcg_cut_10 all 0.4730
ndcg_cut_100 all 0.4762
ndcg_cut_1000 all 0.5896
bm25base_prf¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3626
bpref all 0.4556
recip_rank all 0.7775
P_10 all 0.6023
P_100 all 0.3391
P_1000 all 0.0975
recall_10 all 0.1459
recall_100 all 0.4004
recall_1000 all 0.7357
ndcg all 0.6084
ndcg_cut_10 all 0.5106
ndcg_cut_100 all 0.5007
ndcg_cut_1000 all 0.6084
bm25tuned¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3138
bpref all 0.3975
recip_rank all 0.8872
P_10 all 0.5837
P_100 all 0.3191
P_1000 all 0.0833
recall_10 all 0.1277
recall_100 all 0.3862
recall_1000 all 0.6810
ndcg all 0.5824
ndcg_cut_10 all 0.5140
ndcg_cut_100 all 0.5025
ndcg_cut_1000 all 0.5824
bm25tuned_rm3¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3697
bpref all 0.4434
recip_rank all 0.8074
P_10 all 0.6302
P_100 all 0.3509
P_1000 all 0.0921
recall_10 all 0.1338
recall_100 all 0.4193
recall_1000 all 0.7282
ndcg all 0.6255
ndcg_cut_10 all 0.5485
ndcg_cut_100 all 0.5379
ndcg_cut_1000 all 0.6255
bm25tuned_ax¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3860
bpref all 0.4535
recip_rank all 0.7492
P_10 all 0.6233
P_100 all 0.3709
P_1000 all 0.0953
recall_10 all 0.1385
recall_100 all 0.4399
recall_1000 all 0.7545
ndcg all 0.6298
ndcg_cut_10 all 0.5245
ndcg_cut_100 all 0.5416
ndcg_cut_1000 all 0.6298
bm25tuned_prf¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3859
bpref all 0.4727
recip_rank all 0.8007
P_10 all 0.6209
P_100 all 0.3502
P_1000 all 0.0990
recall_10 all 0.1315
recall_100 all 0.4287
recall_1000 all 0.7553
ndcg all 0.6348
ndcg_cut_10 all 0.5281
ndcg_cut_100 all 0.5283
ndcg_cut_1000 all 0.6348
ms_duet¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2291
bpref all 0.2801
recip_rank all 0.8101
P_10 all 0.6256
P_100 all 0.3056
P_1000 all 0.0306
recall_10 all 0.1328
recall_100 all 0.3871
recall_1000 all 0.3871
ndcg all 0.4266
ndcg_cut_10 all 0.5330
ndcg_cut_100 all 0.4939
ndcg_cut_1000 all 0.4266
uogTrDNN6LM¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3158
bpref all 0.4026
recip_rank all 0.8729
P_10 all 0.6744
P_100 all 0.3016
P_1000 all 0.0757
recall_10 all 0.1446
recall_100 all 0.3712
recall_1000 all 0.6282
ndcg all 0.5771
ndcg_cut_10 all 0.6046
ndcg_cut_100 all 0.5193
ndcg_cut_1000 all 0.5771
uogTrDSSQE5LM¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1240
bpref all 0.3843
recip_rank all 0.8896
P_10 all 0.5442
P_100 all 0.0779
P_1000 all 0.0552
recall_10 all 0.0961
recall_100 all 0.1189
recall_1000 all 0.5485
ndcg all 0.4207
ndcg_cut_10 all 0.5386
ndcg_cut_100 all 0.2872
ndcg_cut_1000 all 0.4207
srchvrs_run1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3491
bpref all 0.4275
recip_rank all 0.8715
P_10 all 0.6349
P_100 all 0.3395
P_1000 all 0.0841
recall_10 all 0.1416
recall_100 all 0.4168
recall_1000 all 0.6701
ndcg all 0.5994
ndcg_cut_10 all 0.5609
ndcg_cut_100 all 0.5393
ndcg_cut_1000 all 0.5994
dct_qp_bm25e¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2858
bpref all 0.3802
recip_rank all 0.8915
P_10 all 0.6140
P_100 all 0.3005
P_1000 all 0.0710
recall_10 all 0.1206
recall_100 all 0.3510
recall_1000 all 0.6061
ndcg all 0.5477
ndcg_cut_10 all 0.5435
ndcg_cut_100 all 0.4902
ndcg_cut_1000 all 0.5477
ms_ensemble¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2369
bpref all 0.2720
recip_rank all 0.8760
P_10 all 0.6442
P_100 all 0.2898
P_1000 all 0.0290
recall_10 all 0.1313
recall_100 all 0.3680
recall_1000 all 0.3680
ndcg all 0.4349
ndcg_cut_10 all 0.5784
ndcg_cut_100 all 0.4988
ndcg_cut_1000 all 0.4349
dct_tp_bm25e2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2852
bpref all 0.3724
recip_rank all 0.8718
P_10 all 0.6349
P_100 all 0.3009
P_1000 all 0.0700
recall_10 all 0.1173
recall_100 all 0.3580
recall_1000 all 0.5950
ndcg all 0.5490
ndcg_cut_10 all 0.5544
ndcg_cut_100 all 0.4973
ndcg_cut_1000 all 0.5490
dct_tp_bm25e¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2628
bpref all 0.3582
recip_rank all 0.8638
P_10 all 0.6372
P_100 all 0.2849
P_1000 all 0.0647
recall_10 all 0.1161
recall_100 all 0.3424
recall_1000 all 0.5642
ndcg all 0.5240
ndcg_cut_10 all 0.5424
ndcg_cut_100 all 0.4768
ndcg_cut_1000 all 0.5240
srchvrs_run2¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3459
bpref all 0.4281
recip_rank all 0.8715
P_10 all 0.6326
P_100 all 0.3363
P_1000 all 0.0841
recall_10 all 0.1397
recall_100 all 0.4137
recall_1000 all 0.6701
ndcg all 0.5975
ndcg_cut_10 all 0.5529
ndcg_cut_100 all 0.5357
ndcg_cut_1000 all 0.5975
bm25exp_marcomb¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.4243
bpref all 0.4942
recip_rank all 0.8992
P_10 all 0.7465
P_100 all 0.4035
P_1000 all 0.0916
recall_10 all 0.1487
recall_100 all 0.4671
recall_1000 all 0.7241
ndcg all 0.6664
ndcg_cut_10 all 0.6456
ndcg_cut_100 all 0.6193
ndcg_cut_1000 all 0.6664
bm25_marcomb¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.4285
bpref all 0.4924
recip_rank all 0.9128
P_10 all 0.7326
P_100 all 0.4030
P_1000 all 0.0921
recall_10 all 0.1465
recall_100 all 0.4667
recall_1000 all 0.7282
ndcg all 0.6681
ndcg_cut_10 all 0.6403
ndcg_cut_100 all 0.6190
ndcg_cut_1000 all 0.6681
bm25exp_marco¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.4036
bpref all 0.4724
recip_rank all 0.9031
P_10 all 0.7116
P_100 all 0.3879
P_1000 all 0.0916
recall_10 all 0.1496
recall_100 all 0.4599
recall_1000 all 0.7241
ndcg all 0.6565
ndcg_cut_10 all 0.6399
ndcg_cut_100 all 0.6008
ndcg_cut_1000 all 0.6565
uogTrDSS6pLM¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.1250
bpref all 0.3497
recip_rank all 0.8896
P_10 all 0.5372
P_100 all 0.0786
P_1000 all 0.0466
recall_10 all 0.1026
recall_100 all 0.1248
recall_1000 all 0.4899
ndcg all 0.3918
ndcg_cut_10 all 0.5323
ndcg_cut_100 all 0.2841
ndcg_cut_1000 all 0.3918
query2doc_RNN¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0111
bpref all 0.0535
recip_rank all 0.2161
P_10 all 0.0837
P_100 all 0.0784
P_1000 all 0.0078
recall_10 all 0.0109
recall_100 all 0.0697
recall_1000 all 0.0697
ndcg all 0.0643
ndcg_cut_10 all 0.0534
ndcg_cut_100 all 0.0806
ndcg_cut_1000 all 0.0643
runid3¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4381
bpref all 0.4671
recip_rank all 0.8663
P_10 all 0.6000
P_100 all 0.2472
P_1000 all 0.0375
recall_10 all 0.2547
recall_100 all 0.5759
recall_1000 all 0.6943
ndcg all 0.6531
ndcg_cut_10 all 0.6975
ndcg_cut_100 all 0.6184
ndcg_cut_1000 all 0.6531
summary (trec_eval)
map all 0.4553
bpref all 0.5547
recip_rank all 0.9593
P_10 all 0.7884
P_100 all 0.3672
P_1000 all 0.0603
recall_10 all 0.1670
recall_100 all 0.5078
recall_1000 all 0.6778
ndcg all 0.6531
ndcg_cut_10 all 0.6975
ndcg_cut_100 all 0.6184
ndcg_cut_1000 all 0.6531
ms_duet_passage¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.3477
bpref all 0.3944
recip_rank all 0.8065
P_10 all 0.5047
P_100 all 0.2102
P_1000 all 0.0375
recall_10 all 0.2200
recall_100 all 0.4929
recall_1000 all 0.6943
ndcg all 0.6093
ndcg_cut_10 all 0.6137
ndcg_cut_100 all 0.5369
ndcg_cut_1000 all 0.6093
summary (trec_eval)
map all 0.3868
bpref all 0.5167
recip_rank all 0.9252
P_10 all 0.7163
P_100 all 0.3114
P_1000 all 0.0603
recall_10 all 0.1531
recall_100 all 0.4397
recall_1000 all 0.6778
ndcg all 0.6093
ndcg_cut_10 all 0.6137
ndcg_cut_100 all 0.5369
ndcg_cut_1000 all 0.6093
ICT-CKNRM_B¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.2289
bpref all 0.2480
recip_rank all 0.8016
P_10 all 0.5698
P_100 all 0.0765
P_1000 all 0.0077
recall_10 all 0.2437
recall_100 all 0.3017
recall_1000 all 0.3017
ndcg all 0.3365
ndcg_cut_10 all 0.6481
ndcg_cut_100 all 0.3554
ndcg_cut_1000 all 0.3365
summary (trec_eval)
map all 0.1897
bpref all 0.2046
recip_rank all 0.9098
P_10 all 0.7465
P_100 all 0.1153
P_1000 all 0.0115
recall_10 all 0.1546
recall_100 all 0.2162
recall_1000 all 0.2162
ndcg all 0.3365
ndcg_cut_10 all 0.6481
ndcg_cut_100 all 0.3554
ndcg_cut_1000 all 0.3365
runid2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.2671
bpref all 0.3461
recip_rank all 0.8088
P_10 all 0.4163
P_100 all 0.1898
P_1000 all 0.0373
recall_10 all 0.1787
recall_100 all 0.4147
recall_1000 all 0.6910
ndcg all 0.5492
ndcg_cut_10 all 0.5322
ndcg_cut_100 all 0.4463
ndcg_cut_1000 all 0.5492
summary (trec_eval)
map all 0.2781
bpref all 0.4581
recip_rank all 0.8781
P_10 all 0.6163
P_100 all 0.2649
P_1000 all 0.0600
recall_10 all 0.1214
recall_100 all 0.3410
recall_1000 all 0.6743
ndcg all 0.5492
ndcg_cut_10 all 0.5322
ndcg_cut_100 all 0.4463
ndcg_cut_1000 all 0.5492
UNH_bm25¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.2566
bpref all 0.3000
recip_rank all 0.6036
P_10 all 0.3465
P_100 all 0.1865
P_1000 all 0.0374
recall_10 all 0.1667
recall_100 all 0.4695
recall_1000 all 0.7073
ndcg all 0.5547
ndcg_cut_10 all 0.4495
ndcg_cut_100 all 0.4626
ndcg_cut_1000 all 0.5547
summary (trec_eval)
map all 0.3427
bpref all 0.4730
recip_rank all 0.7670
P_10 all 0.5791
P_100 all 0.3047
P_1000 all 0.0605
recall_10 all 0.1293
recall_100 all 0.4271
recall_1000 all 0.6846
ndcg all 0.5547
ndcg_cut_10 all 0.4495
ndcg_cut_100 all 0.4626
ndcg_cut_1000 all 0.5547
UNH_exDL_bm25¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.0364
bpref all 0.0908
recip_rank all 0.0958
P_10 all 0.0605
P_100 all 0.0463
P_1000 all 0.0136
recall_10 all 0.0184
recall_100 all 0.1090
recall_1000 all 0.2151
ndcg all 0.1400
ndcg_cut_10 all 0.0817
ndcg_cut_100 all 0.0989
ndcg_cut_1000 all 0.1400
summary (trec_eval)
map all 0.0587
bpref all 0.1415
recip_rank all 0.1648
P_10 all 0.1163
P_100 all 0.0742
P_1000 all 0.0207
recall_10 all 0.0179
recall_100 all 0.0900
recall_1000 all 0.1916
ndcg all 0.1400
ndcg_cut_10 all 0.0817
ndcg_cut_100 all 0.0989
ndcg_cut_1000 all 0.1400
runid4¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4383
bpref all 0.4677
recip_rank all 0.8702
P_10 all 0.6093
P_100 all 0.2479
P_1000 all 0.0375
recall_10 all 0.2608
recall_100 all 0.5773
recall_1000 all 0.6943
ndcg all 0.6531
ndcg_cut_10 all 0.7028
ndcg_cut_100 all 0.6193
ndcg_cut_1000 all 0.6531
summary (trec_eval)
map all 0.4554
bpref all 0.5552
recip_rank all 0.9554
P_10 all 0.7977
P_100 all 0.3686
P_1000 all 0.0603
recall_10 all 0.1674
recall_100 all 0.5094
recall_1000 all 0.6778
ndcg all 0.6531
ndcg_cut_10 all 0.7028
ndcg_cut_100 all 0.6193
ndcg_cut_1000 all 0.6531
ICT-CKNRM_B50¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.2429
bpref all 0.2581
recip_rank all 0.7597
P_10 all 0.5302
P_100 all 0.1337
P_1000 all 0.0134
recall_10 all 0.1971
recall_100 all 0.4140
recall_1000 all 0.4140
ndcg all 0.4147
ndcg_cut_10 all 0.6014
ndcg_cut_100 all 0.4463
ndcg_cut_1000 all 0.4147
summary (trec_eval)
map all 0.2636
bpref all 0.2926
recip_rank all 0.8675
P_10 all 0.7349
P_100 all 0.2209
P_1000 all 0.0221
recall_10 all 0.1314
recall_100 all 0.3536
recall_1000 all 0.3536
ndcg all 0.4147
ndcg_cut_10 all 0.6014
ndcg_cut_100 all 0.4463
ndcg_cut_1000 all 0.4147
runid5¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.2506
bpref all 0.3045
recip_rank all 0.7999
P_10 all 0.4140
P_100 all 0.1905
P_1000 all 0.0295
recall_10 all 0.1581
recall_100 all 0.4299
recall_1000 all 0.5829
ndcg all 0.4884
ndcg_cut_10 all 0.5252
ndcg_cut_100 all 0.4497
ndcg_cut_1000 all 0.4884
summary (trec_eval)
map all 0.2599
bpref all 0.3738
recip_rank all 0.8723
P_10 all 0.6140
P_100 all 0.2712
P_1000 all 0.0435
recall_10 all 0.1126
recall_100 all 0.3515
recall_1000 all 0.5118
ndcg all 0.4884
ndcg_cut_10 all 0.5252
ndcg_cut_100 all 0.4497
ndcg_cut_1000 all 0.4884
bm25base_p¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.3013
bpref all 0.3378
recip_rank all 0.7036
P_10 all 0.4116
P_100 all 0.1967
P_1000 all 0.0407
recall_10 all 0.1751
recall_100 all 0.4910
recall_1000 all 0.7501
ndcg all 0.6067
ndcg_cut_10 all 0.5058
ndcg_cut_100 all 0.5018
ndcg_cut_1000 all 0.6067
summary (trec_eval)
map all 0.3773
bpref all 0.5000
recip_rank all 0.8245
P_10 all 0.6186
P_100 all 0.3191
P_1000 all 0.0654
recall_10 all 0.1285
recall_100 all 0.4531
recall_1000 all 0.7389
ndcg all 0.6067
ndcg_cut_10 all 0.5058
ndcg_cut_100 all 0.5018
ndcg_cut_1000 all 0.6067
bm25base_rm3_p¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.3390
bpref all 0.3661
recip_rank all 0.6683
P_10 all 0.4372
P_100 all 0.2209
P_1000 all 0.0448
recall_10 all 0.1861
recall_100 all 0.5216
recall_1000 all 0.7998
ndcg all 0.6395
ndcg_cut_10 all 0.5180
ndcg_cut_100 all 0.5286
ndcg_cut_1000 all 0.6395
summary (trec_eval)
map all 0.4270
bpref all 0.5371
recip_rank all 0.8167
P_10 all 0.6419
P_100 all 0.3512
P_1000 all 0.0716
recall_10 all 0.1327
recall_100 all 0.4761
recall_1000 all 0.7882
ndcg all 0.6395
ndcg_cut_10 all 0.5180
ndcg_cut_100 all 0.5286
ndcg_cut_1000 all 0.6395
bm25base_ax_p¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.3745
bpref all 0.4031
recip_rank all 0.6516
P_10 all 0.4674
P_100 all 0.2223
P_1000 all 0.0462
recall_10 all 0.2129
recall_100 all 0.5351
recall_1000 all 0.8241
ndcg all 0.6648
ndcg_cut_10 all 0.5511
ndcg_cut_100 all 0.5496
ndcg_cut_1000 all 0.6648
summary (trec_eval)
map all 0.4651
bpref all 0.5676
recip_rank all 0.7736
P_10 all 0.6907
P_100 all 0.3593
P_1000 all 0.0744
recall_10 all 0.1438
recall_100 all 0.4995
recall_1000 all 0.8129
ndcg all 0.6648
ndcg_cut_10 all 0.5511
ndcg_cut_100 all 0.5496
ndcg_cut_1000 all 0.6648
bm25base_prf_p¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.3561
bpref all 0.3837
recip_rank all 0.6211
P_10 all 0.4628
P_100 all 0.2247
P_1000 all 0.0435
recall_10 all 0.1966
recall_100 all 0.5404
recall_1000 all 0.7929
ndcg all 0.6438
ndcg_cut_10 all 0.5372
ndcg_cut_100 all 0.5448
ndcg_cut_1000 all 0.6438
summary (trec_eval)
map all 0.4533
bpref all 0.5544
recip_rank all 0.8170
P_10 all 0.6721
P_100 all 0.3609
P_1000 all 0.0705
recall_10 all 0.1387
recall_100 all 0.4974
recall_1000 all 0.7845
ndcg all 0.6438
ndcg_cut_10 all 0.5372
ndcg_cut_100 all 0.5448
ndcg_cut_1000 all 0.6438
bm25tuned_p¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.2903
bpref all 0.3286
recip_rank all 0.6850
P_10 all 0.4047
P_100 all 0.1951
P_1000 all 0.0405
recall_10 all 0.1841
recall_100 all 0.4974
recall_1000 all 0.7450
ndcg all 0.6001
ndcg_cut_10 all 0.4973
ndcg_cut_100 all 0.4981
ndcg_cut_1000 all 0.6001
summary (trec_eval)
map all 0.3766
bpref all 0.4960
recip_rank all 0.8457
P_10 all 0.6047
P_100 all 0.3219
P_1000 all 0.0653
recall_10 all 0.1263
recall_100 all 0.4603
recall_1000 all 0.7384
ndcg all 0.6001
ndcg_cut_10 all 0.4973
ndcg_cut_100 all 0.4981
ndcg_cut_1000 all 0.6001
bm25tuned_ax_p¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.3632
bpref all 0.3945
recip_rank all 0.6481
P_10 all 0.4465
P_100 all 0.2233
P_1000 all 0.0458
recall_10 all 0.2085
recall_100 all 0.5404
recall_1000 all 0.8138
ndcg all 0.6663
ndcg_cut_10 all 0.5461
ndcg_cut_100 all 0.5564
ndcg_cut_1000 all 0.6663
summary (trec_eval)
map all 0.4722
bpref all 0.5706
recip_rank all 0.8218
P_10 all 0.6907
P_100 all 0.3640
P_1000 all 0.0741
recall_10 all 0.1495
recall_100 all 0.5065
recall_1000 all 0.8094
ndcg all 0.6663
ndcg_cut_10 all 0.5461
ndcg_cut_100 all 0.5564
ndcg_cut_1000 all 0.6663
bm25tuned_rm3_p¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.3377
bpref all 0.3619
recip_rank all 0.6992
P_10 all 0.4349
P_100 all 0.2135
P_1000 all 0.0444
recall_10 all 0.1951
recall_100 all 0.5143
recall_1000 all 0.7792
ndcg all 0.6370
ndcg_cut_10 all 0.5231
ndcg_cut_100 all 0.5263
ndcg_cut_1000 all 0.6370
summary (trec_eval)
map all 0.4249
bpref all 0.5296
recip_rank all 0.8229
P_10 all 0.6395
P_100 all 0.3442
P_1000 all 0.0709
recall_10 all 0.1324
recall_100 all 0.4747
recall_1000 all 0.7762
ndcg all 0.6370
ndcg_cut_10 all 0.5231
ndcg_cut_100 all 0.5263
ndcg_cut_1000 all 0.6370
bm25tuned_prf_p¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.3684
bpref all 0.3960
recip_rank all 0.6996
P_10 all 0.4721
P_100 all 0.2272
P_1000 all 0.0440
recall_10 all 0.2142
recall_100 all 0.5420
recall_1000 all 0.7988
ndcg all 0.6529
ndcg_cut_10 all 0.5536
ndcg_cut_100 all 0.5514
ndcg_cut_1000 all 0.6529
summary (trec_eval)
map all 0.4522
bpref all 0.5527
recip_rank all 0.8178
P_10 all 0.6698
P_100 all 0.3630
P_1000 all 0.0711
recall_10 all 0.1372
recall_100 all 0.4969
recall_1000 all 0.7894
ndcg all 0.6529
ndcg_cut_10 all 0.5536
ndcg_cut_100 all 0.5514
ndcg_cut_1000 all 0.6529
test1¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4567
bpref all 0.4849
recip_rank all 0.8702
P_10 all 0.6372
P_100 all 0.2537
P_1000 all 0.0375
recall_10 all 0.2706
recall_100 all 0.5821
recall_1000 all 0.6943
ndcg all 0.6627
ndcg_cut_10 all 0.7314
ndcg_cut_100 all 0.6346
ndcg_cut_1000 all 0.6627
summary (trec_eval)
map all 0.4719
bpref all 0.5664
recip_rank all 0.9690
P_10 all 0.8279
P_100 all 0.3779
P_1000 all 0.0603
recall_10 all 0.1756
recall_100 all 0.5213
recall_1000 all 0.6778
ndcg all 0.6627
ndcg_cut_10 all 0.7314
ndcg_cut_100 all 0.6346
ndcg_cut_1000 all 0.6627
p_exp_bert¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4749
bpref all 0.5075
recip_rank all 0.8671
P_10 all 0.6442
P_100 all 0.2735
P_1000 all 0.0420
recall_10 all 0.2596
recall_100 all 0.5956
recall_1000 all 0.7481
ndcg all 0.6981
ndcg_cut_10 all 0.7336
ndcg_cut_100 all 0.6547
ndcg_cut_1000 all 0.6981
summary (trec_eval)
map all 0.4994
bpref all 0.6104
recip_rank all 0.9568
P_10 all 0.8488
P_100 all 0.3965
P_1000 all 0.0664
recall_10 all 0.1789
recall_100 all 0.5356
recall_1000 all 0.7352
ndcg all 0.6981
ndcg_cut_10 all 0.7336
ndcg_cut_100 all 0.6547
ndcg_cut_1000 all 0.6981
p_exp_rm3_bert¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.5049
bpref all 0.5407
recip_rank all 0.8884
P_10 all 0.6512
P_100 all 0.2844
P_1000 all 0.0465
recall_10 all 0.2621
recall_100 all 0.6239
recall_1000 all 0.8060
ndcg all 0.7337
ndcg_cut_10 all 0.7422
ndcg_cut_100 all 0.6745
ndcg_cut_1000 all 0.7337
summary (trec_eval)
map all 0.5294
bpref all 0.6505
recip_rank all 0.9684
P_10 all 0.8512
P_100 all 0.4114
P_1000 all 0.0732
recall_10 all 0.1790
recall_100 all 0.5524
recall_1000 all 0.7803
ndcg all 0.7337
ndcg_cut_10 all 0.7422
ndcg_cut_100 all 0.6745
ndcg_cut_1000 all 0.7337
p_bert¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4677
bpref all 0.4952
recip_rank all 0.8663
P_10 all 0.6488
P_100 all 0.2705
P_1000 all 0.0405
recall_10 all 0.2598
recall_100 all 0.6008
recall_1000 all 0.7450
ndcg all 0.6975
ndcg_cut_10 all 0.7380
ndcg_cut_100 all 0.6585
ndcg_cut_1000 all 0.6975
summary (trec_eval)
map all 0.5049
bpref all 0.6088
recip_rank all 0.9574
P_10 all 0.8535
P_100 all 0.3984
P_1000 all 0.0653
recall_10 all 0.1812
recall_100 all 0.5518
recall_1000 all 0.7384
ndcg all 0.6975
ndcg_cut_10 all 0.7380
ndcg_cut_100 all 0.6585
ndcg_cut_1000 all 0.6975
ICT-BERT2¶
Metadata | Participants | Proceedings| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.2421
bpref all 0.2533
recip_rank all 0.8743
P_10 all 0.5581
P_100 all 0.0765
P_1000 all 0.0077
recall_10 all 0.2415
recall_100 all 0.3017
recall_1000 all 0.3017
ndcg all 0.3452
ndcg_cut_10 all 0.6650
ndcg_cut_100 all 0.3643
ndcg_cut_1000 all 0.3452
summary (trec_eval)
map all 0.1941
bpref all 0.2074
recip_rank all 0.9529
P_10 all 0.7372
P_100 all 0.1153
P_1000 all 0.0115
recall_10 all 0.1539
recall_100 all 0.2162
recall_1000 all 0.2162
ndcg all 0.3452
ndcg_cut_10 all 0.6650
ndcg_cut_100 all 0.3643
ndcg_cut_1000 all 0.3452
srchvrs_ps_run1¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.2972
bpref all 0.3385
recip_rank all 0.5597
P_10 all 0.4186
P_100 all 0.2144
P_1000 all 0.0404
recall_10 all 0.1858
recall_100 all 0.5264
recall_1000 all 0.7405
ndcg all 0.5960
ndcg_cut_10 all 0.4990
ndcg_cut_100 all 0.5099
ndcg_cut_1000 all 0.5960
summary (trec_eval)
map all 0.4001
bpref all 0.5220
recip_rank all 0.8068
P_10 all 0.6535
P_100 all 0.3347
P_1000 all 0.0643
recall_10 all 0.1462
recall_100 all 0.4668
recall_1000 all 0.7114
ndcg all 0.5960
ndcg_cut_10 all 0.4990
ndcg_cut_100 all 0.5099
ndcg_cut_1000 all 0.5960
srchvrs_ps_run2¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.4090
bpref all 0.4325
recip_rank all 0.8302
P_10 all 0.5674
P_100 all 0.2481
P_1000 all 0.0360
recall_10 all 0.2617
recall_100 all 0.5682
recall_1000 all 0.6837
ndcg all 0.6317
ndcg_cut_10 all 0.6645
ndcg_cut_100 all 0.6030
ndcg_cut_1000 all 0.6317
summary (trec_eval)
map all 0.4545
bpref all 0.5374
recip_rank all 0.9581
P_10 all 0.7930
P_100 all 0.3644
P_1000 all 0.0572
recall_10 all 0.1708
recall_100 all 0.5034
recall_1000 all 0.6505
ndcg all 0.6317
ndcg_cut_10 all 0.6645
ndcg_cut_100 all 0.6030
ndcg_cut_1000 all 0.6317
srchvrs_ps_run3¶
Metadata | Participants| Input| Summary (trec_eval) | Summary (passages-eval)| Appendix
summary (passages-eval)
map all 0.3184
bpref all 0.3486
recip_rank all 0.6942
P_10 all 0.4628
P_100 all 0.2140
P_1000 all 0.0404
recall_10 all 0.1979
recall_100 all 0.5270
recall_1000 all 0.7405
ndcg all 0.6119
ndcg_cut_10 all 0.5558
ndcg_cut_100 all 0.5299
ndcg_cut_1000 all 0.6119
summary (trec_eval)
map all 0.4133
bpref all 0.5227
recip_rank all 0.8429
P_10 all 0.7023
P_100 all 0.3423
P_1000 all 0.0643
recall_10 all 0.1522
recall_100 all 0.4797
recall_1000 all 0.7114
ndcg all 0.6119
ndcg_cut_10 all 0.5558
ndcg_cut_100 all 0.5299
ndcg_cut_1000 all 0.6119