Results - Podcast 2020¶
LRGREtvrs-r_1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0009
bpref all 0.0071
recip_rank all 0.0217
P_10 all 0.0021
P_100 all 0.0027
P_1000 all 0.0013
recall_10 all 0.0002
recall_100 all 0.0084
recall_1000 all 0.0444
ndcg all 0.0137
ndcg_cut_10 all 0.0007
ndcg_cut_100 all 0.0045
ndcg_cut_1000 all 0.0137
run_dcu1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3442
bpref all 0.4567
recip_rank all 0.7254
P_10 all 0.5021
P_100 all 0.2265
P_1000 all 0.0361
recall_10 all 0.1551
recall_100 all 0.5530
recall_1000 all 0.8366
ndcg all 0.5699
ndcg_cut_10 all 0.3937
ndcg_cut_100 all 0.4616
ndcg_cut_1000 all 0.5699
run_dcu2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3309
bpref all 0.4517
recip_rank all 0.6434
P_10 all 0.4813
P_100 all 0.2221
P_1000 all 0.0354
recall_10 all 0.1511
recall_100 all 0.5599
recall_1000 all 0.8247
ndcg all 0.5512
ndcg_cut_10 all 0.3631
ndcg_cut_100 all 0.4471
ndcg_cut_1000 all 0.5512
run_dcu3¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3443
bpref all 0.4569
recip_rank all 0.7130
P_10 all 0.5021
P_100 all 0.2275
P_1000 all 0.0362
recall_10 all 0.1537
recall_100 all 0.5577
recall_1000 all 0.8324
ndcg all 0.5686
ndcg_cut_10 all 0.3898
ndcg_cut_100 all 0.4605
ndcg_cut_1000 all 0.5686
run_dcu4¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3520
bpref all 0.4896
recip_rank all 0.7041
P_10 all 0.5375
P_100 all 0.2206
P_1000 all 0.0360
recall_10 all 0.1897
recall_100 all 0.5721
recall_1000 all 0.8633
ndcg all 0.5811
ndcg_cut_10 all 0.4088
ndcg_cut_100 all 0.4683
ndcg_cut_1000 all 0.5811
run_dcu5¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3594
bpref all 0.4874
recip_rank all 0.7311
P_10 all 0.5396
P_100 all 0.2258
P_1000 all 0.0359
recall_10 all 0.1844
recall_100 all 0.5773
recall_1000 all 0.8520
ndcg all 0.5857
ndcg_cut_10 all 0.4212
ndcg_cut_100 all 0.4796
ndcg_cut_1000 all 0.5857
LRGREtvrs-r_2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0015
bpref all 0.0171
recip_rank all 0.0159
P_10 all 0.0125
P_100 all 0.0042
P_1000 all 0.0020
recall_10 all 0.0013
recall_100 all 0.0049
recall_1000 all 0.0459
ndcg all 0.0185
ndcg_cut_10 all 0.0057
ndcg_cut_100 all 0.0051
ndcg_cut_1000 all 0.0185
LRGREtvrs-r_3¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0026
bpref all 0.0242
recip_rank all 0.0467
P_10 all 0.0125
P_100 all 0.0052
P_1000 all 0.0031
recall_10 all 0.0025
recall_100 all 0.0091
recall_1000 all 0.0763
ndcg all 0.0295
ndcg_cut_10 all 0.0072
ndcg_cut_100 all 0.0081
ndcg_cut_1000 all 0.0295
UTDThesis_Run1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.1974
bpref all 0.2581
recip_rank all 0.6405
P_10 all 0.4271
P_100 all 0.1617
P_1000 all 0.0162
recall_10 all 0.1263
recall_100 all 0.3781
recall_1000 all 0.3781
ndcg all 0.3442
ndcg_cut_10 all 0.3269
ndcg_cut_100 all 0.3445
ndcg_cut_1000 all 0.3442
BM25¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3167
bpref all 0.4041
recip_rank all 0.6598
P_10 all 0.4875
P_100 all 0.2325
P_1000 all 0.0338
recall_10 all 0.1409
recall_100 all 0.5335
recall_1000 all 0.7314
ndcg all 0.5218
ndcg_cut_10 all 0.3664
ndcg_cut_100 all 0.4404
ndcg_cut_1000 all 0.5218
QL¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3116
bpref all 0.4054
recip_rank all 0.6776
P_10 all 0.4812
P_100 all 0.2296
P_1000 all 0.0343
recall_10 all 0.1517
recall_100 all 0.5322
recall_1000 all 0.7419
ndcg all 0.5247
ndcg_cut_10 all 0.3663
ndcg_cut_100 all 0.4370
ndcg_cut_1000 all 0.5247
RERANK-QUERY¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2920
bpref all 0.3177
recip_rank all 0.7616
P_10 all 0.5562
P_100 all 0.1808
P_1000 all 0.0181
recall_10 all 0.1774
recall_100 all 0.4279
recall_1000 all 0.4279
ndcg all 0.4324
ndcg_cut_10 all 0.4572
ndcg_cut_100 all 0.4329
ndcg_cut_1000 all 0.4324
RERANK-DESC¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2921
bpref all 0.3233
recip_rank all 0.7342
P_10 all 0.5687
P_100 all 0.1808
P_1000 all 0.0181
recall_10 all 0.1809
recall_100 all 0.4279
recall_1000 all 0.4279
ndcg all 0.4288
ndcg_cut_10 all 0.4593
ndcg_cut_100 all 0.4294
ndcg_cut_1000 all 0.4288
BERT-DESC-S¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2914
bpref all 0.3212
recip_rank all 0.7476
P_10 all 0.5667
P_100 all 0.1808
P_1000 all 0.0181
recall_10 all 0.1831
recall_100 all 0.4279
recall_1000 all 0.4279
ndcg all 0.4293
ndcg_cut_10 all 0.4613
ndcg_cut_100 all 0.4298
ndcg_cut_1000 all 0.4293
BERT-DESC-Q¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2693
bpref all 0.3031
recip_rank all 0.7150
P_10 all 0.5250
P_100 all 0.1808
P_1000 all 0.0181
recall_10 all 0.1630
recall_100 all 0.4279
recall_1000 all 0.4279
ndcg all 0.4107
ndcg_cut_10 all 0.4197
ndcg_cut_100 all 0.4112
ndcg_cut_1000 all 0.4107
BERT-DESC-TD¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.2794
bpref all 0.3079
recip_rank all 0.7498
P_10 all 0.5563
P_100 all 0.1808
P_1000 all 0.0181
recall_10 all 0.1698
recall_100 all 0.4279
recall_1000 all 0.4279
ndcg all 0.4265
ndcg_cut_10 all 0.4560
ndcg_cut_100 all 0.4271
ndcg_cut_1000 all 0.4265
UMD_IR_run1¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3524
bpref all 0.5091
recip_rank all 0.7275
P_10 all 0.5271
P_100 all 0.2244
P_1000 all 0.0383
recall_10 all 0.1881
recall_100 all 0.5978
recall_1000 all 0.8902
ndcg all 0.6182
ndcg_cut_10 all 0.4281
ndcg_cut_100 all 0.4992
ndcg_cut_1000 all 0.6182
UMD_IR_run2¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.3665
bpref all 0.4668
recip_rank all 0.6182
P_10 all 0.5125
P_100 all 0.2546
P_1000 all 0.0383
recall_10 all 0.1690
recall_100 all 0.6131
recall_1000 all 0.8902
ndcg all 0.5936
ndcg_cut_10 all 0.3822
ndcg_cut_100 all 0.4894
ndcg_cut_1000 all 0.5936
LRGREtvrs-r_4¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.0012
bpref all 0.0132
recip_rank all 0.0499
P_10 all 0.0042
P_100 all 0.0027
P_1000 all 0.0017
recall_10 all 0.0005
recall_100 all 0.0076
recall_1000 all 0.0385
ndcg all 0.0153
ndcg_cut_10 all 0.0029
ndcg_cut_100 all 0.0051
ndcg_cut_1000 all 0.0153
UMD_IR_run3¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4624
bpref all 0.5364
recip_rank all 0.7419
P_10 all 0.5958
P_100 all 0.2929
P_1000 all 0.0388
recall_10 all 0.2192
recall_100 all 0.7407
recall_1000 all 0.9151
ndcg all 0.6682
ndcg_cut_10 all 0.4798
ndcg_cut_100 all 0.5969
ndcg_cut_1000 all 0.6682
UMD_ID_run4¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4283
bpref all 0.5261
recip_rank all 0.7469
P_10 all 0.5583
P_100 all 0.2733
P_1000 all 0.0393
recall_10 all 0.1933
recall_100 all 0.6839
recall_1000 all 0.9184
ndcg all 0.6563
ndcg_cut_10 all 0.4539
ndcg_cut_100 all 0.5663
ndcg_cut_1000 all 0.6563
UMD_IR_run5¶
Metadata | Participants | Proceedings| Input| Summary| Appendix
summary (trec_eval)
map all 0.4342
bpref all 0.5071
recip_rank all 0.6673
P_10 all 0.5833
P_100 all 0.2721
P_1000 all 0.0386
recall_10 all 0.2100
recall_100 all 0.6713
recall_1000 all 0.9067
ndcg all 0.6467
ndcg_cut_10 all 0.4525
ndcg_cut_100 all 0.5523
ndcg_cut_1000 all 0.6467
hltcoe1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2637
bpref all 0.3675
recip_rank all 0.4769
P_10 all 0.3833
P_100 all 0.2060
P_1000 all 0.0302
recall_10 all 0.1144
recall_100 all 0.5065
recall_1000 all 0.6883
ndcg all 0.4530
ndcg_cut_10 all 0.2750
ndcg_cut_100 all 0.3798
ndcg_cut_1000 all 0.4530
hltcoe2¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2922
bpref all 0.3796
recip_rank all 0.6000
P_10 all 0.4542
P_100 all 0.2079
P_1000 all 0.0279
recall_10 all 0.1410
recall_100 all 0.5107
recall_1000 all 0.6339
ndcg all 0.4715
ndcg_cut_10 all 0.3544
ndcg_cut_100 all 0.4200
ndcg_cut_1000 all 0.4715
hltcoe3¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2825
bpref all 0.3888
recip_rank all 0.6198
P_10 all 0.4292
P_100 all 0.2052
P_1000 all 0.0327
recall_10 all 0.1341
recall_100 all 0.5156
recall_1000 all 0.7601
ndcg all 0.5033
ndcg_cut_10 all 0.3314
ndcg_cut_100 all 0.4039
ndcg_cut_1000 all 0.5033
hltcoe4¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.3232
bpref all 0.4190
recip_rank all 0.7062
P_10 all 0.5354
P_100 all 0.2194
P_1000 all 0.0293
recall_10 all 0.1617
recall_100 all 0.5283
recall_1000 all 0.6683
ndcg all 0.5117
ndcg_cut_10 all 0.4055
ndcg_cut_100 all 0.4539
ndcg_cut_1000 all 0.5117
hltcoe5¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.2197
bpref all 0.3131
recip_rank all 0.5114
P_10 all 0.3667
P_100 all 0.1633
P_1000 all 0.0237
recall_10 all 0.1189
recall_100 all 0.3673
recall_1000 all 0.5225
ndcg all 0.3769
ndcg_cut_10 all 0.2855
ndcg_cut_100 all 0.3190
ndcg_cut_1000 all 0.3769
oudalab1¶
Metadata | Participants| Input| Summary| Appendix
summary (trec_eval)
map all 0.0013
bpref all 0.0020
recip_rank all 0.0799
P_10 all 0.0125
P_100 all 0.0013
P_1000 all 0.0001
recall_10 all 0.0021
recall_100 all 0.0021
recall_1000 all 0.0021
ndcg all 0.0043
ndcg_cut_10 all 0.0106
ndcg_cut_100 all 0.0043
ndcg_cut_1000 all 0.0043