Results - Conversational Assistance 2020¶

raw_polyu1¶

summary (trec_eval)

map             all 0.1586
bpref           all 0.2204
recip_rank      all 0.5378
P_10            all 0.2947
P_100           all 0.1128
P_1000          all 0.0177
recall_10       all 0.0997
recall_100      all 0.3408
recall_1000     all 0.5262
ndcg            all 0.3463
ndcg_cut_10     all 0.2424
ndcg_cut_100    all 0.2805
ndcg_cut_1000   all 0.3463

man_polyu1¶

summary (trec_eval)

map             all 0.2572
bpref           all 0.3352
recip_rank      all 0.7042
P_10            all 0.4447
P_100           all 0.1513
P_1000          all 0.0222
recall_10       all 0.1655
recall_100      all 0.4862
recall_1000     all 0.6975
ndcg            all 0.4882
ndcg_cut_10     all 0.3731
ndcg_cut_100    all 0.4139
ndcg_cut_1000   all 0.4882

HPCLab-CNR-run1¶

summary (trec_eval)

map             all 0.2205
bpref           all 0.2904
recip_rank      all 0.5703
P_10            all 0.3615
P_100           all 0.1312
P_1000          all 0.0191
recall_10       all 0.1353
recall_100      all 0.4157
recall_1000     all 0.5732
ndcg            all 0.4032
ndcg_cut_10     all 0.3017
ndcg_cut_100    all 0.3476
ndcg_cut_1000   all 0.4032

HPCLab-CNR-run3¶

summary (trec_eval)

map             all 0.2363
bpref           all 0.3121
recip_rank      all 0.5948
P_10            all 0.3841
P_100           all 0.1375
P_1000          all 0.0196
recall_10       all 0.1458
recall_100      all 0.4330
recall_1000     all 0.5888
ndcg            all 0.4218
ndcg_cut_10     all 0.3199
ndcg_cut_100    all 0.3671
ndcg_cut_1000   all 0.4218

castur_albert¶

summary (trec_eval)

map             all 0.1960
bpref           all 0.2475
recip_rank      all 0.5387
P_10            all 0.3337
P_100           all 0.1219
P_1000          all 0.0164
recall_10       all 0.1180
recall_100      all 0.3840
recall_1000     all 0.4920
ndcg            all 0.3557
ndcg_cut_10     all 0.2752
ndcg_cut_100    all 0.3177
ndcg_cut_1000   all 0.3557

rewrite_albert¶

summary (trec_eval)

map             all 0.2203
bpref           all 0.2740
recip_rank      all 0.5786
P_10            all 0.3688
P_100           all 0.1330
P_1000          all 0.0182
recall_10       all 0.1260
recall_100      all 0.4033
recall_1000     all 0.5336
ndcg            all 0.3892
ndcg_cut_10     all 0.3138
ndcg_cut_100    all 0.3444
ndcg_cut_1000   all 0.3892

T5_BERT100¶

summary (trec_eval)

map             all 0.1766
bpref           all 0.2284
recip_rank      all 0.5495
P_10            all 0.3404
P_100           all 0.0931
P_1000          all 0.0183
recall_10       all 0.1165
recall_100      all 0.2767
recall_1000     all 0.5285
ndcg            all 0.3533
ndcg_cut_10     all 0.2813
ndcg_cut_100    all 0.2662
ndcg_cut_1000   all 0.3533

AUTO_BERT100¶

summary (trec_eval)

map             all 0.1815
bpref           all 0.2309
recip_rank      all 0.5454
P_10            all 0.3423
P_100           all 0.0947
P_1000          all 0.0188
recall_10       all 0.1213
recall_100      all 0.2943
recall_1000     all 0.5510
ndcg            all 0.3638
ndcg_cut_10     all 0.2856
ndcg_cut_100    all 0.2746
ndcg_cut_1000   all 0.3638

AUTO_T5_RRF¶

summary (trec_eval)

map             all 0.1846
bpref           all 0.2327
recip_rank      all 0.5468
P_10            all 0.3389
P_100           all 0.1051
P_1000          all 0.0199
recall_10       all 0.1186
recall_100      all 0.3227
recall_1000     all 0.5810
ndcg            all 0.3767
ndcg_cut_10     all 0.2835
ndcg_cut_100    all 0.2890
ndcg_cut_1000   all 0.3767

WLU_ManUttOnly¶

summary (trec_eval)

map             all 0.0456
bpref           all 0.1609
recip_rank      all 0.2287
P_10            all 0.1111
P_100           all 0.0422
P_1000          all 0.0243
recall_10       all 0.0328
recall_100      all 0.1297
recall_1000     all 0.7461
ndcg            all 0.2872
ndcg_cut_10     all 0.0735
ndcg_cut_100    all 0.0904
ndcg_cut_1000   all 0.2872

WLU_RawUttOnly¶

summary (trec_eval)

map             all 0.0147
bpref           all 0.0684
recip_rank      all 0.0948
P_10            all 0.0413
P_100           all 0.0166
P_1000          all 0.0110
recall_10       all 0.0092
recall_100      all 0.0411
recall_1000     all 0.2891
ndcg            all 0.1106
ndcg_cut_10     all 0.0244
ndcg_cut_100    all 0.0291
ndcg_cut_1000   all 0.1106

HBKU_t5_1v2¶

summary (trec_eval)

map             all 0.2083
bpref           all 0.2613
recip_rank      all 0.5719
P_10            all 0.3563
P_100           all 0.1223
P_1000          all 0.0176
recall_10       all 0.1364
recall_100      all 0.3833
recall_1000     all 0.5222
ndcg            all 0.3790
ndcg_cut_10     all 0.3012
ndcg_cut_100    all 0.3294
ndcg_cut_1000   all 0.3790

HBKU_t5_1v1¶

summary (trec_eval)

map             all 0.2061
bpref           all 0.2624
recip_rank      all 0.5557
P_10            all 0.3452
P_100           all 0.1188
P_1000          all 0.0176
recall_10       all 0.1310
recall_100      all 0.3730
recall_1000     all 0.5222
ndcg            all 0.3736
ndcg_cut_10     all 0.2919
ndcg_cut_100    all 0.3204
ndcg_cut_1000   all 0.3736

HBKU_t2_1v2¶

summary (trec_eval)

map             all 0.2077
bpref           all 0.2613
recip_rank      all 0.5545
P_10            all 0.3543
P_100           all 0.1214
P_1000          all 0.0174
recall_10       all 0.1360
recall_100      all 0.3815
recall_1000     all 0.5190
ndcg            all 0.3770
ndcg_cut_10     all 0.2992
ndcg_cut_100    all 0.3277
ndcg_cut_1000   all 0.3770

HBKU_t2_1v1¶

summary (trec_eval)

map             all 0.2038
bpref           all 0.2642
recip_rank      all 0.5323
P_10            all 0.3365
P_100           all 0.1163
P_1000          all 0.0174
recall_10       all 0.1276
recall_100      all 0.3670
recall_1000     all 0.5190
ndcg            all 0.3692
ndcg_cut_10     all 0.2856
ndcg_cut_100    all 0.3153
ndcg_cut_1000   all 0.3692

HPCLab-CNR-run2¶

summary (trec_eval)

map             all 0.1850
bpref           all 0.2532
recip_rank      all 0.5294
P_10            all 0.3187
P_100           all 0.1163
P_1000          all 0.0175
recall_10       all 0.1155
recall_100      all 0.3640
recall_1000     all 0.5239
ndcg            all 0.3597
ndcg_cut_10     all 0.2618
ndcg_cut_100    all 0.3038
ndcg_cut_1000   all 0.3597

HPCLab-CNR-run4¶

summary (trec_eval)

map             all 0.1937
bpref           all 0.2534
recip_rank      all 0.5409
P_10            all 0.3178
P_100           all 0.1134
P_1000          all 0.0165
recall_10       all 0.1181
recall_100      all 0.3616
recall_1000     all 0.5143
ndcg            all 0.3585
ndcg_cut_10     all 0.2695
ndcg_cut_100    all 0.3076
ndcg_cut_1000   all 0.3585

PAS_BQUERY_MER¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.2004
bpref           all 0.2549
recip_rank      all 0.5837
P_10            all 0.3514
P_100           all 0.1149
P_1000          all 0.0178
recall_10       all 0.1331
recall_100      all 0.3640
recall_1000     all 0.5425
ndcg            all 0.3808
ndcg_cut_10     all 0.3031
ndcg_cut_100    all 0.3229
ndcg_cut_1000   all 0.3808

PAS_RQUERY_MER¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.1964
bpref           all 0.2492
recip_rank      all 0.5791
P_10            all 0.3562
P_100           all 0.1118
P_1000          all 0.0175
recall_10       all 0.1340
recall_100      all 0.3549
recall_1000     all 0.5374
ndcg            all 0.3775
ndcg_cut_10     all 0.3058
ndcg_cut_100    all 0.3178
ndcg_cut_1000   all 0.3775

duth¶

summary (trec_eval)

map             all 0.1116
bpref           all 0.1702
recip_rank      all 0.3265
P_10            all 0.1971
P_100           all 0.0781
P_1000          all 0.0158
recall_10       all 0.0728
recall_100      all 0.2319
recall_1000     all 0.4389
ndcg            all 0.2565
ndcg_cut_10     all 0.1481
ndcg_cut_100    all 0.1833
ndcg_cut_1000   all 0.2565

duth_arq¶

summary (trec_eval)

map             all 0.1248
bpref           all 0.1913
recip_rank      all 0.3795
P_10            all 0.2183
P_100           all 0.0837
P_1000          all 0.0184
recall_10       all 0.0905
recall_100      all 0.2829
recall_1000     all 0.5565
ndcg            all 0.3105
ndcg_cut_10     all 0.1704
ndcg_cut_100    all 0.2148
ndcg_cut_1000   all 0.3105

duth_manual¶

summary (trec_eval)

map             all 0.1927
bpref           all 0.2741
recip_rank      all 0.5030
P_10            all 0.3106
P_100           all 0.1200
P_1000          all 0.0231
recall_10       all 0.1268
recall_100      all 0.3982
recall_1000     all 0.7192
ndcg            all 0.4185
ndcg_cut_10     all 0.2461
ndcg_cut_100    all 0.3085
ndcg_cut_1000   all 0.4185

PASO_BQUERO_MER¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.2080
bpref           all 0.2618
recip_rank      all 0.5804
P_10            all 0.3558
P_100           all 0.1242
P_1000          all 0.0170
recall_10       all 0.1316
recall_100      all 0.3917
recall_1000     all 0.5187
ndcg            all 0.3817
ndcg_cut_10     all 0.3039
ndcg_cut_100    all 0.3375
ndcg_cut_1000   all 0.3817

WatACBase¶

summary (trec_eval)

map             all 0.1179
bpref           all 0.1943
recip_rank      all 0.3522
P_10            all 0.2168
P_100           all 0.0890
P_1000          all 0.0180
recall_10       all 0.0712
recall_100      all 0.2809
recall_1000     all 0.5506
ndcg            all 0.2947
ndcg_cut_10     all 0.1594
ndcg_cut_100    all 0.2025
ndcg_cut_1000   all 0.2947

grill_ctxDuo¶

summary (trec_eval)

map             all 0.3827
bpref           all 0.4514
recip_rank      all 0.7837
P_10            all 0.5673
P_100           all 0.1930
P_1000          all 0.0256
recall_10       all 0.2221
recall_100      all 0.6362
recall_1000     all 0.7991
ndcg            all 0.6069
ndcg_cut_10     all 0.4886
ndcg_cut_100    all 0.5510
ndcg_cut_1000   all 0.6069

grill_bmDuo¶

summary (trec_eval)

map             all 0.3241
bpref           all 0.3988
recip_rank      all 0.7956
P_10            all 0.5409
P_100           all 0.1681
P_1000          all 0.0242
recall_10       all 0.2047
recall_100      all 0.5546
recall_1000     all 0.7665
ndcg            all 0.5711
ndcg_cut_10     all 0.4767
ndcg_cut_100    all 0.5033
ndcg_cut_1000   all 0.5711

grill_duoBART¶

summary (trec_eval)

map             all 0.2154
bpref           all 0.2795
recip_rank      all 0.6169
P_10            all 0.3837
P_100           all 0.1237
P_1000          all 0.0181
recall_10       all 0.1377
recall_100      all 0.3697
recall_1000     all 0.5264
ndcg            all 0.4033
ndcg_cut_10     all 0.3430
ndcg_cut_100    all 0.3519
ndcg_cut_1000   all 0.4033

WatACBaseRe¶

summary (trec_eval)

map             all 0.2025
bpref           all 0.2713
recip_rank      all 0.5365
P_10            all 0.3356
P_100           all 0.1196
P_1000          all 0.0178
recall_10       all 0.1337
recall_100      all 0.3933
recall_1000     all 0.5468
ndcg            all 0.3839
ndcg_cut_10     all 0.2870
ndcg_cut_100    all 0.3290
ndcg_cut_1000   all 0.3839

grill_fuseDuo¶

summary (trec_eval)

map             all 0.2779
bpref           all 0.3647
recip_rank      all 0.7014
P_10            all 0.4615
P_100           all 0.1581
P_1000          all 0.0256
recall_10       all 0.1702
recall_100      all 0.4924
recall_1000     all 0.7991
ndcg            all 0.5362
ndcg_cut_10     all 0.4034
ndcg_cut_100    all 0.4396
ndcg_cut_1000   all 0.5362

umass_curr_rm3¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.1664
bpref           all 0.2269
recip_rank      all 0.4667
P_10            all 0.2851
P_100           all 0.1093
P_1000          all 0.0203
recall_10       all 0.1008
recall_100      all 0.3354
recall_1000     all 0.5878
ndcg            all 0.3581
ndcg_cut_10     all 0.2332
ndcg_cut_100    all 0.2690
ndcg_cut_1000   all 0.3581

umass_4prev_rm3¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.1524
bpref           all 0.2157
recip_rank      all 0.4509
P_10            all 0.2635
P_100           all 0.1053
P_1000          all 0.0199
recall_10       all 0.0927
recall_100      all 0.3275
recall_1000     all 0.5794
ndcg            all 0.3421
ndcg_cut_10     all 0.2076
ndcg_cut_100    all 0.2528
ndcg_cut_1000   all 0.3421

WatACGPT2Re¶

summary (trec_eval)

map             all 0.2216
bpref           all 0.2817
recip_rank      all 0.5565
P_10            all 0.3548
P_100           all 0.1298
P_1000          all 0.0177
recall_10       all 0.1318
recall_100      all 0.4044
recall_1000     all 0.5363
ndcg            all 0.3932
ndcg_cut_10     all 0.3044
ndcg_cut_100    all 0.3483
ndcg_cut_1000   all 0.3932

hist_attention¶

summary (trec_eval)

map             all 0.1626
bpref           all 0.2209
recip_rank      all 0.4428
P_10            all 0.2764
P_100           all 0.1118
P_1000          all 0.0164
recall_10       all 0.0947
recall_100      all 0.3515
recall_1000     all 0.4920
ndcg            all 0.3209
ndcg_cut_10     all 0.2138
ndcg_cut_100    all 0.2722
ndcg_cut_1000   all 0.3209

hist_concat¶

summary (trec_eval)

map             all 0.1940
bpref           all 0.2451
recip_rank      all 0.5357
P_10            all 0.3312
P_100           all 0.1237
P_1000          all 0.0164
recall_10       all 0.1145
recall_100      all 0.3871
recall_1000     all 0.4920
ndcg            all 0.3539
ndcg_cut_10     all 0.2711
ndcg_cut_100    all 0.3170
ndcg_cut_1000   all 0.3539

WatACReAll¶

summary (trec_eval)

map             all 0.2384
bpref           all 0.3029
recip_rank      all 0.5697
P_10            all 0.3726
P_100           all 0.1385
P_1000          all 0.0205
recall_10       all 0.1405
recall_100      all 0.4402
recall_1000     all 0.6339
ndcg            all 0.4350
ndcg_cut_10     all 0.3156
ndcg_cut_100    all 0.3707
ndcg_cut_1000   all 0.4350

HBKU_t2_1v2_mnl¶

summary (trec_eval)

map             all 0.2613
bpref           all 0.3388
recip_rank      all 0.7196
P_10            all 0.4452
P_100           all 0.1439
P_1000          all 0.0198
recall_10       all 0.1721
recall_100      all 0.4911
recall_1000     all 0.6317
ndcg            all 0.4691
ndcg_cut_10     all 0.3777
ndcg_cut_100    all 0.4199
ndcg_cut_1000   all 0.4691

HBKU_t5_1v2_mnl¶

summary (trec_eval)

map             all 0.2684
bpref           all 0.3448
recip_rank      all 0.7245
P_10            all 0.4481
P_100           all 0.1481
P_1000          all 0.0203
recall_10       all 0.1724
recall_100      all 0.5014
recall_1000     all 0.6478
ndcg            all 0.4776
ndcg_cut_10     all 0.3819
ndcg_cut_100    all 0.4266
ndcg_cut_1000   all 0.4776

HBKU_t5_1v1_mnl¶

summary (trec_eval)

map             all 0.2635
bpref           all 0.3429
recip_rank      all 0.7097
P_10            all 0.4413
P_100           all 0.1475
P_1000          all 0.0203
recall_10       all 0.1712
recall_100      all 0.5005
recall_1000     all 0.6478
ndcg            all 0.4730
ndcg_cut_10     all 0.3759
ndcg_cut_100    all 0.4219
ndcg_cut_1000   all 0.4730

HBKU_t2_1v1_mnl¶

summary (trec_eval)

map             all 0.2444
bpref           all 0.3311
recip_rank      all 0.6743
P_10            all 0.4202
P_100           all 0.1402
P_1000          all 0.0198
recall_10       all 0.1663
recall_100      all 0.4788
recall_1000     all 0.6317
ndcg            all 0.4537
ndcg_cut_10     all 0.3552
ndcg_cut_100    all 0.4006
ndcg_cut_1000   all 0.4537

quretecQR¶

summary (trec_eval)

map             all 0.1719
bpref           all 0.2038
recip_rank      all 0.5893
P_10            all 0.3692
P_100           all 0.0871
P_1000          all 0.0087
recall_10       all 0.1463
recall_100      all 0.2850
recall_1000     all 0.2850
ndcg            all 0.2825
ndcg_cut_10     all 0.3138
ndcg_cut_100    all 0.2826
ndcg_cut_1000   all 0.2825

baselineQR¶

summary (trec_eval)

map             all 0.1584
bpref           all 0.1888
recip_rank      all 0.5558
P_10            all 0.3380
P_100           all 0.0846
P_1000          all 0.0085
recall_10       all 0.1236
recall_100      all 0.2656
recall_1000     all 0.2656
ndcg            all 0.2606
ndcg_cut_10     all 0.2870
ndcg_cut_100    all 0.2607
ndcg_cut_1000   all 0.2606

humanQR¶

summary (trec_eval)

map             all 0.2702
bpref           all 0.3104
recip_rank      all 0.7993
P_10            all 0.5452
P_100           all 0.1219
P_1000          all 0.0122
recall_10       all 0.2159
recall_100      all 0.4078
recall_1000     all 0.4078
ndcg            all 0.4144
ndcg_cut_10     all 0.4602
ndcg_cut_100    all 0.4146
ndcg_cut_1000   all 0.4144

quretecNoRerank¶

summary (trec_eval)

map             all 0.1071
bpref           all 0.1520
recip_rank      all 0.4055
P_10            all 0.2226
P_100           all 0.0871
P_1000          all 0.0087
recall_10       all 0.0863
recall_100      all 0.2850
recall_1000     all 0.2850
ndcg            all 0.2157
ndcg_cut_10     all 0.1723
ndcg_cut_100    all 0.2158
ndcg_cut_1000   all 0.2157

ASCFDA_baseline¶

summary (trec_eval)

map             all 0.3096
bpref           all 0.3771
recip_rank      all 0.6962
P_10            all 0.4875
P_100           all 0.1536
P_1000          all 0.0202
recall_10       all 0.1952
recall_100      all 0.4920
recall_1000     all 0.6106
ndcg            all 0.4943
ndcg_cut_10     all 0.4356
ndcg_cut_100    all 0.4536
ndcg_cut_1000   all 0.4943

h2oloo_RUN1¶

summary (trec_eval)

map             all 0.3388
bpref           all 0.4140
recip_rank      all 0.7103
P_10            all 0.5101
P_100           all 0.1755
P_1000          all 0.0237
recall_10       all 0.1973
recall_100      all 0.5771
recall_1000     all 0.7242
ndcg            all 0.5491
ndcg_cut_10     all 0.4347
ndcg_cut_100    all 0.4954
ndcg_cut_1000   all 0.5491

ASCFDA_d2q_emb¶

summary (trec_eval)

map             all 0.3090
bpref           all 0.3772
recip_rank      all 0.6961
P_10            all 0.4846
P_100           all 0.1538
P_1000          all 0.0203
recall_10       all 0.1941
recall_100      all 0.4929
recall_1000     all 0.6131
ndcg            all 0.4934
ndcg_cut_10     all 0.4327
ndcg_cut_100    all 0.4522
ndcg_cut_1000   all 0.4934

h2oloo_RUN2¶

summary (trec_eval)

map             all 0.3625
bpref           all 0.4550
recip_rank      all 0.7436
P_10            all 0.5413
P_100           all 0.1745
P_1000          all 0.0237
recall_10       all 0.2160
recall_100      all 0.5793
recall_1000     all 0.7242
ndcg            all 0.5745
ndcg_cut_10     all 0.4777
ndcg_cut_100    all 0.5208
ndcg_cut_1000   all 0.5745

h2oloo_RUN3¶

summary (trec_eval)

map             all 0.3297
bpref           all 0.4061
recip_rank      all 0.6959
P_10            all 0.4928
P_100           all 0.1590
P_1000          all 0.0212
recall_10       all 0.2000
recall_100      all 0.5296
recall_1000     all 0.6606
ndcg            all 0.5217
ndcg_cut_10     all 0.4358
ndcg_cut_100    all 0.4756
ndcg_cut_1000   all 0.5217

h2oloo_RUN4¶

summary (trec_eval)

map             all 0.3345
bpref           all 0.4091
recip_rank      all 0.7003
P_10            all 0.5014
P_100           all 0.1620
P_1000          all 0.0213
recall_10       all 0.2070
recall_100      all 0.5346
recall_1000     all 0.6593
ndcg            all 0.5260
ndcg_cut_10     all 0.4461
ndcg_cut_100    all 0.4819
ndcg_cut_1000   all 0.5260

ASCFDA_qa¶

summary (trec_eval)

map             all 0.3102
bpref           all 0.3810
recip_rank      all 0.6993
P_10            all 0.4918
P_100           all 0.1543
P_1000          all 0.0209
recall_10       all 0.1965
recall_100      all 0.5030
recall_1000     all 0.6498
ndcg            all 0.5131
ndcg_cut_10     all 0.4437
ndcg_cut_100    all 0.4632
ndcg_cut_1000   all 0.5131

ASCFDA_rm3¶

summary (trec_eval)

map             all 0.3092
bpref           all 0.3823
recip_rank      all 0.6936
P_10            all 0.4822
P_100           all 0.1524
P_1000          all 0.0210
recall_10       all 0.1965
recall_100      all 0.4916
recall_1000     all 0.6405
ndcg            all 0.5003
ndcg_cut_10     all 0.4322
ndcg_cut_100    all 0.4495
ndcg_cut_1000   all 0.5003

ielab-bertAQ¶

summary (trec_eval)

map             all 0.0712
bpref           all 0.1530
recip_rank      all 0.1991
P_10            all 0.1178
P_100           all 0.0630
P_1000          all 0.0152
recall_10       all 0.0414
recall_100      all 0.1967
recall_1000     all 0.4606
ndcg            all 0.2170
ndcg_cut_10     all 0.0833
ndcg_cut_100    all 0.1287
ndcg_cut_1000   all 0.2170

ielab-bm25T5QLM¶

summary (trec_eval)

map             all 0.2712
bpref           all 0.3446
recip_rank      all 0.7321
P_10            all 0.4981
P_100           all 0.1455
P_1000          all 0.0168
recall_10       all 0.1966
recall_100      all 0.4812
recall_1000     all 0.5362
ndcg            all 0.4472
ndcg_cut_10     all 0.4090
ndcg_cut_100    all 0.4265
ndcg_cut_1000   all 0.4472

ielab-bertPRFAQ¶

summary (trec_eval)

map             all 0.0610
bpref           all 0.1409
recip_rank      all 0.2019
P_10            all 0.0976
P_100           all 0.0476
P_1000          all 0.0121
recall_10       all 0.0363
recall_100      all 0.1539
recall_1000     all 0.3673
ndcg            all 0.1793
ndcg_cut_10     all 0.0773
ndcg_cut_100    all 0.1076
ndcg_cut_1000   all 0.1793

ielab-bm25AQ¶

summary (trec_eval)

map             all 0.1024
bpref           all 0.1568
recip_rank      all 0.2915
P_10            all 0.1721
P_100           all 0.0737
P_1000          all 0.0152
recall_10       all 0.0575
recall_100      all 0.2308
recall_1000     all 0.4606
ndcg            all 0.2463
ndcg_cut_10     all 0.1314
ndcg_cut_100    all 0.1696
ndcg_cut_1000   all 0.2463