Results - NeuCLIR 2022¶

hltcoe22tht¶

summary (trec_eval)

map             all 0.2224
bpref           all 0.2105
recip_rank      all 0.5270
P_10            all 0.2739
P_100           all 0.1135
P_1000          all 0.0243
recall_10       all 0.2099
recall_100      all 0.4975
recall_1000     all 0.7875
ndcg            all 0.4521
ndcg_cut_10     all 0.3122
ndcg_cut_100    all 0.3702
ndcg_cut_1000   all 0.4521

IDACCS-run1¶

summary (trec_eval)

map             all 0.1067
bpref           all 0.1003
recip_rank      all 0.3698
P_10            all 0.1565
P_100           all 0.0554
P_1000          all 0.0123
recall_10       all 0.1333
recall_100      all 0.3366
recall_1000     all 0.5571
ndcg            all 0.2820
ndcg_cut_10     all 0.1784
ndcg_cut_100    all 0.2207
ndcg_cut_1000   all 0.2820

IDACCS-run1_reranking¶

summary (trec_eval)

map             all 0.1891
bpref           all 0.1670
recip_rank      all 0.5493
P_10            all 0.2500
P_100           all 0.1007
P_1000          all 0.0239
recall_10       all 0.2075
recall_100      all 0.5333
recall_1000     all 0.8292
ndcg            all 0.4558
ndcg_cut_10     all 0.3024
ndcg_cut_100    all 0.3702
ndcg_cut_1000   all 0.4558

IDACCS-baseline_raranking¶

summary (trec_eval)

map             all 0.1526
bpref           all 0.1471
recip_rank      all 0.4631
P_10            all 0.2109
P_100           all 0.0970
P_1000          all 0.0239
recall_10       all 0.1404
recall_100      all 0.4775
recall_1000     all 0.8292
ndcg            all 0.4071
ndcg_cut_10     all 0.2313
ndcg_cut_100    all 0.3097
ndcg_cut_1000   all 0.4071

IDACCS-baseline¶

summary (trec_eval)

map             all 0.0802
bpref           all 0.0859
recip_rank      all 0.3812
P_10            all 0.1348
P_100           all 0.0459
P_1000          all 0.0105
recall_10       all 0.1134
recall_100      all 0.2471
recall_1000     all 0.4636
ndcg            all 0.2310
ndcg_cut_10     all 0.1540
ndcg_cut_100    all 0.1743
ndcg_cut_1000   all 0.2310

IDACCS-baseline_rus¶

summary (trec_eval)

map             all 0.0746
bpref           all 0.0947
recip_rank      all 0.3823
P_10            all 0.1422
P_100           all 0.0620
P_1000          all 0.0173
recall_10       all 0.0573
recall_100      all 0.1850
recall_1000     all 0.4680
ndcg            all 0.2757
ndcg_cut_10     all 0.1608
ndcg_cut_100    all 0.1774
ndcg_cut_1000   all 0.2757

IDACCS-baseline_rrank_rus¶

summary (trec_eval)

map             all 0.1738
bpref           all 0.1853
recip_rank      all 0.5209
P_10            all 0.2800
P_100           all 0.1304
P_1000          all 0.0340
recall_10       all 0.1301
recall_100      all 0.4093
recall_1000     all 0.7744
ndcg            all 0.4617
ndcg_cut_10     all 0.2693
ndcg_cut_100    all 0.3305
ndcg_cut_1000   all 0.4617

IDACCS-run1_rrank_rus¶

summary (trec_eval)

map             all 0.2029
bpref           all 0.2101
recip_rank      all 0.5981
P_10            all 0.3156
P_100           all 0.1438
P_1000          all 0.0340
recall_10       all 0.1335
recall_100      all 0.4247
recall_1000     all 0.7744
ndcg            all 0.4832
ndcg_cut_10     all 0.3031
ndcg_cut_100    all 0.3598
ndcg_cut_1000   all 0.4832

IDACCS-run1_rus¶

summary (trec_eval)

map             all 0.0933
bpref           all 0.1070
recip_rank      all 0.4216
P_10            all 0.1467
P_100           all 0.0773
P_1000          all 0.0193
recall_10       all 0.0755
recall_100      all 0.2350
recall_1000     all 0.4979
ndcg            all 0.3110
ndcg_cut_10     all 0.1786
ndcg_cut_100    all 0.2139
ndcg_cut_1000   all 0.3110

IDACCS-run1_zho¶

summary (trec_eval)

map             all 0.0639
bpref           all 0.0907
recip_rank      all 0.2953
P_10            all 0.1429
P_100           all 0.0741
P_1000          all 0.0199
recall_10       all 0.0532
recall_100      all 0.1937
recall_1000     all 0.4443
ndcg            all 0.2373
ndcg_cut_10     all 0.1357
ndcg_cut_100    all 0.1574
ndcg_cut_1000   all 0.2373

IDACCS-run1_rrank_zho¶

summary (trec_eval)

map             all 0.1375
bpref           all 0.1471
recip_rank      all 0.3736
P_10            all 0.2184
P_100           all 0.1171
P_1000          all 0.0321
recall_10       all 0.0886
recall_100      all 0.3682
recall_1000     all 0.7814
ndcg            all 0.3956
ndcg_cut_10     all 0.1914
ndcg_cut_100    all 0.2661
ndcg_cut_1000   all 0.3956

IDACCS-baseline_rrank_zho¶

summary (trec_eval)

map             all 0.1312
bpref           all 0.1446
recip_rank      all 0.4291
P_10            all 0.1776
P_100           all 0.1155
P_1000          all 0.0321
recall_10       all 0.0823
recall_100      all 0.3895
recall_1000     all 0.7814
ndcg            all 0.4011
ndcg_cut_10     all 0.1885
ndcg_cut_100    all 0.2730
ndcg_cut_1000   all 0.4011

IDACCS-baseline_zho¶

summary (trec_eval)

map             all 0.0555
bpref           all 0.0795
recip_rank      all 0.3029
P_10            all 0.1469
P_100           all 0.0618
P_1000          all 0.0178
recall_10       all 0.0542
recall_100      all 0.1769
recall_1000     all 0.4276
ndcg            all 0.2233
ndcg_cut_10     all 0.1334
ndcg_cut_100    all 0.1455
ndcg_cut_1000   all 0.2233

IDACCS-run2_fas¶

summary (trec_eval)

map             all 0.0944
bpref           all 0.0879
recip_rank      all 0.3443
P_10            all 0.1348
P_100           all 0.0502
P_1000          all 0.0118
recall_10       all 0.1209
recall_100      all 0.3057
recall_1000     all 0.5292
ndcg            all 0.2596
ndcg_cut_10     all 0.1543
ndcg_cut_100    all 0.1958
ndcg_cut_1000   all 0.2596

IDACCS-run2_rrank_fas¶

summary (trec_eval)

map             all 0.1778
bpref           all 0.1608
recip_rank      all 0.5185
P_10            all 0.2435
P_100           all 0.0991
P_1000          all 0.0239
recall_10       all 0.2055
recall_100      all 0.5218
recall_1000     all 0.8292
ndcg            all 0.4414
ndcg_cut_10     all 0.2851
ndcg_cut_100    all 0.3557
ndcg_cut_1000   all 0.4414

IDACCS-run2_rrank_rus¶

summary (trec_eval)

map             all 0.1946
bpref           all 0.1971
recip_rank      all 0.5891
P_10            all 0.3089
P_100           all 0.1409
P_1000          all 0.0340
recall_10       all 0.1300
recall_100      all 0.4219
recall_1000     all 0.7744
ndcg            all 0.4836
ndcg_cut_10     all 0.3008
ndcg_cut_100    all 0.3599
ndcg_cut_1000   all 0.4836

IDACCS-run2_rus¶

summary (trec_eval)

map             all 0.0818
bpref           all 0.0943
recip_rank      all 0.3891
P_10            all 0.1467
P_100           all 0.0733
P_1000          all 0.0189
recall_10       all 0.0776
recall_100      all 0.2254
recall_1000     all 0.4874
ndcg            all 0.2943
ndcg_cut_10     all 0.1765
ndcg_cut_100    all 0.2020
ndcg_cut_1000   all 0.2943

IDACCS-run2_zho¶

summary (trec_eval)

map             all 0.0596
bpref           all 0.0835
recip_rank      all 0.3197
P_10            all 0.1347
P_100           all 0.0657
P_1000          all 0.0190
recall_10       all 0.0466
recall_100      all 0.1689
recall_1000     all 0.4238
ndcg            all 0.2289
ndcg_cut_10     all 0.1349
ndcg_cut_100    all 0.1458
ndcg_cut_1000   all 0.2289

IDACCS-run2_rrank_zho¶

summary (trec_eval)

map             all 0.1316
bpref           all 0.1399
recip_rank      all 0.3793
P_10            all 0.2082
P_100           all 0.1145
P_1000          all 0.0321
recall_10       all 0.0833
recall_100      all 0.3887
recall_1000     all 0.7814
ndcg            all 0.3911
ndcg_cut_10     all 0.1861
ndcg_cut_100    all 0.2627
ndcg_cut_1000   all 0.3911

KASYS-run¶

summary (trec_eval)

map             all 0.1615
bpref           all 0.1584
recip_rank      all 0.5430
P_10            all 0.2652
P_100           all 0.0807
P_1000          all 0.0150
recall_10       all 0.2074
recall_100      all 0.3608
recall_1000     all 0.5423
ndcg            all 0.3604
ndcg_cut_10     all 0.3244
ndcg_cut_100    all 0.3124
ndcg_cut_1000   all 0.3604

KASYS-run-rus¶

summary (trec_eval)

map             all 0.1509
bpref           all 0.1571
recip_rank      all 0.5077
P_10            all 0.2467
P_100           all 0.1044
P_1000          all 0.0199
recall_10       all 0.1401
recall_100      all 0.2875
recall_1000     all 0.5108
ndcg            all 0.3459
ndcg_cut_10     all 0.2659
ndcg_cut_100    all 0.2742
ndcg_cut_1000   all 0.3459

KASYS-run-zho¶

summary (trec_eval)

map             all 0.1659
bpref           all 0.1891
recip_rank      all 0.5314
P_10            all 0.3041
P_100           all 0.1182
P_1000          all 0.0253
recall_10       all 0.1322
recall_100      all 0.3409
recall_1000     all 0.5249
ndcg            all 0.3754
ndcg_cut_10     all 0.2993
ndcg_cut_100    all 0.3125
ndcg_cut_1000   all 0.3754

CFDA_CLIP_dq¶

summary (trec_eval)

map             all 0.3639
bpref           all 0.3439
recip_rank      all 0.7686
P_10            all 0.3848
P_100           all 0.1352
P_1000          all 0.0234
recall_10       all 0.3053
recall_100      all 0.6074
recall_1000     all 0.7577
ndcg            all 0.5799
ndcg_cut_10     all 0.4975
ndcg_cut_100    all 0.5400
ndcg_cut_1000   all 0.5799

CFDA_CLIP_rus_dq¶

summary (trec_eval)

map             all 0.3862
bpref           all 0.3810
recip_rank      all 0.8722
P_10            all 0.4911
P_100           all 0.1931
P_1000          all 0.0312
recall_10       all 0.2679
recall_100      all 0.5257
recall_1000     all 0.7008
ndcg            all 0.5954
ndcg_cut_10     all 0.5367
ndcg_cut_100    all 0.5377
ndcg_cut_1000   all 0.5954

CFDA_CLIP_zho_L¶

summary (trec_eval)

map             all 0.3454
bpref           all 0.3310
recip_rank      all 0.7833
P_10            all 0.4796
P_100           all 0.1845
P_1000          all 0.0287
recall_10       all 0.2416
recall_100      all 0.5773
recall_1000     all 0.7500
ndcg            all 0.5626
ndcg_cut_10     all 0.4758
ndcg_cut_100    all 0.5192
ndcg_cut_1000   all 0.5626

CFDA_CLIP_fas_clf¶

summary (trec_eval)

map             all 0.3298
bpref           all 0.3283
recip_rank      all 0.7367
P_10            all 0.3609
P_100           all 0.1259
P_1000          all 0.0234
recall_10       all 0.2804
recall_100      all 0.5898
recall_1000     all 0.7577
ndcg            all 0.5582
ndcg_cut_10     all 0.4723
ndcg_cut_100    all 0.5076
ndcg_cut_1000   all 0.5582

CFDA_CLIP_rus_clf¶

summary (trec_eval)

map             all 0.3829
bpref           all 0.3752
recip_rank      all 0.8170
P_10            all 0.4689
P_100           all 0.1971
P_1000          all 0.0312
recall_10       all 0.2621
recall_100      all 0.5361
recall_1000     all 0.7008
ndcg            all 0.5917
ndcg_cut_10     all 0.5111
ndcg_cut_100    all 0.5362
ndcg_cut_1000   all 0.5917

CFDA_CLIP_fas_L¶

summary (trec_eval)

map             all 0.3435
bpref           all 0.3285
recip_rank      all 0.7717
P_10            all 0.3543
P_100           all 0.1254
P_1000          all 0.0234
recall_10       all 0.2910
recall_100      all 0.5885
recall_1000     all 0.7577
ndcg            all 0.5695
ndcg_cut_10     all 0.4735
ndcg_cut_100    all 0.5201
ndcg_cut_1000   all 0.5695

CFDA_CLIP_rus_L¶

summary (trec_eval)

map             all 0.3486
bpref           all 0.3425
recip_rank      all 0.8048
P_10            all 0.4267
P_100           all 0.1867
P_1000          all 0.0312
recall_10       all 0.2306
recall_100      all 0.5172
recall_1000     all 0.7008
ndcg            all 0.5670
ndcg_cut_10     all 0.4683
ndcg_cut_100    all 0.5043
ndcg_cut_1000   all 0.5670

CFDA_CLIP_zho_dq¶

summary (trec_eval)

map             all 0.3603
bpref           all 0.3477
recip_rank      all 0.7769
P_10            all 0.4980
P_100           all 0.1798
P_1000          all 0.0287
recall_10       all 0.2600
recall_100      all 0.5490
recall_1000     all 0.7500
ndcg            all 0.5692
ndcg_cut_10     all 0.4932
ndcg_cut_100    all 0.5173
ndcg_cut_1000   all 0.5692

CFDA_CLIP_zho_clf¶

summary (trec_eval)

map             all 0.3494
bpref           all 0.3340
recip_rank      all 0.7857
P_10            all 0.4939
P_100           all 0.1800
P_1000          all 0.0287
recall_10       all 0.2470
recall_100      all 0.5662
recall_1000     all 0.7500
ndcg            all 0.5654
ndcg_cut_10     all 0.4801
ndcg_cut_100    all 0.5164
ndcg_cut_1000   all 0.5654

NLE_fa_mono_rr¶

summary (trec_eval)

map             all 0.3407
bpref           all 0.3105
recip_rank      all 0.7137
P_10            all 0.3696
P_100           all 0.1400
P_1000          all 0.0283
recall_10       all 0.3083
recall_100      all 0.6521
recall_1000     all 0.9127
ndcg            all 0.5941
ndcg_cut_10     all 0.4509
ndcg_cut_100    all 0.5213
ndcg_cut_1000   all 0.5941

NLE_fa_mono¶

summary (trec_eval)

map             all 0.3996
bpref           all 0.3681
recip_rank      all 0.7914
P_10            all 0.3935
P_100           all 0.1487
P_1000          all 0.0283
recall_10       all 0.3414
recall_100      all 0.6984
recall_1000     all 0.9127
ndcg            all 0.6405
ndcg_cut_10     all 0.5243
ndcg_cut_100    all 0.5776
ndcg_cut_1000   all 0.6405

NLE_fa_adhoc¶

summary (trec_eval)

map             all 0.3933
bpref           all 0.3645
recip_rank      all 0.7377
P_10            all 0.3761
P_100           all 0.1478
P_1000          all 0.0282
recall_10       all 0.3198
recall_100      all 0.7068
recall_1000     all 0.9197
ndcg            all 0.6334
ndcg_cut_10     all 0.4992
ndcg_cut_100    all 0.5685
ndcg_cut_1000   all 0.6334

NLE_fa_adhoc_rr¶

summary (trec_eval)

map             all 0.4065
bpref           all 0.3822
recip_rank      all 0.7397
P_10            all 0.4087
P_100           all 0.1415
P_1000          all 0.0287
recall_10       all 0.3596
recall_100      all 0.6768
recall_1000     all 0.9264
ndcg            all 0.6563
ndcg_cut_10     all 0.5373
ndcg_cut_100    all 0.5852
ndcg_cut_1000   all 0.6563

splade_farsi_ht¶

summary (trec_eval)

map             all 0.2905
bpref           all 0.2601
recip_rank      all 0.6066
P_10            all 0.3326
P_100           all 0.1276
P_1000          all 0.0243
recall_10       all 0.2849
recall_100      all 0.5990
recall_1000     all 0.8245
ndcg            all 0.5227
ndcg_cut_10     all 0.4040
ndcg_cut_100    all 0.4593
ndcg_cut_1000   all 0.5227

splade_farsi_mt¶

summary (trec_eval)

map             all 0.3136
bpref           all 0.2845
recip_rank      all 0.6943
P_10            all 0.3261
P_100           all 0.1263
P_1000          all 0.0244
recall_10       all 0.2787
recall_100      all 0.6206
recall_1000     all 0.8350
ndcg            all 0.5559
ndcg_cut_10     all 0.4330
ndcg_cut_100    all 0.4928
ndcg_cut_1000   all 0.5559

splade_farsi_dt¶

summary (trec_eval)

map             all 0.2870
bpref           all 0.2644
recip_rank      all 0.6182
P_10            all 0.3413
P_100           all 0.1207
P_1000          all 0.0231
recall_10       all 0.2745
recall_100      all 0.5884
recall_1000     all 0.8335
ndcg            all 0.5433
ndcg_cut_10     all 0.4351
ndcg_cut_100    all 0.4819
ndcg_cut_1000   all 0.5433

splade_russian_dt¶

summary (trec_eval)

map             all 0.3496
bpref           all 0.3473
recip_rank      all 0.7864
P_10            all 0.4044
P_100           all 0.1693
P_1000          all 0.0347
recall_10       all 0.2424
recall_100      all 0.5436
recall_1000     all 0.8226
ndcg            all 0.6120
ndcg_cut_10     all 0.4583
ndcg_cut_100    all 0.5050
ndcg_cut_1000   all 0.6120

splade_russian_mt¶

summary (trec_eval)

map             all 0.2929
bpref           all 0.2927
recip_rank      all 0.6332
P_10            all 0.4156
P_100           all 0.1693
P_1000          all 0.0337
recall_10       all 0.2052
recall_100      all 0.4854
recall_1000     all 0.7590
ndcg            all 0.5380
ndcg_cut_10     all 0.4065
ndcg_cut_100    all 0.4365
ndcg_cut_1000   all 0.5380

splade_russian_ht¶

summary (trec_eval)

map             all 0.3019
bpref           all 0.2962
recip_rank      all 0.6678
P_10            all 0.4378
P_100           all 0.1709
P_1000          all 0.0337
recall_10       all 0.2286
recall_100      all 0.5111
recall_1000     all 0.7776
ndcg            all 0.5593
ndcg_cut_10     all 0.4437
ndcg_cut_100    all 0.4604
ndcg_cut_1000   all 0.5593

NLE_ru_mono_rr¶

summary (trec_eval)

map             all 0.4294
bpref           all 0.4173
recip_rank      all 0.8252
P_10            all 0.5133
P_100           all 0.2171
P_1000          all 0.0380
recall_10       all 0.2867
recall_100      all 0.6095
recall_1000     all 0.8849
ndcg            all 0.6824
ndcg_cut_10     all 0.5525
ndcg_cut_100    all 0.5860
ndcg_cut_1000   all 0.6824

NLE_ru_mono¶

summary (trec_eval)

map             all 0.3909
bpref           all 0.3792
recip_rank      all 0.8027
P_10            all 0.4600
P_100           all 0.2109
P_1000          all 0.0380
recall_10       all 0.2391
recall_100      all 0.6083
recall_1000     all 0.8855
ndcg            all 0.6586
ndcg_cut_10     all 0.4970
ndcg_cut_100    all 0.5591
ndcg_cut_1000   all 0.6586

NLE_ru_adhoc_rr¶

summary (trec_eval)

map             all 0.4730
bpref           all 0.4487
recip_rank      all 0.8152
P_10            all 0.5444
P_100           all 0.2351
P_1000          all 0.0385
recall_10       all 0.2911
recall_100      all 0.6599
recall_1000     all 0.8978
ndcg            all 0.7066
ndcg_cut_10     all 0.5748
ndcg_cut_100    all 0.6215
ndcg_cut_1000   all 0.7066

NLE_ru_adhoc¶

summary (trec_eval)

map             all 0.3835
bpref           all 0.3688
recip_rank      all 0.7759
P_10            all 0.4889
P_100           all 0.2116
P_1000          all 0.0379
recall_10       all 0.2585
recall_100      all 0.5906
recall_1000     all 0.8769
ndcg            all 0.6456
ndcg_cut_10     all 0.4955
ndcg_cut_100    all 0.5436
ndcg_cut_1000   all 0.6456

KASYS_one_model-fas¶

summary (trec_eval)

map             all 0.2003
bpref           all 0.1934
recip_rank      all 0.5577
P_10            all 0.2630
P_100           all 0.0915
P_1000          all 0.0172
recall_10       all 0.2127
recall_100      all 0.4343
recall_1000     all 0.5909
ndcg            all 0.4029
ndcg_cut_10     all 0.3218
ndcg_cut_100    all 0.3607
ndcg_cut_1000   all 0.4029

KASYS_onemodel-rerank-fas¶

summary (trec_eval)

map             all 0.2854
bpref           all 0.2850
recip_rank      all 0.6307
P_10            all 0.3196
P_100           all 0.1148
P_1000          all 0.0239
recall_10       all 0.2512
recall_100      all 0.5457
recall_1000     all 0.8292
ndcg            all 0.5250
ndcg_cut_10     all 0.3931
ndcg_cut_100    all 0.4513
ndcg_cut_1000   all 0.5250

coe22-mhq-zho_colxtt¶

summary (trec_eval)

map             all 0.0246
bpref           all 0.0683
recip_rank      all 0.1249
P_10            all 0.0510
P_100           all 0.0247
P_1000          all 0.0254
recall_10       all 0.0102
recall_100      all 0.0438
recall_1000     all 0.5705
ndcg            all 0.2055
ndcg_cut_10     all 0.0382
ndcg_cut_100    all 0.0374
ndcg_cut_1000   all 0.2055

coe22-mhq-rus_colxtt¶

summary (trec_eval)

map             all 0.0359
bpref           all 0.0764
recip_rank      all 0.2090
P_10            all 0.0556
P_100           all 0.0380
P_1000          all 0.0306
recall_10       all 0.0097
recall_100      all 0.0663
recall_1000     all 0.6630
ndcg            all 0.2592
ndcg_cut_10     all 0.0501
ndcg_cut_100    all 0.0617
ndcg_cut_1000   all 0.2592

coe22-mhq-fas_colxtt¶

summary (trec_eval)

map             all 0.0215
bpref           all 0.0525
recip_rank      all 0.1076
P_10            all 0.0304
P_100           all 0.0246
P_1000          all 0.0206
recall_10       all 0.0057
recall_100      all 0.0638
recall_1000     all 0.7053
ndcg            all 0.2090
ndcg_cut_10     all 0.0308
ndcg_cut_100    all 0.0445
ndcg_cut_1000   all 0.2090

coe22-tdq-fas_colxtt¶

summary (trec_eval)

map             all 0.2910
bpref           all 0.2765
recip_rank      all 0.5988
P_10            all 0.3217
P_100           all 0.1257
P_1000          all 0.0237
recall_10       all 0.2633
recall_100      all 0.5786
recall_1000     all 0.8079
ndcg            all 0.5293
ndcg_cut_10     all 0.3989
ndcg_cut_100    all 0.4641
ndcg_cut_1000   all 0.5293

coe22-tdq-rus_colxtt¶

summary (trec_eval)

map             all 0.3277
bpref           all 0.3213
recip_rank      all 0.7468
P_10            all 0.4178
P_100           all 0.1780
P_1000          all 0.0334
recall_10       all 0.2350
recall_100      all 0.5264
recall_1000     all 0.7843
ndcg            all 0.5820
ndcg_cut_10     all 0.4529
ndcg_cut_100    all 0.4896
ndcg_cut_1000   all 0.5820

coe22-tdq-zho_colxtt¶

summary (trec_eval)

map             all 0.3499
bpref           all 0.3635
recip_rank      all 0.6800
P_10            all 0.4551
P_100           all 0.1671
P_1000          all 0.0334
recall_10       all 0.2527
recall_100      all 0.5698
recall_1000     all 0.8110
ndcg            all 0.5656
ndcg_cut_10     all 0.4383
ndcg_cut_100    all 0.4850
ndcg_cut_1000   all 0.5656

coe22-tdq-fas_colxmtt¶

summary (trec_eval)

map             all 0.0000
bpref           all 0.0000
recip_rank      all 0.0000
P_10            all 0.0000
P_100           all 0.0000
P_1000          all 0.0000
recall_10       all 0.0000
recall_100      all 0.0000
recall_1000     all 0.0000
ndcg            all 0.0000
ndcg_cut_10     all 0.0000
ndcg_cut_100    all 0.0000
ndcg_cut_1000   all 0.0000

coe22-tdq-rus_colxmtt¶

summary (trec_eval)

map             all 0.0000
bpref           all 0.0001
recip_rank      all 0.0001
P_10            all 0.0000
P_100           all 0.0000
P_1000          all 0.0000
recall_10       all 0.0000
recall_100      all 0.0000
recall_1000     all 0.0007
ndcg            all 0.0005
ndcg_cut_10     all 0.0000
ndcg_cut_100    all 0.0000
ndcg_cut_1000   all 0.0005

coe22-tdq-zho_colxmtt¶

summary (trec_eval)

map             all 0.0001
bpref           all 0.0006
recip_rank      all 0.0027
P_10            all 0.0020
P_100           all 0.0002
P_1000          all 0.0001
recall_10       all 0.0006
recall_100      all 0.0006
recall_1000     all 0.0010
ndcg            all 0.0005
ndcg_cut_10     all 0.0005
ndcg_cut_100    all 0.0003
ndcg_cut_1000   all 0.0005

coe22-tq-fas_colxtt¶

summary (trec_eval)

map             all 0.2727
bpref           all 0.2719
recip_rank      all 0.5683
P_10            all 0.3000
P_100           all 0.1213
P_1000          all 0.0233
recall_10       all 0.2235
recall_100      all 0.5685
recall_1000     all 0.7730
ndcg            all 0.5076
ndcg_cut_10     all 0.3642
ndcg_cut_100    all 0.4513
ndcg_cut_1000   all 0.5076

coe22-tq-rus_colxtt¶

summary (trec_eval)

map             all 0.3350
bpref           all 0.3400
recip_rank      all 0.7515
P_10            all 0.4067
P_100           all 0.1776
P_1000          all 0.0317
recall_10       all 0.2408
recall_100      all 0.5213
recall_1000     all 0.7713
ndcg            all 0.5933
ndcg_cut_10     all 0.4551
ndcg_cut_100    all 0.5046
ndcg_cut_1000   all 0.5933

zh_2t¶

summary (trec_eval)

map             all 0.1814
bpref           all 0.1816
recip_rank      all 0.5590
P_10            all 0.2531
P_100           all 0.0959
P_1000          all 0.0226
recall_10       all 0.1740
recall_100      all 0.4211
recall_1000     all 0.6522
ndcg            all 0.4050
ndcg_cut_10     all 0.2675
ndcg_cut_100    all 0.3295
ndcg_cut_1000   all 0.4050

coe22-tq-zho_colxtt¶

summary (trec_eval)

map             all 0.3322
bpref           all 0.3426
recip_rank      all 0.6739
P_10            all 0.4408
P_100           all 0.1698
P_1000          all 0.0343
recall_10       all 0.2230
recall_100      all 0.5424
recall_1000     all 0.7810
ndcg            all 0.5534
ndcg_cut_10     all 0.4262
ndcg_cut_100    all 0.4724
ndcg_cut_1000   all 0.5534

coe22-tq-fas_colxmtt¶

summary (trec_eval)

map             all 0.0000
bpref           all 0.0000
recip_rank      all 0.0000
P_10            all 0.0000
P_100           all 0.0000
P_1000          all 0.0000
recall_10       all 0.0000
recall_100      all 0.0000
recall_1000     all 0.0000
ndcg            all 0.0000
ndcg_cut_10     all 0.0000
ndcg_cut_100    all 0.0000
ndcg_cut_1000   all 0.0000

coe22-tq-rus_colxmtt¶

summary (trec_eval)

map             all 0.0000
bpref           all 0.0000
recip_rank      all 0.0001
P_10            all 0.0000
P_100           all 0.0000
P_1000          all 0.0000
recall_10       all 0.0000
recall_100      all 0.0000
recall_1000     all 0.0007
ndcg            all 0.0005
ndcg_cut_10     all 0.0000
ndcg_cut_100    all 0.0000
ndcg_cut_1000   all 0.0005

coe22-tq-zho_colxmtt¶

summary (trec_eval)

map             all 0.0000
bpref           all 0.0000
recip_rank      all 0.0000
P_10            all 0.0000
P_100           all 0.0000
P_1000          all 0.0000
recall_10       all 0.0000
recall_100      all 0.0000
recall_1000     all 0.0002
ndcg            all 0.0001
ndcg_cut_10     all 0.0000
ndcg_cut_100    all 0.0000
ndcg_cut_1000   all 0.0001

zh_2tr¶

summary (trec_eval)

map             all 0.2031
bpref           all 0.1936
recip_rank      all 0.5389
P_10            all 0.2367
P_100           all 0.1108
P_1000          all 0.0244
recall_10       all 0.1782
recall_100      all 0.4634
recall_1000     all 0.7022
ndcg            all 0.4283
ndcg_cut_10     all 0.2705
ndcg_cut_100    all 0.3541
ndcg_cut_1000   all 0.4283

zh_qt¶

summary (trec_eval)

map             all 0.1734
bpref           all 0.1865
recip_rank      all 0.5520
P_10            all 0.2612
P_100           all 0.0800
P_1000          all 0.0175
recall_10       all 0.1778
recall_100      all 0.3352
recall_1000     all 0.4940
ndcg            all 0.3337
ndcg_cut_10     all 0.2590
ndcg_cut_100    all 0.2827
ndcg_cut_1000   all 0.3337

zh_qtr¶

summary (trec_eval)

map             all 0.1889
bpref           all 0.1925
recip_rank      all 0.5448
P_10            all 0.2490
P_100           all 0.0880
P_1000          all 0.0195
recall_10       all 0.1620
recall_100      all 0.3586
recall_1000     all 0.5327
ndcg            all 0.3586
ndcg_cut_10     all 0.2604
ndcg_cut_100    all 0.3038
ndcg_cut_1000   all 0.3586

zh_dt¶

summary (trec_eval)

map             all 0.1448
bpref           all 0.1521
recip_rank      all 0.4400
P_10            all 0.1939
P_100           all 0.0667
P_1000          all 0.0183
recall_10       all 0.1245
recall_100      all 0.3237
recall_1000     all 0.5296
ndcg            all 0.3305
ndcg_cut_10     all 0.2220
ndcg_cut_100    all 0.2591
ndcg_cut_1000   all 0.3305

zh_dtr¶

summary (trec_eval)

map             all 0.1796
bpref           all 0.1758
recip_rank      all 0.4443
P_10            all 0.2143
P_100           all 0.0782
P_1000          all 0.0197
recall_10       all 0.1300
recall_100      all 0.3698
recall_1000     all 0.5787
ndcg            all 0.3615
ndcg_cut_10     all 0.2367
ndcg_cut_100    all 0.2905
ndcg_cut_1000   all 0.3615

zh_4rrf¶

summary (trec_eval)

map             all 0.1009
bpref           all 0.1103
recip_rank      all 0.4692
P_10            all 0.1816
P_100           all 0.0496
P_1000          all 0.0120
recall_10       all 0.1116
recall_100      all 0.2305
recall_1000     all 0.4227
ndcg            all 0.2589
ndcg_cut_10     all 0.1930
ndcg_cut_100    all 0.1991
ndcg_cut_1000   all 0.2589

coe22-man-fas¶

summary (trec_eval)

map             all 0.2306
bpref           all 0.2314
recip_rank      all 0.5128
P_10            all 0.2739
P_100           all 0.1072
P_1000          all 0.0235
recall_10       all 0.2205
recall_100      all 0.4759
recall_1000     all 0.7945
ndcg            all 0.4499
ndcg_cut_10     all 0.3235
ndcg_cut_100    all 0.3649
ndcg_cut_1000   all 0.4499

coe22-man-rus¶

summary (trec_eval)

map             all 0.2545
bpref           all 0.2689
recip_rank      all 0.6642
P_10            all 0.3578
P_100           all 0.1416
P_1000          all 0.0288
recall_10       all 0.1728
recall_100      all 0.4130
recall_1000     all 0.6795
ndcg            all 0.4758
ndcg_cut_10     all 0.3587
ndcg_cut_100    all 0.3796
ndcg_cut_1000   all 0.4758

zh_4rrfprf¶

summary (trec_eval)

map             all 0.1066
bpref           all 0.1169
recip_rank      all 0.4391
P_10            all 0.1755
P_100           all 0.0561
P_1000          all 0.0141
recall_10       all 0.1014
recall_100      all 0.2447
recall_1000     all 0.4565
ndcg            all 0.2663
ndcg_cut_10     all 0.1819
ndcg_cut_100    all 0.2022
ndcg_cut_1000   all 0.2663

zh_4rrf2¶

summary (trec_eval)

map             all 0.1061
bpref           all 0.1144
recip_rank      all 0.4623
P_10            all 0.1735
P_100           all 0.0545
P_1000          all 0.0136
recall_10       all 0.1057
recall_100      all 0.2410
recall_1000     all 0.4539
ndcg            all 0.2700
ndcg_cut_10     all 0.1873
ndcg_cut_100    all 0.2055
ndcg_cut_1000   all 0.2700

coe22-man-zho¶

summary (trec_eval)

map             all 0.2732
bpref           all 0.3014
recip_rank      all 0.7186
P_10            all 0.4204
P_100           all 0.1196
P_1000          all 0.0254
recall_10       all 0.2248
recall_100      all 0.4412
recall_1000     all 0.6871
ndcg            all 0.4821
ndcg_cut_10     all 0.4167
ndcg_cut_100    all 0.4065
ndcg_cut_1000   all 0.4821

coe22-bm25-td-dt-fas¶

summary (trec_eval)

map             all 0.2532
bpref           all 0.2373
recip_rank      all 0.4997
P_10            all 0.3000
P_100           all 0.1126
P_1000          all 0.0239
recall_10       all 0.2456
recall_100      all 0.5171
recall_1000     all 0.8292
ndcg            all 0.4773
ndcg_cut_10     all 0.3438
ndcg_cut_100    all 0.3916
ndcg_cut_1000   all 0.4773

coe22-bm25-td-dt-rus¶

summary (trec_eval)

map             all 0.2162
bpref           all 0.2180
recip_rank      all 0.5508
P_10            all 0.3000
P_100           all 0.1409
P_1000          all 0.0340
recall_10       all 0.1605
recall_100      all 0.4248
recall_1000     all 0.7744
ndcg            all 0.4747
ndcg_cut_10     all 0.2798
ndcg_cut_100    all 0.3439
ndcg_cut_1000   all 0.4747

coe22-bm25-td-dt-zho¶

summary (trec_eval)

map             all 0.2636
bpref           all 0.2556
recip_rank      all 0.5692
P_10            all 0.3449
P_100           all 0.1390
P_1000          all 0.0321
recall_10       all 0.2122
recall_100      all 0.5022
recall_1000     all 0.7814
ndcg            all 0.4942
ndcg_cut_10     all 0.3317
ndcg_cut_100    all 0.3976
ndcg_cut_1000   all 0.4942

coe22-bm25-d-dt-zho¶

summary (trec_eval)

map             all 0.2537
bpref           all 0.2396
recip_rank      all 0.5199
P_10            all 0.3082
P_100           all 0.1343
P_1000          all 0.0307
recall_10       all 0.2107
recall_100      all 0.4818
recall_1000     all 0.7602
ndcg            all 0.4770
ndcg_cut_10     all 0.3093
ndcg_cut_100    all 0.3833
ndcg_cut_1000   all 0.4770

ru_2t¶

summary (trec_eval)

map             all 0.2159
bpref           all 0.2268
recip_rank      all 0.5117
P_10            all 0.2933
P_100           all 0.1244
P_1000          all 0.0286
recall_10       all 0.1769
recall_100      all 0.4248
recall_1000     all 0.6994
ndcg            all 0.4632
ndcg_cut_10     all 0.3049
ndcg_cut_100    all 0.3570
ndcg_cut_1000   all 0.4632

coe22-bm25-d-dt-rus¶

summary (trec_eval)

map             all 0.2377
bpref           all 0.2362
recip_rank      all 0.5200
P_10            all 0.3533
P_100           all 0.1580
P_1000          all 0.0343
recall_10       all 0.1877
recall_100      all 0.4547
recall_1000     all 0.7707
ndcg            all 0.4846
ndcg_cut_10     all 0.3232
ndcg_cut_100    all 0.3654
ndcg_cut_1000   all 0.4846

coe22-bm25-d-dt-fas¶

summary (trec_eval)

map             all 0.2157
bpref           all 0.2115
recip_rank      all 0.4425
P_10            all 0.2652
P_100           all 0.1052
P_1000          all 0.0222
recall_10       all 0.2149
recall_100      all 0.4860
recall_1000     all 0.7675
ndcg            all 0.4202
ndcg_cut_10     all 0.2956
ndcg_cut_100    all 0.3473
ndcg_cut_1000   all 0.4202

coe22-bm25-t-dt-fas¶

summary (trec_eval)

map             all 0.2318
bpref           all 0.2241
recip_rank      all 0.5108
P_10            all 0.2848
P_100           all 0.1130
P_1000          all 0.0231
recall_10       all 0.2298
recall_100      all 0.5392
recall_1000     all 0.7975
ndcg            all 0.4619
ndcg_cut_10     all 0.3337
ndcg_cut_100    all 0.3894
ndcg_cut_1000   all 0.4619

ru_2tr¶

summary (trec_eval)

map             all 0.2159
bpref           all 0.2143
recip_rank      all 0.5647
P_10            all 0.2889
P_100           all 0.1358
P_1000          all 0.0316
recall_10       all 0.1693
recall_100      all 0.4416
recall_1000     all 0.7335
ndcg            all 0.4705
ndcg_cut_10     all 0.2924
ndcg_cut_100    all 0.3552
ndcg_cut_1000   all 0.4705

coe22-bm25-t-dt-rus¶

summary (trec_eval)

map             all 0.2377
bpref           all 0.2362
recip_rank      all 0.5200
P_10            all 0.3533
P_100           all 0.1580
P_1000          all 0.0343
recall_10       all 0.1877
recall_100      all 0.4547
recall_1000     all 0.7707
ndcg            all 0.4846
ndcg_cut_10     all 0.3232
ndcg_cut_100    all 0.3654
ndcg_cut_1000   all 0.4846

coe22-bm25-t-dt-zho¶

summary (trec_eval)

map             all 0.2813
bpref           all 0.2747
recip_rank      all 0.5777
P_10            all 0.3449
P_100           all 0.1439
P_1000          all 0.0333
recall_10       all 0.2209
recall_100      all 0.5032
recall_1000     all 0.8054
ndcg            all 0.5156
ndcg_cut_10     all 0.3337
ndcg_cut_100    all 0.4133
ndcg_cut_1000   all 0.5156

coe22-bm25-t-ht-zho¶

summary (trec_eval)

map             all 0.3199
bpref           all 0.3135
recip_rank      all 0.7368
P_10            all 0.3796
P_100           all 0.1567
P_1000          all 0.0299
recall_10       all 0.2340
recall_100      all 0.5662
recall_1000     all 0.7777
ndcg            all 0.5473
ndcg_cut_10     all 0.4003
ndcg_cut_100    all 0.4778
ndcg_cut_1000   all 0.5473

coe22-bm25-t-ht-rus¶

summary (trec_eval)

map             all 0.2880
bpref           all 0.2911
recip_rank      all 0.6018
P_10            all 0.3711
P_100           all 0.1602
P_1000          all 0.0339
recall_10       all 0.1998
recall_100      all 0.4538
recall_1000     all 0.7589
ndcg            all 0.5141
ndcg_cut_10     all 0.3668
ndcg_cut_100    all 0.3997
ndcg_cut_1000   all 0.5141

ru_qt¶

summary (trec_eval)

map             all 0.2655
bpref           all 0.2785
recip_rank      all 0.6933
P_10            all 0.3578
P_100           all 0.1567
P_1000          all 0.0319
recall_10       all 0.1953
recall_100      all 0.4787
recall_1000     all 0.7403
ndcg            all 0.5145
ndcg_cut_10     all 0.3790
ndcg_cut_100    all 0.4152
ndcg_cut_1000   all 0.5145

coe22-bm25-td-ht-rus¶

summary (trec_eval)

map             all 0.2792
bpref           all 0.2872
recip_rank      all 0.6623
P_10            all 0.3689
P_100           all 0.1589
P_1000          all 0.0338
recall_10       all 0.1837
recall_100      all 0.4870
recall_1000     all 0.7663
ndcg            all 0.5210
ndcg_cut_10     all 0.3713
ndcg_cut_100    all 0.4104
ndcg_cut_1000   all 0.5210

ru_qtr¶

summary (trec_eval)

map             all 0.2723
bpref           all 0.2734
recip_rank      all 0.6517
P_10            all 0.3844
P_100           all 0.1718
P_1000          all 0.0344
recall_10       all 0.1814
recall_100      all 0.4827
recall_1000     all 0.7736
ndcg            all 0.5157
ndcg_cut_10     all 0.3630
ndcg_cut_100    all 0.4086
ndcg_cut_1000   all 0.5157

coe22-bm25-td-ht-fas¶

summary (trec_eval)

map             all 0.2117
bpref           all 0.1997
recip_rank      all 0.4085
P_10            all 0.2739
P_100           all 0.1111
P_1000          all 0.0242
recall_10       all 0.2107
recall_100      all 0.4709
recall_1000     all 0.7735
ndcg            all 0.4232
ndcg_cut_10     all 0.2971
ndcg_cut_100    all 0.3404
ndcg_cut_1000   all 0.4232

coe22-bm25-td-ht-zho¶

summary (trec_eval)

map             all 0.2956
bpref           all 0.2949
recip_rank      all 0.6330
P_10            all 0.3857
P_100           all 0.1447
P_1000          all 0.0299
recall_10       all 0.2358
recall_100      all 0.5169
recall_1000     all 0.7942
ndcg            all 0.5199
ndcg_cut_10     all 0.3688
ndcg_cut_100    all 0.4312
ndcg_cut_1000   all 0.5199

ru_dt¶

summary (trec_eval)

map             all 0.0765
bpref           all 0.0804
recip_rank      all 0.2821
P_10            all 0.1156
P_100           all 0.0449
P_1000          all 0.0133
recall_10       all 0.0654
recall_100      all 0.2341
recall_1000     all 0.4169
ndcg            all 0.2305
ndcg_cut_10     all 0.1245
ndcg_cut_100    all 0.1613
ndcg_cut_1000   all 0.2305

coe22-bm25-d-ht-zho¶

summary (trec_eval)

map             all 0.2657
bpref           all 0.2630
recip_rank      all 0.6014
P_10            all 0.3286
P_100           all 0.1284
P_1000          all 0.0267
recall_10       all 0.2087
recall_100      all 0.4761
recall_1000     all 0.7354
ndcg            all 0.4782
ndcg_cut_10     all 0.3310
ndcg_cut_100    all 0.3936
ndcg_cut_1000   all 0.4782

coe22-bm25-d-ht-rus¶

summary (trec_eval)

map             all 0.1957
bpref           all 0.2002
recip_rank      all 0.5338
P_10            all 0.2956
P_100           all 0.1347
P_1000          all 0.0307
recall_10       all 0.1329
recall_100      all 0.3634
recall_1000     all 0.7010
ndcg            all 0.4253
ndcg_cut_10     all 0.2730
ndcg_cut_100    all 0.3088
ndcg_cut_1000   all 0.4253

coe22-bm25-d-ht-fas¶

summary (trec_eval)

map             all 0.1973
bpref           all 0.1869
recip_rank      all 0.3481
P_10            all 0.2217
P_100           all 0.1052
P_1000          all 0.0224
recall_10       all 0.1806
recall_100      all 0.4441
recall_1000     all 0.7415
ndcg            all 0.3983
ndcg_cut_10     all 0.2653
ndcg_cut_100    all 0.3212
ndcg_cut_1000   all 0.3983

ru_dtr¶

summary (trec_eval)

map             all 0.0853
bpref           all 0.0818
recip_rank      all 0.1747
P_10            all 0.1289
P_100           all 0.0478
P_1000          all 0.0143
recall_10       all 0.0722
recall_100      all 0.1974
recall_1000     all 0.4292
ndcg            all 0.2212
ndcg_cut_10     all 0.1079
ndcg_cut_100    all 0.1400
ndcg_cut_1000   all 0.2212

coe22-bm25-d-mt-fas¶

summary (trec_eval)

map             all 0.1834
bpref           all 0.1743
recip_rank      all 0.3401
P_10            all 0.2109
P_100           all 0.1043
P_1000          all 0.0217
recall_10       all 0.1734
recall_100      all 0.4449
recall_1000     all 0.6913
ndcg            all 0.3751
ndcg_cut_10     all 0.2486
ndcg_cut_100    all 0.3081
ndcg_cut_1000   all 0.3751

coe22-bm25-d-mt-rus¶

summary (trec_eval)

map             all 0.2042
bpref           all 0.2143
recip_rank      all 0.5265
P_10            all 0.2978
P_100           all 0.1291
P_1000          all 0.0302
recall_10       all 0.1547
recall_100      all 0.3827
recall_1000     all 0.6733
ndcg            all 0.4301
ndcg_cut_10     all 0.2718
ndcg_cut_100    all 0.3175
ndcg_cut_1000   all 0.4301

coe22-bm25-d-mt-zho¶

summary (trec_eval)

map             all 0.2074
bpref           all 0.2087
recip_rank      all 0.4557
P_10            all 0.2633
P_100           all 0.1127
P_1000          all 0.0238
recall_10       all 0.1814
recall_100      all 0.4335
recall_1000     all 0.6954
ndcg            all 0.4120
ndcg_cut_10     all 0.2611
ndcg_cut_100    all 0.3285
ndcg_cut_1000   all 0.4120

coe22-bm25-td-mt-zho¶

summary (trec_eval)

map             all 0.2579
bpref           all 0.2490
recip_rank      all 0.5413
P_10            all 0.3102
P_100           all 0.1292
P_1000          all 0.0276
recall_10       all 0.2035
recall_100      all 0.5143
recall_1000     all 0.7683
ndcg            all 0.4822
ndcg_cut_10     all 0.3144
ndcg_cut_100    all 0.3940
ndcg_cut_1000   all 0.4822

ru_2rrf¶

summary (trec_eval)

map             all 0.2371
bpref           all 0.2534
recip_rank      all 0.6361
P_10            all 0.3667
P_100           all 0.1556
P_1000          all 0.0316
recall_10       all 0.1727
recall_100      all 0.4780
recall_1000     all 0.7439
ndcg            all 0.4936
ndcg_cut_10     all 0.3531
ndcg_cut_100    all 0.3920
ndcg_cut_1000   all 0.4936

coe22-bm25-td-mt-rus¶

summary (trec_eval)

map             all 0.2810
bpref           all 0.2878
recip_rank      all 0.6099
P_10            all 0.3689
P_100           all 0.1547
P_1000          all 0.0337
recall_10       all 0.2090
recall_100      all 0.4819
recall_1000     all 0.7704
ndcg            all 0.5221
ndcg_cut_10     all 0.3656
ndcg_cut_100    all 0.4067
ndcg_cut_1000   all 0.5221

coe22-bm25-td-mt-fas¶

summary (trec_eval)

map             all 0.2343
bpref           all 0.2138
recip_rank      all 0.4406
P_10            all 0.2652
P_100           all 0.1143
P_1000          all 0.0244
recall_10       all 0.2286
recall_100      all 0.5225
recall_1000     all 0.7846
ndcg            all 0.4463
ndcg_cut_10     all 0.3128
ndcg_cut_100    all 0.3703
ndcg_cut_1000   all 0.4463

coe22-bm25-t-mt-fas¶

summary (trec_eval)

map             all 0.2214
bpref           all 0.2058
recip_rank      all 0.5103
P_10            all 0.2870
P_100           all 0.1159
P_1000          all 0.0243
recall_10       all 0.2110
recall_100      all 0.4857
recall_1000     all 0.7864
ndcg            all 0.4478
ndcg_cut_10     all 0.3180
ndcg_cut_100    all 0.3667
ndcg_cut_1000   all 0.4478

ru_2rrfprf¶

summary (trec_eval)

map             all 0.2638
bpref           all 0.2714
recip_rank      all 0.6227
P_10            all 0.4000
P_100           all 0.1727
P_1000          all 0.0348
recall_10       all 0.1815
recall_100      all 0.4655
recall_1000     all 0.8036
ndcg            all 0.5224
ndcg_cut_10     all 0.3732
ndcg_cut_100    all 0.4066
ndcg_cut_1000   all 0.5224

coe22-bm25-t-mt-rus¶

summary (trec_eval)

map             all 0.2868
bpref           all 0.2925
recip_rank      all 0.6003
P_10            all 0.3644
P_100           all 0.1600
P_1000          all 0.0335
recall_10       all 0.2026
recall_100      all 0.4712
recall_1000     all 0.7573
ndcg            all 0.5179
ndcg_cut_10     all 0.3616
ndcg_cut_100    all 0.4092
ndcg_cut_1000   all 0.5179

ru_2rrf2¶

summary (trec_eval)

map             all 0.2633
bpref           all 0.2689
recip_rank      all 0.6416
P_10            all 0.4000
P_100           all 0.1647
P_1000          all 0.0338
recall_10       all 0.1845
recall_100      all 0.4565
recall_1000     all 0.7884
ndcg            all 0.5221
ndcg_cut_10     all 0.3779
ndcg_cut_100    all 0.4044
ndcg_cut_1000   all 0.5221

fa_2t¶

summary (trec_eval)

map             all 0.2305
bpref           all 0.2256
recip_rank      all 0.4874
P_10            all 0.2435
P_100           all 0.0959
P_1000          all 0.0224
recall_10       all 0.2338
recall_100      all 0.4845
recall_1000     all 0.7507
ndcg            all 0.4461
ndcg_cut_10     all 0.3019
ndcg_cut_100    all 0.3652
ndcg_cut_1000   all 0.4461

fa_2tr¶

summary (trec_eval)

map             all 0.2019
bpref           all 0.1893
recip_rank      all 0.4183
P_10            all 0.2370
P_100           all 0.0972
P_1000          all 0.0227
recall_10       all 0.2013
recall_100      all 0.4870
recall_1000     all 0.7705
ndcg            all 0.4196
ndcg_cut_10     all 0.2656
ndcg_cut_100    all 0.3376
ndcg_cut_1000   all 0.4196

fa_qt¶

summary (trec_eval)

map             all 0.2271
bpref           all 0.2039
recip_rank      all 0.4434
P_10            all 0.2761
P_100           all 0.1113
P_1000          all 0.0229
recall_10       all 0.2384
recall_100      all 0.5039
recall_1000     all 0.7373
ndcg            all 0.4443
ndcg_cut_10     all 0.3254
ndcg_cut_100    all 0.3765
ndcg_cut_1000   all 0.4443

coe22-bm25-t-mt-zho¶

summary (trec_eval)

map             all 0.2605
bpref           all 0.2640
recip_rank      all 0.5767
P_10            all 0.3204
P_100           all 0.1376
P_1000          all 0.0301
recall_10       all 0.2052
recall_100      all 0.5000
recall_1000     all 0.7805
ndcg            all 0.4899
ndcg_cut_10     all 0.3292
ndcg_cut_100    all 0.4000
ndcg_cut_1000   all 0.4899

fa_qtr¶

summary (trec_eval)

map             all 0.2358
bpref           all 0.2229
recip_rank      all 0.4584
P_10            all 0.2826
P_100           all 0.1204
P_1000          all 0.0250
recall_10       all 0.2200
recall_100      all 0.5209
recall_1000     all 0.8092
ndcg            all 0.4563
ndcg_cut_10     all 0.3204
ndcg_cut_100    all 0.3784
ndcg_cut_1000   all 0.4563

fa_dt¶

summary (trec_eval)

map             all 0.1162
bpref           all 0.1152
recip_rank      all 0.2733
P_10            all 0.1152
P_100           all 0.0459
P_1000          all 0.0107
recall_10       all 0.1243
recall_100      all 0.3322
recall_1000     all 0.4971
ndcg            all 0.2573
ndcg_cut_10     all 0.1391
ndcg_cut_100    all 0.2102
ndcg_cut_1000   all 0.2573

fa_dtr¶

summary (trec_eval)

map             all 0.1215
bpref           all 0.1063
recip_rank      all 0.2410
P_10            all 0.1283
P_100           all 0.0433
P_1000          all 0.0088
recall_10       all 0.1352
recall_100      all 0.3280
recall_1000     all 0.4846
ndcg            all 0.2442
ndcg_cut_10     all 0.1459
ndcg_cut_100    all 0.2028
ndcg_cut_1000   all 0.2442

fa_3rrf¶

summary (trec_eval)

map             all 0.2079
bpref           all 0.2004
recip_rank      all 0.4859
P_10            all 0.2478
P_100           all 0.0943
P_1000          all 0.0208
recall_10       all 0.1966
recall_100      all 0.4723
recall_1000     all 0.7173
ndcg            all 0.4251
ndcg_cut_10     all 0.2992
ndcg_cut_100    all 0.3529
ndcg_cut_1000   all 0.4251

fa_3rrfprf¶

summary (trec_eval)

map             all 0.2145
bpref           all 0.1944
recip_rank      all 0.4480
P_10            all 0.2717
P_100           all 0.1098
P_1000          all 0.0237
recall_10       all 0.2291
recall_100      all 0.4937
recall_1000     all 0.7820
ndcg            all 0.4421
ndcg_cut_10     all 0.3079
ndcg_cut_100    all 0.3628
ndcg_cut_1000   all 0.4421

fa_3rrf2¶

summary (trec_eval)

map             all 0.2194
bpref           all 0.1931
recip_rank      all 0.4553
P_10            all 0.2652
P_100           all 0.1030
P_1000          all 0.0233
recall_10       all 0.2334
recall_100      all 0.4946
recall_1000     all 0.7669
ndcg            all 0.4427
ndcg_cut_10     all 0.3157
ndcg_cut_100    all 0.3668
ndcg_cut_1000   all 0.4427

RietRandomRun¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.0270
bpref           all 0.0471
recip_rank      all 0.0876
P_10            all 0.0391
P_100           all 0.0307
P_1000          all 0.0239
recall_10       all 0.0066
recall_100      all 0.0587
recall_1000     all 0.8292
ndcg            all 0.2363
ndcg_cut_10     all 0.0262
ndcg_cut_100    all 0.0440
ndcg_cut_1000   all 0.2363

RietRandomRun2¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.0322
bpref           all 0.0531
recip_rank      all 0.0938
P_10            all 0.0388
P_100           all 0.0408
P_1000          all 0.0321
recall_10       all 0.0054
recall_100      all 0.0740
recall_1000     all 0.7814
ndcg            all 0.2574
ndcg_cut_10     all 0.0170
ndcg_cut_100    all 0.0481
ndcg_cut_1000   all 0.2574

RietRandomRun3¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.0383
bpref           all 0.0492
recip_rank      all 0.1342
P_10            all 0.0622
P_100           all 0.0433
P_1000          all 0.0340
recall_10       all 0.0102
recall_100      all 0.0935
recall_1000     all 0.7744
ndcg            all 0.2825
ndcg_cut_10     all 0.0387
ndcg_cut_100    all 0.0579
ndcg_cut_1000   all 0.2825

KASYS_onemodel-rerank-rus¶

summary (trec_eval)

map             all 0.3205
bpref           all 0.3288
recip_rank      all 0.7481
P_10            all 0.4333
P_100           all 0.1696
P_1000          all 0.0340
recall_10       all 0.2337
recall_100      all 0.4904
recall_1000     all 0.7744
ndcg            all 0.5794
ndcg_cut_10     all 0.4585
ndcg_cut_100    all 0.4800
ndcg_cut_1000   all 0.5794

KASYS_one_model-rus¶

summary (trec_eval)

map             all 0.2256
bpref           all 0.2353
recip_rank      all 0.6691
P_10            all 0.3444
P_100           all 0.1296
P_1000          all 0.0230
recall_10       all 0.1982
recall_100      all 0.4029
recall_1000     all 0.6014
ndcg            all 0.4603
ndcg_cut_10     all 0.3731
ndcg_cut_100    all 0.3912
ndcg_cut_1000   all 0.4603

jhumc.fa5.td.rf¶

summary (trec_eval)

map             all 0.2154
bpref           all 0.1972
recip_rank      all 0.4534
P_10            all 0.2587
P_100           all 0.0965
P_1000          all 0.0216
recall_10       all 0.2291
recall_100      all 0.4679
recall_1000     all 0.7743
ndcg            all 0.4346
ndcg_cut_10     all 0.2975
ndcg_cut_100    all 0.3538
ndcg_cut_1000   all 0.4346

jhumc.ru5.td.rf¶

summary (trec_eval)

map             all 0.1989
bpref           all 0.1933
recip_rank      all 0.4360
P_10            all 0.2800
P_100           all 0.1311
P_1000          all 0.0288
recall_10       all 0.1491
recall_100      all 0.4105
recall_1000     all 0.7043
ndcg            all 0.4256
ndcg_cut_10     all 0.2523
ndcg_cut_100    all 0.3128
ndcg_cut_1000   all 0.4256

jhumc.zh5.td.rf¶

summary (trec_eval)

map             all 0.2746
bpref           all 0.2613
recip_rank      all 0.5946
P_10            all 0.3265
P_100           all 0.1408
P_1000          all 0.0321
recall_10       all 0.1947
recall_100      all 0.4841
recall_1000     all 0.7792
ndcg            all 0.5032
ndcg_cut_10     all 0.3320
ndcg_cut_100    all 0.4034
ndcg_cut_1000   all 0.5032

jhumc.ru5.td.ce.rf¶

summary (trec_eval)

map             all 0.2253
bpref           all 0.2386
recip_rank      all 0.6437
P_10            all 0.2911
P_100           all 0.1160
P_1000          all 0.0212
recall_10       all 0.1904
recall_100      all 0.3890
recall_1000     all 0.5646
ndcg            all 0.4311
ndcg_cut_10     all 0.3428
ndcg_cut_100    all 0.3620
ndcg_cut_1000   all 0.4311

jhumc.zh5.td.ce.rf¶

summary (trec_eval)

map             all 0.2581
bpref           all 0.2662
recip_rank      all 0.5994
P_10            all 0.3367
P_100           all 0.1363
P_1000          all 0.0274
recall_10       all 0.1919
recall_100      all 0.4427
recall_1000     all 0.6261
ndcg            all 0.4403
ndcg_cut_10     all 0.3236
ndcg_cut_100    all 0.3786
ndcg_cut_1000   all 0.4403

p1.fa.hoc¶

summary (trec_eval)

map             all 0.3971
bpref           all 0.3784
recip_rank      all 0.6891
P_10            all 0.4239
P_100           all 0.1426
P_1000          all 0.0223
recall_10       all 0.3541
recall_100      all 0.6659
recall_1000     all 0.8069
ndcg            all 0.5950
ndcg_cut_10     all 0.5184
ndcg_cut_100    all 0.5614
ndcg_cut_1000   all 0.5950

jhumc.fa4.td.rf¶

summary (trec_eval)

map             all 0.2291
bpref           all 0.2158
recip_rank      all 0.4928
P_10            all 0.3196
P_100           all 0.1096
P_1000          all 0.0239
recall_10       all 0.2256
recall_100      all 0.5235
recall_1000     all 0.8016
ndcg            all 0.4683
ndcg_cut_10     all 0.3439
ndcg_cut_100    all 0.3871
ndcg_cut_1000   all 0.4683

jhumc.ru4.td.rf¶

summary (trec_eval)

map             all 0.1983
bpref           all 0.2074
recip_rank      all 0.4637
P_10            all 0.2978
P_100           all 0.1262
P_1000          all 0.0258
recall_10       all 0.1640
recall_100      all 0.3982
recall_1000     all 0.6492
ndcg            all 0.4143
ndcg_cut_10     all 0.2666
ndcg_cut_100    all 0.3207
ndcg_cut_1000   all 0.4143

jhumc.zh4.td.rf¶

summary (trec_eval)

map             all 0.2558
bpref           all 0.2485
recip_rank      all 0.5115
P_10            all 0.3122
P_100           all 0.1333
P_1000          all 0.0284
recall_10       all 0.1906
recall_100      all 0.4747
recall_1000     all 0.7261
ndcg            all 0.4664
ndcg_cut_10     all 0.3048
ndcg_cut_100    all 0.3792
ndcg_cut_1000   all 0.4664

p1.ru.hoc¶

summary (trec_eval)

map             all 0.4167
bpref           all 0.4113
recip_rank      all 0.8237
P_10            all 0.5578
P_100           all 0.2222
P_1000          all 0.0303
recall_10       all 0.2980
recall_100      all 0.6486
recall_1000     all 0.7642
ndcg            all 0.6365
ndcg_cut_10     all 0.5701
ndcg_cut_100    all 0.5997
ndcg_cut_1000   all 0.6365

jhumc.fawords.td.rf¶

summary (trec_eval)

map             all 0.2077
bpref           all 0.1818
recip_rank      all 0.4586
P_10            all 0.2435
P_100           all 0.1013
P_1000          all 0.0233
recall_10       all 0.2317
recall_100      all 0.4857
recall_1000     all 0.7995
ndcg            all 0.4311
ndcg_cut_10     all 0.2972
ndcg_cut_100    all 0.3444
ndcg_cut_1000   all 0.4311

jhumc.ruwords.td.rf¶

summary (trec_eval)

map             all 0.2016
bpref           all 0.2088
recip_rank      all 0.4626
P_10            all 0.3089
P_100           all 0.1424
P_1000          all 0.0265
recall_10       all 0.1262
recall_100      all 0.4346
recall_1000     all 0.6571
ndcg            all 0.4202
ndcg_cut_10     all 0.2796
ndcg_cut_100    all 0.3352
ndcg_cut_1000   all 0.4202

jhumc.zhwords.td.rf¶

summary (trec_eval)

map             all 0.2423
bpref           all 0.2318
recip_rank      all 0.5719
P_10            all 0.3224
P_100           all 0.1376
P_1000          all 0.0296
recall_10       all 0.1834
recall_100      all 0.4738
recall_1000     all 0.7520
ndcg            all 0.4770
ndcg_cut_10     all 0.3138
ndcg_cut_100    all 0.3850
ndcg_cut_1000   all 0.4770

p1.zh.hoc¶

summary (trec_eval)

map             all 0.2177
bpref           all 0.2220
recip_rank      all 0.6887
P_10            all 0.3796
P_100           all 0.1100
P_1000          all 0.0136
recall_10       all 0.2099
recall_100      all 0.3695
recall_1000     all 0.4539
ndcg            all 0.3889
ndcg_cut_10     all 0.3921
ndcg_cut_100    all 0.3742
ndcg_cut_1000   all 0.3889

p2.fa.rerank¶

summary (trec_eval)

map             all 0.4350
bpref           all 0.4166
recip_rank      all 0.7237
P_10            all 0.4522
P_100           all 0.1476
P_1000          all 0.0239
recall_10       all 0.3829
recall_100      all 0.6813
recall_1000     all 0.8292
ndcg            all 0.6387
ndcg_cut_10     all 0.5700
ndcg_cut_100    all 0.6024
ndcg_cut_1000   all 0.6387

p2.ru.rerank¶

summary (trec_eval)

map             all 0.4216
bpref           all 0.4228
recip_rank      all 0.8265
P_10            all 0.5444
P_100           all 0.2222
P_1000          all 0.0340
recall_10       all 0.2923
recall_100      all 0.6139
recall_1000     all 0.7744
ndcg            all 0.6400
ndcg_cut_10     all 0.5582
ndcg_cut_100    all 0.5854
ndcg_cut_1000   all 0.6400

p2.zh.rerank¶

summary (trec_eval)

map             all 0.4039
bpref           all 0.3949
recip_rank      all 0.7983
P_10            all 0.5184
P_100           all 0.2010
P_1000          all 0.0321
recall_10       all 0.2816
recall_100      all 0.5912
recall_1000     all 0.7814
ndcg            all 0.6103
ndcg_cut_10     all 0.5146
ndcg_cut_100    all 0.5616
ndcg_cut_1000   all 0.6103

p3.fa.mono¶

summary (trec_eval)

map             all 0.4215
bpref           all 0.3979
recip_rank      all 0.7297
P_10            all 0.4348
P_100           all 0.1587
P_1000          all 0.0244
recall_10       all 0.3518
recall_100      all 0.7057
recall_1000     all 0.8329
ndcg            all 0.6308
ndcg_cut_10     all 0.5400
ndcg_cut_100    all 0.6015
ndcg_cut_1000   all 0.6308

p3.ru.mono¶

summary (trec_eval)

map             all 0.4387
bpref           all 0.4388
recip_rank      all 0.8540
P_10            all 0.5667
P_100           all 0.2351
P_1000          all 0.0318
recall_10       all 0.2974
recall_100      all 0.6530
recall_1000     all 0.7612
ndcg            all 0.6513
ndcg_cut_10     all 0.5768
ndcg_cut_100    all 0.6159
ndcg_cut_1000   all 0.6513

umcp_hmm_zh¶

summary (trec_eval)

map             all 0.1471
bpref           all 0.1547
recip_rank      all 0.4116
P_10            all 0.2122
P_100           all 0.0902
P_1000          all 0.0219
recall_10       all 0.1211
recall_100      all 0.3429
recall_1000     all 0.6323
ndcg            all 0.3572
ndcg_cut_10     all 0.2069
ndcg_cut_100    all 0.2623
ndcg_cut_1000   all 0.3572

p3.zh.mono¶

summary (trec_eval)

map             all 0.3837
bpref           all 0.3839
recip_rank      all 0.8123
P_10            all 0.4857
P_100           all 0.1692
P_1000          all 0.0244
recall_10       all 0.2784
recall_100      all 0.5844
recall_1000     all 0.7022
ndcg            all 0.5689
ndcg_cut_10     all 0.4932
ndcg_cut_100    all 0.5416
ndcg_cut_1000   all 0.5689

umcp_hmm_fa¶

summary (trec_eval)

map             all 0.1206
bpref           all 0.0920
recip_rank      all 0.3953
P_10            all 0.1500
P_100           all 0.0700
P_1000          all 0.0150
recall_10       all 0.1329
recall_100      all 0.4172
recall_1000     all 0.6498
ndcg            all 0.3247
ndcg_cut_10     all 0.1880
ndcg_cut_100    all 0.2621
ndcg_cut_1000   all 0.3247

umcp_hmm_ru¶

summary (trec_eval)

map             all 0.1809
bpref           all 0.1872
recip_rank      all 0.4582
P_10            all 0.2600
P_100           all 0.1158
P_1000          all 0.0269
recall_10       all 0.1436
recall_100      all 0.3482
recall_1000     all 0.5966
ndcg            all 0.3889
ndcg_cut_10     all 0.2571
ndcg_cut_100    all 0.2906
ndcg_cut_1000   all 0.3889

fa_xdpr.xorHn-mm.EN.d.R¶

summary (trec_eval)

map             all 0.0868
bpref           all 0.0914
recip_rank      all 0.2853
P_10            all 0.1196
P_100           all 0.0630
P_1000          all 0.0135
recall_10       all 0.0777
recall_100      all 0.2837
recall_1000     all 0.5443
ndcg            all 0.2475
ndcg_cut_10     all 0.1163
ndcg_cut_100    all 0.1800
ndcg_cut_1000   all 0.2475

zh_xdpr.xorHn-mm.EN.d.R¶

summary (trec_eval)

map             all 0.0855
bpref           all 0.1054
recip_rank      all 0.2381
P_10            all 0.1388
P_100           all 0.0606
P_1000          all 0.0159
recall_10       all 0.0537
recall_100      all 0.1932
recall_1000     all 0.3538
ndcg            all 0.2059
ndcg_cut_10     all 0.1132
ndcg_cut_100    all 0.1523
ndcg_cut_1000   all 0.2059

ru_xdpr.xorHn-mm.EN.d.R¶

summary (trec_eval)

map             all 0.1104
bpref           all 0.1161
recip_rank      all 0.4181
P_10            all 0.1800
P_100           all 0.0633
P_1000          all 0.0135
recall_10       all 0.0990
recall_100      all 0.2323
recall_1000     all 0.4705
ndcg            all 0.2912
ndcg_cut_10     all 0.2032
ndcg_cut_100    all 0.2186
ndcg_cut_1000   all 0.2912

fa_xdpr.mm.2rrf-mtQ.all.R¶

summary (trec_eval)

map             all 0.2033
bpref           all 0.1928
recip_rank      all 0.5183
P_10            all 0.2696
P_100           all 0.1093
P_1000          all 0.0193
recall_10       all 0.1787
recall_100      all 0.4646
recall_1000     all 0.6933
ndcg            all 0.4075
ndcg_cut_10     all 0.2990
ndcg_cut_100    all 0.3469
ndcg_cut_1000   all 0.4075

zh_xdpr.mm.4rrf-mtQ.all.R¶

summary (trec_eval)

map             all 0.2180
bpref           all 0.2354
recip_rank      all 0.5342
P_10            all 0.3673
P_100           all 0.1461
P_1000          all 0.0317
recall_10       all 0.1380
recall_100      all 0.3871
recall_1000     all 0.6582
ndcg            all 0.4278
ndcg_cut_10     all 0.3159
ndcg_cut_100    all 0.3438
ndcg_cut_1000   all 0.4278

ru_xdpr.mm.2rrf-mtQ.all.R¶

summary (trec_eval)

map             all 0.2755
bpref           all 0.2720
recip_rank      all 0.6763
P_10            all 0.3778
P_100           all 0.1642
P_1000          all 0.0302
recall_10       all 0.1955
recall_100      all 0.4520
recall_1000     all 0.6913
ndcg            all 0.5172
ndcg_cut_10     all 0.4112
ndcg_cut_100    all 0.4324
ndcg_cut_1000   all 0.5172

fa_dense-rrf.prf¶

summary (trec_eval)

map             all 0.2050
bpref           all 0.1891
recip_rank      all 0.4732
P_10            all 0.2870
P_100           all 0.1120
P_1000          all 0.0198
recall_10       all 0.1986
recall_100      all 0.4906
recall_1000     all 0.7354
ndcg            all 0.4136
ndcg_cut_10     all 0.2943
ndcg_cut_100    all 0.3512
ndcg_cut_1000   all 0.4136

zh_dense-rrf.prf¶

summary (trec_eval)

map             all 0.2348
bpref           all 0.2476
recip_rank      all 0.5545
P_10            all 0.3551
P_100           all 0.1500
P_1000          all 0.0309
recall_10       all 0.1580
recall_100      all 0.3979
recall_1000     all 0.6355
ndcg            all 0.4398
ndcg_cut_10     all 0.3235
ndcg_cut_100    all 0.3645
ndcg_cut_1000   all 0.4398

ru_dense-rrf.prf¶

summary (trec_eval)

map             all 0.2586
bpref           all 0.2573
recip_rank      all 0.6941
P_10            all 0.3778
P_100           all 0.1573
P_1000          all 0.0293
recall_10       all 0.1923
recall_100      all 0.4243
recall_1000     all 0.6958
ndcg            all 0.5115
ndcg_cut_10     all 0.4101
ndcg_cut_100    all 0.4187
ndcg_cut_1000   all 0.5115

fa_dense-rrf.BM25.SPLADE¶

summary (trec_eval)

map             all 0.3269
bpref           all 0.2788
recip_rank      all 0.5997
P_10            all 0.3609
P_100           all 0.1454
P_1000          all 0.0282
recall_10       all 0.2854
recall_100      all 0.6846
recall_1000     all 0.9172
ndcg            all 0.5754
ndcg_cut_10     all 0.4295
ndcg_cut_100    all 0.5065
ndcg_cut_1000   all 0.5754

zh_dense-rrf.BM25¶

summary (trec_eval)

map             all 0.2097
bpref           all 0.2010
recip_rank      all 0.5504
P_10            all 0.2816
P_100           all 0.1388
P_1000          all 0.0313
recall_10       all 0.1428
recall_100      all 0.4420
recall_1000     all 0.7063
ndcg            all 0.4552
ndcg_cut_10     all 0.2805
ndcg_cut_100    all 0.3657
ndcg_cut_1000   all 0.4552

ru_dense-rrf.BM25.SPLADE¶

summary (trec_eval)

map             all 0.3855
bpref           all 0.3622
recip_rank      all 0.8081
P_10            all 0.4711
P_100           all 0.2127
P_1000          all 0.0382
recall_10       all 0.2419
recall_100      all 0.6022
recall_1000     all 0.8943
ndcg            all 0.6571
ndcg_cut_10     all 0.5050
ndcg_cut_100    all 0.5550
ndcg_cut_1000   all 0.6571

fa_xdpr.ms.oht.d.R¶

summary (trec_eval)

map             all 0.1922
bpref           all 0.1845
recip_rank      all 0.4465
P_10            all 0.2783
P_100           all 0.1022
P_1000          all 0.0187
recall_10       all 0.2001
recall_100      all 0.4312
recall_1000     all 0.6612
ndcg            all 0.3841
ndcg_cut_10     all 0.2898
ndcg_cut_100    all 0.3235
ndcg_cut_1000   all 0.3841

zh_xdpr.ms.oht.d.R¶

summary (trec_eval)

map             all 0.2361
bpref           all 0.2567
recip_rank      all 0.5728
P_10            all 0.3755
P_100           all 0.1439
P_1000          all 0.0297
recall_10       all 0.1677
recall_100      all 0.3639
recall_1000     all 0.5939
ndcg            all 0.4329
ndcg_cut_10     all 0.3521
ndcg_cut_100    all 0.3599
ndcg_cut_1000   all 0.4329

ru_xdpr.ms.oht.d.R¶

summary (trec_eval)

map             all 0.2368
bpref           all 0.2427
recip_rank      all 0.5913
P_10            all 0.3133
P_100           all 0.1460
P_1000          all 0.0263
recall_10       all 0.1668
recall_100      all 0.3903
recall_1000     all 0.5915
ndcg            all 0.4497
ndcg_cut_10     all 0.3556
ndcg_cut_100    all 0.3790
ndcg_cut_1000   all 0.4497

p4.fa.hoc¶

summary (trec_eval)

map             all 0.4042
bpref           all 0.3942
recip_rank      all 0.7077
P_10            all 0.4370
P_100           all 0.1450
P_1000          all 0.0237
recall_10       all 0.3790
recall_100      all 0.6326
recall_1000     all 0.7820
ndcg            all 0.5997
ndcg_cut_10     all 0.5421
ndcg_cut_100    all 0.5634
ndcg_cut_1000   all 0.5997

p4.ru.hoc¶

summary (trec_eval)

map             all 0.4340
bpref           all 0.4312
recip_rank      all 0.8513
P_10            all 0.5711
P_100           all 0.2320
P_1000          all 0.0348
recall_10       all 0.3096
recall_100      all 0.6432
recall_1000     all 0.8036
ndcg            all 0.6594
ndcg_cut_10     all 0.5838
ndcg_cut_100    all 0.6046
ndcg_cut_1000   all 0.6594

KASYS_one_model-zho¶

summary (trec_eval)

map             all 0.2217
bpref           all 0.2470
recip_rank      all 0.6243
P_10            all 0.3531
P_100           all 0.1365
P_1000          all 0.0274
recall_10       all 0.1520
recall_100      all 0.3668
recall_1000     all 0.5628
ndcg            all 0.4372
ndcg_cut_10     all 0.3620
ndcg_cut_100    all 0.3732
ndcg_cut_1000   all 0.4372

F4-PyTerrierPL2¶

summary (trec_eval)

map             all 0.1109
bpref           all 0.1007
recip_rank      all 0.2653
P_10            all 0.1739
P_100           all 0.0639
P_1000          all 0.0155
recall_10       all 0.1358
recall_100      all 0.3303
recall_1000     all 0.5766
ndcg            all 0.2886
ndcg_cut_10     all 0.1817
ndcg_cut_100    all 0.2217
ndcg_cut_1000   all 0.2886

KASYS_onemodel-rerank-zho¶

summary (trec_eval)

map             all 0.2864
bpref           all 0.2945
recip_rank      all 0.6574
P_10            all 0.4061
P_100           all 0.1592
P_1000          all 0.0321
recall_10       all 0.1957
recall_100      all 0.4764
recall_1000     all 0.7814
ndcg            all 0.5244
ndcg_cut_10     all 0.3971
ndcg_cut_100    all 0.4361
ndcg_cut_1000   all 0.5244

huaweimtl-fa-m-hybrid1¶

summary (trec_eval)

map             all 0.3662
bpref           all 0.3419
recip_rank      all 0.6985
P_10            all 0.3630
P_100           all 0.1459
P_1000          all 0.0280
recall_10       all 0.2898
recall_100      all 0.6676
recall_1000     all 0.8971
ndcg            all 0.6034
ndcg_cut_10     all 0.4689
ndcg_cut_100    all 0.5358
ndcg_cut_1000   all 0.6034

huaweimtl-fa-c-hybrid2¶

summary (trec_eval)

map             all 0.2796
bpref           all 0.2380
recip_rank      all 0.6228
P_10            all 0.3152
P_100           all 0.1111
P_1000          all 0.0241
recall_10       all 0.2739
recall_100      all 0.5784
recall_1000     all 0.8448
ndcg            all 0.5299
ndcg_cut_10     all 0.4011
ndcg_cut_100    all 0.4523
ndcg_cut_1000   all 0.5299

huaweimtl-fa-c-hybrid3¶

summary (trec_eval)

map             all 0.2857
bpref           all 0.2497
recip_rank      all 0.6175
P_10            all 0.2913
P_100           all 0.1113
P_1000          all 0.0241
recall_10       all 0.2640
recall_100      all 0.5753
recall_1000     all 0.8451
ndcg            all 0.5328
ndcg_cut_10     all 0.3932
ndcg_cut_100    all 0.4536
ndcg_cut_1000   all 0.5328

huaweimtl-zh-m-hybrid1¶

summary (trec_eval)

map             all 0.2551
bpref           all 0.2541
recip_rank      all 0.6503
P_10            all 0.3714
P_100           all 0.1500
P_1000          all 0.0305
recall_10       all 0.1885
recall_100      all 0.4977
recall_1000     all 0.7556
ndcg            all 0.5134
ndcg_cut_10     all 0.3868
ndcg_cut_100    all 0.4341
ndcg_cut_1000   all 0.5134

huaweimtl-zh-c-hybrid2¶

summary (trec_eval)

map             all 0.2130
bpref           all 0.2117
recip_rank      all 0.6758
P_10            all 0.3286
P_100           all 0.1294
P_1000          all 0.0288
recall_10       all 0.1688
recall_100      all 0.4442
recall_1000     all 0.7029
ndcg            all 0.4801
ndcg_cut_10     all 0.3561
ndcg_cut_100    all 0.3962
ndcg_cut_1000   all 0.4801

huaweimtl-zh-c-hybrid3¶

summary (trec_eval)

map             all 0.2328
bpref           all 0.2391
recip_rank      all 0.6564
P_10            all 0.3429
P_100           all 0.1402
P_1000          all 0.0286
recall_10       all 0.1725
recall_100      all 0.4641
recall_1000     all 0.7061
ndcg            all 0.4914
ndcg_cut_10     all 0.3699
ndcg_cut_100    all 0.4129
ndcg_cut_1000   all 0.4914

huaweimtl-ru-m-hybrid1¶

summary (trec_eval)

map             all 0.3790
bpref           all 0.3716
recip_rank      all 0.7886
P_10            all 0.4756
P_100           all 0.2038
P_1000          all 0.0374
recall_10       all 0.2611
recall_100      all 0.5907
recall_1000     all 0.8808
ndcg            all 0.6530
ndcg_cut_10     all 0.5059
ndcg_cut_100    all 0.5505
ndcg_cut_1000   all 0.6530

huaweimtl-ru-c-hybrid2¶

summary (trec_eval)

map             all 0.3775
bpref           all 0.3698
recip_rank      all 0.8224
P_10            all 0.4733
P_100           all 0.1991
P_1000          all 0.0374
recall_10       all 0.2657
recall_100      all 0.5781
recall_1000     all 0.8791
ndcg            all 0.6547
ndcg_cut_10     all 0.5078
ndcg_cut_100    all 0.5486
ndcg_cut_1000   all 0.6547

huaweimtl-ru-c-hybrid3¶

summary (trec_eval)

map             all 0.3659
bpref           all 0.3477
recip_rank      all 0.8225
P_10            all 0.4667
P_100           all 0.2036
P_1000          all 0.0374
recall_10       all 0.2425
recall_100      all 0.5894
recall_1000     all 0.8772
ndcg            all 0.6462
ndcg_cut_10     all 0.4980
ndcg_cut_100    all 0.5435
ndcg_cut_1000   all 0.6462

F4-PyTerrierPL2-ru¶

summary (trec_eval)

map             all 0.2135
bpref           all 0.2311
recip_rank      all 0.5391
P_10            all 0.2711
P_100           all 0.1178
P_1000          all 0.0274
recall_10       all 0.1593
recall_100      all 0.3794
recall_1000     all 0.6641
ndcg            all 0.4394
ndcg_cut_10     all 0.2911
ndcg_cut_100    all 0.3382
ndcg_cut_1000   all 0.4394

F4-PyTerrierPL2-zh¶

summary (trec_eval)

map             all 0.1852
bpref           all 0.1931
recip_rank      all 0.5123
P_10            all 0.2673
P_100           all 0.0980
P_1000          all 0.0232
recall_10       all 0.1667
recall_100      all 0.3681
recall_1000     all 0.6258
ndcg            all 0.3986
ndcg_cut_10     all 0.2786
ndcg_cut_100    all 0.3174
ndcg_cut_1000   all 0.3986

jhumc.fa5.td.ce.rf¶

summary (trec_eval)

map             all 0.2089
bpref           all 0.1987
recip_rank      all 0.4970
P_10            all 0.2870
P_100           all 0.1020
P_1000          all 0.0198
recall_10       all 0.1978
recall_100      all 0.3814
recall_1000     all 0.6024
ndcg            all 0.3939
ndcg_cut_10     all 0.3186
ndcg_cut_100    all 0.3387
ndcg_cut_1000   all 0.3939