Results - Common Core 2018¶

feup-run1¶

summary (trec_eval)

map             all 0.0070
bpref           all 0.0126
recip_rank      all 0.1897
P_10            all 0.0680
P_100           all 0.0086
P_1000          all 0.0009
recall_10       all 0.0115
recall_100      all 0.0135
recall_1000     all 0.0135
ndcg            all 0.0267
ndcg_cut_10     all 0.0572
ndcg_cut_100    all 0.0285
ndcg_cut_1000   all 0.0267

feup-run2¶

summary (trec_eval)

map             all 0.0051
bpref           all 0.0254
recip_rank      all 0.0903
P_10            all 0.0240
P_100           all 0.0116
P_1000          all 0.0046
recall_10       all 0.0024
recall_100      all 0.0176
recall_1000     all 0.0753
ndcg            all 0.0419
ndcg_cut_10     all 0.0227
ndcg_cut_100    all 0.0192
ndcg_cut_1000   all 0.0419

uwmrg¶

summary (trec_eval)

map             all 0.2761
bpref           all 0.3358
recip_rank      all 0.7614
P_10            all 0.5000
P_100           all 0.2328
P_1000          all 0.0538
recall_10       all 0.1001
recall_100      all 0.4056
recall_1000     all 0.7961
ndcg            all 0.5822
ndcg_cut_10     all 0.4463
ndcg_cut_100    all 0.4190
ndcg_cut_1000   all 0.5822

uwmrgx¶

summary (trec_eval)

map             all 0.2362
bpref           all 0.3011
recip_rank      all 0.6250
P_10            all 0.4360
P_100           all 0.2078
P_1000          all 0.0486
recall_10       all 0.0898
recall_100      all 0.3821
recall_1000     all 0.7452
ndcg            all 0.5306
ndcg_cut_10     all 0.3855
ndcg_cut_100    all 0.3738
ndcg_cut_1000   all 0.5306

feup-run3¶

summary (trec_eval)

map             all 0.0069
bpref           all 0.0126
recip_rank      all 0.1897
P_10            all 0.0660
P_100           all 0.0086
P_1000          all 0.0009
recall_10       all 0.0115
recall_100      all 0.0135
recall_1000     all 0.0135
ndcg            all 0.0266
ndcg_cut_10     all 0.0563
ndcg_cut_100    all 0.0284
ndcg_cut_1000   all 0.0266

feup-run5¶

summary (trec_eval)

map             all 0.0068
bpref           all 0.0126
recip_rank      all 0.1897
P_10            all 0.0580
P_100           all 0.0086
P_1000          all 0.0009
recall_10       all 0.0103
recall_100      all 0.0135
recall_1000     all 0.0135
ndcg            all 0.0263
ndcg_cut_10     all 0.0515
ndcg_cut_100    all 0.0280
ndcg_cut_1000   all 0.0263

anserini_ax¶

summary (trec_eval)

map             all 0.2734
bpref           all 0.3222
recip_rank      all 0.6584
P_10            all 0.4960
P_100           all 0.2468
P_1000          all 0.0562
recall_10       all 0.0963
recall_100      all 0.4249
recall_1000     all 0.7567
ndcg            all 0.5582
ndcg_cut_10     all 0.4329
ndcg_cut_100    all 0.4177
ndcg_cut_1000   all 0.5582

anserini_ax17¶

summary (trec_eval)

map             all 0.2059
bpref           all 0.2770
recip_rank      all 0.5742
P_10            all 0.4060
P_100           all 0.2046
P_1000          all 0.0517
recall_10       all 0.0788
recall_100      all 0.3739
recall_1000     all 0.7107
ndcg            all 0.4942
ndcg_cut_10     all 0.3541
ndcg_cut_100    all 0.3469
ndcg_cut_1000   all 0.4942

anserini_sdm¶

summary (trec_eval)

map             all 0.2364
bpref           all 0.2978
recip_rank      all 0.7348
P_10            all 0.4860
P_100           all 0.2036
P_1000          all 0.0476
recall_10       all 0.1092
recall_100      all 0.3771
recall_1000     all 0.6717
ndcg            all 0.5127
ndcg_cut_10     all 0.4405
ndcg_cut_100    all 0.3838
ndcg_cut_1000   all 0.5127

anserini_rm3¶

summary (trec_eval)

map             all 0.2680
bpref           all 0.3121
recip_rank      all 0.6502
P_10            all 0.4680
P_100           all 0.2366
P_1000          all 0.0511
recall_10       all 0.0963
recall_100      all 0.4135
recall_1000     all 0.7174
ndcg            all 0.5422
ndcg_cut_10     all 0.4328
ndcg_cut_100    all 0.4113
ndcg_cut_1000   all 0.5422

anserini_bm25¶

summary (trec_eval)

map             all 0.2284
bpref           all 0.2941
recip_rank      all 0.7145
P_10            all 0.4500
P_100           all 0.2014
P_1000          all 0.0472
recall_10       all 0.1050
recall_100      all 0.3828
recall_1000     all 0.6678
ndcg            all 0.5064
ndcg_cut_10     all 0.4096
ndcg_cut_100    all 0.3794
ndcg_cut_1000   all 0.5064

anserini_qlax¶

summary (trec_eval)

map             all 0.2749
bpref           all 0.3139
recip_rank      all 0.6430
P_10            all 0.4780
P_100           all 0.2476
P_1000          all 0.0551
recall_10       all 0.0970
recall_100      all 0.4141
recall_1000     all 0.7413
ndcg            all 0.5484
ndcg_cut_10     all 0.4281
ndcg_cut_100    all 0.4125
ndcg_cut_1000   all 0.5484

anserini_qlax17¶

summary (trec_eval)

map             all 0.2039
bpref           all 0.2716
recip_rank      all 0.5678
P_10            all 0.4280
P_100           all 0.2008
P_1000          all 0.0504
recall_10       all 0.0837
recall_100      all 0.3421
recall_1000     all 0.6933
ndcg            all 0.4875
ndcg_cut_10     all 0.3629
ndcg_cut_100    all 0.3375
ndcg_cut_1000   all 0.4875

anserini_qlsdm¶

summary (trec_eval)

map             all 0.2326
bpref           all 0.2928
recip_rank      all 0.7138
P_10            all 0.4740
P_100           all 0.2026
P_1000          all 0.0473
recall_10       all 0.1087
recall_100      all 0.3733
recall_1000     all 0.6644
ndcg            all 0.5071
ndcg_cut_10     all 0.4334
ndcg_cut_100    all 0.3788
ndcg_cut_1000   all 0.5071

anserini_qlrm3¶

summary (trec_eval)

map             all 0.2501
bpref           all 0.3014
recip_rank      all 0.6231
P_10            all 0.4660
P_100           all 0.2234
P_1000          all 0.0537
recall_10       all 0.0969
recall_100      all 0.3965
recall_1000     all 0.7271
ndcg            all 0.5359
ndcg_cut_10     all 0.4168
ndcg_cut_100    all 0.3907
ndcg_cut_1000   all 0.5359

anserini_ql¶

summary (trec_eval)

map             all 0.2294
bpref           all 0.2918
recip_rank      all 0.6931
P_10            all 0.4660
P_100           all 0.2030
P_1000          all 0.0473
recall_10       all 0.1070
recall_100      all 0.3741
recall_1000     all 0.6639
ndcg            all 0.5059
ndcg_cut_10     all 0.4236
ndcg_cut_100    all 0.3786
ndcg_cut_1000   all 0.5059

feup-run7¶

summary (trec_eval)

map             all 0.0070
bpref           all 0.0126
recip_rank      all 0.1897
P_10            all 0.0680
P_100           all 0.0086
P_1000          all 0.0009
recall_10       all 0.0115
recall_100      all 0.0135
recall_1000     all 0.0135
ndcg            all 0.0267
ndcg_cut_10     all 0.0572
ndcg_cut_100    all 0.0285
ndcg_cut_1000   all 0.0267

feup-run8¶

summary (trec_eval)

map             all 0.0069
bpref           all 0.0126
recip_rank      all 0.1897
P_10            all 0.0640
P_100           all 0.0086
P_1000          all 0.0009
recall_10       all 0.0110
recall_100      all 0.0135
recall_1000     all 0.0135
ndcg            all 0.0265
ndcg_cut_10     all 0.0546
ndcg_cut_100    all 0.0283
ndcg_cut_1000   all 0.0265

feup-run4¶

summary (trec_eval)

map             all 0.0033
bpref           all 0.0107
recip_rank      all 0.0860
P_10            all 0.0260
P_100           all 0.0116
P_1000          all 0.0012
recall_10       all 0.0029
recall_100      all 0.0176
recall_1000     all 0.0176
ndcg            all 0.0177
ndcg_cut_10     all 0.0234
ndcg_cut_100    all 0.0191
ndcg_cut_1000   all 0.0177

feup-run6¶

summary (trec_eval)

map             all 0.0028
bpref           all 0.0108
recip_rank      all 0.0860
P_10            all 0.0200
P_100           all 0.0116
P_1000          all 0.0012
recall_10       all 0.0024
recall_100      all 0.0176
recall_1000     all 0.0176
ndcg            all 0.0168
ndcg_cut_10     all 0.0197
ndcg_cut_100    all 0.0181
ndcg_cut_1000   all 0.0168

h2oloo_LR2AX0.6¶

summary (trec_eval)

map             all 0.3256
bpref           all 0.3807
recip_rank      all 0.7635
P_10            all 0.5800
P_100           all 0.2872
P_1000          all 0.0608
recall_10       all 0.1068
recall_100      all 0.4527
recall_1000     all 0.7967
ndcg            all 0.6145
ndcg_cut_10     all 0.5300
ndcg_cut_100    all 0.4808
ndcg_cut_1000   all 0.6145

h2oloo_enax0.6¶

summary (trec_eval)

map             all 0.3341
bpref           all 0.3862
recip_rank      all 0.7393
P_10            all 0.5860
P_100           all 0.3046
P_1000          all 0.0616
recall_10       all 0.1131
recall_100      all 0.4779
recall_1000     all 0.8076
ndcg            all 0.6233
ndcg_cut_10     all 0.5226
ndcg_cut_100    all 0.4973
ndcg_cut_1000   all 0.6233

h2oloo_enax0.7¶

summary (trec_eval)

map             all 0.3351
bpref           all 0.3928
recip_rank      all 0.7654
P_10            all 0.5920
P_100           all 0.3004
P_1000          all 0.0610
recall_10       all 0.1078
recall_100      all 0.4620
recall_1000     all 0.7985
ndcg            all 0.6218
ndcg_cut_10     all 0.5377
ndcg_cut_100    all 0.4947
ndcg_cut_1000   all 0.6218

h2oloo_LR2_rm3¶

summary (trec_eval)

map             all 0.3273
bpref           all 0.3746
recip_rank      all 0.7552
P_10            all 0.5800
P_100           all 0.2896
P_1000          all 0.0575
recall_10       all 0.1072
recall_100      all 0.4600
recall_1000     all 0.7855
ndcg            all 0.6113
ndcg_cut_10     all 0.5257
ndcg_cut_100    all 0.4884
ndcg_cut_1000   all 0.6113

jarir_cb_re¶

summary (trec_eval)

map             all 0.1896
bpref           all 0.2505
recip_rank      all 0.5072
P_10            all 0.3200
P_100           all 0.1786
P_1000          all 0.0475
recall_10       all 0.0690
recall_100      all 0.3544
recall_1000     all 0.6786
ndcg            all 0.4595
ndcg_cut_10     all 0.2748
ndcg_cut_100    all 0.3091
ndcg_cut_1000   all 0.4595

jarir_cbow¶

summary (trec_eval)

map             all 0.1289
bpref           all 0.2186
recip_rank      all 0.4069
P_10            all 0.2460
P_100           all 0.1372
P_1000          all 0.0419
recall_10       all 0.0487
recall_100      all 0.2519
recall_1000     all 0.6129
ndcg            all 0.3841
ndcg_cut_10     all 0.2095
ndcg_cut_100    all 0.2279
ndcg_cut_1000   all 0.3841

jarir_sg_re¶

summary (trec_eval)

map             all 0.2040
bpref           all 0.2578
recip_rank      all 0.5154
P_10            all 0.3700
P_100           all 0.1988
P_1000          all 0.0484
recall_10       all 0.0826
recall_100      all 0.3855
recall_1000     all 0.6968
ndcg            all 0.4861
ndcg_cut_10     all 0.3239
ndcg_cut_100    all 0.3443
ndcg_cut_1000   all 0.4861

RMITUQVDBFDM3¶

summary (trec_eval)

map             all 0.3753
bpref           all 0.4069
recip_rank      all 0.7681
P_10            all 0.5840
P_100           all 0.3076
P_1000          all 0.0640
recall_10       all 0.1163
recall_100      all 0.5322
recall_1000     all 0.8797
ndcg            all 0.6683
ndcg_cut_10     all 0.5330
ndcg_cut_100    all 0.5259
ndcg_cut_1000   all 0.6683

RMITUQVDBFNZDM1¶

summary (trec_eval)

map             all 0.3850
bpref           all 0.4111
recip_rank      all 0.7941
P_10            all 0.6020
P_100           all 0.3206
P_1000          all 0.0632
recall_10       all 0.1237
recall_100      all 0.5404
recall_1000     all 0.8773
ndcg            all 0.6763
ndcg_cut_10     all 0.5570
ndcg_cut_100    all 0.5460
ndcg_cut_1000   all 0.6763

RMITUQVBestDM2¶

summary (trec_eval)

map             all 0.3177
bpref           all 0.3690
recip_rank      all 0.8384
P_10            all 0.5560
P_100           all 0.2698
P_1000          all 0.0549
recall_10       all 0.1268
recall_100      all 0.4774
recall_1000     all 0.7874
ndcg            all 0.6196
ndcg_cut_10     all 0.5415
ndcg_cut_100    all 0.4928
ndcg_cut_1000   all 0.6196

RMITFDA4¶

summary (trec_eval)

map             all 0.3109
bpref           all 0.3459
recip_rank      all 0.7232
P_10            all 0.5120
P_100           all 0.2566
P_1000          all 0.0584
recall_10       all 0.1050
recall_100      all 0.4570
recall_1000     all 0.8239
ndcg            all 0.6100
ndcg_cut_10     all 0.4727
ndcg_cut_100    all 0.4543
ndcg_cut_1000   all 0.6100

RMITEXTGIGADA5¶

summary (trec_eval)

map             all 0.2585
bpref           all 0.3092
recip_rank      all 0.6813
P_10            all 0.4680
P_100           all 0.2290
P_1000          all 0.0529
recall_10       all 0.1006
recall_100      all 0.4194
recall_1000     all 0.7480
ndcg            all 0.5432
ndcg_cut_10     all 0.4244
ndcg_cut_100    all 0.4040
ndcg_cut_1000   all 0.5432

jarir_skipgram¶

summary (trec_eval)

map             all 0.1769
bpref           all 0.2404
recip_rank      all 0.4096
P_10            all 0.2980
P_100           all 0.1914
P_1000          all 0.0482
recall_10       all 0.0653
recall_100      all 0.3621
recall_1000     all 0.6932
ndcg            all 0.4576
ndcg_cut_10     all 0.2490
ndcg_cut_100    all 0.3104
ndcg_cut_1000   all 0.4576

jarir_cb_ind¶

summary (trec_eval)

map             all 0.1317
bpref           all 0.2180
recip_rank      all 0.4608
P_10            all 0.2600
P_100           all 0.1406
P_1000          all 0.0401
recall_10       all 0.0583
recall_100      all 0.2724
recall_1000     all 0.6081
ndcg            all 0.3868
ndcg_cut_10     all 0.2232
ndcg_cut_100    all 0.2394
ndcg_cut_1000   all 0.3868

jarir_sg_ind¶

summary (trec_eval)

map             all 0.1471
bpref           all 0.2307
recip_rank      all 0.4877
P_10            all 0.2720
P_100           all 0.1524
P_1000          all 0.0414
recall_10       all 0.0574
recall_100      all 0.2906
recall_1000     all 0.6445
ndcg            all 0.4130
ndcg_cut_10     all 0.2350
ndcg_cut_100    all 0.2585
ndcg_cut_1000   all 0.4130

h2oloo_LRax0.6¶

summary (trec_eval)

map             all 0.3227
bpref           all 0.3702
recip_rank      all 0.7317
P_10            all 0.5800
P_100           all 0.2924
P_1000          all 0.0576
recall_10       all 0.1119
recall_100      all 0.4707
recall_1000     all 0.7936
ndcg            all 0.6123
ndcg_cut_10     all 0.5151
ndcg_cut_100    all 0.4887
ndcg_cut_1000   all 0.6123

h2oloo_enrm30.6¶

summary (trec_eval)

map             all 0.3382
bpref           all 0.3823
recip_rank      all 0.7478
P_10            all 0.5920
P_100           all 0.3024
P_1000          all 0.0576
recall_10       all 0.1130
recall_100      all 0.4768
recall_1000     all 0.7888
ndcg            all 0.6193
ndcg_cut_10     all 0.5387
ndcg_cut_100    all 0.5037
ndcg_cut_1000   all 0.6193

h2oloo_e7ax0.6¶

summary (trec_eval)

map             all 0.3310
bpref           all 0.3804
recip_rank      all 0.7559
P_10            all 0.5840
P_100           all 0.3022
P_1000          all 0.0615
recall_10       all 0.1114
recall_100      all 0.4784
recall_1000     all 0.8050
ndcg            all 0.6215
ndcg_cut_10     all 0.5226
ndcg_cut_100    all 0.4956
ndcg_cut_1000   all 0.6215

h2oloo_e7ax0.7¶

summary (trec_eval)

map             all 0.3274
bpref           all 0.3852
recip_rank      all 0.7622
P_10            all 0.5880
P_100           all 0.2994
P_1000          all 0.0613
recall_10       all 0.1128
recall_100      all 0.4710
recall_1000     all 0.8054
ndcg            all 0.6209
ndcg_cut_10     all 0.5286
ndcg_cut_100    all 0.4925
ndcg_cut_1000   all 0.6209

h2oloo_e7rm30.6¶

summary (trec_eval)

map             all 0.3333
bpref           all 0.3768
recip_rank      all 0.7589
P_10            all 0.5820
P_100           all 0.3000
P_1000          all 0.0577
recall_10       all 0.1073
recall_100      all 0.4757
recall_1000     all 0.7848
ndcg            all 0.6143
ndcg_cut_10     all 0.5279
ndcg_cut_100    all 0.4978
ndcg_cut_1000   all 0.6143

h2oloo_e7rm30.7¶

summary (trec_eval)

map             all 0.3361
bpref           all 0.3846
recip_rank      all 0.7721
P_10            all 0.5940
P_100           all 0.3008
P_1000          all 0.0577
recall_10       all 0.1120
recall_100      all 0.4717
recall_1000     all 0.7853
ndcg            all 0.6177
ndcg_cut_10     all 0.5446
ndcg_cut_100    all 0.5012
ndcg_cut_1000   all 0.6177

UWaterMDS_DS_A¶

summary (trec_eval)

map             all 0.3739
bpref           all 0.3940
recip_rank      all 0.7804
P_10            all 0.6500
P_100           all 0.3416
P_1000          all 0.0426
recall_10       all 0.1311
recall_100      all 0.5220
recall_1000     all 0.5761
ndcg            all 0.5488
ndcg_cut_10     all 0.5591
ndcg_cut_100    all 0.5503
ndcg_cut_1000   all 0.5488

UWaterMDS_DS_B¶

summary (trec_eval)

map             all 0.2369
bpref           all 0.2658
recip_rank      all 0.3845
P_10            all 0.2920
P_100           all 0.3006
P_1000          all 0.0426
recall_10       all 0.0688
recall_100      all 0.4567
recall_1000     all 0.5761
ndcg            all 0.4320
ndcg_cut_10     all 0.2126
ndcg_cut_100    all 0.3875
ndcg_cut_1000   all 0.4320

UWaterMDS_Rank¶

summary (trec_eval)

map             all 0.4303
bpref           all 0.4651
recip_rank      all 0.7666
P_10            all 0.6360
P_100           all 0.3600
P_1000          all 0.0578
recall_10       all 0.1297
recall_100      all 0.5718
recall_1000     all 0.8018
ndcg            all 0.6552
ndcg_cut_10     all 0.5556
ndcg_cut_100    all 0.5762
ndcg_cut_1000   all 0.6552

umass_cbsdm¶

summary (trec_eval)

map             all 0.2277
bpref           all 0.2905
recip_rank      all 0.6494
P_10            all 0.4300
P_100           all 0.1988
P_1000          all 0.0465
recall_10       all 0.1057
recall_100      all 0.3913
recall_1000     all 0.6814
ndcg            all 0.5084
ndcg_cut_10     all 0.3944
ndcg_cut_100    all 0.3794
ndcg_cut_1000   all 0.5084

umass_bsdm¶

summary (trec_eval)

map             all 0.2307
bpref           all 0.2845
recip_rank      all 0.6646
P_10            all 0.4400
P_100           all 0.2050
P_1000          all 0.0466
recall_10       all 0.1033
recall_100      all 0.3989
recall_1000     all 0.6834
ndcg            all 0.5088
ndcg_cut_10     all 0.4033
ndcg_cut_100    all 0.3829
ndcg_cut_1000   all 0.5088

umass_sdm¶

summary (trec_eval)

map             all 0.2339
bpref           all 0.2998
recip_rank      all 0.7153
P_10            all 0.4440
P_100           all 0.2046
P_1000          all 0.0483
recall_10       all 0.1007
recall_100      all 0.3860
recall_1000     all 0.6868
ndcg            all 0.5175
ndcg_cut_10     all 0.4155
ndcg_cut_100    all 0.3867
ndcg_cut_1000   all 0.5175

umass_ql¶

summary (trec_eval)

map             all 0.2312
bpref           all 0.3042
recip_rank      all 0.6823
P_10            all 0.4360
P_100           all 0.2020
P_1000          all 0.0482
recall_10       all 0.1018
recall_100      all 0.3907
recall_1000     all 0.6829
ndcg            all 0.5160
ndcg_cut_10     all 0.4116
ndcg_cut_100    all 0.3855
ndcg_cut_1000   all 0.5160

bt-BoWBoE¶

summary (trec_eval)

map             all 0.2468
bpref           all 0.3045
recip_rank      all 0.7115
P_10            all 0.4640
P_100           all 0.2206
P_1000          all 0.0472
recall_10       all 0.1078
recall_100      all 0.4099
recall_1000     all 0.6855
ndcg            all 0.5231
ndcg_cut_10     all 0.4311
ndcg_cut_100    all 0.4030
ndcg_cut_1000   all 0.5231

bt-BoW¶

summary (trec_eval)

map             all 0.2340
bpref           all 0.2960
recip_rank      all 0.6882
P_10            all 0.4400
P_100           all 0.2090
P_1000          all 0.0472
recall_10       all 0.0987
recall_100      all 0.3965
recall_1000     all 0.6855
ndcg            all 0.5127
ndcg_cut_10     all 0.4108
ndcg_cut_100    all 0.3854
ndcg_cut_1000   all 0.5127

webis-argument¶

summary (trec_eval)

map             all 0.1015
bpref           all 0.1807
recip_rank      all 0.4932
P_10            all 0.3140
P_100           all 0.1100
P_1000          all 0.0288
recall_10       all 0.0694
recall_100      all 0.1925
recall_1000     all 0.4241
ndcg            all 0.3074
ndcg_cut_10     all 0.2835
ndcg_cut_100    all 0.2156
ndcg_cut_1000   all 0.3074

bt-BoE¶

summary (trec_eval)

map             all 0.2054
bpref           all 0.2757
recip_rank      all 0.5897
P_10            all 0.3860
P_100           all 0.1934
P_1000          all 0.0472
recall_10       all 0.0810
recall_100      all 0.3529
recall_1000     all 0.6855
ndcg            all 0.4866
ndcg_cut_10     all 0.3501
ndcg_cut_100    all 0.3453
ndcg_cut_1000   all 0.4866

b-BoE¶

summary (trec_eval)

map             all 0.2001
bpref           all 0.2775
recip_rank      all 0.5626
P_10            all 0.3800
P_100           all 0.1932
P_1000          all 0.0472
recall_10       all 0.0826
recall_100      all 0.3501
recall_1000     all 0.6855
ndcg            all 0.4810
ndcg_cut_10     all 0.3384
ndcg_cut_100    all 0.3384
ndcg_cut_1000   all 0.4810

t-BoE¶

summary (trec_eval)

map             all 0.1049
bpref           all 0.2002
recip_rank      all 0.4449
P_10            all 0.2640
P_100           all 0.1094
P_1000          all 0.0472
recall_10       all 0.0519
recall_100      all 0.1848
recall_1000     all 0.6855
ndcg            all 0.3977
ndcg_cut_10     all 0.2354
ndcg_cut_100    all 0.1985
ndcg_cut_1000   all 0.3977

eb-boost¶

summary (trec_eval)

map             all 0.2171
bpref           all 0.2807
recip_rank      all 0.6098
P_10            all 0.4200
P_100           all 0.2040
P_1000          all 0.0472
recall_10       all 0.0869
recall_100      all 0.3603
recall_1000     all 0.6855
ndcg            all 0.4993
ndcg_cut_10     all 0.3859
ndcg_cut_100    all 0.3618
ndcg_cut_1000   all 0.4993

b-BoW¶

summary (trec_eval)

map             all 0.2360
bpref           all 0.3026
recip_rank      all 0.7211
P_10            all 0.4480
P_100           all 0.2134
P_1000          all 0.0472
recall_10       all 0.1065
recall_100      all 0.3929
recall_1000     all 0.6855
ndcg            all 0.5188
ndcg_cut_10     all 0.4246
ndcg_cut_100    all 0.3931
ndcg_cut_1000   all 0.5188

webis-bm25f¶

summary (trec_eval)

map             all 0.0584
bpref           all 0.1380
recip_rank      all 0.3568
P_10            all 0.2080
P_100           all 0.0896
P_1000          all 0.0267
recall_10       all 0.0410
recall_100      all 0.1504
recall_1000     all 0.3820
ndcg            all 0.2418
ndcg_cut_10     all 0.1816
ndcg_cut_100    all 0.1490
ndcg_cut_1000   all 0.2418

b-BoWBoE-t-BoE¶

summary (trec_eval)

map             all 0.2457
bpref           all 0.3013
recip_rank      all 0.7004
P_10            all 0.4800
P_100           all 0.2196
P_1000          all 0.0472
recall_10       all 0.1092
recall_100      all 0.3969
recall_1000     all 0.6855
ndcg            all 0.5249
ndcg_cut_10     all 0.4422
ndcg_cut_100    all 0.4019
ndcg_cut_1000   all 0.5249

b-BoW-t-BoWBoE¶

summary (trec_eval)

map             all 0.2389
bpref           all 0.3015
recip_rank      all 0.7297
P_10            all 0.4660
P_100           all 0.2074
P_1000          all 0.0472
recall_10       all 0.1083
recall_100      all 0.3961
recall_1000     all 0.6855
ndcg            all 0.5179
ndcg_cut_10     all 0.4289
ndcg_cut_100    all 0.3900
ndcg_cut_1000   all 0.5179

BM25-b-BoW¶

summary (trec_eval)

map             all 0.2219
bpref           all 0.2899
recip_rank      all 0.6571
P_10            all 0.4140
P_100           all 0.1988
P_1000          all 0.0472
recall_10       all 0.1000
recall_100      all 0.3847
recall_1000     all 0.6855
ndcg            all 0.5066
ndcg_cut_10     all 0.3826
ndcg_cut_100    all 0.3727
ndcg_cut_1000   all 0.5066

webis-baseline¶

summary (trec_eval)

map             all 0.0471
bpref           all 0.1211
recip_rank      all 0.3034
P_10            all 0.1240
P_100           all 0.0782
P_1000          all 0.0256
recall_10       all 0.0259
recall_100      all 0.1365
recall_1000     all 0.3681
ndcg            all 0.2114
ndcg_cut_10     all 0.0938
ndcg_cut_100    all 0.1171
ndcg_cut_1000   all 0.2114

sab18coreA¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.2491
bpref           all 0.2966
recip_rank      all 0.6180
P_10            all 0.4480
P_100           all 0.2248
P_1000          all 0.0498
recall_10       all 0.0935
recall_100      all 0.4159
recall_1000     all 0.7415
ndcg            all 0.5318
ndcg_cut_10     all 0.3947
ndcg_cut_100    all 0.3940
ndcg_cut_1000   all 0.5318

sab18coreE1¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.2510
bpref           all 0.3195
recip_rank      all 0.6556
P_10            all 0.4800
P_100           all 0.2362
P_1000          all 0.0451
recall_10       all 0.0861
recall_100      all 0.3859
recall_1000     all 0.6636
ndcg            all 0.5068
ndcg_cut_10     all 0.4421
ndcg_cut_100    all 0.4041
ndcg_cut_1000   all 0.5068

sab18coreO1¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.2119
bpref           all 0.3249
recip_rank      all 0.6334
P_10            all 0.4560
P_100           all 0.2156
P_1000          all 0.0467
recall_10       all 0.0884
recall_100      all 0.3380
recall_1000     all 0.6360
ndcg            all 0.4828
ndcg_cut_10     all 0.4064
ndcg_cut_100    all 0.3617
ndcg_cut_1000   all 0.4828

sabopt50v45¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.2274
bpref           all 0.3279
recip_rank      all 0.6548
P_10            all 0.4940
P_100           all 0.2316
P_1000          all 0.0484
recall_10       all 0.0964
recall_100      all 0.3740
recall_1000     all 0.6796
ndcg            all 0.5086
ndcg_cut_10     all 0.4250
ndcg_cut_100    all 0.3883
ndcg_cut_1000   all 0.5086

sab18nyt_E1¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.2471
bpref           all 0.3250
recip_rank      all 0.6452
P_10            all 0.4660
P_100           all 0.2348
P_1000          all 0.0463
recall_10       all 0.0834
recall_100      all 0.3829
recall_1000     all 0.6693
ndcg            all 0.5089
ndcg_cut_10     all 0.4290
ndcg_cut_100    all 0.3995
ndcg_cut_1000   all 0.5089

sab18nyt_O1.50¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.2296
bpref           all 0.3401
recip_rank      all 0.6864
P_10            all 0.4840
P_100           all 0.2272
P_1000          all 0.0476
recall_10       all 0.0960
recall_100      all 0.3724
recall_1000     all 0.6824
ndcg            all 0.5123
ndcg_cut_10     all 0.4347
ndcg_cut_100    all 0.3954
ndcg_cut_1000   all 0.5123

sab18nyt_O1¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.2178
bpref           all 0.3320
recip_rank      all 0.6963
P_10            all 0.4660
P_100           all 0.2116
P_1000          all 0.0451
recall_10       all 0.0911
recall_100      all 0.3471
recall_1000     all 0.6393
ndcg            all 0.4906
ndcg_cut_10     all 0.4172
ndcg_cut_100    all 0.3738
ndcg_cut_1000   all 0.4906

UWaterMDS_SEQ¶

summary (trec_eval)

map             all 0.1739
bpref           all 0.2270
recip_rank      all 0.6349
P_10            all 0.4160
P_100           all 0.1846
P_1000          all 0.0378
recall_10       all 0.0817
recall_100      all 0.2528
recall_1000     all 0.4295
ndcg            all 0.3606
ndcg_cut_10     all 0.3570
ndcg_cut_100    all 0.2970
ndcg_cut_1000   all 0.3606

sabaqv45nytO150¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.1158
bpref           all 0.1743
recip_rank      all 0.3559
P_10            all 0.2300
P_100           all 0.1026
P_1000          all 0.0211
recall_10       all 0.0523
recall_100      all 0.1935
recall_1000     all 0.3557
ndcg            all 0.2600
ndcg_cut_10     all 0.2021
ndcg_cut_100    all 0.1902
ndcg_cut_1000   all 0.2600

sab18aqv45nytE1¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.1767
bpref           all 0.1951
recip_rank      all 0.3419
P_10            all 0.2800
P_100           all 0.1440
P_1000          all 0.0265
recall_10       all 0.0576
recall_100      all 0.2648
recall_1000     all 0.4369
ndcg            all 0.3229
ndcg_cut_10     all 0.2439
ndcg_cut_100    all 0.2516
ndcg_cut_1000   all 0.3229

sab18aqv45nytO1¶

Metadata | Participants| Input| Summary| Appendix

summary (trec_eval)

map             all 0.1163
bpref           all 0.1791
recip_rank      all 0.3868
P_10            all 0.2360
P_100           all 0.1044
P_1000          all 0.0218
recall_10       all 0.0530
recall_100      all 0.1977
recall_1000     all 0.3694
ndcg            all 0.2667
ndcg_cut_10     all 0.2099
ndcg_cut_100    all 0.1941
ndcg_cut_1000   all 0.2667