Results - Chemical 2009¶

SCAI09TSNP¶

summary (eval)

map             all 0.2314
bpref           all 0.3628
recip_rank      all 0.9556
P_10            all 0.7111
P_100           all 0.2111
P_1000          all 0.0398
recall_10       all 0.1153
recall_100      all 0.3083
recall_1000     all 0.5107
ndcg            all 0.4736
ndcg_cut_10     all 0.6635
ndcg_cut_100    all 0.4048
ndcg_cut_1000   all 0.4736

SCAI09TSMAN¶

summary (eval)

map             all 0.2569
bpref           all 0.3918
recip_rank      all 0.8802
P_10            all 0.7444
P_100           all 0.2328
P_1000          all 0.0409
recall_10       all 0.1432
recall_100      all 0.3497
recall_1000     all 0.5369
ndcg            all 0.5032
ndcg_cut_10     all 0.6850
ndcg_cut_100    all 0.4466
ndcg_cut_1000   all 0.5032

SCAI09TSPM¶

summary (eval)

map             all 0.1530
bpref           all 0.2866
recip_rank      all 0.8190
P_10            all 0.5500
P_100           all 0.1678
P_1000          all 0.0348
recall_10       all 0.0820
recall_100      all 0.2272
recall_1000     all 0.4244
ndcg            all 0.3822
ndcg_cut_10     all 0.5152
ndcg_cut_100    all 0.3162
ndcg_cut_1000   all 0.3822

DUT09TSRun1¶

summary (eval)

map             all 0.1729
bpref           all 0.3462
recip_rank      all 0.6057
P_10            all 0.4889
P_100           all 0.2156
P_1000          all 0.0526
recall_10       all 0.0664
recall_100      all 0.2573
recall_1000     all 0.5851
ndcg            all 0.4388
ndcg_cut_10     all 0.4349
ndcg_cut_100    all 0.3094
ndcg_cut_1000   all 0.4388

DUT09TSRun2¶

summary (eval)

map             all 0.2221
bpref           all 0.3741
recip_rank      all 0.8404
P_10            all 0.6056
P_100           all 0.2428
P_1000          all 0.0502
recall_10       all 0.0854
recall_100      all 0.3131
recall_1000     all 0.6049
ndcg            all 0.5069
ndcg_cut_10     all 0.6111
ndcg_cut_100    all 0.4075
ndcg_cut_1000   all 0.5069

DUT09TSRun3¶

summary (eval)

map             all 0.2131
bpref           all 0.3639
recip_rank      all 0.8118
P_10            all 0.6111
P_100           all 0.2417
P_1000          all 0.0494
recall_10       all 0.0867
recall_100      all 0.3087
recall_1000     all 0.5920
ndcg            all 0.4946
ndcg_cut_10     all 0.6086
ndcg_cut_100    all 0.3986
ndcg_cut_1000   all 0.4946

BiTeM09¶

summary (eval)

map             all 0.1577
bpref           all 0.2813
recip_rank      all 0.5281
P_10            all 0.4778
P_100           all 0.1944
P_1000          all 0.0395
recall_10       all 0.0554
recall_100      all 0.2564
recall_1000     all 0.4782
ndcg            all 0.3778
ndcg_cut_10     all 0.4264
ndcg_cut_100    all 0.2973
ndcg_cut_1000   all 0.3778

BiTeM09po¶

summary (eval)

map             all 0.1949
bpref           all 0.3152
recip_rank      all 0.6611
P_10            all 0.5556
P_100           all 0.2061
P_1000          all 0.0422
recall_10       all 0.0846
recall_100      all 0.2940
recall_1000     all 0.5243
ndcg            all 0.4409
ndcg_cut_10     all 0.5271
ndcg_cut_100    all 0.3514
ndcg_cut_1000   all 0.4409

BiTeM09qe¶

summary (eval)

map             all 0.1041
bpref           all 0.1798
recip_rank      all 0.3025
P_10            all 0.2333
P_100           all 0.1339
P_1000          all 0.0238
recall_10       all 0.0311
recall_100      all 0.2270
recall_1000     all 0.3859
ndcg            all 0.2712
ndcg_cut_10     all 0.1988
ndcg_cut_100    all 0.2103
ndcg_cut_1000   all 0.2712

BiTeM09qepo¶

summary (eval)

map             all 0.1186
bpref           all 0.1922
recip_rank      all 0.3739
P_10            all 0.2722
P_100           all 0.1389
P_1000          all 0.0258
recall_10       all 0.0634
recall_100      all 0.2282
recall_1000     all 0.4068
ndcg            all 0.2987
ndcg_cut_10     all 0.2513
ndcg_cut_100    all 0.2287
ndcg_cut_1000   all 0.2987

BiTeM09comb¶

summary (eval)

map             all 0.1193
bpref           all 0.1939
recip_rank      all 0.3835
P_10            all 0.2667
P_100           all 0.1400
P_1000          all 0.0258
recall_10       all 0.0631
recall_100      all 0.2295
recall_1000     all 0.4068
ndcg            all 0.2992
ndcg_cut_10     all 0.2501
ndcg_cut_100    all 0.2305
ndcg_cut_1000   all 0.2992

purdueTS09r1¶

summary (eval)

map             all 0.2648
bpref           all 0.4480
recip_rank      all 0.8046
P_10            all 0.6944
P_100           all 0.2711
P_1000          all 0.0552
recall_10       all 0.1065
recall_100      all 0.3344
recall_1000     all 0.6053
ndcg            all 0.5443
ndcg_cut_10     all 0.6505
ndcg_cut_100    all 0.4498
ndcg_cut_1000   all 0.5443

DUT09TSRun4¶

summary (eval)

map             all 0.2214
bpref           all 0.3962
recip_rank      all 0.7991
P_10            all 0.6889
P_100           all 0.2578
P_1000          all 0.0558
recall_10       all 0.0849
recall_100      all 0.2716
recall_1000     all 0.5565
ndcg            all 0.4961
ndcg_cut_10     all 0.6511
ndcg_cut_100    all 0.4033
ndcg_cut_1000   all 0.4961

DUT09TSRun6¶

summary (eval)

map             all 0.2788
bpref           all 0.4778
recip_rank      all 0.8588
P_10            all 0.7833
P_100           all 0.2600
P_1000          all 0.0556
recall_10       all 0.1274
recall_100      all 0.3450
recall_1000     all 0.5993
ndcg            all 0.5449
ndcg_cut_10     all 0.6918
ndcg_cut_100    all 0.4489
ndcg_cut_1000   all 0.5449

york09ca03¶

summary (eval)

map             all 0.2156
bpref           all 0.3889
recip_rank      all 0.8019
P_10            all 0.6889
P_100           all 0.2728
P_1000          all 0.0540
recall_10       all 0.0828
recall_100      all 0.2887
recall_1000     all 0.5121
ndcg            all 0.4840
ndcg_cut_10     all 0.6452
ndcg_cut_100    all 0.4107
ndcg_cut_1000   all 0.4840

york09ca04¶

summary (eval)

map             all 0.1530
bpref           all 0.3128
recip_rank      all 0.7156
P_10            all 0.5778
P_100           all 0.2139
P_1000          all 0.0482
recall_10       all 0.0609
recall_100      all 0.2175
recall_1000     all 0.4539
ndcg            all 0.3896
ndcg_cut_10     all 0.4930
ndcg_cut_100    all 0.3048
ndcg_cut_1000   all 0.3896

york09ca05¶

summary (eval)

map             all 0.0302
bpref           all 0.2012
recip_rank      all 0.3034
P_10            all 0.2167
P_100           all 0.0600
P_1000          all 0.0436
recall_10       all 0.0139
recall_100      all 0.0435
recall_1000     all 0.4197
ndcg            all 0.2179
ndcg_cut_10     all 0.1394
ndcg_cut_100    all 0.0637
ndcg_cut_1000   all 0.2179

york09ca06¶

summary (eval)

map             all 0.0410
bpref           all 0.1980
recip_rank      all 0.3989
P_10            all 0.2500
P_100           all 0.0717
P_1000          all 0.0411
recall_10       all 0.0174
recall_100      all 0.0519
recall_1000     all 0.4006
ndcg            all 0.2244
ndcg_cut_10     all 0.1650
ndcg_cut_100    all 0.0788
ndcg_cut_1000   all 0.2244

BiTeM09ipc1¶

summary (eval)

map             all 0.1141
bpref           all 0.1911
recip_rank      all 0.3346
P_10            all 0.3222
P_100           all 0.1539
P_1000          all 0.0258
recall_10       all 0.0539
recall_100      all 0.2370
recall_1000     all 0.4068
ndcg            all 0.2933
ndcg_cut_10     all 0.2602
ndcg_cut_100    all 0.2322
ndcg_cut_1000   all 0.2933

BiTeM09ipc3¶

summary (eval)

map             all 0.1160
bpref           all 0.1987
recip_rank      all 0.3368
P_10            all 0.3278
P_100           all 0.1544
P_1000          all 0.0258
recall_10       all 0.0572
recall_100      all 0.2548
recall_1000     all 0.4068
ndcg            all 0.2985
ndcg_cut_10     all 0.2676
ndcg_cut_100    all 0.2411
ndcg_cut_1000   all 0.2985

BiTeM09ipc5¶

summary (eval)

map             all 0.1140
bpref           all 0.1989
recip_rank      all 0.3441
P_10            all 0.3222
P_100           all 0.1539
P_1000          all 0.0258
recall_10       all 0.0561
recall_100      all 0.2538
recall_1000     all 0.4068
ndcg            all 0.2971
ndcg_cut_10     all 0.2651
ndcg_cut_100    all 0.2390
ndcg_cut_1000   all 0.2971

BiTeM09ipc3b¶

summary (eval)

map             all 0.1169
bpref           all 0.1943
recip_rank      all 0.3291
P_10            all 0.2778
P_100           all 0.1494
P_1000          all 0.0258
recall_10       all 0.0527
recall_100      all 0.2551
recall_1000     all 0.4068
ndcg            all 0.2968
ndcg_cut_10     all 0.2414
ndcg_cut_100    all 0.2377
ndcg_cut_1000   all 0.2968

msoe09TSx1¶

summary (eval)

map             all 0.0343
bpref           all 0.2019
recip_rank      all 0.3029
P_10            all 0.2167
P_100           all 0.0500
P_1000          all 0.0538
recall_10       all 0.0121
recall_100      all 0.0271
recall_1000     all 0.5950
ndcg            all 0.2835
ndcg_cut_10     all 0.1481
ndcg_cut_100    all 0.0540
ndcg_cut_1000   all 0.2835

msoe09TSx2¶

summary (eval)

map             all 0.0352
bpref           all 0.2022
recip_rank      all 0.3459
P_10            all 0.2222
P_100           all 0.0517
P_1000          all 0.0537
recall_10       all 0.0129
recall_100      all 0.0296
recall_1000     all 0.5923
ndcg            all 0.2843
ndcg_cut_10     all 0.1553
ndcg_cut_100    all 0.0576
ndcg_cut_1000   all 0.2843

msoe09TSx3¶

summary (eval)

map             all 0.0387
bpref           all 0.2064
recip_rank      all 0.3663
P_10            all 0.2167
P_100           all 0.0572
P_1000          all 0.0543
recall_10       all 0.0133
recall_100      all 0.0330
recall_1000     all 0.6012
ndcg            all 0.2931
ndcg_cut_10     all 0.1634
ndcg_cut_100    all 0.0658
ndcg_cut_1000   all 0.2931

msoe09TSx4¶

summary (eval)

map             all 0.0256
bpref           all 0.1442
recip_rank      all 0.3386
P_10            all 0.2167
P_100           all 0.0478
P_1000          all 0.0383
recall_10       all 0.0158
recall_100      all 0.0382
recall_1000     all 0.4120
ndcg            all 0.2178
ndcg_cut_10     all 0.1479
ndcg_cut_100    all 0.0577
ndcg_cut_1000   all 0.2178

msoe09TSx5¶

summary (eval)

map             all 0.0352
bpref           all 0.1938
recip_rank      all 0.2423
P_10            all 0.2056
P_100           all 0.0589
P_1000          all 0.0536
recall_10       all 0.0107
recall_100      all 0.0363
recall_1000     all 0.5907
ndcg            all 0.2845
ndcg_cut_10     all 0.1540
ndcg_cut_100    all 0.0633
ndcg_cut_1000   all 0.2845

DUTIR09BM25F¶

summary (eval)

map             all 0.2602
bpref           all 0.3980
recip_rank      all 0.7540
P_10            all 0.6778
P_100           all 0.2294
P_1000          all 0.0411
recall_10       all 0.1216
recall_100      all 0.3503
recall_1000     all 0.5670
ndcg            all 0.4976
ndcg_cut_10     all 0.6065
ndcg_cut_100    all 0.4243
ndcg_cut_1000   all 0.4976

york09ca02¶

summary (eval)

map             all 0.0894
bpref           all 0.2233
recip_rank      all 0.5125
P_10            all 0.4056
P_100           all 0.1389
P_1000          all 0.0364
recall_10       all 0.0321
recall_100      all 0.1284
recall_1000     all 0.3235
ndcg            all 0.2656
ndcg_cut_10     all 0.3654
ndcg_cut_100    all 0.1915
ndcg_cut_1000   all 0.2656

york09ca07¶

summary (eval)

map             all 0.2583
bpref           all 0.4445
recip_rank      all 0.8098
P_10            all 0.6889
P_100           all 0.2733
P_1000          all 0.0582
recall_10       all 0.0949
recall_100      all 0.3280
recall_1000     all 0.6080
ndcg            all 0.5375
ndcg_cut_10     all 0.6345
ndcg_cut_100    all 0.4313
ndcg_cut_1000   all 0.5375

york09ca08¶

summary (eval)

map             all 0.2227
bpref           all 0.4189
recip_rank      all 0.8237
P_10            all 0.6833
P_100           all 0.2450
P_1000          all 0.0554
recall_10       all 0.0934
recall_100      all 0.2943
recall_1000     all 0.6122
ndcg            all 0.5130
ndcg_cut_10     all 0.6230
ndcg_cut_100    all 0.3970
ndcg_cut_1000   all 0.5130

UIowaS09PA1¶

summary (full)

map             all 0.0683
bpref           all 0.4066
recip_rank      all 0.3864
recall_100      all 0.1851
ndcg            all 0.2643

summary (small)

map             all 0.0485
bpref           all 0.4207
recip_rank      all 0.2373
P_10            all 0.1140
P_100           all 0.0492
P_1000          all 0.0112
recall_10       all 0.0455
recall_100      all 0.1888
recall_1000     all 0.4207
ndcg            all 0.2245
ndcg_cut_10     all 0.1183
ndcg_cut_100    all 0.1434
ndcg_cut_1000   all 0.2245

SCAI09PAt2a¶

summary (full)

map             all 0.0046
bpref           all 0.3355
recip_rank      all 0.0195
recall_100      all 0.0086
ndcg            all 0.1238

summary (small)

map             all 0.0053
bpref           all 0.4577
recip_rank      all 0.0176
P_10            all 0.0040
P_100           all 0.0029
P_1000          all 0.0118
recall_10       all 0.0020
recall_100      all 0.0117
recall_1000     all 0.4577
ndcg            all 0.1415
ndcg_cut_10     all 0.0038
ndcg_cut_100    all 0.0077
ndcg_cut_1000   all 0.1415

SCAI09PAf2a¶

summary (full)

map             all 0.0046
bpref           all 0.3418
recip_rank      all 0.0188
recall_100      all 0.0102
ndcg            all 0.1232

summary (small)

map             all 0.0055
bpref           all 0.5165
recip_rank      all 0.0149
P_10            all 0.0030
P_100           all 0.0041
P_1000          all 0.0132
recall_10       all 0.0005
recall_100      all 0.0144
recall_1000     all 0.5165
ndcg            all 0.1556
ndcg_cut_10     all 0.0024
ndcg_cut_100    all 0.0078
ndcg_cut_1000   all 0.1556

SCAI09PAt2b¶

summary (full)

map             all 0.0045
bpref           all 0.3314
recip_rank      all 0.0196
recall_100      all 0.0101
ndcg            all 0.1225

summary (small)

map             all 0.0050
bpref           all 0.4586
recip_rank      all 0.0175
P_10            all 0.0040
P_100           all 0.0044
P_1000          all 0.0118
recall_10       all 0.0016
recall_100      all 0.0176
recall_1000     all 0.4586
ndcg            all 0.1417
ndcg_cut_10     all 0.0030
ndcg_cut_100    all 0.0094
ndcg_cut_1000   all 0.1417

SCAI09PAf2b¶

summary (full)

map             all 0.0045
bpref           all 0.3344
recip_rank      all 0.0206
recall_100      all 0.0092
ndcg            all 0.1207

summary (small)

map             all 0.0053
bpref           all 0.5115
recip_rank      all 0.0134
P_10            all 0.0040
P_100           all 0.0031
P_1000          all 0.0130
recall_10       all 0.0010
recall_100      all 0.0102
recall_1000     all 0.5115
ndcg            all 0.1531
ndcg_cut_10     all 0.0028
ndcg_cut_100    all 0.0058
ndcg_cut_1000   all 0.1531

SCAI09PAt2c¶

summary (full)

map             all 0.0049
bpref           all 0.3405
recip_rank      all 0.0233
recall_100      all 0.0096
ndcg            all 0.1262

summary (small)

map             all 0.0043
bpref           all 0.4091
recip_rank      all 0.0130
P_10            all 0.0030
P_100           all 0.0029
P_1000          all 0.0108
recall_10       all 0.0009
recall_100      all 0.0132
recall_1000     all 0.4091
ndcg            all 0.1256
ndcg_cut_10     all 0.0023
ndcg_cut_100    all 0.0066
ndcg_cut_1000   all 0.1256

SCAI09PAf2c¶

summary (full)

map             all 0.0051
bpref           all 0.3500
recip_rank      all 0.0223
recall_100      all 0.0103
ndcg            all 0.1266

summary (small)

map             all 0.0056
bpref           all 0.4799
recip_rank      all 0.0212
P_10            all 0.0030
P_100           all 0.0042
P_1000          all 0.0122
recall_10       all 0.0027
recall_100      all 0.0162
recall_1000     all 0.4799
ndcg            all 0.1468
ndcg_cut_10     all 0.0039
ndcg_cut_100    all 0.0105
ndcg_cut_1000   all 0.1468

SCAI09PAt2d¶

summary (full)

map             all 0.0021
bpref           all 0.2048
recip_rank      all 0.0118
recall_100      all 0.0059
ndcg            all 0.0772

summary (small)

map             all 0.0021
bpref           all 0.2763
recip_rank      all 0.0085
P_10            all 0.0010
P_100           all 0.0020
P_1000          all 0.0071
recall_10       all 0.0005
recall_100      all 0.0072
recall_1000     all 0.2763
ndcg            all 0.0853
ndcg_cut_10     all 0.0007
ndcg_cut_100    all 0.0039
ndcg_cut_1000   all 0.0853

SCAI09PAf2d¶

summary (full)

map             all 0.0021
bpref           all 0.1990
recip_rank      all 0.0158
recall_100      all 0.0065
ndcg            all 0.0734

summary (small)

map             all 0.0029
bpref           all 0.3168
recip_rank      all 0.0317
P_10            all 0.0050
P_100           all 0.0028
P_1000          all 0.0080
recall_10       all 0.0013
recall_100      all 0.0101
recall_1000     all 0.3168
ndcg            all 0.0980
ndcg_cut_10     all 0.0060
ndcg_cut_100    all 0.0070
ndcg_cut_1000   all 0.0980

SCAI09PAt2e¶

summary (full)

map             all 0.0056
bpref           all 0.3775
recip_rank      all 0.0212
recall_100      all 0.0109
ndcg            all 0.1399

summary (small)

map             all 0.0052
bpref           all 0.4877
recip_rank      all 0.0126
P_10            all 0.0040
P_100           all 0.0036
P_1000          all 0.0126
recall_10       all 0.0015
recall_100      all 0.0124
recall_1000     all 0.4877
ndcg            all 0.1496
ndcg_cut_10     all 0.0023
ndcg_cut_100    all 0.0074
ndcg_cut_1000   all 0.1496

SCAI09PAf2e¶

summary (full)

map             all 0.0059
bpref           all 0.3925
recip_rank      all 0.0260
recall_100      all 0.0114
ndcg            all 0.1424

summary (small)

map             all 0.0062
bpref           all 0.5540
recip_rank      all 0.0356
P_10            all 0.0050
P_100           all 0.0032
P_1000          all 0.0142
recall_10       all 0.0007
recall_100      all 0.0112
recall_1000     all 0.5540
ndcg            all 0.1675
ndcg_cut_10     all 0.0056
ndcg_cut_100    all 0.0071
ndcg_cut_1000   all 0.1675

DUTIRRun1¶

summary (small)

map             all 0.0195
bpref           all 0.0932
recip_rank      all 0.1060
P_10            all 0.0470
P_100           all 0.0228
P_1000          all 0.0044
recall_10       all 0.0103
recall_100      all 0.0491
recall_1000     all 0.0932
ndcg            all 0.0683
ndcg_cut_10     all 0.0478
ndcg_cut_100    all 0.0480
ndcg_cut_1000   all 0.0683

DUTIRRun2¶

summary (small)

map             all 0.0203
bpref           all 0.0969
recip_rank      all 0.0924
P_10            all 0.0540
P_100           all 0.0239
P_1000          all 0.0046
recall_10       all 0.0114
recall_100      all 0.0508
recall_1000     all 0.0969
ndcg            all 0.0695
ndcg_cut_10     all 0.0509
ndcg_cut_100    all 0.0490
ndcg_cut_1000   all 0.0695

DUTIRRun3¶

summary (small)

map             all 0.0204
bpref           all 0.0984
recip_rank      all 0.0932
P_10            all 0.0530
P_100           all 0.0243
P_1000          all 0.0046
recall_10       all 0.0113
recall_100      all 0.0517
recall_1000     all 0.0984
ndcg            all 0.0702
ndcg_cut_10     all 0.0503
ndcg_cut_100    all 0.0496
ndcg_cut_1000   all 0.0702

msoe09TSx1ta¶

summary (small)

map             all 0.0015
bpref           all 0.1040
recip_rank      all 0.0103
P_10            all 0.0020
P_100           all 0.0039
P_1000          all 0.0033
recall_10       all 0.0005
recall_100      all 0.0127
recall_1000     all 0.1040
ndcg            all 0.0395
ndcg_cut_10     all 0.0014
ndcg_cut_100    all 0.0076
ndcg_cut_1000   all 0.0395

msoe09TSx2ta¶

summary (small)

map             all 0.0015
bpref           all 0.1040
recip_rank      all 0.0107
P_10            all 0.0030
P_100           all 0.0039
P_1000          all 0.0033
recall_10       all 0.0009
recall_100      all 0.0127
recall_1000     all 0.1040
ndcg            all 0.0395
ndcg_cut_10     all 0.0021
ndcg_cut_100    all 0.0076
ndcg_cut_1000   all 0.0395

msoe09TSx3ta¶

summary (small)

map             all 0.0015
bpref           all 0.1055
recip_rank      all 0.0109
P_10            all 0.0020
P_100           all 0.0039
P_1000          all 0.0033
recall_10       all 0.0005
recall_100      all 0.0133
recall_1000     all 0.1055
ndcg            all 0.0399
ndcg_cut_10     all 0.0015
ndcg_cut_100    all 0.0077
ndcg_cut_1000   all 0.0399

msoe09TSx4ta¶

summary (small)

map             all 0.0022
bpref           all 0.1635
recip_rank      all 0.0177
P_10            all 0.0030
P_100           all 0.0048
P_1000          all 0.0046
recall_10       all 0.0011
recall_100      all 0.0172
recall_1000     all 0.1635
ndcg            all 0.0600
ndcg_cut_10     all 0.0030
ndcg_cut_100    all 0.0104
ndcg_cut_1000   all 0.0600

msoe09TSx5ta¶

summary (small)

map             all 0.0019
bpref           all 0.1365
recip_rank      all 0.0136
P_10            all 0.0040
P_100           all 0.0045
P_1000          all 0.0040
recall_10       all 0.0018
recall_100      all 0.0156
recall_1000     all 0.1365
ndcg            all 0.0496
ndcg_cut_10     all 0.0029
ndcg_cut_100    all 0.0092
ndcg_cut_1000   all 0.0496

SCAI09PAt1a¶

summary (full)

map             all 0.0058
bpref           all 0.3601
recip_rank      all 0.0261
recall_100      all 0.0117
ndcg            all 0.1359

summary (small)

map             all 0.0075
bpref           all 0.4274
recip_rank      all 0.0403
P_10            all 0.0080
P_100           all 0.0040
P_1000          all 0.0116
recall_10       all 0.0044
recall_100      all 0.0147
recall_1000     all 0.4274
ndcg            all 0.1395
ndcg_cut_10     all 0.0099
ndcg_cut_100    all 0.0122
ndcg_cut_1000   all 0.1395

SCAI09PAf1a¶

summary (full)

map             all 0.0059
bpref           all 0.3777
recip_rank      all 0.0256
recall_100      all 0.0109
ndcg            all 0.1386

summary (small)

map             all 0.0058
bpref           all 0.5164
recip_rank      all 0.0163
P_10            all 0.0040
P_100           all 0.0035
P_1000          all 0.0137
recall_10       all 0.0008
recall_100      all 0.0116
recall_1000     all 0.5164
ndcg            all 0.1591
ndcg_cut_10     all 0.0029
ndcg_cut_100    all 0.0069
ndcg_cut_1000   all 0.1591

SCAI09PAt1b¶

summary (full)

map             all 0.0058
bpref           all 0.3826
recip_rank      all 0.0252
recall_100      all 0.0127
ndcg            all 0.1430

summary (small)

map             all 0.0053
bpref           all 0.4519
recip_rank      all 0.0181
P_10            all 0.0040
P_100           all 0.0047
P_1000          all 0.0118
recall_10       all 0.0022
recall_100      all 0.0147
recall_1000     all 0.4519
ndcg            all 0.1420
ndcg_cut_10     all 0.0035
ndcg_cut_100    all 0.0095
ndcg_cut_1000   all 0.1420

SCAI09PAf1b¶

summary (full)

map             all 0.0057
bpref           all 0.3894
recip_rank      all 0.0228
recall_100      all 0.0111
ndcg            all 0.1414

summary (small)

map             all 0.0056
bpref           all 0.5170
recip_rank      all 0.0153
P_10            all 0.0050
P_100           all 0.0040
P_1000          all 0.0133
recall_10       all 0.0012
recall_100      all 0.0153
recall_1000     all 0.5170
ndcg            all 0.1587
ndcg_cut_10     all 0.0034
ndcg_cut_100    all 0.0087
ndcg_cut_1000   all 0.1587

SCAI09PAt1c¶

summary (full)

map             all 0.0048
bpref           all 0.3336
recip_rank      all 0.0215
recall_100      all 0.0101
ndcg            all 0.1255

summary (small)

map             all 0.0041
bpref           all 0.3935
recip_rank      all 0.0152
P_10            all 0.0030
P_100           all 0.0027
P_1000          all 0.0106
recall_10       all 0.0005
recall_100      all 0.0066
recall_1000     all 0.3935
ndcg            all 0.1236
ndcg_cut_10     all 0.0028
ndcg_cut_100    all 0.0050
ndcg_cut_1000   all 0.1236

SCAI09PAf1c¶

summary (full)

map             all 0.0053
bpref           all 0.3501
recip_rank      all 0.0246
recall_100      all 0.0110
ndcg            all 0.1285

summary (small)

map             all 0.0056
bpref           all 0.4822
recip_rank      all 0.0201
P_10            all 0.0050
P_100           all 0.0048
P_1000          all 0.0129
recall_10       all 0.0016
recall_100      all 0.0136
recall_1000     all 0.4822
ndcg            all 0.1500
ndcg_cut_10     all 0.0040
ndcg_cut_100    all 0.0089
ndcg_cut_1000   all 0.1500

SCAI09PAt1d¶

summary (full)

map             all 0.0028
bpref           all 0.2138
recip_rank      all 0.0191
recall_100      all 0.0076
ndcg            all 0.0825

summary (small)

map             all 0.0028
bpref           all 0.2660
recip_rank      all 0.0211
P_10            all 0.0040
P_100           all 0.0037
P_1000          all 0.0074
recall_10       all 0.0013
recall_100      all 0.0136
recall_1000     all 0.2660
ndcg            all 0.0876
ndcg_cut_10     all 0.0032
ndcg_cut_100    all 0.0074
ndcg_cut_1000   all 0.0876

SCAI09PAf1d¶

summary (full)

map             all 0.0027
bpref           all 0.2137
recip_rank      all 0.0172
recall_100      all 0.0075
ndcg            all 0.0797

summary (small)

map             all 0.0027
bpref           all 0.3067
recip_rank      all 0.0093
P_10            all 0.0010
P_100           all 0.0023
P_1000          all 0.0084
recall_10       all 0.0002
recall_100      all 0.0091
recall_1000     all 0.3067
ndcg            all 0.0965
ndcg_cut_10     all 0.0005
ndcg_cut_100    all 0.0046
ndcg_cut_1000   all 0.0965

SCAI09PAt1e¶

summary (full)

map             all 0.0060
bpref           all 0.3777
recip_rank      all 0.0265
recall_100      all 0.0113
ndcg            all 0.1417

summary (small)

map             all 0.0053
bpref           all 0.4413
recip_rank      all 0.0189
P_10            all 0.0050
P_100           all 0.0040
P_1000          all 0.0118
recall_10       all 0.0012
recall_100      all 0.0173
recall_1000     all 0.4413
ndcg            all 0.1402
ndcg_cut_10     all 0.0042
ndcg_cut_100    all 0.0095
ndcg_cut_1000   all 0.1402

SCAI09PAf1e¶

summary (full)

map             all 0.0065
bpref           all 0.4004
recip_rank      all 0.0247
recall_100      all 0.0124
ndcg            all 0.1471

summary (small)

map             all 0.0069
bpref           all 0.5444
recip_rank      all 0.0239
P_10            all 0.0040
P_100           all 0.0036
P_1000          all 0.0141
recall_10       all 0.0018
recall_100      all 0.0137
recall_1000     all 0.5444
ndcg            all 0.1686
ndcg_cut_10     all 0.0044
ndcg_cut_100    all 0.0092
ndcg_cut_1000   all 0.1686

SCAI09PAt3a¶

summary (full)

map             all 0.0047
bpref           all 0.3369
recip_rank      all 0.0207
recall_100      all 0.0101
ndcg            all 0.1252

summary (small)

map             all 0.0042
bpref           all 0.4302
recip_rank      all 0.0119
P_10            all 0.0020
P_100           all 0.0029
P_1000          all 0.0112
recall_10       all 0.0006
recall_100      all 0.0115
recall_1000     all 0.4302
ndcg            all 0.1315
ndcg_cut_10     all 0.0017
ndcg_cut_100    all 0.0056
ndcg_cut_1000   all 0.1315

SCAI09PAf3a¶

summary (full)

map             all 0.0047
bpref           all 0.3380
recip_rank      all 0.0234
recall_100      all 0.0100
ndcg            all 0.1227

summary (small)

map             all 0.0055
bpref           all 0.4898
recip_rank      all 0.0193
P_10            all 0.0030
P_100           all 0.0034
P_1000          all 0.0127
recall_10       all 0.0013
recall_100      all 0.0114
recall_1000     all 0.4898
ndcg            all 0.1497
ndcg_cut_10     all 0.0036
ndcg_cut_100    all 0.0075
ndcg_cut_1000   all 0.1497

SCAI09PAt3b¶

summary (full)

map             all 0.0050
bpref           all 0.3514
recip_rank      all 0.0227
recall_100      all 0.0108
ndcg            all 0.1311

summary (small)

map             all 0.0049
bpref           all 0.4461
recip_rank      all 0.0272
P_10            all 0.0030
P_100           all 0.0039
P_1000          all 0.0116
recall_10       all 0.0009
recall_100      all 0.0152
recall_1000     all 0.4461
ndcg            all 0.1385
ndcg_cut_10     all 0.0038
ndcg_cut_100    all 0.0092
ndcg_cut_1000   all 0.1385

SCAI09PAf3b¶

summary (full)

map             all 0.0050
bpref           all 0.3536
recip_rank      all 0.0239
recall_100      all 0.0097
ndcg            all 0.1288

summary (small)

map             all 0.0054
bpref           all 0.5013
recip_rank      all 0.0217
P_10            all 0.0040
P_100           all 0.0039
P_1000          all 0.0130
recall_10       all 0.0009
recall_100      all 0.0115
recall_1000     all 0.5013
ndcg            all 0.1529
ndcg_cut_10     all 0.0036
ndcg_cut_100    all 0.0071
ndcg_cut_1000   all 0.1529

SCAI09PAt3c¶

summary (full)

map             all 0.0046
bpref           all 0.3290
recip_rank      all 0.0172
recall_100      all 0.0086
ndcg            all 0.1222

summary (small)

map             all 0.0040
bpref           all 0.3947
recip_rank      all 0.0114
P_10            all 0.0030
P_100           all 0.0028
P_1000          all 0.0104
recall_10       all 0.0006
recall_100      all 0.0114
recall_1000     all 0.3947
ndcg            all 0.1215
ndcg_cut_10     all 0.0020
ndcg_cut_100    all 0.0055
ndcg_cut_1000   all 0.1215

SCAI09PAf3c¶

summary (full)

map             all 0.0048
bpref           all 0.3367
recip_rank      all 0.0222
recall_100      all 0.0097
ndcg            all 0.1222

summary (small)

map             all 0.0049
bpref           all 0.4587
recip_rank      all 0.0170
P_10            all 0.0040
P_100           all 0.0031
P_1000          all 0.0119
recall_10       all 0.0018
recall_100      all 0.0103
recall_1000     all 0.4587
ndcg            all 0.1401
ndcg_cut_10     all 0.0031
ndcg_cut_100    all 0.0066
ndcg_cut_1000   all 0.1401

SCAI09PAt3d¶

summary (full)

map             all 0.0024
bpref           all 0.2105
recip_rank      all 0.0177
recall_100      all 0.0067
ndcg            all 0.0803

summary (small)

map             all 0.0026
bpref           all 0.2728
recip_rank      all 0.0145
P_10            all 0.0020
P_100           all 0.0026
P_1000          all 0.0069
recall_10       all 0.0010
recall_100      all 0.0119
recall_1000     all 0.2728
ndcg            all 0.0857
ndcg_cut_10     all 0.0021
ndcg_cut_100    all 0.0063
ndcg_cut_1000   all 0.0857

SCAI09PAf3d¶

summary (full)

map             all 0.0022
bpref           all 0.2035
recip_rank      all 0.0157
recall_100      all 0.0063
ndcg            all 0.0756

summary (small)

map             all 0.0027
bpref           all 0.3102
recip_rank      all 0.0236
P_10            all 0.0040
P_100           all 0.0023
P_1000          all 0.0077
recall_10       all 0.0017
recall_100      all 0.0070
recall_1000     all 0.3102
ndcg            all 0.0944
ndcg_cut_10     all 0.0042
ndcg_cut_100    all 0.0051
ndcg_cut_1000   all 0.0944

SCAI09PAt3e¶

summary (full)

map             all 0.0055
bpref           all 0.3726
recip_rank      all 0.0245
recall_100      all 0.0118
ndcg            all 0.1389

summary (small)

map             all 0.0048
bpref           all 0.4649
recip_rank      all 0.0145
P_10            all 0.0010
P_100           all 0.0038
P_1000          all 0.0120
recall_10       all 0.0002
recall_100      all 0.0151
recall_1000     all 0.4649
ndcg            all 0.1433
ndcg_cut_10     all 0.0014
ndcg_cut_100    all 0.0081
ndcg_cut_1000   all 0.1433

SCAI09PAf3e¶

summary (full)

map             all 0.0056
bpref           all 0.3811
recip_rank      all 0.0227
recall_100      all 0.0122
ndcg            all 0.1388

summary (small)

map             all 0.0054
bpref           all 0.5273
recip_rank      all 0.0088
P_10            all 0.0000
P_100           all 0.0030
P_1000          all 0.0136
recall_10       all 0.0000
recall_100      all 0.0127
recall_1000     all 0.5273
ndcg            all 0.1595
ndcg_cut_10     all 0.0000
ndcg_cut_100    all 0.0065
ndcg_cut_1000   all 0.1595

SCAI09PAt4a¶

summary (full)

map             all 0.0044
bpref           all 0.3166
recip_rank      all 0.0251
recall_100      all 0.0094
ndcg            all 0.1186

summary (small)

map             all 0.0044
bpref           all 0.4048
recip_rank      all 0.0280
P_10            all 0.0030
P_100           all 0.0029
P_1000          all 0.0105
recall_10       all 0.0008
recall_100      all 0.0074
recall_1000     all 0.4048
ndcg            all 0.1255
ndcg_cut_10     all 0.0050
ndcg_cut_100    all 0.0060
ndcg_cut_1000   all 0.1255

SCAI09PAf4a¶

summary (full)

map             all 0.0044
bpref           all 0.3181
recip_rank      all 0.0220
recall_100      all 0.0093
ndcg            all 0.1163

summary (small)

map             all 0.0043
bpref           all 0.4524
recip_rank      all 0.0081
P_10            all 0.0010
P_100           all 0.0026
P_1000          all 0.0117
recall_10       all 0.0004
recall_100      all 0.0073
recall_1000     all 0.4524
ndcg            all 0.1372
ndcg_cut_10     all 0.0007
ndcg_cut_100    all 0.0046
ndcg_cut_1000   all 0.1372

SCAI09PAt4c¶

summary (full)

map             all 0.0049
bpref           all 0.3440
recip_rank      all 0.0254
recall_100      all 0.0107
ndcg            all 0.1284

summary (small)

map             all 0.0048
bpref           all 0.4339
recip_rank      all 0.0265
P_10            all 0.0040
P_100           all 0.0033
P_1000          all 0.0113
recall_10       all 0.0015
recall_100      all 0.0131
recall_1000     all 0.4339
ndcg            all 0.1346
ndcg_cut_10     all 0.0046
ndcg_cut_100    all 0.0085
ndcg_cut_1000   all 0.1346

SCAI09PAf4c¶

summary (full)

map             all 0.0049
bpref           all 0.3485
recip_rank      all 0.0228
recall_100      all 0.0104
ndcg            all 0.1271

summary (small)

map             all 0.0055
bpref           all 0.4967
recip_rank      all 0.0235
P_10            all 0.0040
P_100           all 0.0036
P_1000          all 0.0127
recall_10       all 0.0009
recall_100      all 0.0140
recall_1000     all 0.4967
ndcg            all 0.1521
ndcg_cut_10     all 0.0042
ndcg_cut_100    all 0.0087
ndcg_cut_1000   all 0.1521

SCAI09PAt4b¶

summary (full)

map             all 0.0054
bpref           all 0.3666
recip_rank      all 0.0260
recall_100      all 0.0110
ndcg            all 0.1367

summary (small)

map             all 0.0049
bpref           all 0.4752
recip_rank      all 0.0108
P_10            all 0.0010
P_100           all 0.0038
P_1000          all 0.0123
recall_10       all 0.0007
recall_100      all 0.0114
recall_1000     all 0.4752
ndcg            all 0.1458
ndcg_cut_10     all 0.0008
ndcg_cut_100    all 0.0068
ndcg_cut_1000   all 0.1458

SCAI09PAf4b¶

summary (full)

map             all 0.0055
bpref           all 0.3734
recip_rank      all 0.0229
recall_100      all 0.0114
ndcg            all 0.1361

summary (small)

map             all 0.0056
bpref           all 0.5366
recip_rank      all 0.0098
P_10            all 0.0000
P_100           all 0.0035
P_1000          all 0.0140
recall_10       all 0.0000
recall_100      all 0.0105
recall_1000     all 0.5366
ndcg            all 0.1628
ndcg_cut_10     all 0.0000
ndcg_cut_100    all 0.0059
ndcg_cut_1000   all 0.1628

purduePA09r1¶

summary (small)

map             all 0.0654
bpref           all 0.4222
recip_rank      all 0.2468
P_10            all 0.1220
P_100           all 0.0572
P_1000          all 0.0112
recall_10       all 0.0595
recall_100      all 0.2298
recall_1000     all 0.4222
ndcg            all 0.2398
ndcg_cut_10     all 0.1278
ndcg_cut_100    all 0.1709
ndcg_cut_1000   all 0.2398

CMU09Chmtcd¶

summary (full)

map             all 0.0647
bpref           all 0.3605
recip_rank      all 0.4004
recall_100      all 0.1678
ndcg            all 0.2344

summary (small)

map             all 0.0517
bpref           all 0.3779
recip_rank      all 0.3002
P_10            all 0.1220
P_100           all 0.0465
P_1000          all 0.0110
recall_10       all 0.0455
recall_100      all 0.1631
recall_1000     all 0.3779
ndcg            all 0.2090
ndcg_cut_10     all 0.1247
ndcg_cut_100    all 0.1316
ndcg_cut_1000   all 0.2090

CMU09Chmtcdd¶

summary (full)

map             all 0.0975
bpref           all 0.4570
recip_rank      all 0.5129
recall_100      all 0.2326
ndcg            all 0.3091

summary (small)

map             all 0.0894
bpref           all 0.4999
recip_rank      all 0.3819
P_10            all 0.1820
P_100           all 0.0666
P_1000          all 0.0139
recall_10       all 0.0818
recall_100      all 0.2610
recall_1000     all 0.4999
ndcg            all 0.2972
ndcg_cut_10     all 0.1813
ndcg_cut_100    all 0.2096
ndcg_cut_1000   all 0.2972

purduePA09r2¶

summary (small)

map             all 0.0679
bpref           all 0.4236
recip_rank      all 0.2508
P_10            all 0.1240
P_100           all 0.0629
P_1000          all 0.0117
recall_10       all 0.0568
recall_100      all 0.2385
recall_1000     all 0.4236
ndcg            all 0.2476
ndcg_cut_10     all 0.1315
ndcg_cut_100    all 0.1808
ndcg_cut_1000   all 0.2476

UIowaS09PA2¶

summary (small)

map             all 0.0049
bpref           all 0.1457
recip_rank      all 0.0454
P_10            all 0.0160
P_100           all 0.0080
P_1000          all 0.0035
recall_10       all 0.0083
recall_100      all 0.0368
recall_1000     all 0.1457
ndcg            all 0.0616
ndcg_cut_10     all 0.0150
ndcg_cut_100    all 0.0243
ndcg_cut_1000   all 0.0616

UIowaS09PA3¶

summary (small)

map             all 0.0066
bpref           all 0.1092
recip_rank      all 0.0490
P_10            all 0.0190
P_100           all 0.0091
P_1000          all 0.0029
recall_10       all 0.0120
recall_100      all 0.0447
recall_1000     all 0.1092
ndcg            all 0.0542
ndcg_cut_10     all 0.0180
ndcg_cut_100    all 0.0299
ndcg_cut_1000   all 0.0542

BiTeM09PAbl¶

summary (full)

map             all 0.0672
bpref           all 0.4180
recip_rank      all 0.3413
recall_100      all 0.1818
ndcg            all 0.2643

summary (small)

map             all 0.0678
bpref           all 0.4982
recip_rank      all 0.2609
P_10            all 0.1410
P_100           all 0.0535
P_1000          all 0.0124
recall_10       all 0.0648
recall_100      all 0.2173
recall_1000     all 0.4982
ndcg            all 0.2630
ndcg_cut_10     all 0.1434
ndcg_cut_100    all 0.1692
ndcg_cut_1000   all 0.2630

BiTeM09PAcit¶

summary (full)

map             all 0.1798
bpref           all 0.6538
recip_rank      all 0.5226
recall_100      all 0.3294
ndcg            all 0.4148

summary (small)

map             all 0.1663
bpref           all 0.7416
recip_rank      all 0.4910
P_10            all 0.2730
P_100           all 0.1093
P_1000          all 0.0204
recall_10       all 0.1110
recall_100      all 0.4021
recall_1000     all 0.7416
ndcg            all 0.4325
ndcg_cut_10     all 0.2610
ndcg_cut_100    all 0.3114
ndcg_cut_1000   all 0.4325

BiTeM09PAcl¶

summary (full)

map             all 0.0490
bpref           all 0.3018
recip_rank      all 0.4080
recall_100      all 0.1375
ndcg            all 0.2089

summary (small)

map             all 0.0351
bpref           all 0.3336
recip_rank      all 0.2425
P_10            all 0.0950
P_100           all 0.0358
P_1000          all 0.0085
recall_10       all 0.0444
recall_100      all 0.1414
recall_1000     all 0.3336
ndcg            all 0.1785
ndcg_cut_10     all 0.1025
ndcg_cut_100    all 0.1103
ndcg_cut_1000   all 0.1785

BiTeM09PAqe¶

summary (full)

map             all 0.1823
bpref           all 0.6602
recip_rank      all 0.5236
recall_100      all 0.3335
ndcg            all 0.4192

summary (small)

map             all 0.1688
bpref           all 0.7432
recip_rank      all 0.5039
P_10            all 0.2730
P_100           all 0.1092
P_1000          all 0.0204
recall_10       all 0.1128
recall_100      all 0.4011
recall_1000     all 0.7432
ndcg            all 0.4357
ndcg_cut_10     all 0.2614
ndcg_cut_100    all 0.3132
ndcg_cut_1000   all 0.4357

BiTeM09PAcba¶

summary (full)

map             all 0.1835
bpref           all 0.6542
recip_rank      all 0.5328
recall_100      all 0.3375
ndcg            all 0.4192

summary (small)

map             all 0.1683
bpref           all 0.7415
recip_rank      all 0.5013
P_10            all 0.2730
P_100           all 0.1102
P_1000          all 0.0204
recall_10       all 0.1112
recall_100      all 0.4055
recall_1000     all 0.7415
ndcg            all 0.4359
ndcg_cut_10     all 0.2635
ndcg_cut_100    all 0.3163
ndcg_cut_1000   all 0.4359

BiTeM09PAcbb¶

summary (full)

map             all 0.1581
bpref           all 0.6502
recip_rank      all 0.5515
recall_100      all 0.3034
ndcg            all 0.4149

summary (small)

map             all 0.1345
bpref           all 0.7241
recip_rank      all 0.4133
P_10            all 0.2390
P_100           all 0.0940
P_1000          all 0.0200
recall_10       all 0.1038
recall_100      all 0.3666
recall_1000     all 0.7241
ndcg            all 0.4022
ndcg_cut_10     all 0.2204
ndcg_cut_100    all 0.2751
ndcg_cut_1000   all 0.4022

york09caPA01¶

summary (full)

map             all 0.0566
bpref           all 0.3385
recip_rank      all 0.3361
recall_100      all 0.1431
ndcg            all 0.2262

summary (small)

map             all 0.0180
bpref           all 0.1522
recip_rank      all 0.1120
P_10            all 0.0510
P_100           all 0.0217
P_1000          all 0.0062
recall_10       all 0.0104
recall_100      all 0.0552
recall_1000     all 0.1522
ndcg            all 0.0883
ndcg_cut_10     all 0.0536
ndcg_cut_100    all 0.0489
ndcg_cut_1000   all 0.0883

york09caPA03¶

summary (full)

map             all 0.0343
bpref           all 0.1978
recip_rank      all 0.2337
recall_100      all 0.0855
ndcg            all 0.1376

summary (small)

map             all 0.0160
bpref           all 0.1574
recip_rank      all 0.0976
P_10            all 0.0500
P_100           all 0.0189
P_1000          all 0.0056
recall_10       all 0.0097
recall_100      all 0.0480
recall_1000     all 0.1574
ndcg            all 0.0837
ndcg_cut_10     all 0.0512
ndcg_cut_100    all 0.0428
ndcg_cut_1000   all 0.0837