Runs - Session 2013¶

FixInt28.RL1¶

Run ID: FixInt28.RL1
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL1
MD5: f625b2894466b2138febac87df332374
Run description: Baseline system, using last year's methods.

FixInt28.RL2¶

Run ID: FixInt28.RL2
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL2
MD5: f79386e6a8441b36eff574ea1003eb83
Run description: Baseline system, using last year's methods.

FixInt28.RL3¶

Run ID: FixInt28.RL3
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL3
MD5: f79386e6a8441b36eff574ea1003eb83
Run description: Baseline system, using last year's methods.

FixInt28N.RL1¶

Run ID: FixInt28N.RL1
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL1
MD5: ab62f88ac27c5e2626b944ddf96fab2d
Run description: Baseline system with duplicate discounting, using last year's methods.

FixInt28N.RL2¶

Run ID: FixInt28N.RL2
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL2
MD5: 942b295ca475e5facbc9700ca7d422a8
Run description: Baseline system with duplicate discounting, using last year's methods.

FixInt28N.RL3¶

Run ID: FixInt28N.RL3
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL3
MD5: 942b295ca475e5facbc9700ca7d422a8
Run description: Baseline system with duplicate discounting, using last year's methods.

FixInt58.RL1¶

Run ID: FixInt58.RL1
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL1
MD5: 8d5a8db550b13e5ec3f0945d8f1f8db9
Run description: Last year's methods, tuned to optimize instance recall over the session.

FixInt58.RL2¶

Run ID: FixInt58.RL2
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL2
MD5: 377ddca4dee239d820b6ad4077a22106
Run description: Last year's methods, tuned to optimize instance recall over the session.

FixInt58.RL3¶

Run ID: FixInt58.RL3
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL3
MD5: 377ddca4dee239d820b6ad4077a22106
Run description: Last year's methods, tuned to optimize instance recall over the session.

FixInt58N.RL1¶

Run ID: FixInt58N.RL1
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL1
MD5: ec5bc8203a4eb2404c5ba73a1fbd7159
Run description: Last year's methods, tuned to optimize instance recall over the session. Then apply browsing novelty discount.

FixInt58N.RL2¶

Run ID: FixInt58N.RL2
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL2
MD5: 393d2148b96bfceac3b86c5ea865fab9
Run description: Last year's methods, tuned to optimize instance recall over the session. Then apply browsing novelty discount.

FixInt58N.RL3¶

Run ID: FixInt58N.RL3
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL3
MD5: 393d2148b96bfceac3b86c5ea865fab9
Run description: Last year's methods, tuned to optimize instance recall over the session. Then apply browsing novelty discount.

GUrun1.RL1¶

Run ID: GUrun1.RL1
Participant: GeorgetownYang
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL1
MD5: c43af64c37d5253875923af5a31191b0
Run description: Based on gurelax model. Georgetown University.

GUrun1.RL2¶

Run ID: GUrun1.RL2
Participant: GeorgetownYang
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL2
MD5: 1c8f7ed1d01db2d920462202f734218c
Run description: Based on Query Change Model (QCM). Georgetown University.

GUrun1.RL3¶

Run ID: GUrun1.RL3
Participant: GeorgetownYang
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL3
MD5: 9e8e07972feca4f4fc19c9dda5582a38
Run description: Based on Query Change Model (QCM). Georgetown University.

GUrun2.RL1¶

Run ID: GUrun2.RL1
Participant: GeorgetownYang
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL1
MD5: 832093b5aa0499bf5f83b1b843447644
Run description: Based on gurelax model. Georgetown University.

GUrun2.RL2¶

Run ID: GUrun2.RL2
Participant: GeorgetownYang
Track: Session
Year: 2013
Submission: 9/11/2013
Type: automatic
Task: RL2
MD5: 45ab527f7f89230a145e7777dde9f782
Run description: Based on Query Change Model (QCM). Georgetown University.

GUrun2.RL3¶

Run ID: GUrun2.RL3
Participant: GeorgetownYang
Track: Session
Year: 2013
Submission: 9/11/2013
Type: automatic
Task: RL3
MD5: 1760ddc5e6f0250cdf27b54d401fb209
Run description: Based on Query Change Model (QCM). Georgetown University.

GUrun3.RL1¶

Run ID: GUrun3.RL1
Participant: GeorgetownYang
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL1
MD5: ee63fadfc1400017ede1797cfd679822
Run description: Based on gurelax model. Georgetown University.

GUrun3.RL2¶

Run ID: GUrun3.RL2
Participant: GeorgetownYang
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL2
MD5: 7a5750e672d2f6c57c90fbd3451c2a1e
Run description: Based on Query Change Model (QCM). Georgetown University.

GUrun3.RL3¶

Run ID: GUrun3.RL3
Participant: GeorgetownYang
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL3
MD5: 7a750ab3adff3ed51f0fb284242a7b16
Run description: Based on Query Change Model (QCM). Georgetown University.

ICTNET13SER1.RL1¶

Run ID: ICTNET13SER1.RL1
Participant: ICTNET
Track: Session
Year: 2013
Submission: 9/8/2013
Type: automatic
Task: RL1
MD5: 81e19c5e695a3ffa91939e5a6abb4563
Run description: indri result

ICTNET13SER1.RL2¶

Run ID: ICTNET13SER1.RL2
Participant: ICTNET
Track: Session
Year: 2013
Submission: 9/8/2013
Type: automatic
Task: RL2
MD5: 23e799bd4d8575a77d70362c5cd85596
Run description: indri + rankSvm

ICTNET13SER1.RL3¶

Run ID: ICTNET13SER1.RL3
Participant: ICTNET
Track: Session
Year: 2013
Submission: 9/8/2013
Type: automatic
Task: RL3
MD5: b3df9870a40c80db743d2fe8c6596a0f
Run description: indri + query extension + rankSvm

ICTNET13SER2.RL1¶

Run ID: ICTNET13SER2.RL1
Participant: ICTNET
Track: Session
Year: 2013
Submission: 9/8/2013
Type: automatic
Task: RL1
MD5: ed3aca9eb1fcd566bfb1910ec19df1bc
Run description: indri + freeBase

ICTNET13SER2.RL2¶

Run ID: ICTNET13SER2.RL2
Participant: ICTNET
Track: Session
Year: 2013
Submission: 9/8/2013
Type: automatic
Task: RL2
MD5: 5ba83d0f4a3f7f75d7353c4c80ca087d
Run description: indri + freeBase + rankSvm

ICTNET13SER2.RL3¶

Run ID: ICTNET13SER2.RL3
Participant: ICTNET
Track: Session
Year: 2013
Submission: 9/8/2013
Type: automatic
Task: RL3
MD5: f46bb0b846888f8f43ce20226743667a
Run description: indri + query extension + freeBase + rankSvm

ICTNET13SER3.RL1¶

Run ID: ICTNET13SER3.RL1
Participant: ICTNET
Track: Session
Year: 2013
Submission: 9/9/2013
Type: automatic
Task: RL1
MD5: baee5099835141e04182067ff17249f5
Run description: indri + freebase

ICTNET13SER3.RL2¶

Run ID: ICTNET13SER3.RL2
Participant: ICTNET
Track: Session
Year: 2013
Submission: 9/9/2013
Type: automatic
Task: RL2
MD5: 66b7d34f4dd813f5edf3e5851c1bdf72
Run description: indri + query extension + freeBase + rankSvm + noveltyFilt

ICTNET13SER3.RL3¶

Run ID: ICTNET13SER3.RL3
Participant: ICTNET
Track: Session
Year: 2013
Submission: 9/9/2013
Type: automatic
Task: RL3
MD5: 71874e4b9a22d8caa9371e57d92fdd2a
Run description: indri + query extension + freeBase + rankSvm + noveltyFilt

KM1.RL1¶

Run ID: KM1.RL1
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL1
MD5: 7614fa338952fc544556e01a0d1030b9
Run description: KM1 matches the similarity of whole session knowledge and whole session information need.

KM1.RL2¶

Run ID: KM1.RL2
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL2
MD5: 7eec283b2285fc94e40ba200d88ed949
Run description: KM1 matches the similarity of whole session knowledge and whole session information need.

KM1.RL3¶

Run ID: KM1.RL3
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL3
MD5: 7eec283b2285fc94e40ba200d88ed949
Run description: KM1 matches the similarity of whole session knowledge and whole session information need.

KM1N.RL1¶

Run ID: KM1N.RL1
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL1
MD5: 0bba62b622b0c990254aa3c45b4affd4
Run description: KM1N matches the similarity of whole session knowledge and whole session information need and applies browsing novelty discount.

KM1N.RL2¶

Run ID: KM1N.RL2
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL2
MD5: d23c6d166e2197d94111fb4a6111fdd9
Run description: KM1N matches the similarity of whole session knowledge and whole session information need and applies browsing novelty discount.

KM1N.RL3¶

Run ID: KM1N.RL3
Participant: PITT
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL3
MD5: 0bba62b622b0c990254aa3c45b4affd4
Run description: KM1N matches the similarity of whole session knowledge and whole session information need and applies browsing novelty discount.

udelCombUD.RL1¶

Results | Participants | Input | Summary | Appendix

Run ID: udelCombUD.RL1
Participant: udel
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL1
MD5: 9e13c902b2f2cba816745b28fd8826a6
Run description: We use a simple ranking aggregation over the rankings of related queries. Related queries here are obtained using Bing

udelCombUD.RL2¶

Results | Participants | Input | Summary | Appendix

Run ID: udelCombUD.RL2
Participant: udel
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL2
MD5: 0903645e2aa28fda65cb24b82fc74167
Run description: We use a simple ranking aggregation over the rankings of related queries. Related queries here are obtained using Bing

udelCombUD.RL3¶

Results | Participants | Input | Summary | Appendix

Run ID: udelCombUD.RL3
Participant: udel
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL3
MD5: af5c17696dc8c1e6366169e77a30291a
Run description: We use a simple ranking aggregation over the rankings of related queries. Related queries here are obtained using Bing as well as using snippets as related queries. The difference between this and udelCombUD.RL2 is that in udelCombUD.RL2 we consider snippets and related queries of each session, but here in .RL3 we also use snippets and queries of other sessions that belong to the same topic.

UDVirtualCmb.RL1¶

Results | Participants | Input | Summary | Appendix

Run ID: UDVirtualCmb.RL1
Participant: udel
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL1
MD5: 6343ca99924e0aee26467b4086ac0801
Run description: For the RL1 of this run, we use a simple ranking aggregation over the rankings of related queries. Related queries here are obtained using Bing.

UDVirtualCmb.RL2¶

Results | Participants | Input | Summary | Appendix

Run ID: UDVirtualCmb.RL2
Participant: udel
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL2
MD5: 3777f9e891b4ae79f676dbbedfffec00
Run description: For the RL2 of this run, we rerank our UDVirtualCmb.RL1 results by increasing the score of documents that are the most similar to our "model documents". These model documents are obtained by concatenating the content of snippets from different interactions of the same session.

UDVirtualCmb.RL3¶

Results | Participants | Input | Summary | Appendix

Run ID: UDVirtualCmb.RL3
Participant: udel
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL3
MD5: de7eb1fb017ae1e09cef59a14316f271
Run description: For the RL3 of this run, we rerank our UDVirtualCmb.RL1 results by increasing the score of documents that are the most similar to our "model documents". These model documents are obtained by concatenating the content of snippets from different interactions of the same TOPIC (not just a session).

UDVirtualLM.RL1¶

Results | Participants | Input | Summary | Appendix

Run ID: UDVirtualLM.RL1
Participant: udel
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL1
MD5: 01204baa983c89e74be57b9fb7d8d34f
Run description: For the RL1 of this run, we use a simple Indri Language Model.

UDVirtualLM.RL2¶

Results | Participants | Input | Summary | Appendix

Run ID: UDVirtualLM.RL2
Participant: udel
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL2
MD5: 6e2c586e8251f27a16d454e216efcb35
Run description: For the RL2 of this run, we rerank our UDVirtualLM.RL1 results by increasing the score of documents that are the most similar to our "model documents". These model documents are obtained by concatenating the content of snippets from different interactions of the same session.

UDVirtualLM.RL3¶

Results | Participants | Input | Summary | Appendix

Run ID: UDVirtualLM.RL3
Participant: udel
Track: Session
Year: 2013
Submission: 9/10/2013
Type: automatic
Task: RL3
MD5: f648b4a96fe1c78ac3cd47aeac61ff75
Run description: For the RL3 of this run, we rerank our UDVirtualLM.RL1 results by increasing the score of documents that are the most similar to our "model documents". These model documents are obtained by concatenating the content of snippets from different interactions of the same TOPIC (not just a session).

wdtiger1.RL1¶

Results | Participants | Input | Summary | Appendix

Run ID: wdtiger1.RL1
Participant: PRIS
Track: Session
Year: 2013
Submission: 9/8/2013
Type: manual
Task: RL1
MD5: 463f0aa0ce9e9f8b9cacf4870ff37c1b
Run description: We didn't use any additional resources beyond the collection.

wdtiger1.RL2¶

Results | Participants | Input | Summary | Appendix

Run ID: wdtiger1.RL2
Participant: PRIS
Track: Session
Year: 2013
Submission: 9/8/2013
Type: manual
Task: RL2
MD5: 5ee03dd64a0aa5246f91e7968bc952e8
Run description: We didn't use any additional resources beyond the collection.

wdtiger1.RL3¶

Results | Participants | Input | Summary | Appendix

Run ID: wdtiger1.RL3
Participant: PRIS
Track: Session
Year: 2013
Submission: 9/8/2013
Type: manual
Task: RL3
MD5: bd02867ab9e3d7f506239c23d4fd289f
Run description: We didn't use any additional resources beyond the collection.

wdtiger2.RL1¶

Results | Participants | Input | Summary | Appendix

Run ID: wdtiger2.RL1
Participant: PRIS
Track: Session
Year: 2013
Submission: 9/8/2013
Type: manual
Task: RL1
MD5: c7a4de73cd721a9784903bcd3ae8bb81
Run description: We didn't use any additional resources beyond the collection.

wdtiger2.RL2¶

Results | Participants | Input | Summary | Appendix

Run ID: wdtiger2.RL2
Participant: PRIS
Track: Session
Year: 2013
Submission: 9/8/2013
Type: manual
Task: RL2
MD5: 62ea3cc331ff6c9d39736723d274d9e7
Run description: We didn't use any additional resources beyond the collection.

wdtiger2.RL3¶

Results | Participants | Input | Summary | Appendix

Run ID: wdtiger2.RL3
Participant: PRIS
Track: Session
Year: 2013
Submission: 9/8/2013
Type: manual
Task: RL3
MD5: 6895f36de1b3b6261bc018753fa59bbe
Run description: We didn't use any additional resources beyond the collection.

webisS1.RL1¶

Run ID: webisS1.RL1
Participant: webis
Track: Session
Year: 2013
Submission: 8/30/2013
Type: automatic
Task: RL1
MD5: 74639a778213e8baaaf7d030b899f9f1
Run description: indri; segmentation: stein2012q-hybrid-ir-none-stein11e

webisS1.RL2¶

Run ID: webisS1.RL2
Participant: webis
Track: Session
Year: 2013
Submission: 8/30/2013
Type: automatic
Task: RL2
MD5: 18ce6d80263dae9ff100844790939e1f
Run description: indri; segmentation: stein2012q-hybrid-ir-none-stein11e query expansion w/ frequent phrase extraction from same session result diversification

webisS1.RL3¶

Run ID: webisS1.RL3
Participant: webis
Track: Session
Year: 2013
Submission: 8/30/2013
Type: automatic
Task: RL3
MD5: b87f2a2dfd69e0bc089614f851afac62
Run description: indri; segmentation: stein2012q-hybrid-ir-none-stein11e query expansion w/ frequent phrase extraction from similar sessions result diversification from similar sessions

webisS2.RL1¶

Run ID: webisS2.RL1
Participant: webis
Track: Session
Year: 2013
Submission: 8/30/2013
Type: automatic
Task: RL1
MD5: 4042a022f3e009100fa28b38ce21c17e
Run description: indri; segmentation: stein2012q-hybrid-acc PRF from webisS1.RL1

webisS2.RL2¶

Run ID: webisS2.RL2
Participant: webis
Track: Session
Year: 2013
Submission: 8/30/2013
Type: automatic
Task: RL2
MD5: 87a2a71d25d2182904c85dcd9e57e1ef
Run description: indri; segmentation: stein2012q-hybrid-acc PRF from webisS1.RL1 query expansion from same session; using only final clicks

webisS2.RL3¶

Run ID: webisS2.RL3
Participant: webis
Track: Session
Year: 2013
Submission: 8/30/2013
Type: automatic
Task: RL3
MD5: 17a276f58232d8f61e6892af5933bfe9
Run description: indri; segmentation: stein2012q-hybrid-acc PRF from webisS1.RL1 query expansion from similar sessions; using only final clicks

webisS3.RL1¶

Run ID: webisS3.RL1
Participant: webis
Track: Session
Year: 2013
Submission: 8/30/2013
Type: automatic
Task: RL1
MD5: 20ffcfa62b284a3249413ca445726e19
Run description: indri; segmentation: stein2010j-naive

webisS3.RL2¶

Run ID: webisS3.RL2
Participant: webis
Track: Session
Year: 2013
Submission: 8/30/2013
Type: automatic
Task: RL2
MD5: 026a3f5fe3ac1f472be787aa46e82c5a
Run description: indri; segmentation: stein2010j-naive result list expansion with clicks from same session

webisS3.RL3¶

Run ID: webisS3.RL3
Participant: webis
Track: Session
Year: 2013
Submission: 8/30/2013
Type: automatic
Task: RL3
MD5: c01402eea3eaae421a5321fc812ad43b
Run description: indri; segmentation: stein2010j-naive result list expansion with clicks from similar sessions