Skip to content

Runs - Question Answering 2005

afrun1

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: afrun1
  • Participant: macquarieu.molla
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

afrun2

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: afrun2
  • Participant: macquarieu.molla
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

apl05aug

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: apl05aug
  • Participant: jhu.mayfield
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

apl05w5

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: apl05w5
  • Participant: jhu.mayfield
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

asked05a

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: asked05a
  • Participant: tokyo-it.whittaker
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/21/2005
  • Task: main

asked05b

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: asked05b
  • Participant: tokyo-it.whittaker
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/23/2005
  • Task: main

asked05c

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: asked05c
  • Participant: tokyo-it.whittaker
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/24/2005
  • Task: main

ASUQA01

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ASUQA01
  • Participant: arizonau.roussinov
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

ASUQA02

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ASUQA02
  • Participant: arizonau.roussinov
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

clr05

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: clr05
  • Participant: clresearch.litkowski
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

clr05r1

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: clr05r1
  • Participant: clresearch.litkowski
  • Track: Question Answering
  • Year: 2005
  • Submission: 8/27/2005
  • Type: manual
  • Task: relationship
  • Run description: The description sections of the relationship topics were manually converted to a Boolean expression used to retrieve a document set for each question. The description section was then recast as a single question for each topic. The remainder of the task was then performed using a fully automatic question-answering system.

clr05r2

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: clr05r2
  • Participant: clresearch.litkowski
  • Track: Question Answering
  • Year: 2005
  • Submission: 8/27/2005
  • Type: manual
  • Task: relationship
  • Run description: The description sections of the relationship topics were manually converted to a Boolean expression used to retrieve a document set for each question. The description section was then recast as a single question for each topic. The remainder of the task was then performed using a fully automatic question-answering system.

CMUJAV2005

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: CMUJAV2005
  • Participant: cmu.nyberg
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

CMUJAVSEM

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: CMUJAVSEM
  • Participant: cmu.nyberg
  • Track: Question Answering
  • Year: 2005
  • Submission: 8/31/2005
  • Type: automatic
  • Task: relationship
  • Run description: No manual processing was done

CMUJAVSEMMAN

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: CMUJAVSEMMAN
  • Participant: cmu.nyberg
  • Track: Question Answering
  • Year: 2005
  • Submission: 9/1/2005
  • Type: manual
  • Task: relationship
  • Run description: Automatic shallow semantic parsing of input question text was replaced with hand-annotated shallow semantic parses. This was done to see how an increase in accuracy of shallow semantic analysis of input question text would affect overall system performance.

csail1

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: csail1
  • Participant: mit.katz
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

csail2

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: csail2
  • Participant: mit.katz
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

csail2005a

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: csail2005a
  • Participant: mit.katz
  • Track: Question Answering
  • Year: 2005
  • Submission: 8/31/2005
  • Type: automatic
  • Task: relationship
  • Run description: This is a fully automatic run, but the form won't let me submit without a description despite "automatic" being selected in the RUN TYPE above.

csail2005m

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: csail2005m
  • Participant: mit.katz
  • Track: Question Answering
  • Year: 2005
  • Submission: 8/31/2005
  • Type: manual
  • Task: relationship
  • Run description: Between automatic question processing and automatic answer finding, the processed questions were audited by a human whose task included * marking important words if they would not be considered important due to their position in the topic or due to IDF * marking phrases that should not be part of the search because they are already known that Bin Laden is in charge for 1, Iraq for 22 * removing parts of the question which do not contribute to its semantic content for a keyword-based query In particular the results were in all cases substrings of the automatically processed output, which were themselves substrings of the original topic.

csail3

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: csail3
  • Participant: mit.katz
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/29/2005
  • Task: main

Dal05m

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: Dal05m
  • Participant: dalhousieu.keselj
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

Dal05p

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: Dal05p
  • Participant: dalhousieu.keselj
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

Dal05s

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: Dal05s
  • Participant: dalhousieu.keselj
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

dggQA05

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: dggQA05
  • Participant: ucentralfla.glinos
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

dggQA05X

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: dggQA05X
  • Participant: ucentralfla.glinos
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

DLT05QA01

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: DLT05QA01
  • Participant: ulimerick
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/26/2005
  • Task: main

DLT05QA02

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: DLT05QA02
  • Participant: ulimerick
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/26/2005
  • Task: main

Edin2005a

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: Edin2005a
  • Participant: uedinburgh.dalmas
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

Edin2005b

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: Edin2005b
  • Participant: uedinburgh.dalmas
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

Edin2005c

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: Edin2005c
  • Participant: uedinburgh.dalmas
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

FDUQA14A

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: FDUQA14A
  • Participant: fudan.wu
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/26/2005
  • Task: main

FDUQA14B

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: FDUQA14B
  • Participant: fudan.wu
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/26/2005
  • Task: main

humQ05l

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: humQ05l
  • Participant: hummingbird.tomlinson
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/24/2005
  • Task: main

humQ05xl

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: humQ05xl
  • Participant: hummingbird.tomlinson
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/24/2005
  • Task: main

humQ05xle

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: humQ05xle
  • Participant: hummingbird.tomlinson
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/24/2005
  • Task: main

IBM05C3PD

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: IBM05C3PD
  • Participant: ibm.prager
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

IBM05L1P

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: IBM05L1P
  • Participant: ibm.prager
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

IBM05L3P

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: IBM05L3P
  • Participant: ibm.prager
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

ILQUA1

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ILQUA1
  • Participant: ualbany.min
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

ILQUA2

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ILQUA2
  • Participant: ualbany.min
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

ILQUA3

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ILQUA3
  • Participant: ualbany.min
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

Insun05QA1

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: Insun05QA1
  • Participant: hit.zhao
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

lcc05

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: lcc05
  • Participant: lcc.harabagiu
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

lcc05rel1

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: lcc05rel1
  • Participant: lcc.harabagiu
  • Track: Question Answering
  • Year: 2005
  • Submission: 8/31/2005
  • Type: manual
  • Task: relationship
  • Run description: Questions were extracted automatically from each topic. Coreferring nouns in questions were manually replaced with their antecedent (e.g. 'this increase' --> 'this increase in cooperation') or the longest coreferential noun phrase found in the topic (e.g. 'efforts' --> 'efforts made to discourage narco traffickers from using Bonaire as a transit point for drugs to the United States'). Questions containing conjoined NPs were manually split into separate questions, each involving a separate conjunct.

lcc05rel2

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: lcc05rel2
  • Participant: lcc.harabagiu
  • Track: Question Answering
  • Year: 2005
  • Submission: 8/31/2005
  • Type: manual
  • Task: relationship
  • Run description: Questions were extracted automatically from each topic. Coreferring nouns in questions were manually replaced with their antecedent (e.g. 'this increase' --> 'this increase in cooperation') or the longest coreferential noun phrase found in the topic (e.g. 'efforts' --> 'efforts made to discourage narco traffickers from using Bonaire as a transit point for drugs to the United States'). Questions containing conjoined NPs were manually split into separate questions, each involving a separate conjunct. Additional keywords were added automatically (i.e. all other words from topic that didn't match a predefined stop-word list).

lexiclone5

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: lexiclone5
  • Participant: lexiclone.geller
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/25/2005
  • Task: main

lexicloneB

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: lexicloneB
  • Participant: lexiclone.geller
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

MITRE2005A

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: MITRE2005A
  • Participant: mitre.burger
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

MITRE2005B

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: MITRE2005B
  • Participant: mitre.burger
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

MITRE2005C

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: MITRE2005C
  • Participant: mitre.burger
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

mk2005qar1

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: mk2005qar1
  • Participant: dfki-saarlandu.kaisser
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

mk2005qar2

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: mk2005qar2
  • Participant: dfki-saarlandu.kaisser
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

Mon05BIMP1

Participants | Input | Summary | Appendix

  • Run ID: Mon05BIMP1
  • Participant: monashu.zukerman
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/25/2005
  • Task: main

Mon05BIMP2

Participants | Input | Summary | Appendix

  • Run ID: Mon05BIMP2
  • Participant: monashu.zukerman
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/25/2005
  • Task: main

MSRCOMB05

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: MSRCOMB05
  • Participant: microsoft.brill
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/29/2005
  • Task: main

MSRTQA05

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: MSRTQA05
  • Participant: microsoft.brill
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/29/2005
  • Task: main

MSRWSQA05

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: MSRWSQA05
  • Participant: microsoft.brill
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/29/2005
  • Task: main

NUSCHUA1

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: NUSCHUA1
  • Participant: nus.sun
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/26/2005
  • Task: main

NUSCHUA2

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: NUSCHUA2
  • Participant: nus.sun
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/26/2005
  • Task: main

NUSCHUA3

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: NUSCHUA3
  • Participant: nus.sun
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/26/2005
  • Task: main

QACTIS05v1

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: QACTIS05v1
  • Participant: nsa.schone
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

QACTIS05v2

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: QACTIS05v2
  • Participant: nsa.schone
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

QACTIS05v3

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: QACTIS05v3
  • Participant: nsa.schone
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

sab05qa1b

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: sab05qa1b
  • Participant: sabir.buckley
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

SHEF05LC

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: SHEF05LC
  • Participant: usheffield.gaizauskas
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/26/2005
  • Task: main

shef05lmg

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: shef05lmg
  • Participant: usheffield.gaizauskas
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/26/2005
  • Task: main

SHEF05MC

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: SHEF05MC
  • Participant: usheffield.gaizauskas
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/26/2005
  • Task: main

SUNYSB05qa1

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: SUNYSB05qa1
  • Participant: suny.skiena
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/25/2005
  • Task: main

SUNYSB05qa2

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: SUNYSB05qa2
  • Participant: suny.skiena
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/26/2005
  • Task: main

SUNYSB05qa3

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: SUNYSB05qa3
  • Participant: suny.skiena
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

talpupc05a

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: talpupc05a
  • Participant: upc-talp.ferres
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

talpupc05b

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: talpupc05b
  • Participant: upc-talp.ferres
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

talpupc05c

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: talpupc05c
  • Participant: upc-talp.ferres
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

thuir051

Participants | Input | Summary | Appendix

  • Run ID: thuir051
  • Participant: tsinghua.ma
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/29/2005
  • Task: main

TWQA0501

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: TWQA0501
  • Participant: pekingu.yan
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

TWQA0502

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: TWQA0502
  • Participant: pekingu.yan
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

uams05all

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uams05all
  • Participant: uamsterdam.mueller
  • Track: Question Answering
  • Year: 2005
  • Submission: 8/27/2005
  • Task: main

uams05be3

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uams05be3
  • Participant: uamsterdam.mueller
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

uams05l

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uams05l
  • Participant: uamsterdam.mueller
  • Track: Question Answering
  • Year: 2005
  • Submission: 8/31/2005
  • Type: automatic
  • Task: relationship
  • Run description: automatic run, longer snippets

uams05rnk

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uams05rnk
  • Participant: uamsterdam.mueller
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/27/2005
  • Task: main

uams05s

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uams05s
  • Participant: uamsterdam.mueller
  • Track: Question Answering
  • Year: 2005
  • Submission: 8/31/2005
  • Type: automatic
  • Task: relationship
  • Run description: automatic run, shortened snippets

UIowa05QAR01

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: UIowa05QAR01
  • Participant: uiowa.eichmann
  • Track: Question Answering
  • Year: 2005
  • Submission: 9/1/2005
  • Type: manual
  • Task: relationship
  • Run description: The topic definition was manually transformed into a formal system query.

UIowaQA0501

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: UIowaQA0501
  • Participant: uiowa.eichmann
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

UIowaQA0502

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: UIowaQA0502
  • Participant: uiowa.eichmann
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

UIowaQA0503

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: UIowaQA0503
  • Participant: uiowa.eichmann
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

UNTQA0501

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: UNTQA0501
  • Participant: untexas.chen
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

UNTQA0502

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: UNTQA0502
  • Participant: untexas.chen
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main

UNTQA0503

Participants | Proceedings | Input | Summary | Appendix

  • Run ID: UNTQA0503
  • Participant: untexas.chen
  • Track: Question Answering
  • Year: 2005
  • Submission: 7/28/2005
  • Task: main