Skip to content

Runs - Medical 2012

AEHRClvl0

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: AEHRClvl0
  • Participant: AEHRC
  • Track: Medical
  • Year: 2012
  • Submission: 8/5/2012
  • Type: automatic
  • Task: main
  • MD5: 19042f7231165e1623d1bc6c0a7c8641
  • Run description: Graph-based inference model - level 0.

AEHRClvl1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: AEHRClvl1
  • Participant: AEHRC
  • Track: Medical
  • Year: 2012
  • Submission: 8/5/2012
  • Type: automatic
  • Task: main
  • MD5: 5dcdb0b1dc8f744c2abb4b927d35bcfe
  • Run description: Graph-based inference model - level 1.

AEHRClvl2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: AEHRClvl2
  • Participant: AEHRC
  • Track: Medical
  • Year: 2012
  • Submission: 8/5/2012
  • Type: automatic
  • Task: main
  • MD5: d34165fb8485dbed6713d8197bba4ed2
  • Run description: Graph-based inference model - level 2.

AEHRCsub

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: AEHRCsub
  • Participant: AEHRC
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 65a5e1e438a4c843ba673ea7fa8a15a0
  • Run description: AEHRC run based on concepts and subsumptions (SNOMED CT).

APRel1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: APRel1
  • Participant: RMIT
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 3d4601e3a3256763bc4779423a514e9e
  • Run description: This run uses negex algorithm to spot negated concepts before the indexing stage and extends icd codes in the documents. It is mainly based on pseudo relevance feedback, and exploits an automatically generated list of relevant documents in the collection that have icd codes from the queries. Combined with Rocchio for query expansion using BO1 model from terrier open source search engine.

APRel2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: APRel2
  • Participant: RMIT
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 54695b2b5820ffad4427d083e45ff814
  • Run description: Thir run is mostly similar to RMIT's first run with a difference in the way pseudo relevant documents were gathered. In this run we use two most relevant ICD codes for each query as evidence to mark relevant documents. Ranking Model used is PL2 model for retrieval and BO1 for query expansion from Terrier's open source search engine.

atigeo0

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: atigeo0
  • Participant: xMusketeers
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 34aa474fe5e0cf9287f5cd92f7c2a62d
  • Run description: Baseline system with no ICD9 code descriptions

atigeo1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: atigeo1
  • Participant: xMusketeers
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 4372205201bd2d97dfb5fb792ea1b97e
  • Run description: Baseline system with minimal ICD9 code descriptions

atigeo2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: atigeo2
  • Participant: xMusketeers
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: fee9b52bbb0c12a6a3a014d8b4be8500
  • Run description: Baseline system with moderate ICD9 code descriptions

atigeo3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: atigeo3
  • Participant: xMusketeers
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 3236d4395135451bbb398407c92120b0
  • Run description: Baseline system with maximum ICD9 code descriptions

BMIUOUbase

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: BMIUOUbase
  • Participant: BMIUOU
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: fc61cf3d80ebb1cade9a4199403d4720
  • Run description: Use Lucene for query without expansion.

BMIUOUens

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: BMIUOUens
  • Participant: BMIUOU
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 3d3da4a85da4e10f4c1873b12a07db97
  • Run description: Based on Lucene, we do query expansion combining 3 methods synonym expansion, predication expansion, and relation expansion using UMLS. Both expanded and non-expanded words are weighted by idf.

BMIUOUensneg

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: BMIUOUensneg
  • Participant: BMIUOU
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 6fccffbeb2aee34b53deffe5e5928963
  • Run description: Based on Lucene, we do query expansion combining 3 methods synonym expansion, predication expansion, and relation expansion using UMLS. Both expanded and non-expanded words are weighted by idf. We reduced weight for documents that have negation term.

BMIUOUsyn

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: BMIUOUsyn
  • Participant: BMIUOU
  • Track: Medical
  • Year: 2012
  • Submission: 8/7/2012
  • Type: automatic
  • Task: main
  • MD5: 5fb8e94616af88c1cd50b576348053c7
  • Run description: This method used a query expansion based on UMLS and the Lucene search engine. We weight non-expanded words according to idf in the corpus.

buptprisBase

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: buptprisBase
  • Participant: PRIS
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 86049d42abc2294b2206448140f725f7
  • Run description: A baseline using Lucene,with query expanded by several tools including MetaMap,UMLS Metathesaurus and SNOMED,and ICD9 information mining.The weight of each indexed field is defined by personal experiences.Result scores computed with lucene retrival scores.

buptprisCscr

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: buptprisCscr
  • Participant: PRIS
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: b592b5700e27677324cbaf855987bd9c
  • Run description: The buptprisCscore run considers "contents" field exclusively when getting the final score of each returned visit.With intersection algorithm and few-result-deal algorithm the same as buptprisInt.

buptprisInt

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: buptprisInt
  • Participant: PRIS
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 6d8cb14948b0352aca4d082ad9d201b0
  • Run description: To make improvement to buptpris_Base,this run split a query into several subquerys,and compute the intersection of their retrival results.At the same time,this run include a algorithm to deal with the topics returning few results.

buptprisLrnk

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: buptprisLrnk
  • Participant: PRIS
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 7aabaae3296544267d3dea80797a73ba
  • Run description: A try to improve the ranking with learning to rank algorithm on the basis of buptpris_Int run.

DCU21

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: DCU21
  • Participant: DCU
  • Track: Medical
  • Year: 2012
  • Submission: 8/1/2012
  • Type: automatic
  • Task: main
  • MD5: ebc5858309265edceeb507430d51b9a2
  • Run description: standard BM25 with default parameters

DCU22

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: DCU22
  • Participant: DCU
  • Track: Medical
  • Year: 2012
  • Submission: 8/1/2012
  • Type: automatic
  • Task: main
  • MD5: 432098e9bb582d3c563bc6533d794e1a
  • Run description: standard BM25 with default parameters, PRF with 10 docs, 10 terms, filtering

DCU23b

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: DCU23b
  • Participant: DCU
  • Track: Medical
  • Year: 2012
  • Submission: 8/1/2012
  • Type: automatic
  • Task: main
  • MD5: f31dd0f8eb61f5b1441fe0778e1fa154
  • Run description: standard BM25 with default parameters on concept-expanded query

DCU24b

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: DCU24b
  • Participant: DCU
  • Track: Medical
  • Year: 2012
  • Submission: 8/1/2012
  • Type: automatic
  • Task: main
  • MD5: 231dd72ffdb2d8cc4ebbc186ac93c013
  • Run description: standard BM25 with default parameters on concept-expanded query, query expansion using 10 terms, 10 docs, filtering

EssieAuto

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: EssieAuto
  • Participant: NLM
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 638f7722d9a9ed6a5e262088697bbae3
  • Run description: Essie search using frames over positive sections padded with lossy expansion

GE4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: GE4
  • Participant: RMIT
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 522e349225ca8ae31e3bb65fd7268f29
  • Run description: This run uses negex algorithm to spot negated concepts before the indexing stage and extends icd codes in the documents. Using 2 external knowledge sources, namely: UMLS and Dbpedia it expands the extracted concepts from the metamap output and based on the reliability of the semantic types (previsouly trained) from the UMLS, it selects the best candidates for expansion.

ikmlab

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ikmlab
  • Participant: IKMLAB
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 34223ed8f516c7a1d7b2fbc17c03f5ad
  • Run description: We used the UMLS concept to expansion topics

ikmlab2

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ikmlab2
  • Participant: IKMLAB
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: ed77b80ea254476e3e31b6621e4d8443
  • Run description: UMLS concept and bigram used

LSIS1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: LSIS1
  • Participant: LSIS
  • Track: Medical
  • Year: 2012
  • Submission: 8/7/2012
  • Type: automatic
  • Task: main
  • MD5: 3e86967f890051f8679040e57e2e1c20
  • Run description: This run uses MetaMap for medical corpus conceptualization with added best concept strategy, after that the model In_expc2 based on DFR is used for matching the documents and the conceptualized queries by MetaMap with added best concept strategy and expanded using Bo1 model.

LSIS2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: LSIS2
  • Participant: LSIS
  • Track: Medical
  • Year: 2012
  • Submission: 8/7/2012
  • Type: automatic
  • Task: main
  • MD5: 77dfe50107d0ded8a7716afeb7f2660c
  • Run description: This run uses MetaMap for medical corpus conceptualization with added best concept strategy, after that the model In_expc2 based on DFR is used for matching the documents and the expanded queries using Bo1 model.

LSIS3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: LSIS3
  • Participant: LSIS
  • Track: Medical
  • Year: 2012
  • Submission: 8/7/2012
  • Type: automatic
  • Task: main
  • MD5: 8bcee7a63143cd4f261eeddc08e05986
  • Run description: This run uses the original medical corpus, the model In_expc2 based on DFR is used for matching the documents and the expanded queries using Bo1 model.

MayoExpanded

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MayoExpanded
  • Participant: MayoClinicNLP
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 34446a19e94492d3395548d22ee4affe
  • Run description: Queries in this run are expanded via the UMLS and via k-Nearest Neighbor random-indexed semantic vectors (which are trained on millions of Mayo Clinic notes). Query terms are weighted based on the number of synonyms containing that term.

MayoLucene

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MayoLucene
  • Participant: MayoClinicNLP
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: fcfa2a94e0c06d1349434666dca3d766
  • Run description: A baseline system using Apache Lucene.

MayoMetaData

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MayoMetaData
  • Participant: MayoClinicNLP
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: fd94fa57e7a08092efed9c15a245368e
  • Run description: An automatic run using Apache Lucene, testing the value of structured data in information retrieval. Metadata (including ICD-9 codes from admit and discharge diagnoses) are additionally converted into text and searched.

MayoPayload

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MayoPayload
  • Participant: MayoClinicNLP
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 6e65158bf617d2f25d7f9e4fe3b5c7da
  • Run description: An automatic run using Apache Lucene, testing the value of using traditional NLP/Information Extraction output in clinical information retrieval. Specifically, Mayo Clinic's MedTagger pipeline was used to process the reports, and these results were stored in a Lucene index via payloads.

NICTAUBC1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: NICTAUBC1
  • Participant: NICTA
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 57dda8902954aa873ed9ca916e556f67
  • Run description: This system is based in the combination of two expansion techniques: graph-based concept similarity ranking, and hand-crafted rules based on semantic types and DBpedia. The query is first parsed with MetaMap and Negex, and the Personalised Pagerank technique is used to obtain a ranking of concepts related to the original query. The query is further expanded by adding DBpedia terms that are related to the target concepts (and fall under a list of predefined UMLS semantic types).

NICTAUBC2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: NICTAUBC2
  • Participant: NICTA
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: e9e3672c21f04049617a289d3e1cf9ac
  • Run description: A variant of NICTAUBC1, in this case the DBpedia expansion occurs both before and after the Pagerank process. The indexing and the pagerank thesholds change slightly (reports and no stemming for the indexing; threshold of 4 pagerank expansion terms per query).

NICTAUBC4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: NICTAUBC4
  • Participant: NICTA
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 090f7eb7c15ed23f50ddb0652a9f1839
  • Run description: A variant of NICTAUBC1, in this case the Personalised Pagerank expansion is omitted, and the expansion terms are obtained from DBpedia.

NICTAUBC6

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: NICTAUBC6
  • Participant: NICTA
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 8668836b4a275a41ccc92cf27b057965
  • Run description: This system is a variant of BCUNICTA1, and the main difference is the sequence of application of the expansion techniques. First the initial query is expanded using DBpedia and UMLS, and then the Personalised Pagerank process is executed to add further concepts.

NLMLuceneExp

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: NLMLuceneExp
  • Participant: NLM
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: e8d9b4fff62e3510e9926fc47b4039ac
  • Run description: NLMLuceneExp - It uses as well the PICO frames to identify relevant search terms and to do expansion of drugs and procedures. Resources---Wikipedia and Google search

NLMLuceneSec

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: NLMLuceneSec
  • Participant: NLM
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: c96d4e428c73fb9c3ed212359af00b7d
  • Run description: NLMLuceneSec - It uses as well the PICO frames to identify relevant search terms and to do expansion of drugs and procedures. Search terms are weighted according to the section of the report in which they appear. Resources---Wikipedia and Google

NLMManual

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: NLMManual
  • Participant: NLM
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: manual
  • Task: main
  • MD5: 4e039ed68707734eafa2b1a5cea10154
  • Run description: Interactively refined queries padded with an automatic run based on frames search over positive text in sections

OHSUCEtICD

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: OHSUCEtICD
  • Participant: OHSU
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 9158f6080e940a69670b4d26fb8efe95
  • Run description: Automatically-generated queries, using both topic words as well as MetaMap preferred terms, along with alternate terms derived from MeSH, as well as automatically-assigned ICD codes.

OHSUCombET

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: OHSUCombET
  • Participant: OHSU
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: c9ac27a1dd36b63afde04b456966fc27
  • Run description: Automatically-generated queries, using both topic words as well as MetaMap preferred terms, along with alternate terms derived from MeSH.

OHSUCombICD

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: OHSUCombICD
  • Participant: OHSU
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 780d3e9d50bbcc1fb9255857db8a00f8
  • Run description: Automatically-generated queries, using both topic words as well as MetaMap preferred terms, along with automatically-assigned ICD codes.

ohsuManBool

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ohsuManBool
  • Participant: OHSU
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: manual
  • Task: main
  • MD5: a15c04a2cdfa364adbd6b85802921e2a
  • Run description: Manually-generated query using Boolean features of search system, as well as ICD code filters.

quta

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: quta
  • Participant: qutir12
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 3fff8ebc0245918e390054d48bf07079
  • Run description: No external data used in this run Topsig run, 32768-bit signatures, using term stats SPLIT-TYPE = hard SPLIT-MAX = 200 TOPIC-OUTPUT-K = 1000 PSEUDO-FEEDBACK-SAMPLE = 0

qutb

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: qutb
  • Participant: qutir12
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 98be81f725ca68704c1d02238ec90876
  • Run description: Topsig run, 32768-bit signatures, using term stats SPLIT-TYPE = hard SPLIT-MAX = 200 TOPIC-OUTPUT-K = 1000 PSEUDO-FEEDBACK-SAMPLE = 0 Using snomed-ct to perform query culling. Terms or groups of terms that are not descriptions in snomed-ct are removed from the queries automatically.

qutc

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: qutc
  • Participant: qutir12
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: c7d537106cab10c8d651ba1e132fceaa
  • Run description: Topsig run, 32768-bit signatures, using term stats SPLIT-TYPE = hard SPLIT-MAX = 200 TOPIC-OUTPUT-K = 1000 PSEUDO-FEEDBACK-SAMPLE = 0 Using snomed-ct to perform query culling. Terms or groups of terms that are not descriptions in snomed-ct are removed from the queries automatically. Using improved term stats file (in comparison to runs quta and qutb)

RAPRel2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: RAPRel2
  • Participant: RMIT
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 52771aeb9c0655f57f24ba0214f12d8c
  • Run description: This run has the same settings as run-1 however, we use a different technique to create a pseudo relevance qrel to improve our pseudo relevance feedback method. Relevant documents are ranked based on their calculted Idf, taking all ICD codes for each document as terms in the documents. Top 10 documents are selected for each query and used as relevance feedback. This run aims to remove the noise potentially added by our first method.

sennamed1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: sennamed1
  • Participant: sennamed
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: ddbe794c9cfd261002b9a2b5e4cce74d
  • Run description: metamap umls concepts + indri language model + (blind) relevance feedback

sennamed2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: sennamed2
  • Participant: sennamed
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 514f2ae80a8742c4d0620773c1fab4e7
  • Run description: metamap umls concepts + simple tfidf distances + (blind) relevance feedback

sennamed3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: sennamed3
  • Participant: sennamed
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: 2efb601a32a7ab4e9a4aa1632828303a
  • Run description: metamap umls concepts + lemur-based tfidf

sennamedlsi

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: sennamedlsi
  • Participant: sennamed
  • Track: Medical
  • Year: 2012
  • Submission: 8/9/2012
  • Type: automatic
  • Task: main
  • MD5: dff41aa3eed16dfc23bec4cbbc848b86
  • Run description: metamap umls concept extraction + LSI

Siena1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: Siena1
  • Participant: SCIAITeam
  • Track: Medical
  • Year: 2012
  • Submission: 8/6/2012
  • Type: automatic
  • Task: main
  • MD5: 27906149be25eed24011b7835eadc46a
  • Run description: Lucene Negation Tagger Stanford Post Tagger ICD Codes

Siena2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: Siena2
  • Participant: SCIAITeam
  • Track: Medical
  • Year: 2012
  • Submission: 8/6/2012
  • Type: automatic
  • Task: main
  • MD5: 3d726b6ff761a031c8ff66d53153a8b0
  • Run description: Lucene Negation Tagger Stanford Post Tagger ICD Codes UMLS Expansion

Siena3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: Siena3
  • Participant: SCIAITeam
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: manual
  • Task: main
  • MD5: fb136d7c37587f989f536f6f98d05f69
  • Run description: Matrix Run Had to remove lines after printed out.

SNUBME1

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SNUBME1
  • Participant: SNU_BME
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 108e33a5c122f31564e2414270f711e8
  • Run description: run Indri with language model(dirichlet)

SNUBME2

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SNUBME2
  • Participant: SNU_BME
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 9196a871275c007f653970af0f404adb
  • Run description: Indri(run method---two_default) no external resources.

SNUBME3

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SNUBME3
  • Participant: SNU_BME
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 679fde53064c8c5d2aa9d8938d4280ae
  • Run description: Run Indri with dirichlet method. Add MetaMap score to the result above. external resources : MetaMap

SNUBME4

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SNUBME4
  • Participant: SNU_BME
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: manual
  • Task: main
  • MD5: c7a9b8afbb6f1cb825807ccb3b86bb5e
  • Run description: manually added query weights. run using Indri with Two-staging

UCDCSI1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCDCSI1
  • Participant: UCD_CSI
  • Track: Medical
  • Year: 2012
  • Submission: 8/2/2012
  • Type: manual
  • Task: main
  • MD5: 4098cef62073c6bb1b4613a841ffe1cc
  • Run description: A run using MeSH based expansions, Indri's structured query language to specify demographic information such as ages and Concept Re-Ranking.

UCDCSI2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCDCSI2
  • Participant: UCD_CSI
  • Track: Medical
  • Year: 2012
  • Submission: 8/2/2012
  • Type: manual
  • Task: main
  • MD5: aa05d74bcb9747081d842e176ebbef7f
  • Run description: A run using MeSH based expansions, Indri's structured query language to specify demographic information such as ages and Concept Re-Ranking. Furthermore it uses field-based retrieval in order to utilise more specific information regarding medical conditions namely determining the experiencer and whether or not it occurred in the past.

UCDCSI3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCDCSI3
  • Participant: UCD_CSI
  • Track: Medical
  • Year: 2012
  • Submission: 8/2/2012
  • Type: automatic
  • Task: main
  • MD5: 1c737e595b3f176dca185ba6e65505f1
  • Run description: An automatic run using MeSH based expansions, Indri's structured query language to specify demographic information such as ages and Concept Re-Ranking.

UCDCSI4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCDCSI4
  • Participant: UCD_CSI
  • Track: Medical
  • Year: 2012
  • Submission: 8/2/2012
  • Type: automatic
  • Task: main
  • MD5: 8898c2e26a7e7be93d6225d51ad1163b
  • Run description: An automatic run using expansions from the Freebase graph, Indri's structured query language to specify demographic information such as ages and Concept Re-Ranking.

ucm1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ucm1
  • Participant: NIL_UCM
  • Track: Medical
  • Year: 2012
  • Submission: 8/7/2012
  • Type: automatic
  • Task: main
  • MD5: 800cc4f5fd52c12a689b0ee3a5bf16a5
  • Run description: Lucene, basic analyzer, process by report, score per visit compute as the sum of scores per report associated to visit, hitsPerPage = 100

ucm3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ucm3
  • Participant: NIL_UCM
  • Track: Medical
  • Year: 2012
  • Submission: 8/7/2012
  • Type: automatic
  • Task: main
  • MD5: 9e19f5a93c57f2f34da4d97a2ee64d84
  • Run description: Lucene, basic analyzer, process by report, score per visit compute as the sum of scores per report associated to visit, hitsPerPage = 1000

ucm4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ucm4
  • Participant: NIL_UCM
  • Track: Medical
  • Year: 2012
  • Submission: 8/7/2012
  • Type: automatic
  • Task: main
  • MD5: 6b2e6c612e71d2d52f907a25ebff104f
  • Run description: Lucene, basic analyzer, process by report, score per visit compute as the best score per report associated to visit, hitsPerPage = 1000

ucm5

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ucm5
  • Participant: NIL_UCM
  • Track: Medical
  • Year: 2012
  • Submission: 8/7/2012
  • Type: automatic
  • Task: main
  • MD5: 4e3e60feccddc9318e352dbd4d13e960
  • Run description: Lucene, basic analyzer, process by report, score per visit compute as the best score per report associated to visit, hitsPerPage = 1000, index only with reports with visit not NULL

udelMED

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: udelMED
  • Participant: udel
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 821ef9ed8be6bb18f85357a4e6235245
  • Run description: Less advanced IR language models using external expansions. External expansion collections include ClueWeb09 CatB dataset, 07 Genomics Track dataset, and 2012 MESH Terms.

udelMNZ

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: udelMNZ
  • Participant: udel
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: e2cce9352220fcaee6ae41c5873858bc
  • Run description: Method: advanced IR statistical model with external expansion External Collections: ClueWeb09 Cat.B, 2007 Genomics Track dataset, MESH 2012

udelMRF

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: udelMRF
  • Participant: udel
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: d467b4d001a2ccd4a756886c12ea4e55
  • Run description: Advanced IR language models using external expansions. External expansion collections include ClueWeb09 CatB dataset and 07 Genomics Track dataset.

udelSUM

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: udelSUM
  • Participant: udel
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 9a52776d62d70644e31aa4dd5b6fad1b
  • Run description: Advanced IR language models using external expansions. Expansion collections include ClueWeb09 CatB dataset, 07 Genomics Track dataset, and MESH 2012.

UDInfoMed1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoMed1
  • Participant: udel_fang
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 63efc10f08d4662d9368cd03b6b6b5d5
  • Run description: This run uses the original terms in queries and reports. Uses the TwoStage rule.

UDInfoMed12

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoMed12
  • Participant: udel_fang
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: c717d19e6b1d75b5e3d95d58e854c700
  • Run description: This run is based on UMLS mapping. The Unified Medical Language System has been used to map all the terms in the medical reports to a specific medical concept code. This expanded all the words and phrases to a equivalent coded language. All native candidates for each term was used.

UDInfoMed123

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoMed123
  • Participant: udel_fang
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 499ed7cf9b855964bbcd5ef266f05c21
  • Run description: This run is based on UMLS mapping. The Unified Medical Language System has been used to map all the terms in the medical reports to a specific medical concept code. This expanded all the words and phrases to a equivalent coded language.

uogTrMConQ

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: uogTrMConQ
  • Participant: uogTr
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 36c908e07f2dff694c86eff7e1704251
  • Run description: Description---This run combines Divergence from Randomness and Voting Model approaches to medical visit ranking. It applies a novel technique that deals with the medical context of terms in queries and documents, and query expansion.

uogTrMConQRa

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: uogTrMConQRa
  • Participant: uogTr
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: d7228a6adf8d8c32fc757567c91ef6e0
  • Run description: Description: This run combines Divergence from Randomness and Voting Model approaches to medical visit ranking. It applies a novel technique that deals with the medical context of terms in queries and documents, and query expansion, as well as a novel approach to process hidden medical knowledge.

uogTrMConQRd

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: uogTrMConQRd
  • Participant: uogTr
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 53ee41399f2c5685b070b0d9162bab83
  • Run description: Description: This run combines Divergence from Randomness and Voting Model approaches to medical visit ranking. It applies a novel technique that deals with the medical context of terms in queries and documents, and query expansion, as well as a novel approach to process specific types of hidden medical knowledge.

uogTrMConQT

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: uogTrMConQT
  • Participant: uogTr
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: c5800c2e9d706d85fa0cff6a54f795fe
  • Run description: This run combines Divergence from Randomness and Voting Model approaches to medical visit ranking. It applies a novel technique that deals with the medical context of terms in queries and documents, and query expansion, as well as a novel approach to deal with hidden information within the medical records.

USFISDS1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: USFISDS1
  • Participant: USF_ISDS
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 6e3070b7fef73f48c72e866917565b8d
  • Run description: All 50 topic run with non function words removed from topic descriptions. Weighting given to hit counts. Only documents with deduped VisitIds

USFISDS2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: USFISDS2
  • Participant: USF_ISDS
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 0f0cec0afed710f426b34edfca958287
  • Run description: All 50 topic run with non function words removed from topic descriptions. Weighting given to hit counts. Only documents with deduped VisitIds. documents with the same visitid evaluated together.

UTDHLTA

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTA
  • Participant: UTDHLT
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: a89eb6d20435459442956152b69564af
  • Run description: BM25, cohort constraint re-ranking, shallow keyword deconstruction, assertions; utilizes PubMed Central, Wikipedia, UMLS, and WordNet.

UTDHLTASK

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTASK
  • Participant: UTDHLT
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 0fcc995622b9a36f9375ddb45446e7db
  • Run description: BM25, cohort constraint re-ranking, deep keyword deconstruction, assertions; utilizes PubMed Central, Wikipedia, UMLS, and WordNet.

UTDHLTNA

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTNA
  • Participant: UTDHLT
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 479da76e9c1c8065921f01cf5a9be7d9
  • Run description: BM25, cohort constraint re-ranking, shallow keyword deconstruction, no assertions; utilizes PubMed Central, Wikipedia, UMLS, and WordNet.

UTDHLTNASK

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTNASK
  • Participant: UTDHLT
  • Track: Medical
  • Year: 2012
  • Submission: 8/8/2012
  • Type: automatic
  • Task: main
  • MD5: 670bc325bd7bc3a1e12e6d07af3176ec
  • Run description: BM25, cohort constraint re-ranking, deep keyword deconstruction, no assertions; utilizes PubMed Central, Wikipedia, UMLS, and WordNet.

YorkUMB1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: YorkUMB1
  • Participant: york
  • Track: Medical
  • Year: 2012
  • Submission: 8/7/2012
  • Type: automatic
  • Task: main
  • MD5: 30dbbafbabcf4787ab346e33a5e8798f
  • Run description: A baseline run retrieved by using BM25 algorithm with parameter b = 0.75 and k1 = 1.2. Top 2500 reports are selected and mapped to VisitID. The rank of a visit is determined by its top report. The returned visitIDs for each topic are less than 1000.

YorkUMC2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: YorkUMC2
  • Participant: york
  • Track: Medical
  • Year: 2012
  • Submission: 8/7/2012
  • Type: automatic
  • Task: main
  • MD5: 6a01664c8514458f55bbd0c7c61e271f
  • Run description: Automatic run. Use concept relationships in queries to improve the result of baseline run(BM25 b=0.75, k1=1.2). VisitID rank is determined by its top report in the retrieved report list.

YorkUMP4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: YorkUMP4
  • Participant: york
  • Track: Medical
  • Year: 2012
  • Submission: 8/7/2012
  • Type: automatic
  • Task: main
  • MD5: b8804edf5881400f9e5d4ce856a5f914
  • Run description: Using an extended Rocchio's feedback framework---the BM25 weighting model(b=0.3) + KL weighting for feedback (doc=10, term=30) + basic document weighting + full dependency proximity model (weight = 0.2)

YorkUMQ3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: YorkUMQ3
  • Participant: york
  • Track: Medical
  • Year: 2012
  • Submission: 8/7/2012
  • Type: automatic
  • Task: main
  • MD5: f65910ed3b22d2709b7640cabf74be2e
  • Run description: Using an extended Rocchio's feedback framework---the BM25 weighting model(b=0.3) + KL weighting for feedback (doc=10, term=30) + basic document weighting.