Skip to content

Runs - Precision Medicine 2018

aCSIROmedAll

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: aCSIROmedAll
  • Participant: CSIROmed
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 88d177458e2b2aa89b0c2df5e1c6395a
  • Run description: We ran a BM25 ranking ith gene and disease boosting.

aCSIROmedMCB

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: aCSIROmedMCB
  • Participant: CSIROmed
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 6fada5feba9d089abaa85e1406e3046b
  • Run description: We ran a BM25 ranking with gene and disease boosting and boosting cross citations and MeSH matching.

aCSIROmedNEG

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: aCSIROmedNEG
  • Participant: CSIROmed
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: e175291afb8c9f9a8d465533b515478a
  • Run description: We ran a BM25 ranking with gene and disease boosting and negation detection and removal.

BB2_sq_nprf

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: BB2_sq_nprf
  • Participant: Poznan
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 31a49803c425b1fc0267c3d735216c83
  • Run description: Dedicated method of creating a query. IR with BB2 model. No Query Expansion. Gene variant not taken.

BB2_vq_noprf

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: BB2_vq_noprf
  • Participant: Poznan
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 29179f09570b7e07e0721169a30406da
  • Run description: Dedicated method of creating a query. IR with BB2 model. No Query Expansion methods applied.

BB2sqw2vprf

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: BB2sqw2vprf
  • Participant: Poznan
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 0d4d8e89656931127473621ebc79fd3c
  • Run description: Dedicated method of creating a query. IR with BB2 model. Various Query Expansion methods applied. Gene variant not taken.

BB2vqw2vprf

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: BB2vqw2vprf
  • Participant: Poznan
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 0a8d5fe4794adb0d23744d0fe4263aa8
  • Run description: Dedicated method of creating a query. IR with BB2 model. Various Query Expansion methods applied.

bool51

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: bool51
  • Participant: Poznan
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 418af7c56b2ac3baac70692f27f0fc64
  • Run description: Set of boolean queries with weights.

cbnuCT1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cbnuCT1
  • Participant: cbnu
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: trials
  • MD5: 7bc45987db8bedf32c22d6e578238266
  • Run description: documents re-ranking using convolution neural network clustering

cbnuCT2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cbnuCT2
  • Participant: cbnu
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: trials
  • MD5: 15986de15c144850574de2eaf7ac06ea
  • Run description: pseudo relevance feedback using convolution neural network clustering (treatment and age information priority)

cbnuCT3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cbnuCT3
  • Participant: cbnu
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: trials
  • MD5: 789d3bbf2176bf9ea918f68c34f6c580
  • Run description: documents re-ranking using convolution neural network clustering (treatment and age information priority)

cbnuSA1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cbnuSA1
  • Participant: cbnu
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: abstracts
  • MD5: fc41fda9adce05e9e6ca31166a21257f
  • Run description: documents re-ranking using convolution neural network clustering

cbnuSA2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cbnuSA2
  • Participant: cbnu
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 8bcd805cdb8ad7ca95f000c9a49b1744
  • Run description: pseudo relevance feedback using convolution neural network clustering (treatment and age information priority)

cbnuSA3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cbnuSA3
  • Participant: cbnu
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 4f15a69004dc82f6ea7e3b14b04a1389
  • Run description: documents re-ranking using convolution neural network clustering (treatment and age information priority)

cCSIROmedAll

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cCSIROmedAll
  • Participant: CSIROmed
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 37770cd98b193d6fbfd5f5c7f9fddc9f
  • Run description: We ran a BM25 ranking with gene and disease boosting.

cCSIROmedHGB

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cCSIROmedHGB
  • Participant: CSIROmed
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 7426ae8913bb276891bf187f1d90f660
  • Run description: We ran a BM25 ranking with gene and disease boosting, cross-citation boosting, and matching of MeSH headings.

cCSIROmedNEG

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cCSIROmedNEG
  • Participant: CSIROmed
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: f37deac3ae650b037543962fd9d8e484
  • Run description: We ran a BM25 ranking with gene and disease boosting, negation detection and removal, and matching of MeSH headings.

cubicmnz

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cubicmnz
  • Participant: Brown
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 405de8b16bfd0bfe4c78f6f7d12bfaef
  • Run description: CombMNZ with two language models and bm25 retreival models and normalisation with cubic model.

cubicmnzAbs

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cubicmnzAbs
  • Participant: Brown
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 96a22dfeda3ce692313da955d533e756
  • Run description: CombMNZwith two language models and bm25 retrieval model and normalisation with cubic model.

cubicsumEW

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cubicsumEW
  • Participant: Brown
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: ff1418b29ccde39d0a5c3c1f2b5a7e7c
  • Run description: CombSum and cubic model and without normalisation.

cubicsumW

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cubicsumW
  • Participant: Brown
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 030bbd2fb12984edb5700f229842b19c
  • Run description: CombSum and cubic model with word embeddings.

cubicsumWAbs

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: cubicsumWAbs
  • Participant: Brown
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 18ff197a83aa26d6a5895e7fbbcc3d25
  • Run description: CombSUM with wordEmbedding and cubic normalisation.

doc2vec_run

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: doc2vec_run
  • Participant: ASU_Biomedical
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 65eaf30ddd3a6b9bc8149f654d28a273
  • Run description: This is an automatic run using doc2vec to get similar documents along with the scores.Resources used: 1. Python 3.5 2. Gensim Doc2Vec 3.5

doc2vec_run2

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: doc2vec_run2
  • Participant: ASU_Biomedical
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: abstracts
  • MD5: a3358f4638d51728291bb946f1a2cc3b
  • Run description: Supervised approach to predict rank of similar documents.

ECNU_C_Run1

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ECNU_C_Run1
  • Participant: ECNUica
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 64596c1ec1bc85700877e30e38b0c105
  • Run description: The result retreived on entire clinic-trials dataset by terrier platform with BM25 model and pseudo relevance feedback.

ECNU_C_Run2

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ECNU_C_Run2
  • Participant: ECNUica
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: be0b8e1db1fbba56366b1f2a0acefe5e
  • Run description: Combine the PRF and BM25 to retreived on entire clinic-trials dataset.

ECNU_C_Run3

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ECNU_C_Run3
  • Participant: ECNUica
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 30247a922ac1fd470ffc7f8b56ddad1c
  • Run description: Add the descriptions of diseases as expansion of each topic, which are crawled from the NCBI Mesh, then do the same as RUN1.

ECNU_C_Run4

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ECNU_C_Run4
  • Participant: ECNUica
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: c8cb814de10c899342d7c044c129f0bf
  • Run description: Combination of RUN 1 to 3.

ECNU_C_Run5

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ECNU_C_Run5
  • Participant: ECNUica
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: e05ea92b69a143b7ab01540ce1d4d820
  • Run description: Based on RUN4, delete the trials unmatched the constrains such as ages.

ECNU_S_Run1

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ECNU_S_Run1
  • Participant: ECNUica
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: dc5019e24efb5d014f018d04109a71c0
  • Run description: The result retreived on entire Medline and extra-abstract dataset by terrier platform with BM25 model and pseudo relevance feedback.

ECNU_S_Run2

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ECNU_S_Run2
  • Participant: ECNUica
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 9b65af46236d5f80098942e1b44ddbc8
  • Run description: For each topic, rerank fisrt 1000 documents retrieved in RUN1 by using LDA-Model to calculate the average similarity between all terms of each topic and related documents.

ECNU_S_Run3

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ECNU_S_Run3
  • Participant: ECNUica
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 2116eea09b2abe7443a17f7ecb719581
  • Run description: For each topic, rerank fisrt 1000 documents retrieved in RUN1 by using LDA-Model to calculate the average similarity between all terms of each topic and related documents. The terms are included high-frequency words from the frst 20 NCBI-PubMed abstracts which was related to the original topic.

ECNU_S_Run4

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ECNU_S_Run4
  • Participant: ECNUica
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 43e8add69c36c258b029bb82a5f79561
  • Run description: For each topic, rerank fisrt 2000 documents retrieved in RUN1 by using LDA-Model to calculate the average similarity between all terms of each topic and related documents, and finally choose the fisrt 1000 documents as results.

ECNU_S_Run5

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: ECNU_S_Run5
  • Participant: ECNUica
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 86d61c4afa0f6819ca061c226796c0ab
  • Run description: For each topic, rerank fisrt 2000 documents retrieved in RUN1 by using LDA-Model to calculate the average similarity between all terms of each topic and related documents, and finally choose the fisrt 1000 documents as results. The terms are included high-frequency words from the frst 20 NCBI-PubMed abstracts which was related to the original topic.

elastic_run

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: elastic_run
  • Participant: ASU_Biomedical
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 9572e9cb82b98c6b7a3f07782d4d82b2
  • Run description: This is a elastic search based automated run based on Python. We have used following frameworks for this automated run: 1. Python 3.5 2. Elastic Search 6.3

hpictall

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: hpictall
  • Participant: hpi-dhc
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: trials
  • MD5: 29401e5c728bb7297e84f2a5d4991aa9
  • Run description: Same as "hpictboost", but with gene descriptions from NCBI gene list.

hpictbase

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: hpictbase
  • Participant: hpi-dhc
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: trials
  • MD5: 7ce2743905c09b91d4dee5f99e8b5d99
  • Run description: Baseline run. Matching only disease and gene "as is". Boosts as in "hpictboost" run. Excluding non-melanoma.

hpictboost

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: hpictboost
  • Participant: hpi-dhc
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: bec77448844481d107d204d7210f5369
  • Run description: Matching age, sex, the disease preferred term and its synonyms (from SNOMED CT, MeSH, and ICD), gene synonyms (from NCBI gene list) and its family, as well as solid tumors. Boosting cancer and genetics keywords, as well as a list of positive handcrafted boosters. Excluding non-melanoma.

hpictcommon

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: hpictcommon
  • Participant: hpi-dhc
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: trials
  • MD5: 5520a83929f55447261137bdec3b2977
  • Run description: Same as "hpictboost", but without solid tumor expansion and gene family, in order to have a comparable run with Biomedical Articles.

hpictphrase

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: hpictphrase
  • Participant: hpi-dhc
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: trials
  • MD5: 1cc159302e421199a21fcef6f4c6eece
  • Run description: Same as "hpictboost, but with exact matching on diseases.

hpipubbase

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: hpipubbase
  • Participant: hpi-dhc
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: abstracts
  • MD5: bd739d133dc71743158ce5a211309df6
  • Run description: Baseline run. Matching only disease and gene "as is". Boosts as in "hpipubboost" run, but without the ML classifier. Excluding non-melanoma.

hpipubboost

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: hpipubboost
  • Participant: hpi-dhc
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 14e64612a72a39f31bf8ed2e9e360ef1
  • Run description: Matching the disease preferred term and its synonyms (from SNOMED CT, MeSH, and ICD), the gene description and its synonyms (from NCBI gene list). Boosting AACR/ASCO abstracts, chemotherapy suffixes, cancer and genetics keywords, positive and negative handcrafted boosters, as well as a positive prediction from a ML classifier trained on the 2017 gold standard. Excluding non-melanoma.

hpipubclass

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: hpipubclass
  • Participant: hpi-dhc
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 17152104525c9e3485ab2292bbb19d5e
  • Run description: Matching the disease preferred term and its synonyms (from SNOMED CT, MeSH, and ICD), the gene description and its synonyms (from NCBI gene list). Boosting chemotherapy suffixes, cancer and genetics keywords, positive and negative handcrafted boosters, as well as a highly boosted PM/Not PM MALLET MaxEnt classifier with SecondString TFIDF estimates, BANNER tagger gene counter and MeSH headings from the Medline XML. Excluding non-melanoma.

hpipubcommon

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: hpipubcommon
  • Participant: hpi-dhc
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 0ace8c5d18e310e06c5232d031f1778e
  • Run description: Matching the disease preferred term and its synonyms (from SNOMED CT, MeSH, and ICD), gene synonyms (from NCBI gene list). Boosting chemotherapy suffixes, cancer and genetics keywords, positive and negative handcrafted boosters. Excluding non-melanoma.

hpipubnone

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: hpipubnone
  • Participant: hpi-dhc
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/6/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 05422ebf367ca45903327c7b04e6172c
  • Run description: Matching the disease preferred term and its synonyms (from SNOMED CT, MeSH, and ICD), the gene description and its synonyms (from NCBI gene list). Boosting chemotherapy suffixes, cancer and genetics keywords, positive and negative handcrafted boosters. Excluding non-melanoma.

IKM_trail_1

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IKM_trail_1
  • Participant: IKMLAB
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: trials
  • MD5: 3c2850c292e646f136a5fd2463fe35c8
  • Run description: Normal(include Exclusion)

IKM_trail_2

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IKM_trail_2
  • Participant: IKMLAB
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: trials
  • MD5: 0d52fac6fc5b9dd8f192d053a543f4fb
  • Run description: Normal + Minus Exclusion

IKM_trail_3

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IKM_trail_3
  • Participant: IKMLAB
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: trials
  • MD5: a666ec9bb5205ac3ff8f7a06a0acdb93
  • Run description: Normal + Include Only Disease

IKM_trail_4

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IKM_trail_4
  • Participant: IKMLAB
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: trials
  • MD5: eebd8c390e121792f8c8ad0c9e7d6d3e
  • Run description: Normal + Include Only Gene

IKM_trail_5

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IKM_trail_5
  • Participant: IKMLAB
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: trials
  • MD5: 86e8f8fb6888c5df94c8676d74a8c219
  • Run description: Normal - Low Relationship Tags

IKMLAB_1

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IKMLAB_1
  • Participant: IKMLAB
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 2a629dcdc294680845fd7ce8e7825992
  • Run description: Pubtator + Chemical

IKMLAB_2

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IKMLAB_2
  • Participant: IKMLAB
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: d2f30980e973e5cc2cd729f9db63f189
  • Run description: Pubtator + No Chemical

IKMLAB_3

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IKMLAB_3
  • Participant: IKMLAB
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 56b6948f3bcefe30908345c3b08100ed
  • Run description: Extra + No Species and Chemical

IKMLAB_4

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IKMLAB_4
  • Participant: IKMLAB
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 1cfaba33c358e33555c2fddb0c87654f
  • Run description: Extra + Species and Chemical

IKMLAB_5

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IKMLAB_5
  • Participant: IKMLAB
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: fa13208c69331c1e40cef580e31bf270
  • Run description: Using a neural network to get the answer.

imi_mug_abs1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: imi_mug_abs1
  • Participant: imi_mug
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/2/2018
  • Type: automatic
  • Task: abstracts
  • MD5: c0525c8fd5e93537ef9001b504119f9f
  • Run description: Baseline query with MeSH age groups and grid-search optimized parameters.

imi_mug_abs2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: imi_mug_abs2
  • Participant: imi_mug
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 8b9db5cfa78d78c44feabc94e73f8f66
  • Run description: Baseline query with MeSH age groups and grid-search optimized parameters. Boost English and extra topics.

imi_mug_abs3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: imi_mug_abs3
  • Participant: imi_mug
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 59443ed9ea1e33511544bc0372924662
  • Run description: Baseline query with MeSH age groups and grid-search optimized parameters. Boost English and extra topics. Search age group and sex in title, abstract, and MeSH.

imi_mug_abs4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: imi_mug_abs4
  • Participant: imi_mug
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 19823f0294c4ea1feb3e4debd44e1b01
  • Run description: Baseline query with MeSH age groups and grid-search optimized parameters. Boost English and extra topics. Search age group and sex in title, abstract, and MeSH. Abstract should exist.

imi_mug_abs5

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: imi_mug_abs5
  • Participant: imi_mug
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 95f41a33e4a808192a8b193e27e788b1
  • Run description: Baseline query with MeSH age groups and grid-search optimized parameters. Boost English and extra topics. Abstract should exist.

imi_mug_ct1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: imi_mug_ct1
  • Participant: imi_mug
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/2/2018
  • Type: automatic
  • Task: trials
  • MD5: 9f7ff828d4d51851040fc769db03c96e
  • Run description: Baseline query with bi and tri-gram search, plus grid-search optimized parameters.

imi_mug_ct2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: imi_mug_ct2
  • Participant: imi_mug
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 8d000cfcfe8a92defded6b156ec84bc7
  • Run description: Baseline query with bi and tri-gram search, plus grid-search optimized parameters. Disease must not match exclusion criteria.

imi_mug_ct3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: imi_mug_ct3
  • Participant: imi_mug
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: facc917835767ac0bec7af310f26d050
  • Run description: Baseline query with bi and tri-gram search, plus grid-search optimized parameters. All should (relaxed).

imi_mug_ct4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: imi_mug_ct4
  • Participant: imi_mug
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: ac7174119160dc2dd32f29569d9223da
  • Run description: Baseline query with bi and tri-gram search, weighed, plus grid-search optimized parameters.

imi_mug_ct5

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: imi_mug_ct5
  • Participant: imi_mug
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: d268ba2490cab12992f50b1e9d429109
  • Run description: Baseline query with bi and tri-gram search, weighed, plus grid-search optimized parameters.

IMS_NO_PRF

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IMS_NO_PRF
  • Participant: ims_unipd
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/30/2018
  • Type: automatic
  • Task: trials
  • MD5: 1cdd780ef65946afcbdd7396b5b3d4c1
  • Run description: Term-concept based retrieval using concepts within a knowledge-base (UMLS Metathesaurus) to expand the original query. The scoring function is the BM25F (Okapi version).

IMS_PRF

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IMS_PRF
  • Participant: ims_unipd
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/30/2018
  • Type: automatic
  • Task: trials
  • MD5: c91e070eb155ef0b7aaf0e8f7a448330
  • Run description: term-concept based retrieval with Pseudo Relevance Feedback to expand query with concepts-terms that are related to the query terms. The selected concepts-terms are those that have a relation within the UMLS Metathesaurus with the concepts in the original query. The scoring function used is the BM25F (Okapi).

IMS_TERM

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: IMS_TERM
  • Participant: ims_unipd
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/30/2018
  • Type: automatic
  • Task: trials
  • MD5: 8b4076e476c94e92db65de8388560a51
  • Run description: Term-based retrieval using original terms contained within the query. The scoring function is the BM25F (Okapi version).

irit_prf_cli

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: irit_prf_cli
  • Participant: IRIT
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/2/2018
  • Type: automatic
  • Task: trials
  • MD5: 25eadea5338ad5fd9d3c85af8875fcaa
  • Run description: Classical PRF with Indri, nDoc=5 nTerm=10

KL18AbsFuse

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: KL18AbsFuse
  • Participant: KlickLabs
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: a735a3598b0a54affdb35fc74315b5a7
  • Run description: Fusion runs: - Fusion of two different expansion methods and baseline run

KL18absHY

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: KL18absHY
  • Participant: KlickLabs
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 57c67989193135a53160b3605e22cb71
  • Run description: Expansion with NCIT as KB

KL18absWV

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: KL18absWV
  • Participant: KlickLabs
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 8fad1acf30726557de31749674e721ac
  • Run description: - Pooling w2vec expansion run for diversity

KL18TrialBF

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: KL18TrialBF
  • Participant: KlickLabs
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 9c5ee3a433b02c3858a7c65d52cc5b5d
  • Run description: Different baseline with filtering

KL18TrialWV

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: KL18TrialWV
  • Participant: KlickLabs
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: a0f2dab422760c26faa4627d25ca59f6
  • Run description: Word2vec expansion run for diversity

KL18TriFuse

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: KL18TriFuse
  • Participant: KlickLabs
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 9e563c7358b6ea571fa68c336a722517
  • Run description: Fusion run for Trials .

KL18TriHY

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: KL18TriHY
  • Participant: KlickLabs
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: ea1731903a04885691038be66001a2c1
  • Run description: Expansion using NCIT

KLPM18T1Bl

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: KLPM18T1Bl
  • Participant: KlickLabs
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: trials
  • MD5: 3ba8680e2d5068e6530cde0c9f775047
  • Run description: _ baseline with filtering on demographic data,

KLPM18T2Bl

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: KLPM18T2Bl
  • Participant: KlickLabs
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: abstracts
  • MD5: fa897b1aff53beecc3754d7722301f4a
  • Run description: _ baseline Abstracts with filtering on demographic data,

m_trial1

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: m_trial1
  • Participant: FDUDMIIP
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 145a34e18190c69ce1785ed4ab0493dd
  • Run description: method fusion for trial

mayoctcomp

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: mayoctcomp
  • Participant: MayoNLPTeam
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/1/2018
  • Type: automatic
  • Task: trials
  • MD5: 1c2b3bf7f45acf19278421d5a49d2b4a
  • Run description: Comprehensive method combining entity recognition and learning to rank

mayoctscreat

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: mayoctscreat
  • Participant: MayoNLPTeam
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/1/2018
  • Type: automatic
  • Task: trials
  • MD5: db8ffe512ef3a3090e3dc01ee76bc974
  • Run description: using ctakes results for searching disease and conditions

mayoctsimp

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: mayoctsimp
  • Participant: MayoNLPTeam
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/1/2018
  • Type: automatic
  • Task: trials
  • MD5: 7ff1e76c3170569df310ca62826f58bc
  • Run description: Baseline method using keyword search

mayomedcomp

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: mayomedcomp
  • Participant: MayoNLPTeam
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/1/2018
  • Type: automatic
  • Task: abstracts
  • MD5: a3210c59d376e63900554845386c2cb5
  • Run description: comprehensive retrieval model using learning to rank

mayomedcreat

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: mayomedcreat
  • Participant: MayoNLPTeam
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/1/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 121d92d7f70399cfb099d55fd82d0fe5
  • Run description: using ctakes results for searching disease and conditions

mayomedsimp

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: mayomedsimp
  • Participant: MayoNLPTeam
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/1/2018
  • Type: automatic
  • Task: abstracts
  • MD5: bbf9fdad63329172348929e5d717e32c
  • Run description: Simple baseline method using keyword and MeSH term matching.

mayopubtator

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: mayopubtator
  • Participant: MayoNLPTeam
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/1/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 4c3f6f532b988db877a31b5b81aad3a6
  • Run description: using pubtator developed by NIH for searching diseases and genes

MedIER_sa11

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MedIER_sa11
  • Participant: MedIER
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 4d1d38426844711bb40e0587d0f1b813
  • Run description: BM25, appended results from multiple queries; Resources: Gene ontology, PubTator

MedIER_sa12

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MedIER_sa12
  • Participant: MedIER
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: f9ac0df3ffe92d1f620b512a60e5c175
  • Run description: LM, appended results from multiple queries; Resources: Gene ontology, PubTator

MedIER_sa13

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MedIER_sa13
  • Participant: MedIER
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 80f640fc0264fed34ef4daafca892163
  • Run description: RRF Fusion on runs MedIER_sa11 and MedIER_sa12

MedIER_sa14

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MedIER_sa14
  • Participant: MedIER
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 5aceb04004c2c733898affefdd42b88a
  • Run description: BM25, appended results from multiple queries; re-ranked using pseudo-relevance classifier; Resources: Gene ontology, PubTator

MedIER_sa15

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MedIER_sa15
  • Participant: MedIER
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 53cfb2584add309179e9d4935018471d
  • Run description: LM, appended results from multiple queries; re-ranked using pseudo-relevance classifier; Resources: Gene ontology, PubTator

method_fu

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: method_fu
  • Participant: FDUDMIIP
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: c75b39da4ab0b69600a40b9439a87755
  • Run description: method fusion

minfolabBA

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: minfolabBA
  • Participant: InfoLabPM
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/2/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 52766488dac18c593ab9fbb80d16c864
  • Run description: The matching model used: BB2 Direct use of disease, gene and gender

minfolabBC

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: minfolabBC
  • Participant: InfoLabPM
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/2/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 43f597b4ee4aef2b775c0e7481d6bf83
  • Run description: The matching model used: BB2 Expanded disease term to the most preferred atom (via UMLS REST API)

minfolabBD

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: minfolabBD
  • Participant: InfoLabPM
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/2/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 1237a593765b2afb1422193fb7b9724a
  • Run description: The matching model used: BB2 Expanded disease term to the most preferred atom (via UMLS REST API) Expanded Genes terms (via Ensembl REST API)

minfolabTH

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: minfolabTH
  • Participant: InfoLabPM
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/2/2018
  • Type: automatic
  • Task: abstracts
  • MD5: b60f7699e100bc3e0ba256d145961826
  • Run description: The matching model used: BB2 Expanded with human and neoplasm keywords https://www.nlm.nih.gov/bsd/pubmed_subsets/cancer_strategy.html

mnz

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: mnz
  • Participant: Brown
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 09de909edc63930fae39d6bd1f23e674
  • Run description: CombMNZ with two language models and bm25 retreival models.

mnzAbs

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: mnzAbs
  • Participant: Brown
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: f259d4328d9088bc02d50e807bcd3d89
  • Run description: CombMNZwith two language models and bm25 retrieval model.

MSIIP_BASE

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MSIIP_BASE
  • Participant: Cat_Garfield
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 36cde70ea4036f284a7a38e5ad5ba63f
  • Run description: A baseline system.

MSIIP_PBAH

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MSIIP_PBAH
  • Participant: Cat_Garfield
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 03bde58a7d4008a040642667dfc422d6
  • Run description: Using our PM classifier with a high weight upon all the articles.

MSIIP_PBH

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MSIIP_PBH
  • Participant: Cat_Garfield
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: dcd275be734c5197fae38057a04f2beb
  • Run description: Using our PM classifier with a high weight upon all the articles except for the top 10.

MSIIP_PBL

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MSIIP_PBL
  • Participant: Cat_Garfield
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 58e9c2afa3eeea45e8cb9d8d6410bdec
  • Run description: Using our PM classifier with a low weight upon all the articles except for the top 10.

MSIIP_PBPK

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MSIIP_PBPK
  • Participant: Cat_Garfield
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 2e473bf980947588976c86d32081415a
  • Run description: Using our PM classifier along with the PM classification function of our baseline system in the way of disjunctive.

MSIIP_TRIAL1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MSIIP_TRIAL1
  • Participant: Cat_Garfield
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 191eaa052119d6ebc3b9df5ae09e7dc5
  • Run description: msiip_trials3, without condidering 'study_type', 'intervention_type' and 'primary_purpose' fields.

MSIIP_TRIAL2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MSIIP_TRIAL2
  • Participant: Cat_Garfield
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 808d55b38362bc6e44feb21a814cfb46
  • Run description: msiip_trials5, not containing query_expansion, without condidering 'study_type', 'intervention_type' and 'primary_purpose' fields.

MSIIP_TRIAL3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MSIIP_TRIAL3
  • Participant: Cat_Garfield
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 3ecd03dd735d8a5f279bbf07b4249ede
  • Run description: containing all our methods, with some differential methods for some topics involving immonotherapy

MSIIP_TRIAL4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MSIIP_TRIAL4
  • Participant: Cat_Garfield
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 364abe13393ffb2ccb41171b3014c15d
  • Run description: msiip_trials5, not containing query_expansion.

MSIIP_TRIAL5

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: MSIIP_TRIAL5
  • Participant: Cat_Garfield
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 59a5940ba1b25bda1ce3aecfc668b2ef
  • Run description: containing all our methods, all topics share the same methods

NS_PM_1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: NS_PM_1
  • Participant: NOVASearch
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: trials
  • MD5: da978f3c3eeef04b10d9422fde30244b
  • Run description: Base search using Lucene. Re ranking based on three criteria: - Purpose, intervention and study type - Gene type matching the inclusion criteria, expanded using the HGNC database. - Patient condition matching trial condition, expanded using the MeSH and SNOMed databases.

NS_PM_2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: NS_PM_2
  • Participant: NOVASearch
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: trials
  • MD5: d6ed6f9c1472937cadae6811a32417fa
  • Run description: Base search using Lucene. Re ranking based on three criteria: - Purpose, intervention and study type - Gene type matching the inclusion criteria, expanded using the HGNC database.

NS_PM_3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: NS_PM_3
  • Participant: NOVASearch
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: trials
  • MD5: 69aece298477376063e4e1b7546c96d7
  • Run description: LETOR using LambdaMart. Features based on multiple retrieval functions (BM25, TF-IDF, Language Models) and features based on to NS_PM_1 and 2 filters

NS_PM_4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: NS_PM_4
  • Participant: NOVASearch
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: trials
  • MD5: 83c4f7db1e0010e892b477c8edf1321f
  • Run description: LETOR using AdaRank. Features based on multiple retrieval functions (BM25, TF-IDF, Language Models) and features based on to NS_PM_1 and 2 filters

NS_PM_5

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: NS_PM_5
  • Participant: NOVASearch
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: trials
  • MD5: e33b6095bf3f4360668dabd013d698c0
  • Run description: LETOR using Coordinate Ascend. Features based on multiple retrieval functions (BM25, TF-IDF, Language Models) and features based on to NS_PM_1 and 2 filters.

para_fusion

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: para_fusion
  • Participant: FDUDMIIP
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: cfea70527a6da887bd43afe4350e872c
  • Run description: parameter fusion

para_trial

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: para_trial
  • Participant: FDUDMIIP
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: a4a8a754bc23da6ec89d52b4d908664e
  • Run description: parameter fusion

PM_IBI_run1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: PM_IBI_run1
  • Participant: PM_IBI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 1319df6a4695e4bbf5864d255e3752ad
  • Run description: PM_IBI_run1 description: For each topic, we automatically expand the terms describing the related disease(s), gene(s) and variant(s) by relying on the UMLS meta-thesaurus and semantic network and on dbSNP. In particular for each gene and disease term we automatically gathered from UMLS: (i) all its synonym terms; (ii) all the terms describing more specific concepts (hyponyms) by means of the UMLS semantic network (traversed up to a maximum depth of three levels). When variant(s) are present, we retrieved its reference SNP ID number (when possible). The automatically expanded lists of terms - disease(s), gene(s) and variant(s) - are jointly used to properly structure a boolean query to an ElasticSearch document indexer where the whole set of PubMed abstracts provided to the challenge participants has been previously loaded. The top-1000 results retrieved by Elasticsearch are re-ranked by taking into account the following six relevance indicators: (i) for each gene and disease, the number of mentions of the original term and its synonyms (from UMLS); (ii) for each gene and disease, the number of mentions of terms describing more specific concepts (hyponyms - from UMLS); (iii) in case the gene name is present and the related variant is mentioned too, the number of mentions of the variant; (iv) the number of mentions of chemicals (MeSH compounds and string matches from a list of compound names derived from UMLS); (v) the presence, in a customized version of the bio-marker response database ResMarker (http://resmarkerdb.org), of a validated relation among the genes, diseases, variants and chemicals mentioned in the abstract; (vi) the year of publication of the abstract. In the PM_IBI_run1, we generated the final list of ranked results for each topic by considering sequentially the following sub-groups of the abstracts returned by Elasticsearch (each sub-group is in turns internally ordered by relying on the previous set of six relevance indicators): A) abstracts with at least one mention of a disease (exact or more specific term), a gene (exact or more specific term) and a variant in the title B) abstracts with at least one mention of a disease (exact or more specific term) and a gene (exact or more specific term) in the title (no variant mentions) C) abstracts with at least one mention of a disease (exact or more specific term), a gene (exact or more specific term) and a variant considering both title and abstract D) abstracts with at least one mention of a disease (exact or more specific term) and a gene (exact or more specific term) considering both title and abstract (no variant mentions) E) abstracts with one mention of a disease (exact or more specific term) or (XOR) one mention of a gene (exact or more specific term) together with one or more variant mentions, considering both title and abstract F) abstracts with one mention of a disease (exact or more specific term) or (XOR) one mention of a gene (exact or more specific term) considering both title and abstract (no variant mentions)

PM_IBI_run2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: PM_IBI_run2
  • Participant: PM_IBI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: abstracts
  • MD5: b665910ba02810038130f68cf7422e07
  • Run description: PM_IBI_run2 description: For each topic, we automatically expand the terms describing the related disease(s), gene(s) and variant(s) by relying on the UMLS meta-thesaurus and semantic network and on dbSNP. In particular for each gene and disease term we automatically gathered from UMLS: (i) all its synonym terms; (ii) all the terms describing more specific concepts (hyponyms) by means of the UMLS semantic network (traversed up to a maximum depth of three levels). When variant(s) are present, we retrieved its reference SNP ID number (when possible). The automatically expanded lists of terms - disease(s), gene(s) and variant(s) - are jointly used to properly structure a boolean query to an ElasticSearch document indexer where the whole set of PubMed abstracts provided to the challenge participants has been previously loaded. The top-1000 results retrieved by Elasticsearch are re-ranked by taking into account the following six relevance indicators: (i) for each gene and disease, the number of mentions of the original term and its synonyms (from UMLS); (ii) for each gene and disease, the number of mentions of terms describing more specific concepts (hyponyms - from UMLS); (iii) in case the gene name is present and the related variant is mentioned too, the number of mentions of the variant; (iv) the number of mentions of chemicals (MeSH compounds and string matches from a list of compound names derived from UMLS); (v) the presence, in a customized version of the bio-marker response database ResMarker (http://resmarkerdb.org), of a validated relation among the genes, diseases, variants and chemicals mentioned in the abstract; (vi) the year of publication of the abstract. In the PM_IBI_run2, we generated the final list of ranked results for each topic by considering sequentially the following sub-groups of the abstracts returned by Elasticsearch (each sub-group is in turns internally ordered by relying on the previous set of six relevance indicators): A) abstracts with at least one mention of a disease (exact or more specific term), a gene (exact or more specific term) and a variant, considering both title and abstract B) abstracts with at least one mention of a disease (exact or more specific term) and a gene (exact or more specific term), considering both title and abstract (no variant mentions) C) abstracts with one mention of a disease (exact or more specific term) or (XOR) one mention of a gene (exact or more specific term) eventually with one or more variant mentions, considering both title and abstract (In our other run, PM_IBI_run1, we always give highest rank if a paper has gene, disease and variant mentions in the titile. Here title and abstract are jointly considered as texts that give the same relevance to mentions that occur in.)

PM_IBI_run3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: PM_IBI_run3
  • Participant: PM_IBI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 0c77bab9f9125351a14745f38281e15d
  • Run description: PM_IBI_run3 description: Contrary to the other two runs of the PM_IBI team (run1 and run2), this run, PM_IBI_run3, exploits the demographic match between the topic and the abstract to better rank search results. For each topic, we automatically expand the terms describing the related disease(s), gene(s) and variant(s) by relying on the UMLS meta-thesaurus and semantic network and on dbSNP. In particular for each gene and disease term we automatically gathered from UMLS: (i) all its synonym terms; (ii) all the terms describing more specific concepts (hyponyms) by means of the UMLS semantic network (traversed up to a maximum depth of three levels). When variant(s) are present, we retrieved its reference SNP ID number (when possible). The automatically expanded lists of terms - disease(s), gene(s) and variant(s) - are jointly used to properly structure a boolean query to an ElasticSearch document indexer where the whole set of PubMed abstracts provided to the challenge participants has been previously loaded. The top-1000 results retrieved by Elasticsearch are re-ranked by taking into account the following six relevance indicators: (i) for each gene and disease, the number of mentions of the original term and its synonyms (from UMLS); (ii) for each gene and disease, the number of mentions of terms describing more specific concepts (hyponyms - from UMLS); (iii) in case the gene name is present and the related variant is mentioned too, the number of mentions of the variant; (iv) the number of mentions of chemicals (MeSH compounds and string matches from a list of compound names derived from UMLS); (v) the presence, in a customized version of the bio-marker response database ResMarker (http://resmarkerdb.org), of a validated relation among the genes, diseases, variants and chemicals mentioned in the abstract; (vi) the year of publication of the abstract. In the PM_IBI_run3, we extract from each abstract returned by Elasticsearch demographic information (age-ranges of patients), where available. Thus, given the age of the patient specified by the topic description, we can identify all the abstracts in which the age of the patient is included in one or more age-ranges. As a consequence, we divide the results retrieved by the Elasticsearch query in the two following groups: 1) abstracts with one or more age-ranges including the age of the patient 2) abstract with no matching age-range or without age-range specified. Internally we order the abstracts of each of these two groups by considering sequentially the following sub-groups (each sub-group is in turns internally ordered by relying on the previous set of six relevance indicators): A) abstracts with at least one mention of a disease (exact or more specific term), a gene (exact or more specific term) and a variant in the title B) abstracts with at least one mention of a disease (exact or more specific term) and a gene (exact or more specific term) in the title (no variant mentions) C) abstracts with at least one mention of a disease (exact or more specific term), a gene (exact or more specific term) and a variant considering both title and abstract D) abstracts with at least one mention of a disease (exact or more specific term) and a gene (exact or more specific term) considering both title and abstract (no variant mentions) E) abstracts with one mention of a disease (exact or more specific term) or (XOR) one mention of a gene (exact or more specific term) together with one or more variant mentions, considering both title and abstract F) abstracts with one mention of a disease (exact or more specific term) or (XOR) one mention of a gene (exact or more specific term) considering both title and abstract (no variant mentions)

raw_medline

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: raw_medline
  • Participant: FDUDMIIP
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 555abb90ee1ca0519756fca38a7c4de9
  • Run description: Naive method for task 1.

raw_trials

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: raw_trials
  • Participant: FDUDMIIP
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: trials
  • MD5: bc082d4d066ea6d93699383347015374
  • Run description: Naive method from clinical trials.

rbf

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: rbf
  • Participant: FDUDMIIP
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 8aa244dab315e94c29cdee8555e8c842
  • Run description: feedback

rfb_trial1

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: rfb_trial1
  • Participant: FDUDMIIP
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: d6d1cab45f4a6537aa7d0d523741a2cc
  • Run description: feedback

RSA_DSC_CT_1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: RSA_DSC_CT_1
  • Participant: RSA_DSC
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/27/2018
  • Type: automatic
  • Task: trials
  • MD5: 8580f5ef1b7dcbc226173db9ac875d6d
  • Run description: The following stack of queries was used: 1. pr_pr_ex 2. prpr_df 3. sepr_ex 4. sepr_df 5. prse_ex 6. pr_se_df ... A GATE annotation pipeline was used in the topics' processing

RSA_DSC_CT_2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: RSA_DSC_CT_2
  • Participant: RSA_DSC
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/27/2018
  • Type: automatic
  • Task: trials
  • MD5: e53eb48958979e4e51c943fd0763cc7e
  • Run description: The following stack of queries was used: 1. pr_pr_ex 2. prpr_df 3. sese_ex 4. sese_df 5. sepr_ex 6. se_pr_df ... A GATE annotation pipeline was used in the topics' processing

RSA_DSC_CT_3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: RSA_DSC_CT_3
  • Participant: RSA_DSC
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/27/2018
  • Type: automatic
  • Task: trials
  • MD5: 7ed5dfdadbcc22a721ee8c9dfed6b87c
  • Run description: Used the following stack of queries: 1. pr_pr_ex 2. prpr_df 3. prse_ex 4. prse_df 5. sese_ex 6. se_se_df ... A GATE annotation pipeline was used in the topics' processing

RSA_DSC_CT_4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: RSA_DSC_CT_4
  • Participant: RSA_DSC
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/27/2018
  • Type: automatic
  • Task: trials
  • MD5: e0a574972d878d8725898dc49280c859
  • Run description: Uses the following stack of queries: 1. pr_pr_ex 2. prse_ex 3. sese_ex 4. pr_pr_df ... A GATE annotation pipeline was used in the topics' processing.

RSA_DSC_CT_5

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: RSA_DSC_CT_5
  • Participant: RSA_DSC
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/27/2018
  • Type: automatic
  • Task: trials
  • MD5: ebf5635735a6b44349131f8f7d2dc0f5
  • Run description: The following rank of queries was used: 1. pr_pr_ex 2. prse_ex 3. prpr_df 4. se_se_ex .... A GATE annotationa pipeline was used in the topics' processing

RSA_DSC_LA_1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: RSA_DSC_LA_1
  • Participant: RSA_DSC
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/27/2018
  • Type: automatic
  • Task: abstracts
  • MD5: c4321e77c59e672874d2e31eaeb53864
  • Run description: Used the following stack of queries: 1. pr_pr_ex 2. prpr_df 3. prse_ex 4. prse_df 5. sese_ex 6. se_se_df ... A GATE annotation pipeline was used in the topics' processing

RSA_DSC_LA_2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: RSA_DSC_LA_2
  • Participant: RSA_DSC
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/27/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 563a46b37ff9fbfdd3bbc17e7c8354d8
  • Run description: Used the following stack of queries: 1. pr_pr_ex 2. prse_ex 3. sese_ex 4. prpr_df 5. sepr_ex 6. pr_se_df ... A GATE annotation pipeline was used in the topics' processing

RSA_DSC_LA_3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: RSA_DSC_LA_3
  • Participant: RSA_DSC
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/27/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 024532125f0650d09531a9fcf6d622ca
  • Run description: Used the following stack of queries: 1. pr_pr_ex 2. prpr_df 3. prse_ex 4. sese_ex 5. sese_df 6. pr_se_df ... A GATE annotation pipeline was used in the topics' processing

RSA_DSC_LA_4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: RSA_DSC_LA_4
  • Participant: RSA_DSC
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/27/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 5d8463864b8ef94383703ddaef285f60
  • Run description: Used the following stack of queries: 1. pr_pr_ex 2. prse_ex 3. prpr_df 4. sese_ex 5. se*_se_df ... A GATE annotation pipeline was used in the topics' processing

RSA_DSC_LA_5

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: RSA_DSC_LA_5
  • Participant: RSA_DSC
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/27/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 2ff3d0ac9dc91ab93882292832f07196
  • Run description: Used the following stack of queries: 1. pr_pr_ex 2. prse_ex 3. prpr_df 4. prse_df 5. sese_ex 6. se_se_df ... A GATE annotation pipeline was used in the topics' processing

SIBTMct1

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SIBTMct1
  • Participant: SIBTextMining
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: trials
  • MD5: 2e4e1e1d98303bbca4a464b9117a79b0
  • Run description: Diseases are mapped and CTs are filtered by topics thanks to NCI thesaurus in : - conditions, mesh conditions, and keywords fields - along with titles and summary Genes are used in a standard search engine, Terrier, BM25. Demographic features are filtered. Boost are granted according to phases, primary purposes, and study types. Boosting values were computed with last year qrel distribution.

SIBTMct2

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SIBTMct2
  • Participant: SIBTextMining
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: trials
  • MD5: 2fc07eaf9e62f3c8a90f395bb6bb9e0f
  • Run description: Diseases are mapped and CTs are filtered by topics thanks to NCI thesaurus in : - conditions, mesh conditions, and keywords fields Genes are used in a standard search engine, Terrier, BM25. Diseases and mutation keywords are also used in query. Demographic features are filtered. Boost are granted according to phases, primary purposes, and study types. Boosting values were computed with last year qrel distribution.

SIBTMct3

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SIBTMct3
  • Participant: SIBTextMining
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: trials
  • MD5: 99700f6febda8807adfa7f27fb1f6187
  • Run description: Diseases are mapped and CTs are filtered by topics thanks to NCI thesaurus in : - conditions, mesh conditions, and keywords fields Genes are used in a standard search engine, Terrier, BM25. Demographic features are filtered. Boost are granted according to phases, primary purposes, and study types. Boosting values were computed with last year qrel distribution.

SIBTMct4

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SIBTMct4
  • Participant: SIBTextMining
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: trials
  • MD5: efcacec6c9ce90ee33dd7469566d423a
  • Run description: Diseases are mapped and CTs are filtered by topics thanks to NCI thesaurus in : - conditions, mesh conditions, and keywords fields - along with titles and summary Genes are used in a standard search engine, Terrier, BM25. Diseases and mutation keywords are also used in query. Demographic features are filtered. Boost are granted according to phases, primary purposes, and study types. Boosting values were computed with last year qrel distribution.

SIBTMlit1

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SIBTMlit1
  • Participant: SIBTextMining
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/23/2018
  • Type: automatic
  • Task: abstracts
  • MD5: a6c9e0ca4a7d67e1e0eb1824fbe4f23e
  • Run description: Run 1 is our baseline run. Four queries, enabling constraint relaxing (disease+gene+variant; disease+gene; disease+variant; gene+variant) are sent to our search engine. Results are re-ranked based on drug density. Drug density is based on a list of drugs provided by DrugBank, coupled with a boost for cancer-related drugs.

SIBTMlit2

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SIBTMlit2
  • Participant: SIBTextMining
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/23/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 4df01c733157aae1e7228f276e7acd90
  • Run description: Run 2 is based on run 1. Results are further re-ranked based on demographic information. MeSH terms are used to retrieve demographic information in the abstract. Abstracts matching the gender and age informations are favored.

SIBTMlit3

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SIBTMlit3
  • Participant: SIBTextMining
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/23/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 559b66e1498371112a3df43cf0327a70
  • Run description: Run 3 is based on run 2. A classifier has been developed to classify papers into two categories: PM or not PM. The probability of an abstract to be PM is used to re-rank run 2.

SIBTMlit4

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SIBTMlit4
  • Participant: SIBTextMining
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/23/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 6ed49fd34a3d78079ba6f58ace32a448
  • Run description: Run 4 is expanding the search to publications about more specific/general diseases. The simplified neoplasms hierarchy provided by NCI thesaurus is used (https://evs.nci.nih.gov/ftp1/NCI_Thesaurus/Neoplasm/Neoplasm_Core_Hierarchy.html). The run is then merged with run 3 through linear combination.

SIBTMlit5

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SIBTMlit5
  • Participant: SIBTextMining
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/23/2018
  • Type: automatic
  • Task: abstracts
  • MD5: c24f80bff1c792a3dd4c34320d931768
  • Run description: Run 5 is first performing an exact run: the disease, the gene and the variant must be found in the abstract and the demographic information must be either not discussed or matching. Results from run 4 are completing the run 5.

SINAI_Base

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SINAI_Base
  • Participant: SINAI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/31/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 8278acb287184a2078d47022e72e7e55
  • Run description: We create a unique query with the terms of disease, gene and demographic fields. Finally we launch the query in a Lemur IR system.

SINAI_FU

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SINAI_FU
  • Participant: SINAI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/31/2018
  • Type: automatic
  • Task: abstracts
  • MD5: f53b59af99137e4964d8b72edce52547
  • Run description: We create a query with the terms of disease, gene and demographic fields. Then we launch the query in a Lemur IR system to obtain relevant documents. Next we use MetaMap to find UMLS concepts in query and relevant documents. Finally we remove from the list of relevant documents those that do not contain any UMLS concept of the query.

SINAI_FUO

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: SINAI_FUO
  • Participant: SINAI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 7/31/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 9e5c6125ebfd2c648ea66b09e6aac7e7
  • Run description: We create a query with the terms of disease, gene and demographic fields. Then we launch the query in a Lemur IR system to obtain relevant documents. Next we use MetaMap to find UMLS concepts in query and relevant documents. We calculate the percentage of query concepts that appear in each document. Finally we remove from the list of relevant documents those that do not contain any UMLS concept of the query and reranking this list by the percentage of concepts it contains.

sq

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: sq
  • Participant: Poznan
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 983b68352b7c673346c6c3aa5543187f
  • Run description: Simple, boolean query.

sum

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: sum
  • Participant: Brown
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 468c06b520f73d146b721ebaa8cb220d
  • Run description: CombSUM with two language models and bm25 retreival models.

sumAbs

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: sumAbs
  • Participant: Brown
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 0294fb8955b2e51c2196cb377621fca3
  • Run description: CombSum with two language models and bm25 retrieval model.

sumEW

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: sumEW
  • Participant: Brown
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 9dfb4c963bf536b82f94bb56dabcbab5
  • Run description: CombSUM with wordEmbedding and no normalisation.

tinfolabBF

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: tinfolabBF
  • Participant: InfoLabPM
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/2/2018
  • Type: automatic
  • Task: trials
  • MD5: 9f284644b42021589ca7066e897767ac
  • Run description: The matching model used: BB2 Query expansion with genes weighted

tinfolabBK

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: tinfolabBK
  • Participant: InfoLabPM
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/2/2018
  • Type: automatic
  • Task: trials
  • MD5: 28847ceea423c270e3b3c0951271c988
  • Run description: The matching model used: BB2 Query expansion with genes weighted. Expanded disease term to the most preferred atom (via UMLS REST API)

tinfolabF

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: tinfolabF
  • Participant: InfoLabPM
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/2/2018
  • Type: automatic
  • Task: trials
  • MD5: 159815f2bfc842c32cefa1cecf572c4c
  • Run description: The matching model used: BM25 Query expansion with genes weighted

two_stage

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: two_stage
  • Participant: FDUDMIIP
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: e3d45439a89b20c22bc8a29950daabe1
  • Run description: Two stage smoothing.

two_trial1

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: two_trial1
  • Participant: FDUDMIIP
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: e57f42b29f9662118fe75fed5afb52b1
  • Run description: two trial

UCASCT1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCASCT1
  • Participant: UCAS
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: trials
  • MD5: ae6b83f238b5ccaed186937297b4129f
  • Run description: This run is generated by BM25F retrieval model with Bo1 query expansion model. Some synonyms and abbreviations of diseases are added to the topic. Stopword removal and stemming are not performed when indexing and retrieving.

UCASCT2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCASCT2
  • Participant: UCAS
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: trials
  • MD5: df3dd0730f38152f4ffd099c73196635
  • Run description: This run is generated by BM25F retrieval model, whose weight is different from UCASCT1, with Bo1 query expansion model. Some synonyms and abbreviations of diseases are added to the topic. Stopword removal and stemming are not performed when indexing and retrieving.

UCASCT3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCASCT3
  • Participant: UCAS
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: trials
  • MD5: 726a0143492f6fd57ede4ac6f3ccabf2
  • Run description: This run is generated by BM25F retrieval model with Bo1 query expansion model. Some synonyms and abbreviations of diseases are added to the topic. Stopword removal and stemming are performed when indexing and retrieving.

UCASCT4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCASCT4
  • Participant: UCAS
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: trials
  • MD5: 9ff4f19abb1b8c1b325de5541ee6649d
  • Run description: This run is generated by BM25F retrieval model, whose weight is different from UCASCT3, with Bo1 query expansion model. Some synonyms and abbreviations of diseases are added to the topic. Stopword removal and stemming are performed when indexing and retrieving.

UCASCT5

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCASCT5
  • Participant: UCAS
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: trials
  • MD5: e715e47ebd9c53512c492fcd9c8198c4
  • Run description: This run is generated by BM25 retrieval model with KL query expansion model. Some synonyms and abbreviations of diseases are added to the topic. Stopword removal and stemming are not performed when indexing and retrieving.

UCASSA1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCASSA1
  • Participant: UCAS
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 3cd218fae7f8f00cf0575302607b555d
  • Run description: This run is generated by BM25 retrieval model with no query expansion. Some synonyms and abbreviations of diseases are added to the topic. Stopword removal and stemming are performed when indexing and retrieving.

UCASSA2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCASSA2
  • Participant: UCAS
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: abstracts
  • MD5: af4e2091f2c1b643c54f733a13de9418
  • Run description: This run is generated by BM25 retrieval model with no query expansion. Stopword removal and stemming are performed when indexing and retrieving.

UCASSA3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCASSA3
  • Participant: UCAS
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: abstracts
  • MD5: e9f7e04367c3d490e89d2f32f21009a6
  • Run description: An Initial result is generated by BM25 retrieval model with no query expansion. Some synonyms and abbreviations of diseases are added to the topic. Stopword removal and stemming are performed when indexing and retrieving. Then employ K-NRM model to re-rank the initial result.

UCASSA4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCASSA4
  • Participant: UCAS
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 3b725249bd258c0bb6de9e4f5c9a22a8
  • Run description: This run is generated by BM25 retrieval model with no query expansion. Some synonyms and abbreviations of diseases are added to the topic. Stopword removal and stemming are performed when indexing and retrieving.

UCASSA5

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UCASSA5
  • Participant: UCAS
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/3/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 72c406f9ff9384c016164b026b576b3d
  • Run description: An Initial result is generated by BM25 retrieval model with no query expansion. Stopword removal and stemming are performed when indexing and retrieving. Then penalize the score of articles which are not related to treatment, prevention, and prognosis, according to MeSH term.

UDInfoPMCT1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoPMCT1
  • Participant: udel_fang
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 00013971d256bf4ad46ca7fed25b93c2
  • Run description: Term based baseline run. Use the disease and gene as it is.

UDInfoPMCT2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoPMCT2
  • Participant: udel_fang
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 225c2c66acbc65d467ea62acc6c9ec32
  • Run description: Term base retrieval, using the gene and disease as query. Demographic information is used to filter the result

UDInfoPMCT3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoPMCT3
  • Participant: udel_fang
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: aeab539545cf25aefa1f3071e0762c80
  • Run description: Concept based run. using original query, disease + gene as the query.

UDInfoPMCT4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoPMCT4
  • Participant: udel_fang
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 6904a63c4782c0022a5c84498272a998
  • Run description: Concept based run. query expansion with disease ontology

UDInfoPMCT5

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoPMCT5
  • Participant: udel_fang
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: c691cb63d9c901fc6999ac58ba3aaf0d
  • Run description: Two-round. Term based run. Retrieve 5k results in first round using disease + gene + disease ontology expansion. Second round do a binary search using only the original gene field

UDInfoPMSA1

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoPMSA1
  • Participant: udel_fang
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: d263e22c7715ad530c4d1793e9c37a62
  • Run description: use the query as it is, disease + gene, term based

UDInfoPMSA2

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoPMSA2
  • Participant: udel_fang
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 2e55d2aba9ff0c3cda576e4e901b84c3
  • Run description: disease + gene, term based, query expansion using Disease ontology and genecards

UDInfoPMSA3

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoPMSA3
  • Participant: udel_fang
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 41fc44aabc7662b542d5a70e8984cbaf
  • Run description: Concept based run. using original query, disease + gene as the query.

UDInfoPMSA4

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoPMSA4
  • Participant: udel_fang
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: c7447aa0f34a0b1b1c77e0e0b243b351
  • Run description: Concept based run. query expansion with disease ontology

UDInfoPMSA5

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UDInfoPMSA5
  • Participant: udel_fang
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 8680fb2d91b5174cb3295cbb205650bd
  • Run description: Two-round. Term based run. Retrieve 5k results in first round using disease + gene + disease ontology expansion. Second round do a binary search using only the original gene field

UNTIIA_DGES

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UNTIIA_DGES
  • Participant: UNTIIA
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 4833c86f77dab05f5ef310c3f8efaa2d
  • Run description: This run was performed using queries constructed with synonyms of diseases in the topics acquired from MetaMap and synonyms of genes in the topic acquired from NCBI genBank as query expansion with Solr logical query language. The reranking was based on regression analysis, which is a supervised learning algorithm. The training data of the model is from TREC 2017 PM track.

UNTIIA_DGEWS

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UNTIIA_DGEWS
  • Participant: UNTIIA
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 397056c2b3c28a513e4f1204b51da465
  • Run description: This run was performed using queries constructed using disease weighted terms and their synonyms, gene weighted terms and their synonyms with Solr logical query language. The reranking was based on regression analysis, which is a supervised learning algorithm. The training data of the model is from TREC 2017 PM track.

UNTIIA_DGEWU

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UNTIIA_DGEWU
  • Participant: UNTIIA
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: eb0d97e1d20142533dfed0716570a76a
  • Run description: This run was performed using queries constructed using disease weighted terms and their synonyms, gene weighted terms and their synonyms with Solr logical query language. The reranking was based on Doc2Vec, a unsupervised learning technique based on Word2Vec.

UNTIIA_DGS

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UNTIIA_DGS
  • Participant: UNTIIA
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: d0ad53e245a5a2ebdd782227cc889c0d
  • Run description: This run was performed using queries constructed with diseases and genes from the given topics as baseline method. The reranking was based on regression analysis, which is a supervised learning algorithm. The training data of the model is from TREC 2017 PM track.

UNTIIA_WTU

Results | Participants | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UNTIIA_WTU
  • Participant: UNTIIA
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 5dc15c17ebbc60f0f8e2c954bcda115e
  • Run description: This run was performed using queries constructed using disease weighted terms and their synonyms, gene weighted terms and their synonyms, disease specific treatment terms acquired from American cancer society with Solr logical query language. The reranking was based on Doc2Vec, a unsupervised learning technique based on Word2Vec.

UTDHLTRI_NL

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTRI_NL
  • Participant: UTDHLTRI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: cfedde998b594a07a6376d7d1b942236
  • Run description: This run does retrieval using methods use in the previous year with a few adaptations for the new topic format. UMLS, Catalogue of Somatic Mutations in Cancer (COSMIC), FDA, Drug-Gene Interaction Database (DGIdb), and Snomed were used.

UTDHLTRI_NLT

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTRI_NLT
  • Participant: UTDHLTRI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 8eede80164453b405072dac1f79f9774
  • Run description: This run does retrieval using methods use in the previous year with a few adaptations for the new topic format. UMLS, Catalogue of Somatic Mutations in Cancer (COSMIC), FDA, Drug-Gene Interaction Database (DGIdb), and Snomed were used.

UTDHLTRI_RA

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTRI_RA
  • Participant: UTDHLTRI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: ab57b34b13ed4729ce7df5eca6600d16
  • Run description: This run does an initial retrieval using methods use in the previous year, and then applies a learning-to-rank algorithm to re-rank the results. UMLS, Catalogue of Somatic Mutations in Cancer (COSMIC), FDA, Drug-Gene Interaction Database (DGIdb), Snomed, and Ranklib were used.

UTDHLTRI_RAT

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTRI_RAT
  • Participant: UTDHLTRI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 001278f97be64fd88f9d84cbec2c1e5b
  • Run description: This run does an initial retrieval using methods use in the previous year, and then applies a learning-to-rank algorithm to re-rank the results. UMLS, Catalogue of Somatic Mutations in Cancer (COSMIC), FDA, Drug-Gene Interaction Database (DGIdb), Snomed, and Ranklib were used.

UTDHLTRI_RF

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTRI_RF
  • Participant: UTDHLTRI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 1307e9adf9dc00d5bfd141a31b307f67
  • Run description: This run does an initial retrieval using methods use in the previous year, and then applies a learning-to-rank algorithm to re-rank the results. UMLS, Catalogue of Somatic Mutations in Cancer (COSMIC), FDA, Drug-Gene Interaction Database (DGIdb), Snomed, and Ranklib were used.

UTDHLTRI_RFT

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTRI_RFT
  • Participant: UTDHLTRI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: d62ca3cfd285750e85321064f2ccad28
  • Run description: This run does an initial retrieval using methods use in the previous year, and then applies a learning-to-rank algorithm to re-rank the results. UMLS, Catalogue of Somatic Mutations in Cancer (COSMIC), FDA, Drug-Gene Interaction Database (DGIdb), Snomed, and Ranklib were used.

UTDHLTRI_SF

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTRI_SF
  • Participant: UTDHLTRI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: e93a916cb89468a13841c00013d4acf9
  • Run description: This run does an initial retrieval using methods use in the previous year, and then applies a learning-to-rank algorithm to re-rank the results. UMLS, Catalogue of Somatic Mutations in Cancer (COSMIC), FDA, Drug-Gene Interaction Database (DGIdb), Snomed, and Ranklib were used.

UTDHLTRI_SFT

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTRI_SFT
  • Participant: UTDHLTRI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: fd5cfdb9a370b0bbbe53b7c77e6e1381
  • Run description: This run does an initial retrieval using methods use in the previous year, and then applies a learning-to-rank algorithm to re-rank the results. UMLS, Catalogue of Somatic Mutations in Cancer (COSMIC), FDA, Drug-Gene Interaction Database (DGIdb), Snomed, and Ranklib were used.

UTDHLTRI_SS

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTRI_SS
  • Participant: UTDHLTRI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 60df297116dc2130cab642dfa1cb469f
  • Run description: This run does an initial retrieval using methods use in the previous year, and then applies a learning-to-rank algorithm to re-rank the results. UMLS, Catalogue of Somatic Mutations in Cancer (COSMIC), FDA, Drug-Gene Interaction Database (DGIdb), Snomed, and Ranklib were used.

UTDHLTRI_SST

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UTDHLTRI_SST
  • Participant: UTDHLTRI
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: trials
  • MD5: 169955678823f24a91e784f52fbdd4b1
  • Run description: This run does an initial retrieval using methods use in the previous year, and then applies a learning-to-rank algorithm to re-rank the results. UMLS, Catalogue of Somatic Mutations in Cancer (COSMIC), FDA, Drug-Gene Interaction Database (DGIdb), Snomed, and Ranklib were used.

UVAEXPBOOST

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UVAEXPBOOST
  • Participant: UVA_ART
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/4/2018
  • Type: automatic
  • Task: abstracts
  • MD5: ccef2e76b64cd3362f55a914d2fe483e
  • Run description: Resources used: cTAKES (for annotating documents) UMLS (for constructing concept graph) Elasticsearch (for query engine) A subset of documents matching a rough text filter were annotated using cTAKES to produce a set of identified concepts for each document. The documents and the concept terms were indexed in Elasticsearch. We built a concept graph from several UMLS ontologies and implemented a relatedness metric to quantify relationships between concepts. This was used to expand the topic data to a wider group of concepts. The expanded topics were input into a query format for Elasticsearch that emphasized CUI matches (especially disease and gene) and boosted results including terms that refer to treatment and prognosis, and negatively boosted some terms that refer to non-cancer or non-human terms.

UVAEXPBSTDIF

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UVAEXPBSTDIF
  • Participant: UVA_ART
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: 699686de35aadf64b0d233cd2432995d
  • Run description: Resources used: cTAKES (for annotating documents) UMLS (for constructing concept graph) Elasticsearch (for query engine) A subset of documents matching a rough text filter were annotated using cTAKES to produce a set of identified concepts for each document. The documents and the concept terms were indexed in Elasticsearch. We built a concept graph from several UMLS ontologies and implemented a relatedness metric to quantify relationships between concepts. This was used to expand the topic data to a wider group of concepts. The expanded topics were input into a query format for Elasticsearch that emphasized CUI matches (especially disease and gene) and boosted results including terms that refer to treatment and prognosis, and negatively boosted some terms that refer to non-cancer or non-human terms. This run used a different boosting ratio than UVAEXPBOOST.

UVAEXPBSTEXT

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UVAEXPBSTEXT
  • Participant: UVA_ART
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: dd99815234ecb5123a2d80adb464e7c0
  • Run description: Resources used: cTAKES (for annotating documents) UMLS (for constructing concept graph) Elasticsearch (for query engine) A subset of documents matching a rough text filter were annotated using cTAKES to produce a set of identified concepts for each document. The documents and the concept terms were indexed in Elasticsearch. We built a concept graph from several UMLS ontologies and implemented a relatedness metric to quantify relationships between concepts. This was used to expand the topic data to a wider group of concepts. The expanded topics were input into a query format for Elasticsearch that emphasized CUI matches (especially disease and gene) and boosted results including terms that refer to treatment and prognosis, and negatively boosted some terms that refer to non-cancer or non-human terms. This is similar to UVAEXPBOOST but includes extra CUI terms for clinical trials and related to apoptosis and remission, which are boosted, and terms for screening and detection which are negatively boosted.

UVAEXPBSTNEG

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UVAEXPBSTNEG
  • Participant: UVA_ART
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: f78d7f48bb9313bae873bc718a3d17ce
  • Run description: Resources used: cTAKES (for annotating documents) UMLS (for constructing concept graph) Elasticsearch (for query engine) A subset of documents matching a rough text filter were annotated using cTAKES to produce a set of identified concepts for each document. The documents and the concept terms were indexed in Elasticsearch. We built a concept graph from several UMLS ontologies and implemented a relatedness metric to quantify relationships between concepts. This was used to expand the topic data to a wider group of concepts. The expanded topics were input into a query format for Elasticsearch that emphasized CUI matches (especially disease and gene) and boosted results including CUIs that refer to treatment and clinical trial concepts, and negatively boosted some CUIs that refer to cancer screening and detection.

UVAEXPBSTSHD

Results | Participants | Proceedings | Input | Summary (trec_eval) | Summary (sample-eval) | Appendix

  • Run ID: UVAEXPBSTSHD
  • Participant: UVA_ART
  • Track: Precision Medicine
  • Year: 2018
  • Submission: 8/5/2018
  • Type: automatic
  • Task: abstracts
  • MD5: aa91ec0cceef479ab4bb714b2aa8eb20
  • Run description: Resources used: cTAKES (for annotating documents) UMLS (for constructing concept graph) Elasticsearch (for query engine) A subset of documents matching a rough text filter were annotated using cTAKES to produce a set of identified concepts for each document. The documents and the concept terms were indexed in Elasticsearch. We built a concept graph from several UMLS ontologies and implemented a relatedness metric to quantify relationships between concepts. This was used to expand the topic data to a wider group of concepts. The expanded topics were input into a query format for Elasticsearch that emphasized CUI matches (especially disease and gene) and boosted results including terms that refer to treatment and prognosis, and negatively boosted some terms that refer to non-cancer or non-human terms. This run differs in that it leaves gene as a "should" field rather than a "must" field as with other runs. It includes the extra terms from UVAEXPBSTNEG.