Skip to content

Runs - Clinical Trials 2022

Results | Participants | Input | Summary | Appendix

  • Run ID: all_doc_search
  • Participant: POZNAN
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: 5e60c52916484d1003577b03cc79cef0
  • Run description: Boolean search of extracted terms in the entire document. Used with an IDF function.

ANIR_demo

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ANIR_demo
  • Participant: CSIROmed
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: ff05011058c9a5bb62a746de595aeadf
  • Run description: Bi-Encoder SqueezeBert with hybrid statistical scorer tuned on 2021 qrels triples with CT loss, warm started with metamap marco + demographic reranking

bm25_bi_filtered

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: bm25_bi_filtered
  • Participant: els_dshs
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: 97688dfd6c0db352ebf9af4016d735ea
  • Run description: BM25, uni+bi-grams, filtering on age and gender

bm25_st_bienc

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: bm25_st_bienc
  • Participant: els_dshs
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: cefc845f4b2956efe00670d26467cb6b
  • Run description: BM25 (uni+bi-grams, filtered on age and gender) + Sentence Transformer (MiniLM)

Results | Participants | Input | Summary | Appendix

  • Run ID: condition_search
  • Participant: POZNAN
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: 524687731a018d587df47e07cb7999e2
  • Run description: Dedicated model for combining the IDF model with the search done on the condition field in the trial.

Results | Participants | Input | Summary | Appendix

  • Run ID: condition_title_search
  • Participant: POZNAN
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: 94a4fe35f3aed1ebf454d446a0c38da1
  • Run description: Condition search with the title field included in the weighting function

crossrunner

Results | Participants | Input | Summary | Appendix

  • Run ID: crossrunner
  • Participant: V-Ryerson
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/28/2022
  • Type: manual
  • Task: primary
  • MD5: cb8105468e929ea7d61cf0f4e93a4619
  • Run description: BERT

CSIROmedANIR

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: CSIROmedANIR
  • Participant: CSIROmed
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: a1b8d6c6ecef24b24f282c37e1f28d53
  • Run description: Bi-Encoder SqueezeBert with hybrid statistical scorer tuned on 2021 qrels triples with CT loss, warm started with metamap marco.

doct5query

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: doct5query
  • Participant: CSIROmed
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: f0fa6304738266f438b0bccba2b88ffd
  • Run description: BM25 with t5 query expansion and rank fusion.

DoSSIER_1

Results | Participants | Input | Summary | Appendix

  • Run ID: DoSSIER_1
  • Participant: DOSSIER
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/28/2022
  • Type: automatic
  • Task: primary
  • MD5: 04e5a9f0b19658157b614dd6c69036f7
  • Run description: BM25 retrieval based on keywords extracted form the query by KeyBERT.

DoSSIER_2

Results | Participants | Input | Summary | Appendix

  • Run ID: DoSSIER_2
  • Participant: DOSSIER
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: c797aae1b9bd580b231d43dab2388a92
  • Run description: BM25Plus run with input text summary+description+titles+conditions+inclusion lemmatised enriched with keywords from eligibility criteria for positive + negative and family history entities. Query with current medical history text enriched with all KeyBERT keywords and keywords from eligibility criteria for positive + negative and family history entities.

DoSSIER_3

Results | Participants | Input | Summary | Appendix

  • Run ID: DoSSIER_3
  • Participant: DOSSIER
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: f0c85cb7b618752deada87fd623acb85
  • Run description: BM25Plus run with input text summary+description+titles+conditions+eligibility enriched with keywords from eligibility criteria for positive + negative and family history entities. Query with all description text enriched with all KeyBERT keywords and keywords from eligibility criteria for positive + negative and family history entities.

DoSSIER_4

Results | Participants | Input | Summary | Appendix

  • Run ID: DoSSIER_4
  • Participant: DOSSIER
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/28/2022
  • Type: automatic
  • Task: primary
  • MD5: bedbd418c451b286faef7c8f49990719
  • Run description: BM25 retrieval based on keywords extracted form the query by KeyBERT. Then re-ranking with TASB model further trained on the 2first 50 query-document pairs of 2021 TREC CT data.

DoSSIER_5

Results | Participants | Input | Summary | Appendix

  • Run ID: DoSSIER_5
  • Participant: DOSSIER
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/28/2022
  • Type: automatic
  • Task: primary
  • MD5: 37da10fae567e264618ee003280d6d71
  • Run description: Two times re-ranking of DoSSIER_2 top 50. 1st re-ranking with a cross-encoder tuned with 2021 data with descriptive fields. 2nd reranking with a cross-encoder further trained with 2021 data with criteria.

frm3

Results | Participants | Input | Summary | Appendix

  • Run ID: frm3
  • Participant: h2oloo
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/28/2022
  • Type: automatic
  • Task: primary
  • MD5: 8b286e7e40009c9dd9432c6f3946d808
  • Run description: BM25 + RM3 - Anserini/Pyserini on topic description + 120 queries from NQS-3B. Fused with RRF.

frocchio

Results | Participants | Input | Summary | Appendix

  • Run ID: frocchio
  • Participant: h2oloo
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/28/2022
  • Type: automatic
  • Task: primary
  • MD5: c5187c3964e1c00ca270213b4d2852f0
  • Run description: BM25 + Rocchio - Anserini/Pyserini on topic description + 120 queries from NQS-3B. Fused with RRF.

frocchio_monot5_e

Results | Participants | Input | Summary | Appendix

  • Run ID: frocchio_monot5_e
  • Participant: h2oloo
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/28/2022
  • Type: automatic
  • Task: primary
  • MD5: 2523877da77d4599391639331571ef1b
  • Run description: BM25 + Rocchio - Anserini/Pyserini on topic description + 120 queries from NQS-3B. Fused with RRF. Reranked and sorted by monoT5-CT on eligibility segments

frocchio_monot5_ed

Results | Participants | Input | Summary | Appendix

  • Run ID: frocchio_monot5_ed
  • Participant: h2oloo
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/28/2022
  • Type: automatic
  • Task: primary
  • MD5: 7768a535caa6c4f24aceb18c6e45ada6
  • Run description: BM25 + Rocchio - Anserini/Pyserini on topic description + 120 queries from NQS-3B. Fused with RRF. Reranked and sorted by monoT5-CT on eligibility segments and description segments followed by the concatenation of the highest scoring eligibility and description segments

IKR3_BSL

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: IKR3_BSL
  • Participant: UNIMIB
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/27/2022
  • Type: automatic
  • Task: primary
  • MD5: 05b8e2ca15b5b4aefd3a73ff295302c3
  • Run description: DFR - ln_expB2 default parameters, PyTerrier.

IKR3_BSL_TT_HW

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: IKR3_BSL_TT_HW
  • Participant: UNIMIB
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/27/2022
  • Type: automatic
  • Task: primary
  • MD5: 7abe11e7e828af300e262f9db23d3ed3
  • Run description: DFR-ln_expB2 model, TOPSIS retrieval setting applied on the top 2k documents retrieved by the DFR model, Weights are .1,.4,.5

IKR3_BSL_TT_MW

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: IKR3_BSL_TT_MW
  • Participant: UNIMIB
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/27/2022
  • Type: automatic
  • Task: primary
  • MD5: 6b3a5a28c9280d27e4c3639255bf3891
  • Run description: DFR-ln_expB2 model, TOPSIS retrieval setting applied on the top 2k documents retrieved by the DFR model, Weights are .23,.33,.44

IKR3_TT_BW

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: IKR3_TT_BW
  • Participant: UNIMIB
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/27/2022
  • Type: automatic
  • Task: primary
  • MD5: 28d34e3c690aedbfbf84f83a0dd0135c
  • Run description: DFR-ln_expB2 model, TOPSIS retrieval setting, Weights are those that maximize all the precision oriented measures in the 75 queries.

IKR3_TT_MW

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: IKR3_TT_MW
  • Participant: UNIMIB
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/27/2022
  • Type: automatic
  • Task: primary
  • MD5: 909f3903e0bff894ca81b753186ac8d0
  • Run description: DFR-ln_expB2 model, TOPSIS retrieval setting, Weights are assigned manually following an intuition.

ims_BM25Filtered_kw

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ims_BM25Filtered_kw
  • Participant: iiia-unipd
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/24/2022
  • Type: manual
  • Task: primary
  • MD5: 3675bcb119da412be7ab7ad1eab91456
  • Run description: keyword-based manual rewriting + BM25 + age/gender reranking

ims_BM25Filtered_s

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ims_BM25Filtered_s
  • Participant: iiia-unipd
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/24/2022
  • Type: manual
  • Task: primary
  • MD5: 1b67df2ec1e760d19e87db396d6be79f
  • Run description: summary-based manual rewriting + BM25 + age/gender reranking

ims_RM3Filtered_kw

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ims_RM3Filtered_kw
  • Participant: iiia-unipd
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/24/2022
  • Type: manual
  • Task: primary
  • MD5: 57f188f46946910cbf56de734eaf5478
  • Run description: keyword-based manual rewriting + BM25 + RM3 + age/gender reranking

ims_RM3Filtered_s

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ims_RM3Filtered_s
  • Participant: iiia-unipd
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/24/2022
  • Type: manual
  • Task: primary
  • MD5: e4256b00db667f48da5663bf20298bea
  • Run description: summary-based manual rewriting + BM25 + RM3 + age/gender reranking

ims_T5summarizer

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ims_T5summarizer
  • Participant: iiia-unipd
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/24/2022
  • Type: manual
  • Task: primary
  • MD5: 5e63fdac7123d0f27d5381f2ba09a05a
  • Run description: summary-based manual rewriting + T5 rewriting + BM25

jbnu1

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: jbnu1
  • Participant: jbnu
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/28/2022
  • Type: automatic
  • Task: primary
  • MD5: 0c71b5224d59f74b6dec8a4d1d9482f4
  • Run description: Focusing medical terms from ClinicalBERT

jbnu2

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: jbnu2
  • Participant: jbnu
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/28/2022
  • Type: automatic
  • Task: primary
  • MD5: 7a299acd4db5074aff012b513ac8e126
  • Run description: Expanding synonyms for medical terms from ClinicalBERT

monobert500

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: monobert500
  • Participant: CSIROmed
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: 3207ff9dbc53e51c4c97c89064ddcb97
  • Run description: Supervised monoBERT trained on TREC CT 2021 qrels.

phir1m1

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: phir1m1
  • Participant: phi_lab
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/27/2022
  • Type: automatic
  • Task: primary
  • MD5: 8dcbb3e1966ef0c62889350c9c9ac8ac
  • Run description: tf-idf model with named entity recognition

phir2m2

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: phir2m2
  • Participant: phi_lab
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/27/2022
  • Type: automatic
  • Task: primary
  • MD5: 668cde910c3a41aa568e3d4804e48fc9
  • Run description: tf-idf model with named entity recognition and linking

phir3m1prf

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: phir3m1prf
  • Participant: phi_lab
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/27/2022
  • Type: automatic
  • Task: primary
  • MD5: 7742f914afdeea8750c14166545f7b8b
  • Run description: tf-idf model with named entity recognition and linking, with pseudo relevance feedback

phir4m1prf2

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: phir4m1prf2
  • Participant: phi_lab
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/27/2022
  • Type: automatic
  • Task: primary
  • MD5: 180c1a36049877d234d1933108569291
  • Run description: tf-idf model with named entity recognition and linking, with pseudo relevance feedback, tained for ndcg using 2021 topics

phir5m2prf

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: phir5m2prf
  • Participant: phi_lab
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/27/2022
  • Type: automatic
  • Task: primary
  • MD5: 3bdda60211b03802bfe0ed9e7548f5eb
  • Run description: tf-idf model with named entity recognition and linking, with pseudo relevance feedback, tained for RR using 2021 topics

rocchio

Results | Participants | Input | Summary | Appendix

  • Run ID: rocchio
  • Participant: h2oloo
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/28/2022
  • Type: automatic
  • Task: primary
  • MD5: e555c3ce17ab1a1a77bfee87f3610115
  • Run description: BM25 + Rocchio - Anserini/Pyserini

run1

Results | Participants | Input | Summary | Appendix

  • Run ID: run1
  • Participant: ELUCIDATA_ML
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/27/2022
  • Type: automatic
  • Task: primary
  • MD5: 666c04aa361f0607a59e808095e5203a
  • Run description: Uses sentence bert framework

senttr

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: senttr
  • Participant: els_dshs
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/28/2022
  • Type: automatic
  • Task: primary
  • MD5: 652e759a3367826316bd89853363d485
  • Run description: Pre-trained sentence transformer (MiniLM)

st_distilbert

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: st_distilbert
  • Participant: els_dshs
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: 712565edf611c22b133a29b8ebeff7de
  • Run description: Pre-trained DistilBERT (BioASQ+MSMARCO)

zs_bert_500

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: zs_bert_500
  • Participant: CSIROmed
  • Track: Clinical Trials
  • Year: 2022
  • Submission: 8/29/2022
  • Type: automatic
  • Task: primary
  • MD5: 67dc673d2689fda30c4a4977a2185a8f
  • Run description: Zero-shot monoBERT trained on an auxiliary task defined on the CT corpus.