Runs - NeuCLIR 2023
fas-CIIR-ANEH-NativeFuisonTrec23
Participants
Run ID: fas-CIIR-ANEH-NativeFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: auto Task: fas MD5: ae001909bab712e06f04bd735aa12476 Run description: Fusion of provided baseline, dense and sparse neural models.
fas-CIIR-ATEH-HybridFuisonTrec23
Participants
Run ID: fas-CIIR-ATEH-HybridFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: auto Task: fas MD5: 9fa6e09ac47f4ea64cea2b9c5a7cff72 Run description: Fusion of runs based on translated docs and runs based on native docs.
fas-CIIR-ATEH-TransFuisonTrec23
Participants
Run ID: fas-CIIR-ATEH-TransFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: auto Task: fas MD5: dca2076ce1c843f6284fef94cd6aaf8c Run description: Fuse provided baseline, dense and sparse neural models
fas-CIIR-LATE-SPLADE
Participants
Run ID: fas-CIIR-LATE-SPLADE Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 6/26/2023 Type: auto Task: fas MD5: 12cc8dc85a3df4413515702f9a65e355 Run description: sparse neural run using Splade
fas-h2oloo-A1NETHP_BM25sSplades
Participants
Run ID: fas-h2oloo-A1NETHP_BM25sSplades Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: 3c54663bf574836a466b6ad2b3198874 Run description: Ensemble of BM25s and SPLADEs (document translation one + query translation one)
fas-h2oloo-A1NETHP_EverythingRun
Participants
Run ID: fas-h2oloo-A1NETHP_EverythingRun Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: ce7f7afec2cff3b77d00784734b25eb3 Run description: Ensemble of all our baseline first stage runs
fas-h2oloo-A1NETSP_BM25s
Participants
Run ID: fas-h2oloo-A1NETSP_BM25s Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: 00fda7bbdb90af7400845016630bc300 Run description: Ensemble of BM25s (document translation one + query translation one)
fas-h2oloo-A1PND_mContrieverqt
Participants
Run ID: fas-h2oloo-A1PND_mContrieverqt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: fa66b45a70efc7da53557a777ef72141 Run description: Learned Sparse retrieval using mContriever trained on MIRACL
fas-h2oloo-A1PND_SpladeMiraclMonoqt
Participants
Run ID: fas-h2oloo-A1PND_SpladeMiraclMonoqt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: 76ba9e06aaf0ce7929e7e3681afd7982 Run description: Learned Sparse retrieval using SPLADE model trained on MIRACL
fas-h2oloo-A1PNL_spladeqt
Participants
Run ID: fas-h2oloo-A1PNL_spladeqt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: 7640dcec195f51489f107b6d504a941d Run description: Learned Sparse retrieval using SPLADE model from NeuCLIR2022
fas-h2oloo-A1PNS_bm25qt
Participants
Run ID: fas-h2oloo-A1PNS_bm25qt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: 91df19ee95ace1697f75b0edfed768a3 Run description: BM25 with default pyserini parameters
fas-h2oloo-A_frgpt4
Participants
Run ID: fas-h2oloo-A_frgpt4 Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: 3ff3d9fa0081892bcd4f59a30cfbc8e1 Run description: Reranking the top30 of our "Reranking ensemble on top of the Ensemble of all our baseline first stage runs" using GPT4 and then ensembled with the previous run
fas-h2oloo-A_RERANKBM25s
Participants
Run ID: fas-h2oloo-A_RERANKBM25s Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: cb982c2045582184cc2873bcc2366013 Run description: Reranking the top1000 of our "BM25 ensemble"
fas-h2oloo-A_RERANKBM25sSplades
Participants
Run ID: fas-h2oloo-A_RERANKBM25sSplades Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: eb64614ea2ea4c667c83b188502c3d7a Run description: Reranking the top1000 of our "BM25+SPLADEs ensemble"
fas-h2oloo-A_RERANKEverythingRun
Participants
Run ID: fas-h2oloo-A_RERANKEverythingRun Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: ae4b66195cea692eee4fcd1b95bbf968 Run description: Reranking the top1000 of our All first stage ensemble
fas-h2oloo-A_rgpt4
Participants
Run ID: fas-h2oloo-A_rgpt4 Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: 56e905c53615f3fa49266e47edcfde5c Run description: Reranking the top30 of our "Reranking ensemble on top of the Ensemble of all our baseline first stage runs" using GPT4
fas-h2oloo-AETD_RetroMAEReprodt
Participants
Run ID: fas-h2oloo-AETD_RetroMAEReprodt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: 31f5dbd5c06da42afc1a49d5a0381f0f Run description: Our reproduction of RetroMAE trained on MSMARCO
fas-h2oloo-AETD_SpladeMiraclENdt
Participants
Run ID: fas-h2oloo-AETD_SpladeMiraclENdt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: 8ac66e4a1449b06f845ec3c668f80fc8 Run description: Learned sparse neural using splade_pp_self_distil from huggingface
fas-h2oloo-AETL_spladedt
Participants
Run ID: fas-h2oloo-AETL_spladedt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: b40ac129c8992cf0af3895fde9cd6c61 Run description: Learned sparse neural using splade_pp_self_distil from huggingface without any further training
fas-h2oloo-AETS_bm25dt
Participants
Run ID: fas-h2oloo-AETS_bm25dt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: ebd4cc16ce8c3e3f2415b2d365f00c69 Run description: BM25 over translated documents
fas-hltcoe-DEMN-PLAIDkd-monomt5tt-td
Participants
Run ID: fas-hltcoe-DEMN-PLAIDkd-monomt5tt-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 5388cfbd50ad2e4ada3f6e9c59bbb311 Run description: Dense Retrieval with PLAID trained with distillation from monomT5 reranking on top 50 docs retrieved by ColBERT-Xv1 TT model. 1 bit index.
fas-hltcoe-DPMN-PLAID192mono-td
Participants
Run ID: fas-hltcoe-DPMN-PLAID192mono-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 897c9ef06b4f47e5603edabc88c7d8e2 Run description: Dense Retrieval with PLAID trained with total batch size of 192 translated MS-MARCO triples (both q and d in document lang) on 8 GPUs. 1 bit index.
fas-hltcoe-HEMN-PLAIDkd-mT5gt-td
Participants
Run ID: fas-hltcoe-HEMN-PLAIDkd-mT5gt-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 7b264abbb1cd0e57aa14f342e9df8d21 Run description: Dense Retrieval with PLAID trained with distillation (English queries) followed by MonomT5 reranker using Google translated queries on top 1000 documents.
fas-hltcoe-HEMN2-mT5gt-td
Participants
Run ID: fas-hltcoe-HEMN2-mT5gt-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 1b2b36974940ad886e7a946e77621bba Run description: MonomT5 reranker using Google translated queries on top 1000 documents.
fas-hltcoe-MNED-colbertX
Participants
Run ID: fas-hltcoe-MNED-colbertX Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 172c35b90e6209c72a0bde628d68dbdb Run description: Dense Retrieval with a ColBERT-X model trained with translated-train over English queries
fas-hltcoe-MNED-PLAID_shard_by_date_1bit_v1_tt
Participants
Run ID: fas-hltcoe-MNED-PLAID_shard_by_date_1bit_v1_tt Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 7ab27ee9f48eb43949c255d6b8550a50 Run description: Dense Retrieval with PLAID using a v1 translate-train model, with 1 bit indexes, shared into 3 month periods, queries with time only include shards of relevant time window
fas-hltcoe-MNES-patapscoBM25noRM3desc
Participants
Run ID: fas-hltcoe-MNES-patapscoBM25noRM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: aa162ba9805ba5f18a8d3f15648b3457 Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Persian documents and using Google Translate to create Persian queries from English tokenization with spacy and stemming with parsivar
fas-hltcoe-MNES-patapscoBM25noRM3td
Participants
Run ID: fas-hltcoe-MNES-patapscoBM25noRM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 9c4f1685aff837f67c5dadc8b3259638 Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Persian documents and using Google Translate to create Persian queries from English tokenization with spacy and stemming with parsivar
fas-hltcoe-MNES-patapscoBM25noRM3title
Participants
Run ID: fas-hltcoe-MNES-patapscoBM25noRM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: f6a4176fa730fdc909a7542c37ed1f18 Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Persian documents and using Google Translate to create Persian queries from English tokenization with spacy and stemming with parsivar
fas-hltcoe-MNES-patapscoBM25RM3desc
Participants
Run ID: fas-hltcoe-MNES-patapscoBM25RM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 1b9b4213dd3c24def28ef3cd50a9f7f3 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Persian documents and using Google Translate to create Persian queries from English tokenization with spacy and stemming with parsivar
fas-hltcoe-MNES-patapscoBM25RM3td
Participants
Run ID: fas-hltcoe-MNES-patapscoBM25RM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: c6f3ffeb89889ec0b5e4f01951cfaba6 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Persian documents and using Google Translate to create Persian queries from English tokenization with spacy and stemming with parsivar
fas-hltcoe-MNES-patapscoBM25RM3title
Participants
Run ID: fas-hltcoe-MNES-patapscoBM25RM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: db9f19b2b47bf9fe9b6f454d737912e8 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Persian documents and using Google Translate to create Persian queries from English tokenization with spacy and stemming with parsivar
fas-hltcoe-MNPS-patapscoBM25noRM3desc
Participants
Run ID: fas-hltcoe-MNPS-patapscoBM25noRM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 21ce71ede46524daa88d9783167ad188 Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Persian documents and using queries written in Persian queries, tokenization with spacy and stemming with parsivar
fas-hltcoe-MNPS-patapscoBM25noRM3td
Participants
Run ID: fas-hltcoe-MNPS-patapscoBM25noRM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: d9f256d5bacfe0fca240a6cecc8d17cc Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Persian documents and using queries written in Persian queries, tokenization with spacy and stemming with parsivar
fas-hltcoe-MNPS-patapscoBM25noRM3title
Participants
Run ID: fas-hltcoe-MNPS-patapscoBM25noRM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 7a3d4775e44c9976fe3cb79c22814a3d Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Persian documents and using queries written in Persian queries, tokenization with spacy and stemming with parsivar
fas-hltcoe-MNPS-patapscoBM25RM3desc
Participants
Run ID: fas-hltcoe-MNPS-patapscoBM25RM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: dc6700001b1af7efdab2cdc5a0944715 Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Persian documents and using queries written in Persian queries, tokenization with spacy and stemming with parsivar
fas-hltcoe-MNPS-patapscoBM25RM3td
Participants
Run ID: fas-hltcoe-MNPS-patapscoBM25RM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 327f2877a69cb1dc79694c0bb605a981 Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Persian documents and using queries written in Persian queries, tokenization with spacy and stemming with parsivar
fas-hltcoe-MNPS-patapscoBM25RM3title
Participants
Run ID: fas-hltcoe-MNPS-patapscoBM25RM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 8e73ff92637633582e6d819c1fc1040c Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Persian documents and using queries written in Persian queries, tokenization with spacy and stemming with parsivar
fas-hltcoe-MTED-plaid_v2_eng_1
Participants
Run ID: fas-hltcoe-MTED-plaid_v2_eng_1 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 41c386fecf78d8999b28aa4ad1f73aad Run description: Dense Retrieval with PLAID using a distributed v2 model, with 1 bit indexes, indexing English Documents
fas-hltcoe-MTES-patapscoBM25noRM3desc
Participants
Run ID: fas-hltcoe-MTES-patapscoBM25noRM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 9731bdffb00ef164a006e84c274915fa Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy
fas-hltcoe-MTES-patapscoBM25noRM3td
Participants
Run ID: fas-hltcoe-MTES-patapscoBM25noRM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 46bf195eb10f2804a085eac9bda82469 Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy
fas-hltcoe-MTES-patapscoBM25noRM3title
Participants
Run ID: fas-hltcoe-MTES-patapscoBM25noRM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 4499a15df44c54b371620fea3e6a37c2 Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy
fas-hltcoe-MTES-patapscoBM25RM3desc
Participants
Run ID: fas-hltcoe-MTES-patapscoBM25RM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 3480af2e04751c544bee71afa350dedf Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy
fas-hltcoe-MTES-patapscoBM25RM3td
Participants
Run ID: fas-hltcoe-MTES-patapscoBM25RM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: ac897e4aa5a744e0274066d4f003062b Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy
fas-hltcoe-MTES-patapscoBM25RM3title
Participants
Run ID: fas-hltcoe-MTES-patapscoBM25RM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: fas MD5: 986a4fb2b218598cd900fb8cdcadfb1f Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy
fas-hltcoe-SEMN-PSQ-t
Participants
Run ID: fas-hltcoe-SEMN-PSQ-t Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/7/2023 Type: manual Task: fas MD5: f85a411526f33ecec42153e2278bf61c Run description: PSQ with pmf=0.00001, topk=32, cdf=1.0
fas-hltcoe-SEMN-PSQ-td
Participants
Run ID: fas-hltcoe-SEMN-PSQ-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/7/2023 Type: manual Task: fas MD5: a395a5e220917f6817f6509cac7c40fa Run description: PSQ with pmf=0.00001, topk=32, cdf=1.0
fas-umd_hcil-AELN_blade
Participants
Run ID: fas-umd_hcil-AELN_blade Participant: umd_hcil Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: fas MD5: a393c15f639adf4a9bbbb3cb11a613fc Run description: Learned sparse retrieval using bilingual BERT model
mlir-CIIR-ANEH-NativeFuisonTrec23
Participants
Run ID: mlir-CIIR-ANEH-NativeFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: auto Task: mlir MD5: dd68981b4b66c4c93caa8673cf365249 Run description: Fusion of provided baseline, dense and sparse neural models.
mlir-CIIR-ATEH-HybridFuisonTrec23
Participants
Run ID: mlir-CIIR-ATEH-HybridFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: auto Task: mlir MD5: 8d08d3f7afe6580fec001f68bcd398ce Run description: Fusion of runs based on translated docs and runs based on native docs.
mlir-CIIR-ATEH-TransFuisonTrec23
Participants
Run ID: mlir-CIIR-ATEH-TransFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: auto Task: mlir MD5: c79dfd62fdc6a22942e0670d1efaf54f Run description: Fuse provided baseline, dense and sparse neural models.
mlir-CIIR-LATE-SPLADE
Participants
Run ID: mlir-CIIR-LATE-SPLADE Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 6/26/2023 Type: auto Task: mlir MD5: 198564b330fa8aeeadf2299f4aca80bb Run description: sparse neural run using Splade
mlir-h2oloo-A_BM25s
Participants
Run ID: mlir-h2oloo-A_BM25s Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: mlir MD5: 0a855fd8d8c585459a21deb9229609a0 Run description: Concatenation of all our BM25s runs for each language.
mlir-h2oloo-A_BM25sSplades
Participants
Run ID: mlir-h2oloo-A_BM25sSplades Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: mlir MD5: 3599a8f7a6c603653f0af7f1e84acf49 Run description: Concatenation of all our BM25sSplades runs for each language.
mlir-h2oloo-A_EverythingRun
Participants
Run ID: mlir-h2oloo-A_EverythingRun Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: mlir MD5: 6e4126b275fc2d20409dc7ea5f52ee2c Run description: Concatenation of all our EverythingRun runs for each language.
mlir-h2oloo-A_frgpt4
Participants
Run ID: mlir-h2oloo-A_frgpt4 Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: mlir MD5: 41e5e846f155bf54c9c914b96b8b6c08 Run description: Concatenation of all our rgpt4 runs for each language.
mlir-h2oloo-A_RERANKBM25s
Participants
Run ID: mlir-h2oloo-A_RERANKBM25s Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: mlir MD5: 7daedd035706def2680763e132e377a9 Run description: Concatenation of all our RerankBM25s runs for each language.
mlir-h2oloo-A_RERANKBM25sSplades
Participants
Run ID: mlir-h2oloo-A_RERANKBM25sSplades Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: mlir MD5: bc8cff2b20914c8e774b444135f69ba5 Run description: Concatenation of all our RerankBM25sSplades runs for each language.
mlir-h2oloo-A_RERANKEverythingRun
Participants
Run ID: mlir-h2oloo-A_RERANKEverythingRun Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: mlir MD5: 53beeda2a4eef404bda32dffca31d4ea Run description: Concatenation of all our RerankEverything runs for each language.
mlir-h2oloo-A_rgpt4
Participants
Run ID: mlir-h2oloo-A_rgpt4 Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: mlir MD5: a74c9dc366a4ac59c3e3e46f71d54cba Run description: Concatenation of all our gpt4 runs for each language.
mlir-hltcoe-MNED-colbertX
Participants
Run ID: mlir-hltcoe-MNED-colbertX Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: mlir MD5: 3125be547ce0014381b27fa238816fe7 Run description: Dense Retrieval with a ColBERT-X model trained with mixed matches of multilingual translated-train over English queries
mlir-hltcoe-MNED-plaid_v1_mtt_1bit
Participants
Run ID: mlir-hltcoe-MNED-plaid_v1_mtt_1bit Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: mlir MD5: af80cc32b783c1eac6823b347772498e Run description: Dense Retrieval with PLAID using a v1 mixed-batch translate-train model, with 1 bit indexes
mlir-hltcoe-MNED-plaid_v1_mtt_1bit_date
Participants
Run ID: mlir-hltcoe-MNED-plaid_v1_mtt_1bit_date Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: mlir MD5: 0ef2544e50d6909b046cf2953931ef04 Run description: Dense Retrieval with PLAID using a v1 mixed-batch translate-train model, with 1 bit indexes, shared into 3 month periods, queries with time only include shards of relevant time window
mlir-hltcoe-MTED-plaid_v2_eng_1
Participants
Run ID: mlir-hltcoe-MTED-plaid_v2_eng_1 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: mlir MD5: ef7d5e225b6bc73c09dd5e33d8765844 Run description: Dense Retrieval with PLAID using a distributed v2 model, with 1 bit indexes, indexing English Documents
mlir-hltcoe-MTES-patapscoBM25noRM3desc
Participants
Run ID: mlir-hltcoe-MTES-patapscoBM25noRM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: mlir MD5: 15e263cb6551af24ab9743976fcda626 Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy
mlir-hltcoe-MTES-patapscoBM25noRM3td
Participants
Run ID: mlir-hltcoe-MTES-patapscoBM25noRM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: mlir MD5: da377fe6f1e32352db2e9dee2b4a7202 Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy
mlir-hltcoe-MTES-patapscoBM25noRM3title
Participants
Run ID: mlir-hltcoe-MTES-patapscoBM25noRM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: mlir MD5: 3fa6608c720c88a51c1181b20f02b358 Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy
mlir-hltcoe-MTES-patapscoBM25RM3desc
Participants
Run ID: mlir-hltcoe-MTES-patapscoBM25RM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: mlir MD5: f4cb868b8d35b695b9b80194cbfa5ad8 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documentstokenization and stemming with spacy
mlir-hltcoe-MTES-patapscoBM25RM3td
Participants
Run ID: mlir-hltcoe-MTES-patapscoBM25RM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: mlir MD5: 2698733199a41672017fbf6634dd5663 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documentstokenization and stemming with spacy
mlir-hltcoe-MTES-patapscoBM25RM3title
Participants
Run ID: mlir-hltcoe-MTES-patapscoBM25RM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: mlir MD5: 8a83c8640c1883a446a568f0faa8af32 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documentstokenization and stemming with spacy
mlir-hltcoe-SEMN-PSQraw-t
Participants
Run ID: mlir-hltcoe-SEMN-PSQraw-t Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/7/2023 Type: manual Task: mlir MD5: 434d56a4a428210c826a256b00232bd0 Run description: PSQ merge raw scores from CLIR T runs
mlir-hltcoe-SEMN-PSQraw-td
Participants
Run ID: mlir-hltcoe-SEMN-PSQraw-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/7/2023 Type: manual Task: mlir MD5: 0fdb0dc3627d09ee13ce499c70493b87 Run description: PSQ merge raw scores from CLIR TD runs
rus-CIIR-ANEH-NativeFuisonTrec23
Participants
Run ID: rus-CIIR-ANEH-NativeFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: auto Task: rus MD5: 962862fb3e72f6aa5d43ccbf3e840932 Run description: Fusion of provided baseline, dense and sparse neural models.
rus-CIIR-ATEH-HybridFuisonTrec23
Participants
Run ID: rus-CIIR-ATEH-HybridFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: auto Task: rus MD5: b6f23a9390af069e73632d4afb5fab5a Run description: Fusion of runs based on translated docs and runs based on native docs.
rus-CIIR-ATEH-TransFuisonTrec23
Participants
Run ID: rus-CIIR-ATEH-TransFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: auto Task: rus MD5: d685905e5aa1234b623e1fdf27efa3ab Run description: Fuse provided baseline, dense and sparse neural models.
rus-CIIR-LATE-SPLADE
Participants
Run ID: rus-CIIR-LATE-SPLADE Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 6/26/2023 Type: auto Task: rus MD5: 906cd040dbd936bedf423f03eedef6e0 Run description: sparse neural run using Splade
rus-h2oloo-A1NETHR_BM25sSplades
Participants
Run ID: rus-h2oloo-A1NETHR_BM25sSplades Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: 122bae183e880e4eb674f29ec7060688 Run description: Ensemble of BM25s and SPLADEs (document translation one + query translation one)
rus-h2oloo-A1NETHR_EverythingRun
Participants
Run ID: rus-h2oloo-A1NETHR_EverythingRun Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: f035def7fa35d07dc2f59cfb6a30e17d Run description: Ensemble of all our first stage runs
rus-h2oloo-A1NETSR_BM25s
Participants
Run ID: rus-h2oloo-A1NETSR_BM25s Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: a1b68c64421b17e00098e42557490395 Run description: Ensemble of BM25s (document translation one + query translation one)
rus-h2oloo-A1RND_mContrieverqt
Participants
Run ID: rus-h2oloo-A1RND_mContrieverqt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: 23e65c2858468e8d9ae59ca7b3b6595e Run description: mContriever trained on MIRACL
rus-h2oloo-A1RND_SpladeMiraclMonoqt
Participants
Run ID: rus-h2oloo-A1RND_SpladeMiraclMonoqt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: b53dba4628636970adf29d5590382610 Run description: SPLADE trained on MIRACL
rus-h2oloo-A1RNL_spladeqt
Participants
Run ID: rus-h2oloo-A1RNL_spladeqt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: 6004bd59ab97792e7cab6a892d19ad11 Run description: SPLADE used on neuCLIR 2022
rus-h2oloo-A1RNS_bm25qt
Participants
Run ID: rus-h2oloo-A1RNS_bm25qt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: 733b2461ef40afc46233149130b1742d Run description: BM25
rus-h2oloo-A_frgpt4
Participants
Run ID: rus-h2oloo-A_frgpt4 Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: 9d0281c044b4a3cfbdf97011b52a3707 Run description: Reranking the top30 of our "Reranking ensemble on top of the Ensemble of all our baseline first stage runs" using GPT4 and then ensembled with the previous run
rus-h2oloo-A_RERANKBM25s
Participants
Run ID: rus-h2oloo-A_RERANKBM25s Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: 12e426644024498d7807db359c90db79 Run description: Reranking the top1000 of our "BM25 ensemble
rus-h2oloo-A_RERANKBM25sSplades
Participants
Run ID: rus-h2oloo-A_RERANKBM25sSplades Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: ffe6afff89dcf2e480f252fd5352efcd Run description: Reranking the top1000 of our "BM25+SPLADEs ensemble"
rus-h2oloo-A_RERANKEverythingRun
Participants
Run ID: rus-h2oloo-A_RERANKEverythingRun Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: 76df1395652d378655b1b4342d969921 Run description: Reranking the top1000 of our All first stage ensemble
rus-h2oloo-A_rgpt4
Participants
Run ID: rus-h2oloo-A_rgpt4 Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: 597fa281a4fb7dd3978c3b8f0bc81ac4 Run description: Reranking the top30 of our "Reranking ensemble on top of the Ensemble of all our baseline first stage runs" using GPT4
rus-h2oloo-AETD_RetroMAEReprodt
Participants
Run ID: rus-h2oloo-AETD_RetroMAEReprodt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: 80a5f612f4b20f2847d3b570b8ffbf8c Run description: Our RetroMAE reproduction trained on MSMARCO (dense)
rus-h2oloo-AETD_SpladeMiraclENdt
Participants
Run ID: rus-h2oloo-AETD_SpladeMiraclENdt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: 512fd67bfe9c7167b95d57ca5a83dfdd Run description: SPLADE trained on the english part of MIRACL
rus-h2oloo-AETL_spladedt
Participants
Run ID: rus-h2oloo-AETL_spladedt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: a6aad790d28b48900b54c954815c7f55 Run description: SPLADE ++ self distil from huggingface
rus-h2oloo-AETS_bm25dt
Participants
Run ID: rus-h2oloo-AETS_bm25dt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: df9b4b558c57bb12cc8be1afc34d5d20 Run description: BM25 over translated documents
rus-hltcoe-DEMN-PLAIDkd-monomt5tt-td
Participants
Run ID: rus-hltcoe-DEMN-PLAIDkd-monomt5tt-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 9bcb8008f7d57278e31d40f441d4e800 Run description: Dense Retrieval with PLAID trained with distillation from monomT5 reranking on top 50 docs retrieved by ColBERT-Xv1 TT model. 1 bit index.
rus-hltcoe-DRMN-PLAID192mono-td
Participants
Run ID: rus-hltcoe-DRMN-PLAID192mono-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: cc29597b2144e82956115c606165a69d Run description: Dense Retrieval with PLAID trained with total batch size of 192 translated MS-MARCO triples (both q and d in document lang) on 8 GPUs. 1 bit index.
rus-hltcoe-HEMN-PLAIDkd-mT5gt-td
Participants
Run ID: rus-hltcoe-HEMN-PLAIDkd-mT5gt-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 139f8a69b3bf464062e901b96bde6fbf Run description: Dense Retrieval with PLAID trained with distillation (English queries) followed by MonomT5 reranker using Google translated queries on top 1000 documents.
rus-hltcoe-HEMN2-mT5gt-td
Participants
Run ID: rus-hltcoe-HEMN2-mT5gt-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: cc3cb7bd85d7feda42c16788a42cc6b9 Run description: MonomT5 reranker using Google translated queries on top 1000 documents.
rus-hltcoe-MNED-colbertX
Participants
Run ID: rus-hltcoe-MNED-colbertX Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 13169c0837c82a2e25004ad12d74ca6f Run description: Dense Retrieval with a ColBERT-X model trained with translated-train over English queries
rus-hltcoe-MNED-PLAID_shard_by_date_1bit_v1_tt
Participants
Run ID: rus-hltcoe-MNED-PLAID_shard_by_date_1bit_v1_tt Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: f60052b1b2dda840039074771ad4ab2a Run description: Dense Retrieval with PLAID using a v1 translate-train model, with 1 bit indexes, shared into 3 month periods, queries with time only include shards of relevant time window
rus-hltcoe-MNES-patapscoBM25noRM3desc
Participants
Run ID: rus-hltcoe-MNES-patapscoBM25noRM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: e86ab91d195d3f62b3a40a079fff2f73 Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Russian documents and using Google Translate to create Russina queries from English tokenization and stemming with spacy
rus-hltcoe-MNES-patapscoBM25noRM3td
Participants
Run ID: rus-hltcoe-MNES-patapscoBM25noRM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: f97390a929249362a89dce1d1fcec7b4 Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Russian documents and using Google Translate to create Russina queries from English tokenization and stemming with spacy
rus-hltcoe-MNES-patapscoBM25noRM3title
Participants
Run ID: rus-hltcoe-MNES-patapscoBM25noRM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 4d105cccf26c362a47cb10fafd2dac29 Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Russian documents and using Google Translate to create Russina queries from English tokenization and stemming with spacy
rus-hltcoe-MNES-patapscoBM25RM3desc
Participants
Run ID: rus-hltcoe-MNES-patapscoBM25RM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 96358fe0468e932e7fd5e805c5a2b457 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Russian documents and using Google Translate to create Russian queries from English tokenization and stemming with spacy
rus-hltcoe-MNES-patapscoBM25RM3td
Participants
Run ID: rus-hltcoe-MNES-patapscoBM25RM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 153fa14f4237b11a4554009cccf444c1 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Russian documents and using Google Translate to create Russian queries from English tokenization and stemming with spacy
rus-hltcoe-MNES-patapscoBM25RM3title
Participants
Run ID: rus-hltcoe-MNES-patapscoBM25RM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 91e870d5516e7852bc6f24b69295f81e Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Russian documents and using Google Translate to create Russian queries from English tokenization and stemming with spacy
rus-hltcoe-MNRS-patapscoBM25noRM3desc
Participants
Run ID: rus-hltcoe-MNRS-patapscoBM25noRM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 3de33cf34861e7934dbaac398f0bb4e4 Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Russian documents and using queries written in Russian queries, tokenization and stemming with spacy
rus-hltcoe-MNRS-patapscoBM25noRM3td
Participants
Run ID: rus-hltcoe-MNRS-patapscoBM25noRM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: f8b299f256f2e00d8091206b1d3dc39e Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Russian documents and using queries written in Russian queries, tokenization and stemming with spacy
rus-hltcoe-MNRS-patapscoBM25noRM3title
Participants
Run ID: rus-hltcoe-MNRS-patapscoBM25noRM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 2244717b9c243c9b2db354c2a8de0a97 Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Russian documents and using queries written in Russian queries, tokenization and stemming with spacy
rus-hltcoe-MNRS-patapscoBM25RM3desc
Participants
Run ID: rus-hltcoe-MNRS-patapscoBM25RM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 1bd5744df432d68211c51ed4e08e4b72 Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Russian documents and using queries written in Russian queries, tokenization and stemming with spacy
rus-hltcoe-MNRS-patapscoBM25RM3td
Participants
Run ID: rus-hltcoe-MNRS-patapscoBM25RM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 167626d6a57129091a4cc562f73cd250 Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Russian documents and using queries written in Russian queries, tokenization and stemming with spacy
rus-hltcoe-MNRS-patapscoBM25RM3title
Participants
Run ID: rus-hltcoe-MNRS-patapscoBM25RM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: f7b0963745a8a09f0134b91dc89daff1 Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Russian documents and using queries written in Russian queries, tokenization and stemming with spacy
rus-hltcoe-MTED-plaid_v2_eng_1
Participants
Run ID: rus-hltcoe-MTED-plaid_v2_eng_1 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: b445c34be6a61cd2ef306b12353125c1 Run description: Dense Retrieval with PLAID using a distributed v2 model, with 1 bit indexes, indexing English Documents
rus-hltcoe-MTES-patapscoBM25noRM3desc
Participants
Run ID: rus-hltcoe-MTES-patapscoBM25noRM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 9de429f76b3b7c4913bdbf11094c4a21 Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy
rus-hltcoe-MTES-patapscoBM25noRM3td
Participants
Run ID: rus-hltcoe-MTES-patapscoBM25noRM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 5adf65db5c83e99f1a78dd4ef0dafe40 Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy
rus-hltcoe-MTES-patapscoBM25noRM3title
Participants
Run ID: rus-hltcoe-MTES-patapscoBM25noRM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 1a51ba8fcd25d959b73fc09a79230f1e Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy
rus-hltcoe-MTES-patapscoBM25RM3desc
Participants
Run ID: rus-hltcoe-MTES-patapscoBM25RM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: e2974d1eabb37743f2bc3dc74a717580 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy
rus-hltcoe-MTES-patapscoBM25RM3td
Participants
Run ID: rus-hltcoe-MTES-patapscoBM25RM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: ee604247c12d05d23728ca1ab7dcd12b Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy
rus-hltcoe-MTES-patapscoBM25RM3title
Participants
Run ID: rus-hltcoe-MTES-patapscoBM25RM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: rus MD5: 195599b8f2f786c6bdd3f2a3dc63d851 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy
rus-hltcoe-SEMN-PSQ-t
Participants
Run ID: rus-hltcoe-SEMN-PSQ-t Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/7/2023 Type: manual Task: rus MD5: 380e709da9178df7f8ee10b86b5ca0d8 Run description: PSQ with pmf=0.00001, topk=all, cdf=1.0
rus-hltcoe-SEMN-PSQ-td
Participants
Run ID: rus-hltcoe-SEMN-PSQ-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/7/2023 Type: manual Task: rus MD5: 6ec0c7865c358b8d1948ae268d9670b7 Run description: PSQ with pmf=0.00001, topk=all, cdf=1.0
rus-umd_hcil-AELN_blade
Participants
Run ID: rus-umd_hcil-AELN_blade Participant: umd_hcil Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: rus MD5: 942621e1c24828b331d352ae12a18bd1 Run description: Learned sparse retrieval using bilingual BERT model
tech-AI2-1DEAT-Specter2Description
Participants
Run ID: tech-AI2-1DEAT-Specter2Description Participant: AI2 Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: auto Task: tech MD5: 106ce21aed83be35c123c47632358a06 Run description: dense neural using Specter 2 embeddings and FAISS
tech-AI2-1DEAT-Specter2Narrative
Participants
Run ID: tech-AI2-1DEAT-Specter2Narrative Participant: AI2 Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: auto Task: tech MD5: c141b290f4bbaa01d0006e8c97b5b0ba Run description: dense neural using Specter 2 embeddings and FAISS
tech-AI2-1DEAT-Specter2Title
Participants
Run ID: tech-AI2-1DEAT-Specter2Title Participant: AI2 Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: auto Task: tech MD5: a412a526caa113d7881d1e59d94dc3a0 Run description: dense neural using Specter 2 embeddings and FAISS
tech-CIIR-ANEH-NativeFuisonTrec23
Participants
Run ID: tech-CIIR-ANEH-NativeFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 8/14/2023 Type: auto Task: tech MD5: 40dedd2f384a30ffb885c9ae9e47cb36 Run description: Fusion of provided baseline, dense and sparse neural models.
tech-CIIR-ATEH-HybridFuisonTrec23
Participants
Run ID: tech-CIIR-ATEH-HybridFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 8/14/2023 Type: auto Task: tech MD5: 7a46788cdb46fbe8256324db173169f6 Run description: Fusion of runs based on translated docs and runs based on native docs.
tech-CIIR-ATEH-TransFuisonTrec23
Participants
Run ID: tech-CIIR-ATEH-TransFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 8/14/2023 Type: auto Task: tech MD5: 3a669472b2abbb1870659cc876986540 Run description: Fuse provided baseline, dense and sparse neural models
tech-h2oloo-A1CND_mContrieverqt
Participants
Run ID: tech-h2oloo-A1CND_mContrieverqt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: f7862a9facbdfefad72a878cb6a98c0a Run description: Dense retrieval using mContriever trained on MIRACL
tech-h2oloo-A1CNL_SpladeMiraclMonoqt
Participants
Run ID: tech-h2oloo-A1CNL_SpladeMiraclMonoqt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: adaf93de55187810f21e22e8bfc1b2b1 Run description: Learned Sparse Retrieval using SPLADE trained on MIRACL
tech-h2oloo-A1CNL_SpladeNeuclirqt
Participants
Run ID: tech-h2oloo-A1CNL_SpladeNeuclirqt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: bc8bc48a12cac375c2180cd53ffe114f Run description: Learned Sparse Retrieval using SPLADE trained for NeuCLIR 2022
tech-h2oloo-A1CNS_bm25qt
Participants
Run ID: tech-h2oloo-A1CNS_bm25qt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: 14efbc4416f6bda1484ba8ba8ea70e89 Run description: BM25 with rocchio over Chinese documents
tech-h2oloo-A1NETHC_BM25sSplades
Participants
Run ID: tech-h2oloo-A1NETHC_BM25sSplades Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: 266a5034634352dfe73fa5b0b9646a05 Run description: Ensemble of BM25 (2) + SPLADEs (2) with document and query translations
tech-h2oloo-A1NETHC_EverythingRun
Participants
Run ID: tech-h2oloo-A1NETHC_EverythingRun Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: 52ad758f3f9d3fa613411bb9f4d98877 Run description: Ensemble of BM25 (2) + SPLADEs (2) + our other first stages (4) with document and query translations
tech-h2oloo-A1NETSC_BM25s
Participants
Run ID: tech-h2oloo-A1NETSC_BM25s Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: 08e4264bc881f9e3871c6f2288d8068e Run description: Ensemble of BM25 with document and query translations
tech-h2oloo-A_BM25s_fRR
Participants
Run ID: tech-h2oloo-A_BM25s_fRR Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: 53ca116b6cbb9d7fe949c1aad4187a1e Run description: Reranking Ensemble of our "Ensemble of BM25 (2) with document and query translations" with the first stage added to the ensemble
tech-h2oloo-A_BM25s_RR
Participants
Run ID: tech-h2oloo-A_BM25s_RR Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: 0d43404a9873f0c994083d118e2e002e Run description: Reranking Ensemble of our "Ensemble of BM25 (2) + SPLADEs (2) with document and query translations"
tech-h2oloo-A_BM25sSplades_fRR
Participants
Run ID: tech-h2oloo-A_BM25sSplades_fRR Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: f63d180bb657853ba74c6f99df6c14d1 Run description: Reranking Ensemble of our "Ensemble of BM25 (2) + SPLADEs (2) with document and query translations" with the first stage added to the ensemble
tech-h2oloo-A_BM25sSplades_RR
Participants
Run ID: tech-h2oloo-A_BM25sSplades_RR Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: 9118b480e106f23b808a5abafb93971b Run description: Reranking Ensemble of our "Ensemble of BM25 (2) + SPLADEs (2) with document and query translations"
tech-h2oloo-A_EverythingRun_fRR
Participants
Run ID: tech-h2oloo-A_EverythingRun_fRR Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: 124870e5b124d0a862b796d57ce1b07c Run description: Reranking Ensemble of our "Ensemble of BM25 (2) + SPLADEs (2) + other first stage rankers (4) with document and query translations" ensembled with the first stage
tech-h2oloo-A_EverythingRun_RR
Participants
Run ID: tech-h2oloo-A_EverythingRun_RR Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: 4c7289c56a2c19953ac96d024f7ddcbb Run description: Reranking Ensemble of our "Ensemble of BM25 (2) + SPLADEs (2) + other first stage rankers (4) with document and query translations"
tech-h2oloo-AETD_RetroMAEReprodt
Participants
Run ID: tech-h2oloo-AETD_RetroMAEReprodt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: 0058fe923ac3c12ef66170755ce7feb0 Run description: Dense retrieval using a reproduction of RetroMAE trained on MSMARCO
tech-h2oloo-AETL_SpladeMiraclENdt
Participants
Run ID: tech-h2oloo-AETL_SpladeMiraclENdt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: beed14c4b39098b0c01e1478913c5d06 Run description: Learned sparse retrieval using a SPLADE trained on the English part of MIRACL
tech-h2oloo-AETL_SpladePPSDdt
Participants
Run ID: tech-h2oloo-AETL_SpladePPSDdt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: 5f1b73d9e7e7efd3f421b7e9f2fc871a Run description: Learned sparse retrieval using SPLADE++ self distil from huggingface
tech-h2oloo-AETS_bm25dt
Participants
Run ID: tech-h2oloo-AETS_bm25dt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 8/10/2023 Type: auto Task: tech MD5: ea47c9e734b3b82b386e054a5dd5b374 Run description: BM25 with rocchio over English documents
tech-hltcoe-2MNCH-rerank_mt5ht_td
Participants
Run ID: tech-hltcoe-2MNCH-rerank_mt5ht_td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: ae54b6c93c373cc2ceaea5826d3d9083 Run description: Reranking using mt5 cross-encoder run over native documents with human queries making this a monolingual reranking
tech-hltcoe-2MNEH-rerank_mt5gt_td
Participants
Run ID: tech-hltcoe-2MNEH-rerank_mt5gt_td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 12984fcdce8ecd99218396613f91b889 Run description: Reranking using mt5 cross-encoder run over native documents with google translations of English queries
tech-hltcoe-MNCD-plaid_mono_td
Participants
Run ID: tech-hltcoe-MNCD-plaid_mono_td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 6669787798c80f14bb7cb8747b705bc5 Run description: PLAID run using a model trained from monolingual Chinese retrieval indexing native documents with Chinese queries, a monolingual run
tech-hltcoe-MNCD-plaid_monozh_mt5ht_td
Participants
Run ID: tech-hltcoe-MNCD-plaid_monozh_mt5ht_td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: ce6a1296df6a06e03c097a35f8b5197d Run description: Reranking the PLAID run using model trained for Chinese monolingual retrieval using mt5 cross-encoder run over native documents with human queries making this a monolingual reranking
tech-hltcoe-MNCS-patapsco_bm25_ht_d_rm3
Participants
Run ID: tech-hltcoe-MNCS-patapsco_bm25_ht_d_rm3 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: fccd77c3cf84c125e80237bc4b1022db Run description: sparse retrieval with Patapsco BM25 indexing native documents using rm3; queries in document language - monolingual run
tech-hltcoe-MNCS-patapsco_bm25_ht_t_rm3
Participants
Run ID: tech-hltcoe-MNCS-patapsco_bm25_ht_t_rm3 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 74c2f1f69641eb2557b7000b286015f2 Run description: sparse retrieval with Patapsco BM25 indexing native documents using rm3; queries in document language - monolingual run
tech-hltcoe-MNCS-patapsco_bm25_ht_td_rm3
Participants
Run ID: tech-hltcoe-MNCS-patapsco_bm25_ht_td_rm3 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 4f4de60efdcf5dcab282641c689ce0ed Run description: sparse retrieval with Patapsco BM25 indexing native documents using rm3; queries in document language - monolingual run
tech-hltcoe-MNED-colbert_x_td
Participants
Run ID: tech-hltcoe-MNED-colbert_x_td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 93842fd7f5f6acb51cb312093b6aad70 Run description: ColBERT-X run with a model trained using translate train, indexing Chinese documents and retrieving with English queries
tech-hltcoe-MNED-plaid_distilled_td
Participants
Run ID: tech-hltcoe-MNED-plaid_distilled_td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 0e27eaa3d8411e50c7215a8ad0405da4 Run description: PLAID run using model trained with distillation from mt5 indexing native documents with English queries
tech-hltcoe-MNED-plaid_jhpolo_td
Participants
Run ID: tech-hltcoe-MNED-plaid_jhpolo_td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: e4ad14298b6884180929c66921e48795 Run description: PLAID run using a model the was first fine-tuned with distillation of the mt5 model and then fine-tuned for another 10K steps with triples where CSL documents were paired and GPT4 created a query indexing native documents with English queries
tech-hltcoe-MNED-plaid_tt_mt5gt_td
Participants
Run ID: tech-hltcoe-MNED-plaid_tt_mt5gt_td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 7dea9fd968f028fe4c5e04143d1cd38f Run description: Reranking the PLAID run using model trained with distillation from mt5 and using mt5 cross-encoder run over native documents with machine translated queries
tech-hltcoe-MNED-plaid_tt_td
Participants
Run ID: tech-hltcoe-MNED-plaid_tt_td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 0c8fb879ee10ac8c1eb3b48ae9fab9e8 Run description: PLAID run using model trained with translate train in ColBERT-V1 style indexing native documents with English queries
tech-hltcoe-MNEL-blade-d
Participants
Run ID: tech-hltcoe-MNEL-blade-d Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: dc4b11079134ee89ac229dfc2f11b8d5 Run description: sparse neural approach with BLADE using a bilingual BERT model to find the most likely Chinese and English terms in the document. Queries are also embedded to achieve a form of query expansion
tech-hltcoe-MNEL-blade-t
Participants
Run ID: tech-hltcoe-MNEL-blade-t Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 8a8e30f697cbe5c18797aac9f930f168 Run description: sparse neural approach with BLADE using a bilingual BERT model to find the most likely Chinese and English terms in the document. Queries are also embedded to achieve a form of query expansion
tech-hltcoe-MNEL-blade-td
Participants
Run ID: tech-hltcoe-MNEL-blade-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 63d1a9a0b99abba8ea6a4b6748456330 Run description: sparse neural approach with BLADE using a bilingual BERT model to find the most likely Chinese and English terms in the document. Queries are also embedded to achieve a form of query expansion
tech-hltcoe-MNES-patapsco_bm25_qt_d_rm3
Participants
Run ID: tech-hltcoe-MNES-patapsco_bm25_qt_d_rm3 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 1be2e17bf6dcae64df2a218adb15098e Run description: sparse retrieval with Patapsco BM25 indexing native documents using rm3; queries translated by google
tech-hltcoe-MNES-patapsco_bm25_qt_t_rm3
Participants
Run ID: tech-hltcoe-MNES-patapsco_bm25_qt_t_rm3 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: dd7c0e06cda1ca93bc7b6611085d9b77 Run description: sparse retrieval with Patapsco BM25 indexing native documents using rm3; queries translated by google
tech-hltcoe-MNES-patapsco_bm25_qt_td_rm3
Participants
Run ID: tech-hltcoe-MNES-patapsco_bm25_qt_td_rm3 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 622a72cb1d457fd837b5efe176a2767c Run description: sparse retrieval with Patapsco BM25 indexing native documents using rm3; queries translated by google
tech-hltcoe-MNES-psq_t_f32
Participants
Run ID: tech-hltcoe-MNES-psq_t_f32 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/14/2023 Type: manual Task: tech MD5: 6f0bdc5f748f4c304144050fe8246f7b Run description: fast probabilistic structure queries, a sparse CLIR approach with statistical MT translation tables, with --min_translation_prob 0.00010 --max_translation_alternatives 64 --max_translation_cdf 1.0
tech-hltcoe-MNES-psq_td_f32
Participants
Run ID: tech-hltcoe-MNES-psq_td_f32 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/14/2023 Type: manual Task: tech MD5: 025987dc0e644049e9592da9fdc292ff Run description: fast probabilistic structure queries, a sparse CLIR approach with statistical MT translation tables, with --min_translation_prob 0.00010 --max_translation_alternatives 64 --max_translation_cdf 1.0
tech-hltcoe-MTED-plaid_V2model_td
Participants
Run ID: tech-hltcoe-MTED-plaid_V2model_td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 8e4db898406b7234aa31af3402d8a8dc Run description: PLAID run using the Stanford distributed ColBERT V2 model indexing translated documents with English queries
tech-hltcoe-MTES-patapsco_bm25_d_rm3
Participants
Run ID: tech-hltcoe-MTES-patapsco_bm25_d_rm3 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/14/2023 Type: manual Task: tech MD5: 4ea29b0db11c03e83617a9c817a9d964 Run description: sparse retrieval with Patapsco BM25 indexing translated documents using rm3
tech-hltcoe-MTES-patapsco_bm25_t_rm3
Participants
Run ID: tech-hltcoe-MTES-patapsco_bm25_t_rm3 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 28b995332c6039c484cc9dd414e132ad Run description: sparse retrieval with Patapsco BM25 with RM3 indexing translated documents and retrieving with title queries
tech-hltcoe-MTES-patapsco_bm25_td_rm3
Participants
Run ID: tech-hltcoe-MTES-patapsco_bm25_td_rm3 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 8/15/2023 Type: manual Task: tech MD5: 6aca9108a2ed18edc6712715d4bd4124 Run description: sparse retrieval with Patapsco BM25 indexing translated documents using rm3
tech-ISI_SEARCHER-ANE_run_tech_base
Participants
Run ID: tech-ISI_SEARCHER-ANE_run_tech_base Participant: ISI_SEARCHER Track: NeuCLIR Year: 2023 Submission: 8/11/2023 Type: auto Task: tech MD5: 719adfdf17fb53f319234ac054fbd166 Run description: tech-ISI_SEARCHER-ANE_run_tech_base
tech-ISI_SEARCHER-ANE_run_tech_rr
Participants
Run ID: tech-ISI_SEARCHER-ANE_run_tech_rr Participant: ISI_SEARCHER Track: NeuCLIR Year: 2023 Submission: 8/11/2023 Type: auto Task: tech MD5: 92003bd89f9d025b3f66bb23c0cdbd59 Run description: tech-ISI_SEARCHER-ANE_run_tech_rr
tech-ISI_SEARCHER-ANE_run_tech_rr_combine
Participants
Run ID: tech-ISI_SEARCHER-ANE_run_tech_rr_combine Participant: ISI_SEARCHER Track: NeuCLIR Year: 2023 Submission: 8/11/2023 Type: auto Task: tech MD5: 8b6a779eac5a3f9aa97b6930fe8ae3a5 Run description: tech-ISI_SEARCHER-ANE_run_tech_rr_combine
tech-ISI_SEARCHER-ANE_run_tech_rr_combine_td
Participants
Run ID: tech-ISI_SEARCHER-ANE_run_tech_rr_combine_td Participant: ISI_SEARCHER Track: NeuCLIR Year: 2023 Submission: 8/11/2023 Type: auto Task: tech MD5: b8690728bfaba31a53cff7aa7e1845c9 Run description: tech-ISI_SEARCHER-ANE_run_tech_rr_combine_td
zho-CIIR-ANEH-NativeFuisonTrec23
Participants
Run ID: zho-CIIR-ANEH-NativeFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: auto Task: zho MD5: 31b0014505caffc217e72ea9d577f2c1 Run description: Fusion of provided baseline, dense and sparse neural models.
zho-CIIR-ATEH-HybridFuisonTrec23
Participants
Run ID: zho-CIIR-ATEH-HybridFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: auto Task: zho MD5: 80b14130b20c16115f35e33bb7d42f41 Run description: Fusion of runs based on translated docs and runs based on native docs.
zho-CIIR-ATEH-TransFuisonTrec23
Participants
Run ID: zho-CIIR-ATEH-TransFuisonTrec23 Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: auto Task: zho MD5: 9e0aaac687cc079292d443ee99f21c48 Run description: Fuse provided baseline, dense and sparse neural models.
zho-CIIR-LATE-SPLADE
Participants
Run ID: zho-CIIR-LATE-SPLADE Participant: CIIR Track: NeuCLIR Year: 2023 Submission: 6/26/2023 Type: auto Task: zho MD5: cd0266e87378142239ee6a5f9eaedce2 Run description: sparse neural run using Splade
zho-h2oloo-A1CND_mContrieverqt
Participants
Run ID: zho-h2oloo-A1CND_mContrieverqt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: fc7ef71bb0ff3eae0042b88f6c4f271c Run description: mContriever trained on MIRACL
zho-h2oloo-A1CND_SpladeMiraclMonoqt
Participants
Run ID: zho-h2oloo-A1CND_SpladeMiraclMonoqt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: 1b9b98be80c352f4485eaaa06dc0d3fc Run description: SPLADE trained on MIRACL chinese
zho-h2oloo-A1CNL_spladeqt
Participants
Run ID: zho-h2oloo-A1CNL_spladeqt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: bc7d46380699e74d391d4dc36afea978 Run description: SPLADE from neuclir 2022
zho-h2oloo-A1CNS_bm25qt
Participants
Run ID: zho-h2oloo-A1CNS_bm25qt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: 7de19f2dd0d674f4ca576098462c7f71 Run description: BM25
zho-h2oloo-A1NETHC_BM25sSplades
Participants
Run ID: zho-h2oloo-A1NETHC_BM25sSplades Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: 97a7f8a5e91339c559998b6ba5d35d4e Run description: Ensemble of BM25s and SPLADEs (document translation one + query translation one)
zho-h2oloo-A1NETHC_EverythingRun
Participants
Run ID: zho-h2oloo-A1NETHC_EverythingRun Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: 0febb3968d1aa71507646e4640e3667f Run description: Ensemble of all our first stage models
zho-h2oloo-A1NETSC_BM25s
Participants
Run ID: zho-h2oloo-A1NETSC_BM25s Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: 7a3a37eea97c0675ac0d02cca79bc3c1 Run description: Ensemble of BM25s (document translation one + query translation one)
zho-h2oloo-A_frgpt4
Participants
Run ID: zho-h2oloo-A_frgpt4 Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: c54f78979009f68ad023f25ee21fe576 Run description: Reranking the top30 of our "Reranking ensemble on top of the Ensemble of all our baseline first stage runs" using GPT4 and then ensembled with the previous run
zho-h2oloo-A_RERANKBM25s
Participants
Run ID: zho-h2oloo-A_RERANKBM25s Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: 620635028875566ea21b5209d2935f0e Run description: Reranking the top1000 of our "BM25 ensemble
zho-h2oloo-A_RERANKBM25sSplades
Participants
Run ID: zho-h2oloo-A_RERANKBM25sSplades Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: e8c864e9c4bb850fee1291d7789a1556 Run description: Reranking the top1000 of our "BM25+SPLADEs ensemble"
zho-h2oloo-A_RERANKEverythingRun
Participants
Run ID: zho-h2oloo-A_RERANKEverythingRun Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: 2e5ec1fad5360e4d2b24a38656f6f42b Run description: Reranking the top1000 of our All first stage ensemble
zho-h2oloo-A_rgpt4
Participants
Run ID: zho-h2oloo-A_rgpt4 Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: 55cf1ff6c6dd772bd37c99a998c30ac5 Run description: Reranking the top30 of our "Reranking ensemble on top of the Ensemble of all our baseline first stage runs" using GPT4
zho-h2oloo-AETD_RetroMAEReprodt
Participants
Run ID: zho-h2oloo-AETD_RetroMAEReprodt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: 9a4c4fedfd02aa75da30e5f954b0d1a4 Run description: Our RetroMAE reproduction trained on MSMARCO
zho-h2oloo-AETD_SpladeMiraclENdt
Participants
Run ID: zho-h2oloo-AETD_SpladeMiraclENdt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: 17c062c50b166befd3c0da37fe592131 Run description: SPLADE ++ self distil from huggingface fine tuned on MIRACL english
zho-h2oloo-AETL_spladedt
Participants
Run ID: zho-h2oloo-AETL_spladedt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: 5c953f38c376ef3686e8fc5704cb4870 Run description: SPLADE ++ self distil from huggingface
zho-h2oloo-AETS_bm25dt
Participants
Run ID: zho-h2oloo-AETS_bm25dt Participant: h2oloo Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: bc2c81243da1818485c347e02f689736 Run description: BM25 over translated documents
zho-hltcoe-DCMN-PLAID192mono-td
Participants
Run ID: zho-hltcoe-DCMN-PLAID192mono-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 45dddf7296529b2d0760db380667b290 Run description: Dense Retrieval with PLAID trained with distillation from monomT5 reranking on top 50 docs retrieved by ColBERT-Xv1 TT model. 1 bit index.
zho-hltcoe-DEMN-PLAIDkd-monomt5tt-td
Participants
Run ID: zho-hltcoe-DEMN-PLAIDkd-monomt5tt-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 44d88d6881f31a06992e33e750310701 Run description: Dense Retrieval with PLAID trained with distillation from monomT5 reranking on top 50 docs retrieved by ColBERT-Xv1 TT model. 1 bit index.
zho-hltcoe-HEMN-PLAIDkd-mT5gt-dt
Participants
Run ID: zho-hltcoe-HEMN-PLAIDkd-mT5gt-dt Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: fc3d7de9e5db9f143f680547c6f6b4cc Run description: Dense Retrieval with PLAID trained with distillation (English queries) followed by MonomT5 reranker using Google translated queries on top 1000 documents.
zho-hltcoe-HEMN2-mT5gt-dt
Participants
Run ID: zho-hltcoe-HEMN2-mT5gt-dt Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 0578e6f680ae7d3ea3fef2a6ad188838 Run description: MonomT5 reranker using Google translated queries on top 1000 documents.
zho-hltcoe-MNCS-patapscoBM25noRM3desc
Participants
Run ID: zho-hltcoe-MNCS-patapscoBM25noRM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 5ff274e4041d6cd733752d4489c7792a Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Chinese documents and using queries written in Chinese queries, tokenization and stemming with spacy
zho-hltcoe-MNCS-patapscoBM25noRM3td
Participants
Run ID: zho-hltcoe-MNCS-patapscoBM25noRM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 04e27bab64f1715f73d39e04d70221eb Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Chinese documents and using queries written in Chinese queries, tokenization and stemming with spacy
zho-hltcoe-MNCS-patapscoBM25noRM3title
Participants
Run ID: zho-hltcoe-MNCS-patapscoBM25noRM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 95a09ebf9ee448b3f00e757ab012582b Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Chinese documents and using queries written in Chinese queries, tokenization and stemming with spacy
zho-hltcoe-MNCS-patapscoBM25RM3desc
Participants
Run ID: zho-hltcoe-MNCS-patapscoBM25RM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 9367487e9b602e00477e5bff9d02c894 Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Chinese documents and using queries written in Chinese queries, tokenization and stemming with spacy
zho-hltcoe-MNCS-patapscoBM25RM3td
Participants
Run ID: zho-hltcoe-MNCS-patapscoBM25RM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 12e431fbc51440f16243257c7d7322ec Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Chinese documents and using queries written in Chinese queries, tokenization and stemming with spacy
zho-hltcoe-MNCS-patapscoBM25RM3title
Participants
Run ID: zho-hltcoe-MNCS-patapscoBM25RM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 36d8f9e9ba9ec212fc28bd53f2126ab9 Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Chinese documents and using queries written in Chinese queries, tokenization and stemming with spacy
zho-hltcoe-MNED-colbertX
Participants
Run ID: zho-hltcoe-MNED-colbertX Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: b3dbc2ca34e58e29eb04dba933a060b7 Run description: Dense Retrieval with a ColBERT-X model trained with translated-train over English queries
zho-hltcoe-MNED-PLAID_shard_by_date_1bit_v1_tt
Participants
Run ID: zho-hltcoe-MNED-PLAID_shard_by_date_1bit_v1_tt Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: b69b8f17f914b5903e71a9a8e2fed3e2 Run description: Dense Retrieval with PLAID using a v1 translate-train model, with 1 bit indexes, shared into 3 month periods, queries with time only include shards of relevant time window
zho-hltcoe-MNES-patapscoBM25noRM3desc
Participants
Run ID: zho-hltcoe-MNES-patapscoBM25noRM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 3da117fe2835c038695c4a7059a8a824 Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Chinese documents and using Google Translate to create Chinese queries from English tokenization and stemming with spacy
zho-hltcoe-MNES-patapscoBM25noRM3td
Participants
Run ID: zho-hltcoe-MNES-patapscoBM25noRM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 39843fd98ec0c4e89215742acc48690f Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Chinese documents and using Google Translate to create Chinese queries from English tokenization and stemming with spacy
zho-hltcoe-MNES-patapscoBM25noRM3title
Participants
Run ID: zho-hltcoe-MNES-patapscoBM25noRM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 4450012e6bbd4d3c6f2cfd50e370b8d2 Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Chinese documents and using Google Translate to create Chinese queries from English tokenization and stemming with spacy
zho-hltcoe-MNES-patapscoBM25RM3desc
Participants
Run ID: zho-hltcoe-MNES-patapscoBM25RM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 95a84fa27d9fcfd5e045e73814d9d591 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Chinese documents and using Google Translate to create Chinese queries from English, tokenization and stemming with spacy
zho-hltcoe-MNES-patapscoBM25RM3td
Participants
Run ID: zho-hltcoe-MNES-patapscoBM25RM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: cb46bd79caf68b15e7f2be50ef783e21 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Chinese documents and using Google Translate to create Chinese queries from English, tokenization and stemming with spacy
zho-hltcoe-MNES-patapscoBM25RM3title
Participants
Run ID: zho-hltcoe-MNES-patapscoBM25RM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 70a92da64a744fe8222f01cb4b770a4a Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Chinese documents and using Google Translate to create Chinese queries from English, tokenization and stemming with spacy
zho-hltcoe-MTED-plaid_v2_eng_1
Participants
Run ID: zho-hltcoe-MTED-plaid_v2_eng_1 Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: da39cac2cdd1e8eed81cb244f9a81040 Run description: Dense Retrieval with PLAID using a distributed v2 model, with 1 bit indexes, indexing English Documents
zho-hltcoe-MTES-patapscoBM25noRM3desc
Participants
Run ID: zho-hltcoe-MTES-patapscoBM25noRM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: ec6cadfb5e4b97fe9ae7bb976a977485 Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy
zho-hltcoe-MTES-patapscoBM25noRM3td
Participants
Run ID: zho-hltcoe-MTES-patapscoBM25noRM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: a96eeb09e3b77f7bc296daae0b202942 Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy
zho-hltcoe-MTES-patapscoBM25noRM3title
Participants
Run ID: zho-hltcoe-MTES-patapscoBM25noRM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 958419d33f3f758b5de9956669e271ae Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy
zho-hltcoe-MTES-patapscoBM25RM3desc
Participants
Run ID: zho-hltcoe-MTES-patapscoBM25RM3desc Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: abd2d5fe42da7b77e949bc6bb0427097 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy
zho-hltcoe-MTES-patapscoBM25RM3td
Participants
Run ID: zho-hltcoe-MTES-patapscoBM25RM3td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 6e833532c82de65d75720bc482e4ea53 Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy
zho-hltcoe-MTES-patapscoBM25RM3title
Participants
Run ID: zho-hltcoe-MTES-patapscoBM25RM3title Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/8/2023 Type: manual Task: zho MD5: 93986b0eec17e5150ca01d2972895a5a Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy
zho-hltcoe-SEMN-PSQ-t
Participants
Run ID: zho-hltcoe-SEMN-PSQ-t Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/7/2023 Type: manual Task: zho MD5: fd207b06c061fb1f9030d3d2193ccb2d Run description: PSQ with pmf=0.00010, topk=64, cdf=0.99
zho-hltcoe-SEMN-PSQ-td
Participants
Run ID: zho-hltcoe-SEMN-PSQ-td Participant: hltcoe Track: NeuCLIR Year: 2023 Submission: 7/7/2023 Type: manual Task: zho MD5: ff28f75ccfc5a506b34c20fd64f84d63 Run description: PSQ with pmf=0.00010, topk=64, cdf=0.99
zho-ISI_SEARCHER-ANE_run1
Participants
Run ID: zho-ISI_SEARCHER-ANE_run1 Participant: ISI_SEARCHER Track: NeuCLIR Year: 2023 Submission: 7/7/2023 Type: auto Task: zho MD5: 4df53876ca46970ae7e3b906e8a745dd Run description: SEARCHER (see http://www.lrec-conf.org/proceedings/lrec2020/workshops/CLSSTS2020/pdf/2020.clssts-1.4.pdf)
zho-umd_hcil-AELN_blade
Participants
Run ID: zho-umd_hcil-AELN_blade Participant: umd_hcil Track: NeuCLIR Year: 2023 Submission: 7/10/2023 Type: auto Task: zho MD5: 62e3ac792c754e89c24c9c5af80b0b70 Run description: Learned sparse retrieval using bilingual BERT model