Runs - NeuCLIR 2023¶

fas-CIIR-ANEH-NativeFuisonTrec23¶

Run ID: fas-CIIR-ANEH-NativeFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: auto
Task: fas
MD5: ae001909bab712e06f04bd735aa12476
Run description: Fusion of provided baseline, dense and sparse neural models.

fas-CIIR-ATEH-HybridFuisonTrec23¶

Run ID: fas-CIIR-ATEH-HybridFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: auto
Task: fas
MD5: 9fa6e09ac47f4ea64cea2b9c5a7cff72
Run description: Fusion of runs based on translated docs and runs based on native docs.

fas-CIIR-ATEH-TransFuisonTrec23¶

Run ID: fas-CIIR-ATEH-TransFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: auto
Task: fas
MD5: dca2076ce1c843f6284fef94cd6aaf8c
Run description: Fuse provided baseline, dense and sparse neural models

fas-CIIR-LATE-SPLADE¶

Run ID: fas-CIIR-LATE-SPLADE
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 6/26/2023
Type: auto
Task: fas
MD5: 12cc8dc85a3df4413515702f9a65e355
Run description: sparse neural run using Splade

fas-h2oloo-A1NETHP_BM25sSplades¶

Run ID: fas-h2oloo-A1NETHP_BM25sSplades
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: 3c54663bf574836a466b6ad2b3198874
Run description: Ensemble of BM25s and SPLADEs (document translation one + query translation one)

fas-h2oloo-A1NETHP_EverythingRun¶

Run ID: fas-h2oloo-A1NETHP_EverythingRun
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: ce7f7afec2cff3b77d00784734b25eb3
Run description: Ensemble of all our baseline first stage runs

fas-h2oloo-A1NETSP_BM25s¶

Run ID: fas-h2oloo-A1NETSP_BM25s
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: 00fda7bbdb90af7400845016630bc300
Run description: Ensemble of BM25s (document translation one + query translation one)

fas-h2oloo-A1PND_mContrieverqt¶

Run ID: fas-h2oloo-A1PND_mContrieverqt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: fa66b45a70efc7da53557a777ef72141
Run description: Learned Sparse retrieval using mContriever trained on MIRACL

fas-h2oloo-A1PND_SpladeMiraclMonoqt¶

Run ID: fas-h2oloo-A1PND_SpladeMiraclMonoqt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: 76ba9e06aaf0ce7929e7e3681afd7982
Run description: Learned Sparse retrieval using SPLADE model trained on MIRACL

fas-h2oloo-A1PNL_spladeqt¶

Run ID: fas-h2oloo-A1PNL_spladeqt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: 7640dcec195f51489f107b6d504a941d
Run description: Learned Sparse retrieval using SPLADE model from NeuCLIR2022

fas-h2oloo-A1PNS_bm25qt¶

Run ID: fas-h2oloo-A1PNS_bm25qt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: 91df19ee95ace1697f75b0edfed768a3
Run description: BM25 with default pyserini parameters

fas-h2oloo-A_frgpt4¶

Run ID: fas-h2oloo-A_frgpt4
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: 3ff3d9fa0081892bcd4f59a30cfbc8e1
Run description: Reranking the top30 of our "Reranking ensemble on top of the Ensemble of all our baseline first stage runs" using GPT4 and then ensembled with the previous run

fas-h2oloo-A_RERANKBM25s¶

Run ID: fas-h2oloo-A_RERANKBM25s
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: cb982c2045582184cc2873bcc2366013
Run description: Reranking the top1000 of our "BM25 ensemble"

fas-h2oloo-A_RERANKBM25sSplades¶

Run ID: fas-h2oloo-A_RERANKBM25sSplades
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: eb64614ea2ea4c667c83b188502c3d7a
Run description: Reranking the top1000 of our "BM25+SPLADEs ensemble"

fas-h2oloo-A_RERANKEverythingRun¶

Run ID: fas-h2oloo-A_RERANKEverythingRun
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: ae4b66195cea692eee4fcd1b95bbf968
Run description: Reranking the top1000 of our All first stage ensemble

fas-h2oloo-A_rgpt4¶

Run ID: fas-h2oloo-A_rgpt4
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: 56e905c53615f3fa49266e47edcfde5c
Run description: Reranking the top30 of our "Reranking ensemble on top of the Ensemble of all our baseline first stage runs" using GPT4

fas-h2oloo-AETD_RetroMAEReprodt¶

Run ID: fas-h2oloo-AETD_RetroMAEReprodt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: 31f5dbd5c06da42afc1a49d5a0381f0f
Run description: Our reproduction of RetroMAE trained on MSMARCO

fas-h2oloo-AETD_SpladeMiraclENdt¶

Run ID: fas-h2oloo-AETD_SpladeMiraclENdt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: 8ac66e4a1449b06f845ec3c668f80fc8
Run description: Learned sparse neural using splade_pp_self_distil from huggingface

fas-h2oloo-AETL_spladedt¶

Run ID: fas-h2oloo-AETL_spladedt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: b40ac129c8992cf0af3895fde9cd6c61
Run description: Learned sparse neural using splade_pp_self_distil from huggingface without any further training

fas-h2oloo-AETS_bm25dt¶

Run ID: fas-h2oloo-AETS_bm25dt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: ebd4cc16ce8c3e3f2415b2d365f00c69
Run description: BM25 over translated documents

fas-hltcoe-DEMN-PLAIDkd-monomt5tt-td¶

Run ID: fas-hltcoe-DEMN-PLAIDkd-monomt5tt-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 5388cfbd50ad2e4ada3f6e9c59bbb311
Run description: Dense Retrieval with PLAID trained with distillation from monomT5 reranking on top 50 docs retrieved by ColBERT-Xv1 TT model. 1 bit index.

fas-hltcoe-DPMN-PLAID192mono-td¶

Run ID: fas-hltcoe-DPMN-PLAID192mono-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 897c9ef06b4f47e5603edabc88c7d8e2
Run description: Dense Retrieval with PLAID trained with total batch size of 192 translated MS-MARCO triples (both q and d in document lang) on 8 GPUs. 1 bit index.

fas-hltcoe-HEMN-PLAIDkd-mT5gt-td¶

Run ID: fas-hltcoe-HEMN-PLAIDkd-mT5gt-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 7b264abbb1cd0e57aa14f342e9df8d21
Run description: Dense Retrieval with PLAID trained with distillation (English queries) followed by MonomT5 reranker using Google translated queries on top 1000 documents.

fas-hltcoe-HEMN2-mT5gt-td¶

Run ID: fas-hltcoe-HEMN2-mT5gt-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 1b2b36974940ad886e7a946e77621bba
Run description: MonomT5 reranker using Google translated queries on top 1000 documents.

fas-hltcoe-MNED-colbertX¶

Run ID: fas-hltcoe-MNED-colbertX
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 172c35b90e6209c72a0bde628d68dbdb
Run description: Dense Retrieval with a ColBERT-X model trained with translated-train over English queries

fas-hltcoe-MNED-PLAID_shard_by_date_1bit_v1_tt¶

Run ID: fas-hltcoe-MNED-PLAID_shard_by_date_1bit_v1_tt
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 7ab27ee9f48eb43949c255d6b8550a50
Run description: Dense Retrieval with PLAID using a v1 translate-train model, with 1 bit indexes, shared into 3 month periods, queries with time only include shards of relevant time window

fas-hltcoe-MNES-patapscoBM25noRM3desc¶

Run ID: fas-hltcoe-MNES-patapscoBM25noRM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: aa162ba9805ba5f18a8d3f15648b3457
Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Persian documents and using Google Translate to create Persian queries from English tokenization with spacy and stemming with parsivar

fas-hltcoe-MNES-patapscoBM25noRM3td¶

Run ID: fas-hltcoe-MNES-patapscoBM25noRM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 9c4f1685aff837f67c5dadc8b3259638
Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Persian documents and using Google Translate to create Persian queries from English tokenization with spacy and stemming with parsivar

fas-hltcoe-MNES-patapscoBM25noRM3title¶

Run ID: fas-hltcoe-MNES-patapscoBM25noRM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: f6a4176fa730fdc909a7542c37ed1f18
Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Persian documents and using Google Translate to create Persian queries from English tokenization with spacy and stemming with parsivar

fas-hltcoe-MNES-patapscoBM25RM3desc¶

Run ID: fas-hltcoe-MNES-patapscoBM25RM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 1b9b4213dd3c24def28ef3cd50a9f7f3
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Persian documents and using Google Translate to create Persian queries from English tokenization with spacy and stemming with parsivar

fas-hltcoe-MNES-patapscoBM25RM3td¶

Run ID: fas-hltcoe-MNES-patapscoBM25RM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: c6f3ffeb89889ec0b5e4f01951cfaba6
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Persian documents and using Google Translate to create Persian queries from English tokenization with spacy and stemming with parsivar

fas-hltcoe-MNES-patapscoBM25RM3title¶

Run ID: fas-hltcoe-MNES-patapscoBM25RM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: db9f19b2b47bf9fe9b6f454d737912e8
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Persian documents and using Google Translate to create Persian queries from English tokenization with spacy and stemming with parsivar

fas-hltcoe-MNPS-patapscoBM25noRM3desc¶

Run ID: fas-hltcoe-MNPS-patapscoBM25noRM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 21ce71ede46524daa88d9783167ad188
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Persian documents and using queries written in Persian queries, tokenization with spacy and stemming with parsivar

fas-hltcoe-MNPS-patapscoBM25noRM3td¶

Run ID: fas-hltcoe-MNPS-patapscoBM25noRM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: d9f256d5bacfe0fca240a6cecc8d17cc
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Persian documents and using queries written in Persian queries, tokenization with spacy and stemming with parsivar

fas-hltcoe-MNPS-patapscoBM25noRM3title¶

Run ID: fas-hltcoe-MNPS-patapscoBM25noRM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 7a3d4775e44c9976fe3cb79c22814a3d
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Persian documents and using queries written in Persian queries, tokenization with spacy and stemming with parsivar

fas-hltcoe-MNPS-patapscoBM25RM3desc¶

Run ID: fas-hltcoe-MNPS-patapscoBM25RM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: dc6700001b1af7efdab2cdc5a0944715
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Persian documents and using queries written in Persian queries, tokenization with spacy and stemming with parsivar

fas-hltcoe-MNPS-patapscoBM25RM3td¶

Run ID: fas-hltcoe-MNPS-patapscoBM25RM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 327f2877a69cb1dc79694c0bb605a981
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Persian documents and using queries written in Persian queries, tokenization with spacy and stemming with parsivar

fas-hltcoe-MNPS-patapscoBM25RM3title¶

Run ID: fas-hltcoe-MNPS-patapscoBM25RM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 8e73ff92637633582e6d819c1fc1040c
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Persian documents and using queries written in Persian queries, tokenization with spacy and stemming with parsivar

fas-hltcoe-MTED-plaid_v2_eng_1¶

Run ID: fas-hltcoe-MTED-plaid_v2_eng_1
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 41c386fecf78d8999b28aa4ad1f73aad
Run description: Dense Retrieval with PLAID using a distributed v2 model, with 1 bit indexes, indexing English Documents

fas-hltcoe-MTES-patapscoBM25noRM3desc¶

Run ID: fas-hltcoe-MTES-patapscoBM25noRM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 9731bdffb00ef164a006e84c274915fa
Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy

fas-hltcoe-MTES-patapscoBM25noRM3td¶

Run ID: fas-hltcoe-MTES-patapscoBM25noRM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 46bf195eb10f2804a085eac9bda82469
Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy

fas-hltcoe-MTES-patapscoBM25noRM3title¶

Run ID: fas-hltcoe-MTES-patapscoBM25noRM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 4499a15df44c54b371620fea3e6a37c2
Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy

fas-hltcoe-MTES-patapscoBM25RM3desc¶

Run ID: fas-hltcoe-MTES-patapscoBM25RM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 3480af2e04751c544bee71afa350dedf
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy

fas-hltcoe-MTES-patapscoBM25RM3td¶

Run ID: fas-hltcoe-MTES-patapscoBM25RM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: ac897e4aa5a744e0274066d4f003062b
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy

fas-hltcoe-MTES-patapscoBM25RM3title¶

Run ID: fas-hltcoe-MTES-patapscoBM25RM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: fas
MD5: 986a4fb2b218598cd900fb8cdcadfb1f
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy

fas-hltcoe-SEMN-PSQ-t¶

Run ID: fas-hltcoe-SEMN-PSQ-t
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/7/2023
Type: manual
Task: fas
MD5: f85a411526f33ecec42153e2278bf61c
Run description: PSQ with pmf=0.00001, topk=32, cdf=1.0

fas-hltcoe-SEMN-PSQ-td¶

Run ID: fas-hltcoe-SEMN-PSQ-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/7/2023
Type: manual
Task: fas
MD5: a395a5e220917f6817f6509cac7c40fa
Run description: PSQ with pmf=0.00001, topk=32, cdf=1.0

fas-umd_hcil-AELN_blade¶

Run ID: fas-umd_hcil-AELN_blade
Participant: umd_hcil
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: fas
MD5: a393c15f639adf4a9bbbb3cb11a613fc
Run description: Learned sparse retrieval using bilingual BERT model

mlir-CIIR-ANEH-NativeFuisonTrec23¶

Run ID: mlir-CIIR-ANEH-NativeFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: auto
Task: mlir
MD5: dd68981b4b66c4c93caa8673cf365249
Run description: Fusion of provided baseline, dense and sparse neural models.

mlir-CIIR-ATEH-HybridFuisonTrec23¶

Run ID: mlir-CIIR-ATEH-HybridFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: auto
Task: mlir
MD5: 8d08d3f7afe6580fec001f68bcd398ce
Run description: Fusion of runs based on translated docs and runs based on native docs.

mlir-CIIR-ATEH-TransFuisonTrec23¶

Run ID: mlir-CIIR-ATEH-TransFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: auto
Task: mlir
MD5: c79dfd62fdc6a22942e0670d1efaf54f
Run description: Fuse provided baseline, dense and sparse neural models.

mlir-CIIR-LATE-SPLADE¶

Run ID: mlir-CIIR-LATE-SPLADE
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 6/26/2023
Type: auto
Task: mlir
MD5: 198564b330fa8aeeadf2299f4aca80bb
Run description: sparse neural run using Splade

mlir-h2oloo-A_BM25s¶

Run ID: mlir-h2oloo-A_BM25s
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: mlir
MD5: 0a855fd8d8c585459a21deb9229609a0
Run description: Concatenation of all our BM25s runs for each language.

mlir-h2oloo-A_BM25sSplades¶

Run ID: mlir-h2oloo-A_BM25sSplades
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: mlir
MD5: 3599a8f7a6c603653f0af7f1e84acf49
Run description: Concatenation of all our BM25sSplades runs for each language.

mlir-h2oloo-A_EverythingRun¶

Run ID: mlir-h2oloo-A_EverythingRun
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: mlir
MD5: 6e4126b275fc2d20409dc7ea5f52ee2c
Run description: Concatenation of all our EverythingRun runs for each language.

mlir-h2oloo-A_frgpt4¶

Run ID: mlir-h2oloo-A_frgpt4
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: mlir
MD5: 41e5e846f155bf54c9c914b96b8b6c08
Run description: Concatenation of all our rgpt4 runs for each language.

mlir-h2oloo-A_RERANKBM25s¶

Run ID: mlir-h2oloo-A_RERANKBM25s
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: mlir
MD5: 7daedd035706def2680763e132e377a9
Run description: Concatenation of all our RerankBM25s runs for each language.

mlir-h2oloo-A_RERANKBM25sSplades¶

Run ID: mlir-h2oloo-A_RERANKBM25sSplades
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: mlir
MD5: bc8cff2b20914c8e774b444135f69ba5
Run description: Concatenation of all our RerankBM25sSplades runs for each language.

mlir-h2oloo-A_RERANKEverythingRun¶

Run ID: mlir-h2oloo-A_RERANKEverythingRun
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: mlir
MD5: 53beeda2a4eef404bda32dffca31d4ea
Run description: Concatenation of all our RerankEverything runs for each language.

mlir-h2oloo-A_rgpt4¶

Run ID: mlir-h2oloo-A_rgpt4
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: mlir
MD5: a74c9dc366a4ac59c3e3e46f71d54cba
Run description: Concatenation of all our gpt4 runs for each language.

mlir-hltcoe-MNED-colbertX¶

Run ID: mlir-hltcoe-MNED-colbertX
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: mlir
MD5: 3125be547ce0014381b27fa238816fe7
Run description: Dense Retrieval with a ColBERT-X model trained with mixed matches of multilingual translated-train over English queries

mlir-hltcoe-MNED-plaid_v1_mtt_1bit¶

Run ID: mlir-hltcoe-MNED-plaid_v1_mtt_1bit
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: mlir
MD5: af80cc32b783c1eac6823b347772498e
Run description: Dense Retrieval with PLAID using a v1 mixed-batch translate-train model, with 1 bit indexes

mlir-hltcoe-MNED-plaid_v1_mtt_1bit_date¶

Run ID: mlir-hltcoe-MNED-plaid_v1_mtt_1bit_date
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: mlir
MD5: 0ef2544e50d6909b046cf2953931ef04
Run description: Dense Retrieval with PLAID using a v1 mixed-batch translate-train model, with 1 bit indexes, shared into 3 month periods, queries with time only include shards of relevant time window

mlir-hltcoe-MTED-plaid_v2_eng_1¶

Run ID: mlir-hltcoe-MTED-plaid_v2_eng_1
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: mlir
MD5: ef7d5e225b6bc73c09dd5e33d8765844
Run description: Dense Retrieval with PLAID using a distributed v2 model, with 1 bit indexes, indexing English Documents

mlir-hltcoe-MTES-patapscoBM25noRM3desc¶

Run ID: mlir-hltcoe-MTES-patapscoBM25noRM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: mlir
MD5: 15e263cb6551af24ab9743976fcda626
Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy

mlir-hltcoe-MTES-patapscoBM25noRM3td¶

Run ID: mlir-hltcoe-MTES-patapscoBM25noRM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: mlir
MD5: da377fe6f1e32352db2e9dee2b4a7202
Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy

mlir-hltcoe-MTES-patapscoBM25noRM3title¶

Run ID: mlir-hltcoe-MTES-patapscoBM25noRM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: mlir
MD5: 3fa6608c720c88a51c1181b20f02b358
Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy

mlir-hltcoe-MTES-patapscoBM25RM3desc¶

Run ID: mlir-hltcoe-MTES-patapscoBM25RM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: mlir
MD5: f4cb868b8d35b695b9b80194cbfa5ad8
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documentstokenization and stemming with spacy

mlir-hltcoe-MTES-patapscoBM25RM3td¶

Run ID: mlir-hltcoe-MTES-patapscoBM25RM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: mlir
MD5: 2698733199a41672017fbf6634dd5663
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documentstokenization and stemming with spacy

mlir-hltcoe-MTES-patapscoBM25RM3title¶

Run ID: mlir-hltcoe-MTES-patapscoBM25RM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: mlir
MD5: 8a83c8640c1883a446a568f0faa8af32
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documentstokenization and stemming with spacy

mlir-hltcoe-SEMN-PSQraw-t¶

Run ID: mlir-hltcoe-SEMN-PSQraw-t
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/7/2023
Type: manual
Task: mlir
MD5: 434d56a4a428210c826a256b00232bd0
Run description: PSQ merge raw scores from CLIR T runs

mlir-hltcoe-SEMN-PSQraw-td¶

Run ID: mlir-hltcoe-SEMN-PSQraw-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/7/2023
Type: manual
Task: mlir
MD5: 0fdb0dc3627d09ee13ce499c70493b87
Run description: PSQ merge raw scores from CLIR TD runs

rus-CIIR-ANEH-NativeFuisonTrec23¶

Run ID: rus-CIIR-ANEH-NativeFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: auto
Task: rus
MD5: 962862fb3e72f6aa5d43ccbf3e840932
Run description: Fusion of provided baseline, dense and sparse neural models.

rus-CIIR-ATEH-HybridFuisonTrec23¶

Run ID: rus-CIIR-ATEH-HybridFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: auto
Task: rus
MD5: b6f23a9390af069e73632d4afb5fab5a
Run description: Fusion of runs based on translated docs and runs based on native docs.

rus-CIIR-ATEH-TransFuisonTrec23¶

Run ID: rus-CIIR-ATEH-TransFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: auto
Task: rus
MD5: d685905e5aa1234b623e1fdf27efa3ab
Run description: Fuse provided baseline, dense and sparse neural models.

rus-CIIR-LATE-SPLADE¶

Run ID: rus-CIIR-LATE-SPLADE
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 6/26/2023
Type: auto
Task: rus
MD5: 906cd040dbd936bedf423f03eedef6e0
Run description: sparse neural run using Splade

rus-h2oloo-A1NETHR_BM25sSplades¶

Run ID: rus-h2oloo-A1NETHR_BM25sSplades
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: 122bae183e880e4eb674f29ec7060688
Run description: Ensemble of BM25s and SPLADEs (document translation one + query translation one)

rus-h2oloo-A1NETHR_EverythingRun¶

Run ID: rus-h2oloo-A1NETHR_EverythingRun
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: f035def7fa35d07dc2f59cfb6a30e17d
Run description: Ensemble of all our first stage runs

rus-h2oloo-A1NETSR_BM25s¶

Run ID: rus-h2oloo-A1NETSR_BM25s
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: a1b68c64421b17e00098e42557490395
Run description: Ensemble of BM25s (document translation one + query translation one)

rus-h2oloo-A1RND_mContrieverqt¶

Run ID: rus-h2oloo-A1RND_mContrieverqt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: 23e65c2858468e8d9ae59ca7b3b6595e
Run description: mContriever trained on MIRACL

rus-h2oloo-A1RND_SpladeMiraclMonoqt¶

Run ID: rus-h2oloo-A1RND_SpladeMiraclMonoqt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: b53dba4628636970adf29d5590382610
Run description: SPLADE trained on MIRACL

rus-h2oloo-A1RNL_spladeqt¶

Run ID: rus-h2oloo-A1RNL_spladeqt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: 6004bd59ab97792e7cab6a892d19ad11
Run description: SPLADE used on neuCLIR 2022

rus-h2oloo-A1RNS_bm25qt¶

Run ID: rus-h2oloo-A1RNS_bm25qt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: 733b2461ef40afc46233149130b1742d
Run description: BM25

rus-h2oloo-A_frgpt4¶

Run ID: rus-h2oloo-A_frgpt4
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: 9d0281c044b4a3cfbdf97011b52a3707
Run description: Reranking the top30 of our "Reranking ensemble on top of the Ensemble of all our baseline first stage runs" using GPT4 and then ensembled with the previous run

rus-h2oloo-A_RERANKBM25s¶

Run ID: rus-h2oloo-A_RERANKBM25s
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: 12e426644024498d7807db359c90db79
Run description: Reranking the top1000 of our "BM25 ensemble

rus-h2oloo-A_RERANKBM25sSplades¶

Run ID: rus-h2oloo-A_RERANKBM25sSplades
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: ffe6afff89dcf2e480f252fd5352efcd
Run description: Reranking the top1000 of our "BM25+SPLADEs ensemble"

rus-h2oloo-A_RERANKEverythingRun¶

Run ID: rus-h2oloo-A_RERANKEverythingRun
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: 76df1395652d378655b1b4342d969921
Run description: Reranking the top1000 of our All first stage ensemble

rus-h2oloo-A_rgpt4¶

Run ID: rus-h2oloo-A_rgpt4
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: 597fa281a4fb7dd3978c3b8f0bc81ac4
Run description: Reranking the top30 of our "Reranking ensemble on top of the Ensemble of all our baseline first stage runs" using GPT4

rus-h2oloo-AETD_RetroMAEReprodt¶

Run ID: rus-h2oloo-AETD_RetroMAEReprodt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: 80a5f612f4b20f2847d3b570b8ffbf8c
Run description: Our RetroMAE reproduction trained on MSMARCO (dense)

rus-h2oloo-AETD_SpladeMiraclENdt¶

Run ID: rus-h2oloo-AETD_SpladeMiraclENdt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: 512fd67bfe9c7167b95d57ca5a83dfdd
Run description: SPLADE trained on the english part of MIRACL

rus-h2oloo-AETL_spladedt¶

Run ID: rus-h2oloo-AETL_spladedt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: a6aad790d28b48900b54c954815c7f55
Run description: SPLADE ++ self distil from huggingface

rus-h2oloo-AETS_bm25dt¶

Run ID: rus-h2oloo-AETS_bm25dt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: df9b4b558c57bb12cc8be1afc34d5d20
Run description: BM25 over translated documents

rus-hltcoe-DEMN-PLAIDkd-monomt5tt-td¶

Run ID: rus-hltcoe-DEMN-PLAIDkd-monomt5tt-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 9bcb8008f7d57278e31d40f441d4e800
Run description: Dense Retrieval with PLAID trained with distillation from monomT5 reranking on top 50 docs retrieved by ColBERT-Xv1 TT model. 1 bit index.

rus-hltcoe-DRMN-PLAID192mono-td¶

Run ID: rus-hltcoe-DRMN-PLAID192mono-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: cc29597b2144e82956115c606165a69d
Run description: Dense Retrieval with PLAID trained with total batch size of 192 translated MS-MARCO triples (both q and d in document lang) on 8 GPUs. 1 bit index.

rus-hltcoe-HEMN-PLAIDkd-mT5gt-td¶

Run ID: rus-hltcoe-HEMN-PLAIDkd-mT5gt-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 139f8a69b3bf464062e901b96bde6fbf
Run description: Dense Retrieval with PLAID trained with distillation (English queries) followed by MonomT5 reranker using Google translated queries on top 1000 documents.

rus-hltcoe-HEMN2-mT5gt-td¶

Run ID: rus-hltcoe-HEMN2-mT5gt-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: cc3cb7bd85d7feda42c16788a42cc6b9
Run description: MonomT5 reranker using Google translated queries on top 1000 documents.

rus-hltcoe-MNED-colbertX¶

Run ID: rus-hltcoe-MNED-colbertX
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 13169c0837c82a2e25004ad12d74ca6f
Run description: Dense Retrieval with a ColBERT-X model trained with translated-train over English queries

rus-hltcoe-MNED-PLAID_shard_by_date_1bit_v1_tt¶

Run ID: rus-hltcoe-MNED-PLAID_shard_by_date_1bit_v1_tt
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: f60052b1b2dda840039074771ad4ab2a
Run description: Dense Retrieval with PLAID using a v1 translate-train model, with 1 bit indexes, shared into 3 month periods, queries with time only include shards of relevant time window

rus-hltcoe-MNES-patapscoBM25noRM3desc¶

Run ID: rus-hltcoe-MNES-patapscoBM25noRM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: e86ab91d195d3f62b3a40a079fff2f73
Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Russian documents and using Google Translate to create Russina queries from English tokenization and stemming with spacy

rus-hltcoe-MNES-patapscoBM25noRM3td¶

Run ID: rus-hltcoe-MNES-patapscoBM25noRM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: f97390a929249362a89dce1d1fcec7b4
Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Russian documents and using Google Translate to create Russina queries from English tokenization and stemming with spacy

rus-hltcoe-MNES-patapscoBM25noRM3title¶

Run ID: rus-hltcoe-MNES-patapscoBM25noRM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 4d105cccf26c362a47cb10fafd2dac29
Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Russian documents and using Google Translate to create Russina queries from English tokenization and stemming with spacy

rus-hltcoe-MNES-patapscoBM25RM3desc¶

Run ID: rus-hltcoe-MNES-patapscoBM25RM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 96358fe0468e932e7fd5e805c5a2b457
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Russian documents and using Google Translate to create Russian queries from English tokenization and stemming with spacy

rus-hltcoe-MNES-patapscoBM25RM3td¶

Run ID: rus-hltcoe-MNES-patapscoBM25RM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 153fa14f4237b11a4554009cccf444c1
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Russian documents and using Google Translate to create Russian queries from English tokenization and stemming with spacy

rus-hltcoe-MNES-patapscoBM25RM3title¶

Run ID: rus-hltcoe-MNES-patapscoBM25RM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 91e870d5516e7852bc6f24b69295f81e
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Russian documents and using Google Translate to create Russian queries from English tokenization and stemming with spacy

rus-hltcoe-MNRS-patapscoBM25noRM3desc¶

Run ID: rus-hltcoe-MNRS-patapscoBM25noRM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 3de33cf34861e7934dbaac398f0bb4e4
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Russian documents and using queries written in Russian queries, tokenization and stemming with spacy

rus-hltcoe-MNRS-patapscoBM25noRM3td¶

Run ID: rus-hltcoe-MNRS-patapscoBM25noRM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: f8b299f256f2e00d8091206b1d3dc39e
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Russian documents and using queries written in Russian queries, tokenization and stemming with spacy

rus-hltcoe-MNRS-patapscoBM25noRM3title¶

Run ID: rus-hltcoe-MNRS-patapscoBM25noRM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 2244717b9c243c9b2db354c2a8de0a97
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Russian documents and using queries written in Russian queries, tokenization and stemming with spacy

rus-hltcoe-MNRS-patapscoBM25RM3desc¶

Run ID: rus-hltcoe-MNRS-patapscoBM25RM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 1bd5744df432d68211c51ed4e08e4b72
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Russian documents and using queries written in Russian queries, tokenization and stemming with spacy

rus-hltcoe-MNRS-patapscoBM25RM3td¶

Run ID: rus-hltcoe-MNRS-patapscoBM25RM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 167626d6a57129091a4cc562f73cd250
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Russian documents and using queries written in Russian queries, tokenization and stemming with spacy

rus-hltcoe-MNRS-patapscoBM25RM3title¶

Run ID: rus-hltcoe-MNRS-patapscoBM25RM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: f7b0963745a8a09f0134b91dc89daff1
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Russian documents and using queries written in Russian queries, tokenization and stemming with spacy

rus-hltcoe-MTED-plaid_v2_eng_1¶

Run ID: rus-hltcoe-MTED-plaid_v2_eng_1
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: b445c34be6a61cd2ef306b12353125c1
Run description: Dense Retrieval with PLAID using a distributed v2 model, with 1 bit indexes, indexing English Documents

rus-hltcoe-MTES-patapscoBM25noRM3desc¶

Run ID: rus-hltcoe-MTES-patapscoBM25noRM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 9de429f76b3b7c4913bdbf11094c4a21
Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy

rus-hltcoe-MTES-patapscoBM25noRM3td¶

Run ID: rus-hltcoe-MTES-patapscoBM25noRM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 5adf65db5c83e99f1a78dd4ef0dafe40
Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy

rus-hltcoe-MTES-patapscoBM25noRM3title¶

Run ID: rus-hltcoe-MTES-patapscoBM25noRM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 1a51ba8fcd25d959b73fc09a79230f1e
Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy

rus-hltcoe-MTES-patapscoBM25RM3desc¶

Run ID: rus-hltcoe-MTES-patapscoBM25RM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: e2974d1eabb37743f2bc3dc74a717580
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy

rus-hltcoe-MTES-patapscoBM25RM3td¶

Run ID: rus-hltcoe-MTES-patapscoBM25RM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: ee604247c12d05d23728ca1ab7dcd12b
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy

rus-hltcoe-MTES-patapscoBM25RM3title¶

Run ID: rus-hltcoe-MTES-patapscoBM25RM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: rus
MD5: 195599b8f2f786c6bdd3f2a3dc63d851
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy

rus-hltcoe-SEMN-PSQ-t¶

Run ID: rus-hltcoe-SEMN-PSQ-t
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/7/2023
Type: manual
Task: rus
MD5: 380e709da9178df7f8ee10b86b5ca0d8
Run description: PSQ with pmf=0.00001, topk=all, cdf=1.0

rus-hltcoe-SEMN-PSQ-td¶

Run ID: rus-hltcoe-SEMN-PSQ-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/7/2023
Type: manual
Task: rus
MD5: 6ec0c7865c358b8d1948ae268d9670b7
Run description: PSQ with pmf=0.00001, topk=all, cdf=1.0

rus-umd_hcil-AELN_blade¶

Run ID: rus-umd_hcil-AELN_blade
Participant: umd_hcil
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: rus
MD5: 942621e1c24828b331d352ae12a18bd1
Run description: Learned sparse retrieval using bilingual BERT model

tech-AI2-1DEAT-Specter2Description¶

Results | Participants | Input | Summary | Appendix

Run ID: tech-AI2-1DEAT-Specter2Description
Participant: AI2
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: auto
Task: tech
MD5: 106ce21aed83be35c123c47632358a06
Run description: dense neural using Specter 2 embeddings and FAISS

tech-AI2-1DEAT-Specter2Narrative¶

Results | Participants | Input | Summary | Appendix

Run ID: tech-AI2-1DEAT-Specter2Narrative
Participant: AI2
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: auto
Task: tech
MD5: c141b290f4bbaa01d0006e8c97b5b0ba
Run description: dense neural using Specter 2 embeddings and FAISS

tech-AI2-1DEAT-Specter2Title¶

Results | Participants | Input | Summary | Appendix

Run ID: tech-AI2-1DEAT-Specter2Title
Participant: AI2
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: auto
Task: tech
MD5: a412a526caa113d7881d1e59d94dc3a0
Run description: dense neural using Specter 2 embeddings and FAISS

tech-CIIR-ANEH-NativeFuisonTrec23¶

Run ID: tech-CIIR-ANEH-NativeFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 8/14/2023
Type: auto
Task: tech
MD5: 40dedd2f384a30ffb885c9ae9e47cb36
Run description: Fusion of provided baseline, dense and sparse neural models.

tech-CIIR-ATEH-HybridFuisonTrec23¶

Run ID: tech-CIIR-ATEH-HybridFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 8/14/2023
Type: auto
Task: tech
MD5: 7a46788cdb46fbe8256324db173169f6
Run description: Fusion of runs based on translated docs and runs based on native docs.

tech-CIIR-ATEH-TransFuisonTrec23¶

Run ID: tech-CIIR-ATEH-TransFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 8/14/2023
Type: auto
Task: tech
MD5: 3a669472b2abbb1870659cc876986540
Run description: Fuse provided baseline, dense and sparse neural models

tech-h2oloo-A1CND_mContrieverqt¶

Run ID: tech-h2oloo-A1CND_mContrieverqt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: f7862a9facbdfefad72a878cb6a98c0a
Run description: Dense retrieval using mContriever trained on MIRACL

tech-h2oloo-A1CNL_SpladeMiraclMonoqt¶

Run ID: tech-h2oloo-A1CNL_SpladeMiraclMonoqt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: adaf93de55187810f21e22e8bfc1b2b1
Run description: Learned Sparse Retrieval using SPLADE trained on MIRACL

tech-h2oloo-A1CNL_SpladeNeuclirqt¶

Run ID: tech-h2oloo-A1CNL_SpladeNeuclirqt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: bc8bc48a12cac375c2180cd53ffe114f
Run description: Learned Sparse Retrieval using SPLADE trained for NeuCLIR 2022

tech-h2oloo-A1CNS_bm25qt¶

Run ID: tech-h2oloo-A1CNS_bm25qt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: 14efbc4416f6bda1484ba8ba8ea70e89
Run description: BM25 with rocchio over Chinese documents

tech-h2oloo-A1NETHC_BM25sSplades¶

Run ID: tech-h2oloo-A1NETHC_BM25sSplades
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: 266a5034634352dfe73fa5b0b9646a05
Run description: Ensemble of BM25 (2) + SPLADEs (2) with document and query translations

tech-h2oloo-A1NETHC_EverythingRun¶

Run ID: tech-h2oloo-A1NETHC_EverythingRun
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: 52ad758f3f9d3fa613411bb9f4d98877
Run description: Ensemble of BM25 (2) + SPLADEs (2) + our other first stages (4) with document and query translations

tech-h2oloo-A1NETSC_BM25s¶

Run ID: tech-h2oloo-A1NETSC_BM25s
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: 08e4264bc881f9e3871c6f2288d8068e
Run description: Ensemble of BM25 with document and query translations

tech-h2oloo-A_BM25s_fRR¶

Run ID: tech-h2oloo-A_BM25s_fRR
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: 53ca116b6cbb9d7fe949c1aad4187a1e
Run description: Reranking Ensemble of our "Ensemble of BM25 (2) with document and query translations" with the first stage added to the ensemble

tech-h2oloo-A_BM25s_RR¶

Run ID: tech-h2oloo-A_BM25s_RR
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: 0d43404a9873f0c994083d118e2e002e
Run description: Reranking Ensemble of our "Ensemble of BM25 (2) + SPLADEs (2) with document and query translations"

tech-h2oloo-A_BM25sSplades_fRR¶

Run ID: tech-h2oloo-A_BM25sSplades_fRR
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: f63d180bb657853ba74c6f99df6c14d1
Run description: Reranking Ensemble of our "Ensemble of BM25 (2) + SPLADEs (2) with document and query translations" with the first stage added to the ensemble

tech-h2oloo-A_BM25sSplades_RR¶

Run ID: tech-h2oloo-A_BM25sSplades_RR
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: 9118b480e106f23b808a5abafb93971b
Run description: Reranking Ensemble of our "Ensemble of BM25 (2) + SPLADEs (2) with document and query translations"

tech-h2oloo-A_EverythingRun_fRR¶

Run ID: tech-h2oloo-A_EverythingRun_fRR
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: 124870e5b124d0a862b796d57ce1b07c
Run description: Reranking Ensemble of our "Ensemble of BM25 (2) + SPLADEs (2) + other first stage rankers (4) with document and query translations" ensembled with the first stage

tech-h2oloo-A_EverythingRun_RR¶

Run ID: tech-h2oloo-A_EverythingRun_RR
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: 4c7289c56a2c19953ac96d024f7ddcbb
Run description: Reranking Ensemble of our "Ensemble of BM25 (2) + SPLADEs (2) + other first stage rankers (4) with document and query translations"

tech-h2oloo-AETD_RetroMAEReprodt¶

Run ID: tech-h2oloo-AETD_RetroMAEReprodt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: 0058fe923ac3c12ef66170755ce7feb0
Run description: Dense retrieval using a reproduction of RetroMAE trained on MSMARCO

tech-h2oloo-AETL_SpladeMiraclENdt¶

Run ID: tech-h2oloo-AETL_SpladeMiraclENdt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: beed14c4b39098b0c01e1478913c5d06
Run description: Learned sparse retrieval using a SPLADE trained on the English part of MIRACL

tech-h2oloo-AETL_SpladePPSDdt¶

Run ID: tech-h2oloo-AETL_SpladePPSDdt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: 5f1b73d9e7e7efd3f421b7e9f2fc871a
Run description: Learned sparse retrieval using SPLADE++ self distil from huggingface

tech-h2oloo-AETS_bm25dt¶

Run ID: tech-h2oloo-AETS_bm25dt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 8/10/2023
Type: auto
Task: tech
MD5: ea47c9e734b3b82b386e054a5dd5b374
Run description: BM25 with rocchio over English documents

tech-hltcoe-2MNCH-rerank_mt5ht_td¶

Run ID: tech-hltcoe-2MNCH-rerank_mt5ht_td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: ae54b6c93c373cc2ceaea5826d3d9083
Run description: Reranking using mt5 cross-encoder run over native documents with human queries making this a monolingual reranking

tech-hltcoe-2MNEH-rerank_mt5gt_td¶

Run ID: tech-hltcoe-2MNEH-rerank_mt5gt_td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 12984fcdce8ecd99218396613f91b889
Run description: Reranking using mt5 cross-encoder run over native documents with google translations of English queries

tech-hltcoe-MNCD-plaid_mono_td¶

Run ID: tech-hltcoe-MNCD-plaid_mono_td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 6669787798c80f14bb7cb8747b705bc5
Run description: PLAID run using a model trained from monolingual Chinese retrieval indexing native documents with Chinese queries, a monolingual run

tech-hltcoe-MNCD-plaid_monozh_mt5ht_td¶

Run ID: tech-hltcoe-MNCD-plaid_monozh_mt5ht_td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: ce6a1296df6a06e03c097a35f8b5197d
Run description: Reranking the PLAID run using model trained for Chinese monolingual retrieval using mt5 cross-encoder run over native documents with human queries making this a monolingual reranking

tech-hltcoe-MNCS-patapsco_bm25_ht_d_rm3¶

Run ID: tech-hltcoe-MNCS-patapsco_bm25_ht_d_rm3
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: fccd77c3cf84c125e80237bc4b1022db
Run description: sparse retrieval with Patapsco BM25 indexing native documents using rm3; queries in document language - monolingual run

tech-hltcoe-MNCS-patapsco_bm25_ht_t_rm3¶

Run ID: tech-hltcoe-MNCS-patapsco_bm25_ht_t_rm3
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 74c2f1f69641eb2557b7000b286015f2
Run description: sparse retrieval with Patapsco BM25 indexing native documents using rm3; queries in document language - monolingual run

tech-hltcoe-MNCS-patapsco_bm25_ht_td_rm3¶

Run ID: tech-hltcoe-MNCS-patapsco_bm25_ht_td_rm3
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 4f4de60efdcf5dcab282641c689ce0ed
Run description: sparse retrieval with Patapsco BM25 indexing native documents using rm3; queries in document language - monolingual run

tech-hltcoe-MNED-colbert_x_td¶

Run ID: tech-hltcoe-MNED-colbert_x_td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 93842fd7f5f6acb51cb312093b6aad70
Run description: ColBERT-X run with a model trained using translate train, indexing Chinese documents and retrieving with English queries

tech-hltcoe-MNED-plaid_distilled_td¶

Run ID: tech-hltcoe-MNED-plaid_distilled_td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 0e27eaa3d8411e50c7215a8ad0405da4
Run description: PLAID run using model trained with distillation from mt5 indexing native documents with English queries

tech-hltcoe-MNED-plaid_jhpolo_td¶

Run ID: tech-hltcoe-MNED-plaid_jhpolo_td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: e4ad14298b6884180929c66921e48795
Run description: PLAID run using a model the was first fine-tuned with distillation of the mt5 model and then fine-tuned for another 10K steps with triples where CSL documents were paired and GPT4 created a query indexing native documents with English queries

tech-hltcoe-MNED-plaid_tt_mt5gt_td¶

Run ID: tech-hltcoe-MNED-plaid_tt_mt5gt_td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 7dea9fd968f028fe4c5e04143d1cd38f
Run description: Reranking the PLAID run using model trained with distillation from mt5 and using mt5 cross-encoder run over native documents with machine translated queries

tech-hltcoe-MNED-plaid_tt_td¶

Run ID: tech-hltcoe-MNED-plaid_tt_td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 0c8fb879ee10ac8c1eb3b48ae9fab9e8
Run description: PLAID run using model trained with translate train in ColBERT-V1 style indexing native documents with English queries

tech-hltcoe-MNEL-blade-d¶

Run ID: tech-hltcoe-MNEL-blade-d
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: dc4b11079134ee89ac229dfc2f11b8d5
Run description: sparse neural approach with BLADE using a bilingual BERT model to find the most likely Chinese and English terms in the document. Queries are also embedded to achieve a form of query expansion

tech-hltcoe-MNEL-blade-t¶

Run ID: tech-hltcoe-MNEL-blade-t
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 8a8e30f697cbe5c18797aac9f930f168
Run description: sparse neural approach with BLADE using a bilingual BERT model to find the most likely Chinese and English terms in the document. Queries are also embedded to achieve a form of query expansion

tech-hltcoe-MNEL-blade-td¶

Run ID: tech-hltcoe-MNEL-blade-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 63d1a9a0b99abba8ea6a4b6748456330
Run description: sparse neural approach with BLADE using a bilingual BERT model to find the most likely Chinese and English terms in the document. Queries are also embedded to achieve a form of query expansion

tech-hltcoe-MNES-patapsco_bm25_qt_d_rm3¶

Run ID: tech-hltcoe-MNES-patapsco_bm25_qt_d_rm3
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 1be2e17bf6dcae64df2a218adb15098e
Run description: sparse retrieval with Patapsco BM25 indexing native documents using rm3; queries translated by google

tech-hltcoe-MNES-patapsco_bm25_qt_t_rm3¶

Run ID: tech-hltcoe-MNES-patapsco_bm25_qt_t_rm3
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: dd7c0e06cda1ca93bc7b6611085d9b77
Run description: sparse retrieval with Patapsco BM25 indexing native documents using rm3; queries translated by google

tech-hltcoe-MNES-patapsco_bm25_qt_td_rm3¶

Run ID: tech-hltcoe-MNES-patapsco_bm25_qt_td_rm3
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 622a72cb1d457fd837b5efe176a2767c
Run description: sparse retrieval with Patapsco BM25 indexing native documents using rm3; queries translated by google

tech-hltcoe-MNES-psq_t_f32¶

Run ID: tech-hltcoe-MNES-psq_t_f32
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/14/2023
Type: manual
Task: tech
MD5: 6f0bdc5f748f4c304144050fe8246f7b
Run description: fast probabilistic structure queries, a sparse CLIR approach with statistical MT translation tables, with --min_translation_prob 0.00010 --max_translation_alternatives 64 --max_translation_cdf 1.0

tech-hltcoe-MNES-psq_td_f32¶

Run ID: tech-hltcoe-MNES-psq_td_f32
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/14/2023
Type: manual
Task: tech
MD5: 025987dc0e644049e9592da9fdc292ff
Run description: fast probabilistic structure queries, a sparse CLIR approach with statistical MT translation tables, with --min_translation_prob 0.00010 --max_translation_alternatives 64 --max_translation_cdf 1.0

tech-hltcoe-MTED-plaid_V2model_td¶

Run ID: tech-hltcoe-MTED-plaid_V2model_td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 8e4db898406b7234aa31af3402d8a8dc
Run description: PLAID run using the Stanford distributed ColBERT V2 model indexing translated documents with English queries

tech-hltcoe-MTES-patapsco_bm25_d_rm3¶

Run ID: tech-hltcoe-MTES-patapsco_bm25_d_rm3
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/14/2023
Type: manual
Task: tech
MD5: 4ea29b0db11c03e83617a9c817a9d964
Run description: sparse retrieval with Patapsco BM25 indexing translated documents using rm3

tech-hltcoe-MTES-patapsco_bm25_t_rm3¶

Run ID: tech-hltcoe-MTES-patapsco_bm25_t_rm3
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 28b995332c6039c484cc9dd414e132ad
Run description: sparse retrieval with Patapsco BM25 with RM3 indexing translated documents and retrieving with title queries

tech-hltcoe-MTES-patapsco_bm25_td_rm3¶

Run ID: tech-hltcoe-MTES-patapsco_bm25_td_rm3
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 8/15/2023
Type: manual
Task: tech
MD5: 6aca9108a2ed18edc6712715d4bd4124
Run description: sparse retrieval with Patapsco BM25 indexing translated documents using rm3

tech-ISI_SEARCHER-ANE_run_tech_base¶

Run ID: tech-ISI_SEARCHER-ANE_run_tech_base
Participant: ISI_SEARCHER
Track: NeuCLIR
Year: 2023
Submission: 8/11/2023
Type: auto
Task: tech
MD5: 719adfdf17fb53f319234ac054fbd166
Run description: tech-ISI_SEARCHER-ANE_run_tech_base

tech-ISI_SEARCHER-ANE_run_tech_rr¶

Run ID: tech-ISI_SEARCHER-ANE_run_tech_rr
Participant: ISI_SEARCHER
Track: NeuCLIR
Year: 2023
Submission: 8/11/2023
Type: auto
Task: tech
MD5: 92003bd89f9d025b3f66bb23c0cdbd59
Run description: tech-ISI_SEARCHER-ANE_run_tech_rr

tech-ISI_SEARCHER-ANE_run_tech_rr_combine¶

Run ID: tech-ISI_SEARCHER-ANE_run_tech_rr_combine
Participant: ISI_SEARCHER
Track: NeuCLIR
Year: 2023
Submission: 8/11/2023
Type: auto
Task: tech
MD5: 8b6a779eac5a3f9aa97b6930fe8ae3a5
Run description: tech-ISI_SEARCHER-ANE_run_tech_rr_combine

tech-ISI_SEARCHER-ANE_run_tech_rr_combine_td¶

Run ID: tech-ISI_SEARCHER-ANE_run_tech_rr_combine_td
Participant: ISI_SEARCHER
Track: NeuCLIR
Year: 2023
Submission: 8/11/2023
Type: auto
Task: tech
MD5: b8690728bfaba31a53cff7aa7e1845c9
Run description: tech-ISI_SEARCHER-ANE_run_tech_rr_combine_td

zho-CIIR-ANEH-NativeFuisonTrec23¶

Run ID: zho-CIIR-ANEH-NativeFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: auto
Task: zho
MD5: 31b0014505caffc217e72ea9d577f2c1
Run description: Fusion of provided baseline, dense and sparse neural models.

zho-CIIR-ATEH-HybridFuisonTrec23¶

Run ID: zho-CIIR-ATEH-HybridFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: auto
Task: zho
MD5: 80b14130b20c16115f35e33bb7d42f41
Run description: Fusion of runs based on translated docs and runs based on native docs.

zho-CIIR-ATEH-TransFuisonTrec23¶

Run ID: zho-CIIR-ATEH-TransFuisonTrec23
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: auto
Task: zho
MD5: 9e0aaac687cc079292d443ee99f21c48
Run description: Fuse provided baseline, dense and sparse neural models.

zho-CIIR-LATE-SPLADE¶

Run ID: zho-CIIR-LATE-SPLADE
Participant: CIIR
Track: NeuCLIR
Year: 2023
Submission: 6/26/2023
Type: auto
Task: zho
MD5: cd0266e87378142239ee6a5f9eaedce2
Run description: sparse neural run using Splade

zho-h2oloo-A1CND_mContrieverqt¶

Run ID: zho-h2oloo-A1CND_mContrieverqt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: fc7ef71bb0ff3eae0042b88f6c4f271c
Run description: mContriever trained on MIRACL

zho-h2oloo-A1CND_SpladeMiraclMonoqt¶

Run ID: zho-h2oloo-A1CND_SpladeMiraclMonoqt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: 1b9b98be80c352f4485eaaa06dc0d3fc
Run description: SPLADE trained on MIRACL chinese

zho-h2oloo-A1CNL_spladeqt¶

Run ID: zho-h2oloo-A1CNL_spladeqt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: bc7d46380699e74d391d4dc36afea978
Run description: SPLADE from neuclir 2022

zho-h2oloo-A1CNS_bm25qt¶

Run ID: zho-h2oloo-A1CNS_bm25qt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: 7de19f2dd0d674f4ca576098462c7f71
Run description: BM25

zho-h2oloo-A1NETHC_BM25sSplades¶

Run ID: zho-h2oloo-A1NETHC_BM25sSplades
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: 97a7f8a5e91339c559998b6ba5d35d4e
Run description: Ensemble of BM25s and SPLADEs (document translation one + query translation one)

zho-h2oloo-A1NETHC_EverythingRun¶

Run ID: zho-h2oloo-A1NETHC_EverythingRun
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: 0febb3968d1aa71507646e4640e3667f
Run description: Ensemble of all our first stage models

zho-h2oloo-A1NETSC_BM25s¶

Run ID: zho-h2oloo-A1NETSC_BM25s
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: 7a3a37eea97c0675ac0d02cca79bc3c1
Run description: Ensemble of BM25s (document translation one + query translation one)

zho-h2oloo-A_frgpt4¶

Run ID: zho-h2oloo-A_frgpt4
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: c54f78979009f68ad023f25ee21fe576
Run description: Reranking the top30 of our "Reranking ensemble on top of the Ensemble of all our baseline first stage runs" using GPT4 and then ensembled with the previous run

zho-h2oloo-A_RERANKBM25s¶

Run ID: zho-h2oloo-A_RERANKBM25s
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: 620635028875566ea21b5209d2935f0e
Run description: Reranking the top1000 of our "BM25 ensemble

zho-h2oloo-A_RERANKBM25sSplades¶

Run ID: zho-h2oloo-A_RERANKBM25sSplades
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: e8c864e9c4bb850fee1291d7789a1556
Run description: Reranking the top1000 of our "BM25+SPLADEs ensemble"

zho-h2oloo-A_RERANKEverythingRun¶

Run ID: zho-h2oloo-A_RERANKEverythingRun
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: 2e5ec1fad5360e4d2b24a38656f6f42b
Run description: Reranking the top1000 of our All first stage ensemble

zho-h2oloo-A_rgpt4¶

Run ID: zho-h2oloo-A_rgpt4
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: 55cf1ff6c6dd772bd37c99a998c30ac5
Run description: Reranking the top30 of our "Reranking ensemble on top of the Ensemble of all our baseline first stage runs" using GPT4

zho-h2oloo-AETD_RetroMAEReprodt¶

Run ID: zho-h2oloo-AETD_RetroMAEReprodt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: 9a4c4fedfd02aa75da30e5f954b0d1a4
Run description: Our RetroMAE reproduction trained on MSMARCO

zho-h2oloo-AETD_SpladeMiraclENdt¶

Run ID: zho-h2oloo-AETD_SpladeMiraclENdt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: 17c062c50b166befd3c0da37fe592131
Run description: SPLADE ++ self distil from huggingface fine tuned on MIRACL english

zho-h2oloo-AETL_spladedt¶

Run ID: zho-h2oloo-AETL_spladedt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: 5c953f38c376ef3686e8fc5704cb4870
Run description: SPLADE ++ self distil from huggingface

zho-h2oloo-AETS_bm25dt¶

Run ID: zho-h2oloo-AETS_bm25dt
Participant: h2oloo
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: bc2c81243da1818485c347e02f689736
Run description: BM25 over translated documents

zho-hltcoe-DCMN-PLAID192mono-td¶

Run ID: zho-hltcoe-DCMN-PLAID192mono-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 45dddf7296529b2d0760db380667b290
Run description: Dense Retrieval with PLAID trained with distillation from monomT5 reranking on top 50 docs retrieved by ColBERT-Xv1 TT model. 1 bit index.

zho-hltcoe-DEMN-PLAIDkd-monomt5tt-td¶

Run ID: zho-hltcoe-DEMN-PLAIDkd-monomt5tt-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 44d88d6881f31a06992e33e750310701
Run description: Dense Retrieval with PLAID trained with distillation from monomT5 reranking on top 50 docs retrieved by ColBERT-Xv1 TT model. 1 bit index.

zho-hltcoe-HEMN-PLAIDkd-mT5gt-dt¶

Run ID: zho-hltcoe-HEMN-PLAIDkd-mT5gt-dt
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: fc3d7de9e5db9f143f680547c6f6b4cc
Run description: Dense Retrieval with PLAID trained with distillation (English queries) followed by MonomT5 reranker using Google translated queries on top 1000 documents.

zho-hltcoe-HEMN2-mT5gt-dt¶

Run ID: zho-hltcoe-HEMN2-mT5gt-dt
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 0578e6f680ae7d3ea3fef2a6ad188838
Run description: MonomT5 reranker using Google translated queries on top 1000 documents.

zho-hltcoe-MNCS-patapscoBM25noRM3desc¶

Run ID: zho-hltcoe-MNCS-patapscoBM25noRM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 5ff274e4041d6cd733752d4489c7792a
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Chinese documents and using queries written in Chinese queries, tokenization and stemming with spacy

zho-hltcoe-MNCS-patapscoBM25noRM3td¶

Run ID: zho-hltcoe-MNCS-patapscoBM25noRM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 04e27bab64f1715f73d39e04d70221eb
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Chinese documents and using queries written in Chinese queries, tokenization and stemming with spacy

zho-hltcoe-MNCS-patapscoBM25noRM3title¶

Run ID: zho-hltcoe-MNCS-patapscoBM25noRM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 95a09ebf9ee448b3f00e757ab012582b
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco without RM3, indexing Chinese documents and using queries written in Chinese queries, tokenization and stemming with spacy

zho-hltcoe-MNCS-patapscoBM25RM3desc¶

Run ID: zho-hltcoe-MNCS-patapscoBM25RM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 9367487e9b602e00477e5bff9d02c894
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Chinese documents and using queries written in Chinese queries, tokenization and stemming with spacy

zho-hltcoe-MNCS-patapscoBM25RM3td¶

Run ID: zho-hltcoe-MNCS-patapscoBM25RM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 12e431fbc51440f16243257c7d7322ec
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Chinese documents and using queries written in Chinese queries, tokenization and stemming with spacy

zho-hltcoe-MNCS-patapscoBM25RM3title¶

Run ID: zho-hltcoe-MNCS-patapscoBM25RM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 36d8f9e9ba9ec212fc28bd53f2126ab9
Run description: Monolingual Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Chinese documents and using queries written in Chinese queries, tokenization and stemming with spacy

zho-hltcoe-MNED-colbertX¶

Run ID: zho-hltcoe-MNED-colbertX
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: b3dbc2ca34e58e29eb04dba933a060b7
Run description: Dense Retrieval with a ColBERT-X model trained with translated-train over English queries

zho-hltcoe-MNED-PLAID_shard_by_date_1bit_v1_tt¶

Run ID: zho-hltcoe-MNED-PLAID_shard_by_date_1bit_v1_tt
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: b69b8f17f914b5903e71a9a8e2fed3e2
Run description: Dense Retrieval with PLAID using a v1 translate-train model, with 1 bit indexes, shared into 3 month periods, queries with time only include shards of relevant time window

zho-hltcoe-MNES-patapscoBM25noRM3desc¶

Run ID: zho-hltcoe-MNES-patapscoBM25noRM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 3da117fe2835c038695c4a7059a8a824
Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Chinese documents and using Google Translate to create Chinese queries from English tokenization and stemming with spacy

zho-hltcoe-MNES-patapscoBM25noRM3td¶

Run ID: zho-hltcoe-MNES-patapscoBM25noRM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 39843fd98ec0c4e89215742acc48690f
Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Chinese documents and using Google Translate to create Chinese queries from English tokenization and stemming with spacy

zho-hltcoe-MNES-patapscoBM25noRM3title¶

Run ID: zho-hltcoe-MNES-patapscoBM25noRM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 4450012e6bbd4d3c6f2cfd50e370b8d2
Run description: Sparse Retrieval with BM25 using Patapsco without RM3, indexing Chinese documents and using Google Translate to create Chinese queries from English tokenization and stemming with spacy

zho-hltcoe-MNES-patapscoBM25RM3desc¶

Run ID: zho-hltcoe-MNES-patapscoBM25RM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 95a84fa27d9fcfd5e045e73814d9d591
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Chinese documents and using Google Translate to create Chinese queries from English, tokenization and stemming with spacy

zho-hltcoe-MNES-patapscoBM25RM3td¶

Run ID: zho-hltcoe-MNES-patapscoBM25RM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: cb46bd79caf68b15e7f2be50ef783e21
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Chinese documents and using Google Translate to create Chinese queries from English, tokenization and stemming with spacy

zho-hltcoe-MNES-patapscoBM25RM3title¶

Run ID: zho-hltcoe-MNES-patapscoBM25RM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 70a92da64a744fe8222f01cb4b770a4a
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50% , indexing Chinese documents and using Google Translate to create Chinese queries from English, tokenization and stemming with spacy

zho-hltcoe-MTED-plaid_v2_eng_1¶

Run ID: zho-hltcoe-MTED-plaid_v2_eng_1
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: da39cac2cdd1e8eed81cb244f9a81040
Run description: Dense Retrieval with PLAID using a distributed v2 model, with 1 bit indexes, indexing English Documents

zho-hltcoe-MTES-patapscoBM25noRM3desc¶

Run ID: zho-hltcoe-MTES-patapscoBM25noRM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: ec6cadfb5e4b97fe9ae7bb976a977485
Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy

zho-hltcoe-MTES-patapscoBM25noRM3td¶

Run ID: zho-hltcoe-MTES-patapscoBM25noRM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: a96eeb09e3b77f7bc296daae0b202942
Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy

zho-hltcoe-MTES-patapscoBM25noRM3title¶

Run ID: zho-hltcoe-MTES-patapscoBM25noRM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 958419d33f3f758b5de9956669e271ae
Run description: Sparse Retrieval with BM25 using Patapsco to index machine translate documents into English without RM3, tokenization and stemming with spacy

zho-hltcoe-MTES-patapscoBM25RM3desc¶

Run ID: zho-hltcoe-MTES-patapscoBM25RM3desc
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: abd2d5fe42da7b77e949bc6bb0427097
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy

zho-hltcoe-MTES-patapscoBM25RM3td¶

Run ID: zho-hltcoe-MTES-patapscoBM25RM3td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 6e833532c82de65d75720bc482e4ea53
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy

zho-hltcoe-MTES-patapscoBM25RM3title¶

Run ID: zho-hltcoe-MTES-patapscoBM25RM3title
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/8/2023
Type: manual
Task: zho
MD5: 93986b0eec17e5150ca01d2972895a5a
Run description: Sparse Retrieval with BM25 using Patapsco with RM3 adding 10 terms from the top 10 documents, original query is 50%, indexing machine translate documents tokenization and stemming with spacy

zho-hltcoe-SEMN-PSQ-t¶

Run ID: zho-hltcoe-SEMN-PSQ-t
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/7/2023
Type: manual
Task: zho
MD5: fd207b06c061fb1f9030d3d2193ccb2d
Run description: PSQ with pmf=0.00010, topk=64, cdf=0.99

zho-hltcoe-SEMN-PSQ-td¶

Run ID: zho-hltcoe-SEMN-PSQ-td
Participant: hltcoe
Track: NeuCLIR
Year: 2023
Submission: 7/7/2023
Type: manual
Task: zho
MD5: ff28f75ccfc5a506b34c20fd64f84d63
Run description: PSQ with pmf=0.00010, topk=64, cdf=0.99

zho-ISI_SEARCHER-ANE_run1¶

Run ID: zho-ISI_SEARCHER-ANE_run1
Participant: ISI_SEARCHER
Track: NeuCLIR
Year: 2023
Submission: 7/7/2023
Type: auto
Task: zho
MD5: 4df53876ca46970ae7e3b906e8a745dd
Run description: SEARCHER (see http://www.lrec-conf.org/proceedings/lrec2020/workshops/CLSSTS2020/pdf/2020.clssts-1.4.pdf)

zho-umd_hcil-AELN_blade¶

Run ID: zho-umd_hcil-AELN_blade
Participant: umd_hcil
Track: NeuCLIR
Year: 2023
Submission: 7/10/2023
Type: auto
Task: zho
MD5: 62e3ac792c754e89c24c9c5af80b0b70
Run description: Learned sparse retrieval using bilingual BERT model