Participants - BioGen 2025¶
EvalHLTCOE¶
- Name: Will Walden
- Organization: Human Language Technology Center of Excellence - Evaluation Team
- Runs: hltcoe-eval-common-smoothed-sonnet | hltcoe-eval-svc-smoothed-sonnet
InfoLab¶
- Name: Damian Martinez
- Organization: University of Delaware
- Runs: task_a_run6_A | task_a_run2 | task_a_run1 | task_b_run4 | task_a_run3 | task_b_run4_B | task_b_run1 | task_b_run5 | task_a_run4 | task_b_output_reranker_sum
dal¶
- Name: Jitansh Arora
- Organization: Dalhousie University
- Runs: rrf_monot5-msmarco_deepseek-r1 | rrf_monot5-msmarco_llama70b | rmmdn | rmmln | afmmdn | afmmd | expd | empd | expert_prompt | emotional_prompt
UAmsterdam¶
- Name: Jaap Kamps
- Organization: University of Amsterdam
- Runs: UAmsterdam_bergen | UAmsterdam_bergen_llama-8b | UAmsterdam_bergen_llama-70b | UAmsterdam_bergen_mistral-7b | UAmsterdam_bergen_pisco-llama | UAmsterdam_bergen_pisco-mistral
hltcoe-multiagt¶
- Name: Dawn Lawrie
- Organization: JHU HLTCOE SCALE25 gen multiagent
- Runs: hltcoe-multiagt.llama70B.ag_sw-ret_plq-6-wbg-limit | hltcoe-multiagt.llama70B.lg-w-ret_lpq-nt-s_cite | hltcoe-multiagt.llama70B.lg-w-ret_p-nt-s_cite
polito¶
- Name: Daniele Rege Cambrin
- Organization: Politecnico di Torino
- Runs: scifive-ft-512CL-lex
CLaC Lab¶
- Name: Ganesh Chandrasekar
- Organization: Computational Linguistics at Concordia
- Runs: system_a | system_b_tfidf | system_c_medcpt | system_d_medcpt_wide | system_e
h2oloo¶
- Name: Jimmy Lin
- Organization: University of Waterloo
- Runs: h2oloo_rr_q3-30b_t50 | h2oloo_rr_g41_t50 | h2oloo_rr_q3-30b_t20 | h2oloo_rr_q3-30b_nc
CLaC¶
- Name: Harikrishnan Gurushankar Saisudha
- Organization: Computational Linguistics at Concordia
- Runs: simpleQA_BM25 | simpleQA_hybrid | MedHopQA_BM25 | MedHopQA_FAISS | LLM_BM25 | LLM_NLI_BM25
SIB¶
- Name: Luc Mottin
- Organization: Swiss Institute of Bioinformatics
- Runs: SIB-task-a-3 | SIB-task-a-4 | SIB-task-a-2 | SIB-task-a-1 | SIB-task-a-6 | SIB-task-a-5 | SIB-task-a-7 | SIB-task-b-1 | SIB-task-b-2 | SIB-task-b-3 | SIB-task-b-4
uniud¶
- Name: Riccardo Lunardi
- Organization: University of Udine
- Runs: run1_no-rerank_index-passages-sparse_Llama-3.1-8B-Instruct | run2_rerank_index-passages-sparse_Llama-3.1-8B-Instruct | run3_no_rerank_index-passages-dense_Llama-3.1-8B-Instruct | run4_rerank_index-passages-dense_Llama-3.1-8B-Instruct | run6_rerank_index-passages-sparse_Llama-3.3-70B-Instruct | run5_no_rerank_index-passages-sparse_Llama-3.3-70B-Instruct | run7_no_rerank_index-passages-dense_Llama-3.3-70B-Instruct | run8_rerank_index-passages-dense_Llama-3.3-70B-Instruct | run9_no_rerank_index-passages-sparse_gpt-4o-mini | run10_no_rerank_index-passages-dense_gpt-4o-mini | run1_no-rerank_index-passages-sparse | run2_rerank_index-passages-sparse | run3_no-rerank_index-passages-dense | run4_rerank_index-passages-dense
GEHC-HTIC¶
- Name: Soumya Sahoo
- Organization: GE Healthcare
- Runs: gehc_htic_task_a | gehc_htic_task_b | task_a_gehc_htic_run2
hltcoe-rerank¶
- Name: Dylan Ju
- Organization: JHU HLTCOE SCALE25 rerank
- Runs: hltbio-gpt5.searcher | hltbio-lg.crux | hltbio-lg.listllama | hltbio-lg.jina | hltbio-lg.qwen | hltbio-lg.jina.qwen | hltbio-lg-fsrrf | hltbio-lg.fsrrfprf | hltbio-lg.searcher | hltcoe-rerank.llama70B.lg-w-ret_plq-nt-s_cite