Runs - Interactive Knowledge Assistance 2024¶
baseline-auto-convgqr-bm25-minilm¶
Results
| Participants
| Input
| Summary
| Appendix
- Run ID: baseline-auto-convgqr-bm25-minilm
- Participant: coordinators
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
baseline-auto-gpt4-bm25-minilm¶
Results
| Participants
| Input
| Summary
| Appendix
- Run ID: baseline-auto-gpt4-bm25-minilm
- Participant: coordinators
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
baseline-auto-gpt4o-bm25-minilm-genonly¶
Results
| Participants
| Input
| Summary
| Appendix
- Run ID: baseline-auto-gpt4o-bm25-minilm-genonly
- Participant: coordinators
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
baseline-auto-gpt4o-splade-minilm¶
Results
| Participants
| Input
| Summary
| Appendix
- Run ID: baseline-auto-gpt4o-splade-minilm
- Participant: coordinators
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
baseline-auto-llama3.1-splade-minilm¶
Results
| Participants
| Input
| Summary
| Appendix
- Run ID: baseline-auto-llama3.1-splade-minilm
- Participant: coordinators
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
baseline-auto-t5-bm25-minilm¶
Results
| Participants
| Input
| Summary
| Appendix
- Run ID: baseline-auto-t5-bm25-minilm
- Participant: coordinators
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
baseline-gen-only-gpt4o-top5¶
Results
| Participants
| Input
| Summary
| Appendix
- Run ID: baseline-gen-only-gpt4o-top5
- Participant: coordinators
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-gen
baseline-gen-only-llama3.1-top5¶
Results
| Participants
| Input
| Summary
| Appendix
- Run ID: baseline-gen-only-llama3.1-top5
- Participant: coordinators
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-gen
baseline-manual-bm25-minilm¶
Results
| Participants
| Input
| Summary
| Appendix
- Run ID: baseline-manual-bm25-minilm
- Participant: coordinators
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-manual
baseline-manual-splade-minilm¶
Results
| Participants
| Input
| Summary
| Appendix
- Run ID: baseline-manual-splade-minilm
- Participant: coordinators
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-manual
dcu_auto_qe_key_topP-50_topK-5¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: dcu_auto_qe_key_topP-50_topK-5
- Participant: DCU-ADAPT
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
dcu_auto_qe_summ_ptkb_TopP_¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: dcu_auto_qe_summ_ptkb_TopP_
- Participant: DCU-ADAPT
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
dcu_auto_qe_summ_TopP_3¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: dcu_auto_qe_summ_TopP_3
- Participant: DCU-ADAPT
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
dcu_auto_qre_sim¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: dcu_auto_qre_sim
- Participant: DCU-ADAPT
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
dcu_manual_qe_summ_ptkb_TopP_3¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: dcu_manual_qe_summ_ptkb_TopP_3
- Participant: DCU-ADAPT
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
dcu_manual_qe_summ_TopP_3¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: dcu_manual_qe_summ_TopP_3
- Participant: DCU-ADAPT
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
gpt-single-QR-rr-debertav3¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: gpt-single-QR-rr-debertav3
- Participant: uva
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
gpt4-MQ-debertav3¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: gpt4-MQ-debertav3
- Participant: uva
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
gpt4-mq-rr-fusion¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: gpt4-mq-rr-fusion
- Participant: uva
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
iiresearch_ikat2024_rag_top5_bge_reranker¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: iiresearch_ikat2024_rag_top5_bge_reranker
- Participant: ii_research
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-05
- Task: trec2024-ikat-main
iiresearch_ikat2024_rag_top5_monot5_reranker¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: iiresearch_ikat2024_rag_top5_monot5_reranker
- Participant: ii_research
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-08
- Task: trec2024-ikat-main
infosense_llama_pssgqrs_wghtdrerank_1¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: infosense_llama_pssgqrs_wghtdrerank_1
- Participant: infosenselab
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-06
- Task: trec2024-ikat-main
infosense_llama_pssgqrs_wghtdrerank_2¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: infosense_llama_pssgqrs_wghtdrerank_2
- Participant: infosenselab
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-06
- Task: trec2024-ikat-main
infosense_llama_short_long_qrs_2¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: infosense_llama_short_long_qrs_2
- Participant: infosenselab
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-06
- Task: trec2024-ikat-main
infosense_llama_short_long_qrs_3¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: infosense_llama_short_long_qrs_3
- Participant: infosenselab
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-08
- Task: trec2024-ikat-main
ksu_created_query_reranking¶
Results
| Participants
| Input
| Summary
| Appendix
- Run ID: ksu_created_query_reranking
- Participant: ksu
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
manual-splade-debertav3¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: manual-splade-debertav3
- Participant: uva
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-manual
manual-splade-fusion¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: manual-splade-fusion
- Participant: uva
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-manual
nii_auto_base¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: nii_auto_base
- Participant: nii
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-08
- Task: trec2024-ikat-main
nii_auto_ptkb_rr¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: nii_auto_ptkb_rr
- Participant: nii
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
NII_automatic_GeRe¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: NII_automatic_GeRe
- Participant: nii
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
nii_manu_base¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: nii_manu_base
- Participant: nii
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-08
- Task: trec2024-ikat-main
nii_manu_ptkb_rr¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: nii_manu_ptkb_rr
- Participant: nii
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
nii_res_gen¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: nii_res_gen
- Participant: nii
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-08
- Task: trec2024-ikat-main
qd1¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: qd1
- Participant: uva
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-09
- Task: trec2024-ikat-main
RALI_gpt4o_fusion_norerank¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: RALI_gpt4o_fusion_norerank
- Participant: rali lab
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-08
- Task: trec2024-ikat-main
RALI_gpt4o_fusion_rerank¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: RALI_gpt4o_fusion_rerank
- Participant: rali lab
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-07
- Task: trec2024-ikat-main
RALI_gpt4o_no_personalize_fusion_norerank¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: RALI_gpt4o_no_personalize_fusion_norerank
- Participant: rali lab
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-08
- Task: trec2024-ikat-main
RALI_gpt4o_no_personalize_fusion_rerank¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: RALI_gpt4o_no_personalize_fusion_rerank
- Participant: rali lab
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-08
- Task: trec2024-ikat-main
RALI_manual_monot5¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: RALI_manual_monot5
- Participant: rali lab
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-08
- Task: trec2024-ikat-manual
RALI_manual_rankllama¶
Results
| Participants
| Proceedings
| Input
| Summary
| Appendix
- Run ID: RALI_manual_rankllama
- Participant: rali lab
- Track: Interactive Knowledge Assistance
- Year: 2024
- Submission: 2024-09-08
- Task: trec2024-ikat-manual