Skip to content

Runs - Interactive Knowledge Assistance 2024

baseline-auto-convgqr-bm25-minilm

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline-auto-convgqr-bm25-minilm
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

baseline-auto-gpt4-bm25-minilm

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline-auto-gpt4-bm25-minilm
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

baseline-auto-gpt4o-bm25-minilm-genonly

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline-auto-gpt4o-bm25-minilm-genonly
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

baseline-auto-gpt4o-splade-minilm

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline-auto-gpt4o-splade-minilm
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

baseline-auto-llama3.1-splade-minilm

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline-auto-llama3.1-splade-minilm
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

baseline-auto-t5-bm25-minilm

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline-auto-t5-bm25-minilm
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

baseline-gen-only-gpt4o-top5

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline-gen-only-gpt4o-top5
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-gen

baseline-gen-only-llama3.1-top5

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline-gen-only-llama3.1-top5
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-gen

baseline-manual-bm25-minilm

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline-manual-bm25-minilm
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-manual

baseline-manual-splade-minilm

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline-manual-splade-minilm
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-manual

dcu_auto_qe_key_topP-50_topK-5

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: dcu_auto_qe_key_topP-50_topK-5
  • Participant: DCU-ADAPT
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

dcu_auto_qe_summ_ptkb_TopP_

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: dcu_auto_qe_summ_ptkb_TopP_
  • Participant: DCU-ADAPT
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

dcu_auto_qe_summ_TopP_3

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: dcu_auto_qe_summ_TopP_3
  • Participant: DCU-ADAPT
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

dcu_auto_qre_sim

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: dcu_auto_qre_sim
  • Participant: DCU-ADAPT
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

dcu_manual_qe_summ_ptkb_TopP_3

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: dcu_manual_qe_summ_ptkb_TopP_3
  • Participant: DCU-ADAPT
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

dcu_manual_qe_summ_TopP_3

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: dcu_manual_qe_summ_TopP_3
  • Participant: DCU-ADAPT
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

gpt-single-QR-rr-debertav3

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: gpt-single-QR-rr-debertav3
  • Participant: uva
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

gpt4-MQ-debertav3

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: gpt4-MQ-debertav3
  • Participant: uva
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

gpt4-mq-rr-fusion

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: gpt4-mq-rr-fusion
  • Participant: uva
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

iiresearch_ikat2024_rag_top5_bge_reranker

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: iiresearch_ikat2024_rag_top5_bge_reranker
  • Participant: ii_research
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-05
  • Task: trec2024-ikat-main

iiresearch_ikat2024_rag_top5_monot5_reranker

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: iiresearch_ikat2024_rag_top5_monot5_reranker
  • Participant: ii_research
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-08
  • Task: trec2024-ikat-main

infosense_llama_pssgqrs_wghtdrerank_1

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: infosense_llama_pssgqrs_wghtdrerank_1
  • Participant: infosenselab
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-06
  • Task: trec2024-ikat-main

infosense_llama_pssgqrs_wghtdrerank_2

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: infosense_llama_pssgqrs_wghtdrerank_2
  • Participant: infosenselab
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-06
  • Task: trec2024-ikat-main

infosense_llama_short_long_qrs_2

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: infosense_llama_short_long_qrs_2
  • Participant: infosenselab
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-06
  • Task: trec2024-ikat-main

infosense_llama_short_long_qrs_3

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: infosense_llama_short_long_qrs_3
  • Participant: infosenselab
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-08
  • Task: trec2024-ikat-main

ksu_created_query_reranking

Results | Participants | Input | Summary | Appendix

  • Run ID: ksu_created_query_reranking
  • Participant: ksu
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

manual-splade-debertav3

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: manual-splade-debertav3
  • Participant: uva
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-manual

manual-splade-fusion

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: manual-splade-fusion
  • Participant: uva
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-manual

nii_auto_base

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: nii_auto_base
  • Participant: nii
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-08
  • Task: trec2024-ikat-main

nii_auto_ptkb_rr

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: nii_auto_ptkb_rr
  • Participant: nii
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

NII_automatic_GeRe

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: NII_automatic_GeRe
  • Participant: nii
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

nii_manu_base

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: nii_manu_base
  • Participant: nii
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-08
  • Task: trec2024-ikat-main

nii_manu_ptkb_rr

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: nii_manu_ptkb_rr
  • Participant: nii
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

nii_res_gen

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: nii_res_gen
  • Participant: nii
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-08
  • Task: trec2024-ikat-main

qd1

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: qd1
  • Participant: uva
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-09
  • Task: trec2024-ikat-main

RALI_gpt4o_fusion_norerank

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: RALI_gpt4o_fusion_norerank
  • Participant: rali lab
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-08
  • Task: trec2024-ikat-main

RALI_gpt4o_fusion_rerank

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: RALI_gpt4o_fusion_rerank
  • Participant: rali lab
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-07
  • Task: trec2024-ikat-main

RALI_gpt4o_no_personalize_fusion_norerank

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: RALI_gpt4o_no_personalize_fusion_norerank
  • Participant: rali lab
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-08
  • Task: trec2024-ikat-main

RALI_gpt4o_no_personalize_fusion_rerank

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: RALI_gpt4o_no_personalize_fusion_rerank
  • Participant: rali lab
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-08
  • Task: trec2024-ikat-main

RALI_manual_monot5

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: RALI_manual_monot5
  • Participant: rali lab
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-08
  • Task: trec2024-ikat-manual

RALI_manual_rankllama

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: RALI_manual_rankllama
  • Participant: rali lab
  • Track: Interactive Knowledge Assistance
  • Year: 2024
  • Submission: 2024-09-08
  • Task: trec2024-ikat-manual