Skip to content

Runs - Retrieval-Augmented Generation 2024

ag_rag_gpt35_expansion_rrf_15

Results | Participants | Input | Summary | Appendix

  • Run ID: ag_rag_gpt35_expansion_rrf_15
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

ag_rag_gpt35_expansion_rrf_20

Results | Participants | Input | Summary | Appendix

  • Run ID: ag_rag_gpt35_expansion_rrf_20
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

ag_rag_gpt35_expansion_rrf_7

Results | Participants | Input | Summary | Appendix

  • Run ID: ag_rag_gpt35_expansion_rrf_7
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

ag_rag_mistral_expansion_rrf_15

Results | Participants | Input | Summary | Appendix

  • Run ID: ag_rag_mistral_expansion_rrf_15
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

ag_rag_mistral_expansion_rrf_20

Results | Participants | Input | Summary | Appendix

  • Run ID: ag_rag_mistral_expansion_rrf_20
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

ag_rag_mistral_expansion_rrf_7

Results | Participants | Input | Summary | Appendix

  • Run ID: ag_rag_mistral_expansion_rrf_7
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

agtask-bm25-colbert_faiss-gpt4o-llama70b

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: agtask-bm25-colbert_faiss-gpt4o-llama70b
  • Participant: softbank-meisei
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-auggen

anserini_bm25+rocchio.rag24.test_top100

Results | Participants | Input | Summary | Appendix

  • Run ID: anserini_bm25+rocchio.rag24.test_top100
  • Participant: coordinators
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

anserini_bm25.rag24.test_top100

Results | Participants | Input | Summary | Appendix

  • Run ID: anserini_bm25.rag24.test_top100
  • Participant: coordinators
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

ASCITI_co_bge

Results | Participants | Input | Summary | Appendix

  • Run ID: ASCITI_co_bge
  • Participant: citi
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-retrieval

ASCITI_co_co

Results | Participants | Input | Summary | Appendix

  • Run ID: ASCITI_co_co
  • Participant: citi
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-retrieval

ASCITI_co_gpt

Results | Participants | Input | Summary | Appendix

  • Run ID: ASCITI_co_gpt
  • Participant: citi
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-retrieval

baseline_frag_rag24.test_command-r-plus_top20

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline_frag_rag24.test_command-r-plus_top20
  • Participant: coordinators
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-22
  • Task: trec2024-rag-gen

baseline_frag_rag24.test_gpt-4o_top20

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline_frag_rag24.test_gpt-4o_top20
  • Participant: coordinators
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-22
  • Task: trec2024-rag-gen

baseline_rag24.test_command-r-plus_top20

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline_rag24.test_command-r-plus_top20
  • Participant: coordinators
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-22
  • Task: trec2024-rag-auggen

baseline_rag24.test_gpt-4o_top20

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline_rag24.test_gpt-4o_top20
  • Participant: coordinators
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-22
  • Task: trec2024-rag-auggen

baseline_rag24.test_l31_70b_instruct_top20

Results | Participants | Input | Summary | Appendix

  • Run ID: baseline_rag24.test_l31_70b_instruct_top20
  • Participant: coordinators
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-22
  • Task: trec2024-rag-auggen

baseline_top_5

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: baseline_top_5
  • Participant: uis-iai
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

BEST_cot_gpt3.5

Results | Participants | Input | Summary | Appendix

  • Run ID: BEST_cot_gpt3.5
  • Participant: citi
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-gen

BEST_gpt3.5

Results | Participants | Input | Summary | Appendix

  • Run ID: BEST_gpt3.5
  • Participant: citi
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-gen

BEST_gpt3.5_another_prompt

Results | Participants | Input | Summary | Appendix

  • Run ID: BEST_gpt3.5_another_prompt
  • Participant: citi
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-gen

BEST_gpt3.5_new_prompt

Results | Participants | Input | Summary | Appendix

  • Run ID: BEST_gpt3.5_new_prompt
  • Participant: citi
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-gen

buw

Results | Participants | Input | Summary | Appendix

  • Run ID: buw
  • Participant: buw
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

buw_2

Results | Participants | Input | Summary | Appendix

  • Run ID: buw_2
  • Participant: buw
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

buw_3

Results | Participants | Input | Summary | Appendix

  • Run ID: buw_3
  • Participant: buw
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

buw_5

Results | Participants | Input | Summary | Appendix

  • Run ID: buw_5
  • Participant: buw
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

cir_gpt-4o-mini_Cosine_20_0.5_100_301_p1

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: cir_gpt-4o-mini_Cosine_20_0.5_100_301_p1
  • Participant: CIR
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

cir_gpt-4o-mini_Cosine_50_0.25_100_301_p1

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: cir_gpt-4o-mini_Cosine_50_0.25_100_301_p1
  • Participant: CIR
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

cir_gpt-4o-mini_Cosine_50_0.5_100_301_p1

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: cir_gpt-4o-mini_Cosine_50_0.5_100_301_p1
  • Participant: CIR
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

cir_gpt-4o-mini_Cosine_50_0.5_100_301_p2

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: cir_gpt-4o-mini_Cosine_50_0.5_100_301_p2
  • Participant: CIR
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

cir_gpt-4o-mini_Cosine_50_0.5_100_301_p3

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: cir_gpt-4o-mini_Cosine_50_0.5_100_301_p3
  • Participant: CIR
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

cir_gpt-4o-mini_Cosine_50_0.75_100_301_p1

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: cir_gpt-4o-mini_Cosine_50_0.75_100_301_p1
  • Participant: CIR
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

cir_gpt-4o-mini_Cosine_50_1.0_100_301_p1

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: cir_gpt-4o-mini_Cosine_50_1.0_100_301_p1
  • Participant: CIR
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

cir_gpt-4o-mini_Jaccard_50_0.5_100_301_p0

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: cir_gpt-4o-mini_Jaccard_50_0.5_100_301_p0
  • Participant: CIR
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

cir_gpt-4o-mini_Jaccard_50_1.0_100_301_p0

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: cir_gpt-4o-mini_Jaccard_50_1.0_100_301_p0
  • Participant: CIR
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

cir_gpt-4o-mini_no_reranking_50_0.5_100_301_p1

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: cir_gpt-4o-mini_no_reranking_50_0.5_100_301_p1
  • Participant: CIR
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

cohere+post_processing

Results | Participants | Input | Summary | Appendix

  • Run ID: cohere+post_processing
  • Participant: KML
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

dense_on_sparse

Results | Participants | Input | Summary | Appendix

  • Run ID: dense_on_sparse
  • Participant: buw
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

dilab_repllama_listt5_pass1_gpt4o

Results | Participants | Input | Summary | Appendix

  • Run ID: dilab_repllama_listt5_pass1_gpt4o
  • Participant: ldisnu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

dilab_repllama_listt5_pass2_gpt4o

Results | Participants | Input | Summary | Appendix

  • Run ID: dilab_repllama_listt5_pass2_gpt4o
  • Participant: ldisnu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

dilab_repllama_listt5_pass3_gpt4o

Results | Participants | Input | Summary | Appendix

  • Run ID: dilab_repllama_listt5_pass3_gpt4o
  • Participant: ldisnu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

dilab_repllama_listt5_pass4_gpt4o

Results | Participants | Input | Summary | Appendix

  • Run ID: dilab_repllama_listt5_pass4_gpt4o
  • Participant: ldisnu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

Enhanced_Iterative_Fact_Refinement_and_Prioritization

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: Enhanced_Iterative_Fact_Refinement_and_Prioritization
  • Participant: TREMA-UNH
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

fs4+monot5.rag24.test_top100

Results | Participants | Input | Summary | Appendix

  • Run ID: fs4+monot5.rag24.test_top100
  • Participant: coordinators
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

fs4+monot5_listgalore.rag24.test_top100

Results | Participants | Input | Summary | Appendix

  • Run ID: fs4+monot5_listgalore.rag24.test_top100
  • Participant: h2oloo
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

fs4+monot5_rg4o.rag24.test_top100

Results | Participants | Input | Summary | Appendix

  • Run ID: fs4+monot5_rg4o.rag24.test_top100
  • Participant: h2oloo
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

fs4+monot5_rl31-70b.rag24.test_top100

Results | Participants | Input | Summary | Appendix

  • Run ID: fs4+monot5_rl31-70b.rag24.test_top100
  • Participant: h2oloo
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

fs4+monot5_rz.rag24.test_top100

Results | Participants | Input | Summary | Appendix

  • Run ID: fs4+monot5_rz.rag24.test_top100
  • Participant: coordinators
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

fs4_bm25+rocchio_snowael_snowaem_gtel+monot5_rrf+rz_rrf.rag24.test

Results | Participants | Input | Summary | Appendix

  • Run ID: fs4_bm25+rocchio_snowael_snowaem_gtel+monot5_rrf+rz_rrf.rag24.test
  • Participant: coordinators
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-21
  • Task: trec2024-rag-retrieval

FT-llama3

Results | Participants | Input | Summary | Appendix

  • Run ID: FT-llama3
  • Participant: uog-tht
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

ginger-fluency_top_10

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ginger-fluency_top_10
  • Participant: uis-iai
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

ginger-fluency_top_20

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ginger-fluency_top_20
  • Participant: uis-iai
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

ginger-fluency_top_5

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ginger-fluency_top_5
  • Participant: uis-iai
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

ginger_top_5

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ginger_top_5
  • Participant: uis-iai
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

gpt_mini

Results | Participants | Input | Summary | Appendix

  • Run ID: gpt_mini
  • Participant: KML
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

gpt_mini_double_prompt

Results | Participants | Input | Summary | Appendix

  • Run ID: gpt_mini_double_prompt
  • Participant: KML
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-27
  • Task: trec2024-rag-auggen

grill_fine_grained_rel_2_full_doc

Results | Participants | Input | Summary | Appendix

  • Run ID: grill_fine_grained_rel_2_full_doc
  • Participant: grilllab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-retrieval

grill_fine_grained_rel_2_full_doc_cohere

Results | Participants | Input | Summary | Appendix

  • Run ID: grill_fine_grained_rel_2_full_doc_cohere
  • Participant: grilllab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-retrieval

grill_fine_grained_rel_2_summaries_cohere

Results | Participants | Input | Summary | Appendix

  • Run ID: grill_fine_grained_rel_2_summaries_cohere
  • Participant: grilllab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-retrieval

grill_fine_grained_rel_2_summaries_rrf_bm25_cohere

Results | Participants | Input | Summary | Appendix

  • Run ID: grill_fine_grained_rel_2_summaries_rrf_bm25_cohere
  • Participant: grilllab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-retrieval

grill_fine_grained_summaries

Results | Participants | Input | Summary | Appendix

  • Run ID: grill_fine_grained_summaries
  • Participant: grilllab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-retrieval

ICL-mistral

Results | Participants | Input | Summary | Appendix

  • Run ID: ICL-mistral
  • Participant: uog-tht
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

ielab-b-8bp-8bafs

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-b-8bp-8bafs
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

ielab-b70bf-70bqfs-ad_hoc

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-b70bf-70bqfs-ad_hoc
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

ielab-b70bf-70bqp-70bafs

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-b70bf-70bqp-70bafs
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

ielab-b70bf-70bqp-rarr

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-b70bf-70bqp-rarr
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-27
  • Task: trec2024-rag-gen

ielab-b8b-8bp-8bafs

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-b8b-8bp-8bafs
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

ielab-b8bf-8bfs-ad_hoc

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-b8bf-8bfs-ad_hoc
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

ielab-b8bf-8bp-8ba

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-b8bf-8bp-8ba
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

ielab-b8bf-8bp-8bafs

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-b8bf-8bp-8bafs
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

ielab-b8bf-8bzs-ad_hoc

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-b8bf-8bzs-ad_hoc
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

ielab-blender-llama70b

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-blender-llama70b
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

ielab-blender-llama70b-external-only

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-blender-llama70b-external-only
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

ielab-blender-llama70b-filtered

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-blender-llama70b-filtered
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

ielab-blender-llama70b-internal-only

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-blender-llama70b-internal-only
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

ielab-blender-llama8b

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-blender-llama8b
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

ielab-blender-llama8b-filtered

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-blender-llama8b-filtered
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

ielab-bm25-stella-hybrid

Results | Participants | Input | Summary | Appendix

  • Run ID: ielab-bm25-stella-hybrid
  • Participant: ielab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

iiia_dedup

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

iiia_dedup_p1_reverse

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p1_reverse
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_dedup_p1_reverse_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p1_reverse_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_dedup_p1_reverse_ht

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p1_reverse_ht
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_dedup_p1_reverse_ht_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p1_reverse_ht_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_dedup_p1_straight

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p1_straight
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_dedup_p1_straight_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p1_straight_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_dedup_p1_straight_ht

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p1_straight_ht
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_dedup_p1_straight_ht_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p1_straight_ht_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_dedup_p2_reverse

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p2_reverse
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_dedup_p2_reverse_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p2_reverse_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_dedup_p2_reverse_ht

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p2_reverse_ht
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_dedup_p2_reverse_ht_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p2_reverse_ht_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_dedup_p2_straight

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p2_straight
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_dedup_p2_straight_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p2_straight_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_dedup_p2_straight_ht

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p2_straight_ht
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_dedup_p2_straight_ht_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_dedup_p2_straight_ht_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_standard

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

iiia_standard_p1_reverse

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p1_reverse
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_standard_p1_reverse_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p1_reverse_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_standard_p1_reverse_ht

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p1_reverse_ht
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_standard_p1_reverse_ht_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p1_reverse_ht_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_standard_p1_straight

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p1_straight
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_standard_p1_straight_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p1_straight_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_standard_p1_straight_ht

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p1_straight_ht
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_standard_p1_straight_ht_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p1_straight_ht_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_standard_p2_reverse

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p2_reverse
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_standard_p2_reverse_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p2_reverse_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_standard_p2_reverse_ht

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p2_reverse_ht
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_standard_p2_reverse_ht_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p2_reverse_ht_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_standard_p2_straight

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p2_straight
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_standard_p2_straight_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p2_straight_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiia_standard_p2_straight_ht

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p2_straight_ht
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

iiia_standard_p2_straight_ht_ag

Results | Participants | Input | Summary | Appendix

  • Run ID: iiia_standard_p2_straight_ht_ag
  • Participant: IIIA-UNIPD
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

iiresearch-bm25-top10-llama3-8b-instruct

Results | Participants | Input | Summary | Appendix

  • Run ID: iiresearch-bm25-top10-llama3-8b-instruct
  • Participant: ii_research
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

ISIR-IRIT-GEN

Results | Participants | Input | Summary | Appendix

  • Run ID: ISIR-IRIT-GEN
  • Participant: IRIT
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

ISIR-IRIT-Vanilla

Results | Participants | Input | Summary | Appendix

  • Run ID: ISIR-IRIT-Vanilla
  • Participant: IRIT
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

ISIR-IRIT-zephyr_p2

Results | Participants | Input | Summary | Appendix

  • Run ID: ISIR-IRIT-zephyr_p2
  • Participant: IRIT
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

ISIR-IRIT-zephyr_query_gen

Results | Participants | Input | Summary | Appendix

  • Run ID: ISIR-IRIT-zephyr_query_gen
  • Participant: IRIT
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

ISIR-IRIT-zephyr_query_gen_3p

Results | Participants | Input | Summary | Appendix

  • Run ID: ISIR-IRIT-zephyr_query_gen_3p
  • Participant: IRIT
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

ISIR-IRIT-zephyr_sprompt_3p

Results | Participants | Input | Summary | Appendix

  • Run ID: ISIR-IRIT-zephyr_sprompt_3p
  • Participant: IRIT
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

LAS-splade-mxbai

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: LAS-splade-mxbai
  • Participant: ncsu-las
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

LAS-splade-mxbai-mmr8-RAG

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: LAS-splade-mxbai-mmr8-RAG
  • Participant: ncsu-las
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-gen

LAS-splade-mxbai-rrf

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: LAS-splade-mxbai-rrf
  • Participant: ncsu-las
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

LAS-splade-mxbai-rrf-mmr8

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: LAS-splade-mxbai-rrf-mmr8
  • Participant: ncsu-las
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-gen

LAS-splade-mxbai-rrf-mmr8-doc

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: LAS-splade-mxbai-rrf-mmr8-doc
  • Participant: ncsu-las
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

LAS-T5-mxbai-mmr8-RAG

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: LAS-T5-mxbai-mmr8-RAG
  • Participant: ncsu-las
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-gen

LAS_ann_t5_qdrant

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: LAS_ann_t5_qdrant
  • Participant: ncsu-las
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-retrieval

LAS_enn_t5

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: LAS_enn_t5
  • Participant: ncsu-las
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-retrieval

LAS_ENN_T5_RERANKED_MXBAI

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: LAS_ENN_T5_RERANKED_MXBAI
  • Participant: ncsu-las
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

LAS_splad_mxbai-rrf-occams_50_RAG

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: LAS_splad_mxbai-rrf-occams_50_RAG
  • Participant: ncsu-las
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

ldilab_gpt_4o

Results | Participants | Input | Summary | Appendix

  • Run ID: ldilab_gpt_4o
  • Participant: ldisnu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-auggen

ldilab_repllama_listt5_pass1

Results | Participants | Input | Summary | Appendix

  • Run ID: ldilab_repllama_listt5_pass1
  • Participant: ldisnu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

ldilab_repllama_listt5_pass2

Results | Participants | Input | Summary | Appendix

  • Run ID: ldilab_repllama_listt5_pass2
  • Participant: ldisnu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

ldilab_repllama_listt5_pass3

Results | Participants | Input | Summary | Appendix

  • Run ID: ldilab_repllama_listt5_pass3
  • Participant: ldisnu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

ldilab_repllama_listt5_pass4

Results | Participants | Input | Summary | Appendix

  • Run ID: ldilab_repllama_listt5_pass4
  • Participant: ldisnu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

listgalore_gpt4o_ragnarokv4_top20

Results | Participants | Input | Summary | Appendix

  • Run ID: listgalore_gpt4o_ragnarokv4_top20
  • Participant: h2oloo
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-28
  • Task: trec2024-rag-gen

listgalore_gpt4o_ragnarokv4nocite_top20

Results | Participants | Input | Summary | Appendix

  • Run ID: listgalore_gpt4o_ragnarokv4nocite_top20
  • Participant: h2oloo
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-28
  • Task: trec2024-rag-gen

listgalore_l31-70b_ragnarokv4_top20

Results | Participants | Input | Summary | Appendix

  • Run ID: listgalore_l31-70b_ragnarokv4_top20
  • Participant: h2oloo
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-28
  • Task: trec2024-rag-gen

listgalore_l31-70b_ragnarokv4nocite_top20

Results | Participants | Input | Summary | Appendix

  • Run ID: listgalore_l31-70b_ragnarokv4nocite_top20
  • Participant: h2oloo
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-28
  • Task: trec2024-rag-gen

monster

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: monster
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

neu

Results | Participants | Input | Summary | Appendix

  • Run ID: neu
  • Participant: neu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-22
  • Task: trec2024-rag-retrieval

neurag

Results | Participants | Input | Summary | Appendix

  • Run ID: neurag
  • Participant: neu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-22
  • Task: trec2024-rag-gen

neuragfix

Results | Participants | Input | Summary | Appendix

  • Run ID: neuragfix
  • Participant: neu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-22
  • Task: trec2024-rag-gen

neurerank

Results | Participants | Input | Summary | Appendix

  • Run ID: neurerank
  • Participant: neu
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-22
  • Task: trec2024-rag-retrieval

oneshot_post_sentenced

Results | Participants | Input | Summary | Appendix

  • Run ID: oneshot_post_sentenced
  • Participant: buw
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

PG-mistral

Results | Participants | Input | Summary | Appendix

  • Run ID: PG-mistral
  • Participant: uog-tht
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

qdrant_bge_small

Results | Participants | Input | Summary | Appendix

  • Run ID: qdrant_bge_small
  • Participant: SGU
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-retrieval

qrant_bge_gemini

Results | Participants | Input | Summary | Appendix

  • Run ID: qrant_bge_gemini
  • Participant: SGU
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

rag_bm25-colbert_faiss-gpt4o-llama70b

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: rag_bm25-colbert_faiss-gpt4o-llama70b
  • Participant: softbank-meisei
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-gen

ragtask-bm25-rank_zephyr-gpt4o-llama70b

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: ragtask-bm25-rank_zephyr-gpt4o-llama70b
  • Participant: softbank-meisei
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-gen

Ranked_Iterative_Fact_Extraction_and_Refinement

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: Ranked_Iterative_Fact_Extraction_and_Refinement
  • Participant: TREMA-UNH
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

Ranked_Iterative_Fact_Extraction_and_Refinement_RIFER_-_bm25

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: Ranked_Iterative_Fact_Extraction_and_Refinement_RIFER_-_bm25
  • Participant: TREMA-UNH
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

rtask-bm25-colbert_faiss

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: rtask-bm25-colbert_faiss
  • Participant: softbank-meisei
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

rtask-bm25-rank_zephyr

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: rtask-bm25-rank_zephyr
  • Participant: softbank-meisei
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

ruc001

Results | Participants | Input | Summary | Appendix

  • Run ID: ruc001
  • Participant: Ruc01
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

SECOND_cot_gpt3.5

Results | Participants | Input | Summary | Appendix

  • Run ID: SECOND_cot_gpt3.5
  • Participant: citi
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-gen

SECOND_gpt3.5

Results | Participants | Input | Summary | Appendix

  • Run ID: SECOND_gpt3.5
  • Participant: citi
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-gen

SECOND_gpt3.5_new_prompt

Results | Participants | Input | Summary | Appendix

  • Run ID: SECOND_gpt3.5_new_prompt
  • Participant: citi
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-gen

sim_and_rerank_200_docs

Results | Participants | Input | Summary | Appendix

  • Run ID: sim_and_rerank_200_docs
  • Participant: KML
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-24
  • Task: trec2024-rag-retrieval

sim_and_rerank_v1

Results | Participants | Input | Summary | Appendix

  • Run ID: sim_and_rerank_v1
  • Participant: KML
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

SPLADE+BGEv2m3

Results | Participants | Input | Summary | Appendix

  • Run ID: SPLADE+BGEv2m3
  • Participant: TLSE3
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-retrieval

SPLADE+Gemini

Results | Participants | Input | Summary | Appendix

  • Run ID: SPLADE+Gemini
  • Participant: TLSE3
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-retrieval

SPLADE+Jina

Results | Participants | Input | Summary | Appendix

  • Run ID: SPLADE+Jina
  • Participant: TLSE3
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-retrieval

SpladeV3_only

Results | Participants | Input | Summary | Appendix

  • Run ID: SpladeV3_only
  • Participant: TLSE3
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-retrieval

test.rag24.no.rrf.no.expansion

Results | Participants | Input | Summary | Appendix

  • Run ID: test.rag24.no.rrf.no.expansion
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

test.rag24.rrf.expanded.BM25.MiniLM

Results | Participants | Input | Summary | Appendix

  • Run ID: test.rag24.rrf.expanded.BM25.MiniLM
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

test.rag24.rrf.raw.query.MiniLM+BM25

Results | Participants | Input | Summary | Appendix

  • Run ID: test.rag24.rrf.raw.query.MiniLM+BM25
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

UDInfolab.AG-v1

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.AG-v1
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-27
  • Task: trec2024-rag-auggen

UDInfolab.AG-v2

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.AG-v2
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-27
  • Task: trec2024-rag-auggen

UDInfolab.bge

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.bge
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-retrieval

UDInfolab.bge.AnsAi

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.bge.AnsAi
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

UDInfolab.bge.query

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.bge.query
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

UDInfolab.bge.ranker

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.bge.ranker
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

UDInfolab.bgeV2

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.bgeV2
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

UDInfolab.bm25

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.bm25
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

UDInfolab.bm25.ro

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.bm25.ro
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

UDInfolab.bm25.ro.tuned

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.bm25.ro.tuned
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

UDInfolab.RAG.AnsAI

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.RAG.AnsAI
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

UDInfolab.RAG.bge.QueryAgm.tuned

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.RAG.bge.QueryAgm.tuned
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-27
  • Task: trec2024-rag-gen

UDInfolab.RAG.bge.QueryAnsAI.tuned

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.RAG.bge.QueryAnsAI.tuned
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-27
  • Task: trec2024-rag-gen

UDInfolab.RAG.bge.tuned

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.RAG.bge.tuned
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-27
  • Task: trec2024-rag-gen

UDInfolab.RAG.Query

Results | Participants | Input | Summary | Appendix

  • Run ID: UDInfolab.RAG.Query
  • Participant: InfoLab
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

uwc0

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uwc0
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

uwc1

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uwc1
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

uwc2

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uwc2
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

uwcBA

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uwcBA
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

uwcBQ

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uwcBQ
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

uwcCQ

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uwcCQ
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

uwcCQA

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uwcCQA
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

uwcCQAR

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uwcCQAR
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

uwcCQR

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: uwcCQR
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-23
  • Task: trec2024-rag-retrieval

UWCgarag

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: UWCgarag
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-22
  • Task: trec2024-rag-gen

UWCrag

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: UWCrag
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-22
  • Task: trec2024-rag-gen

UWCrag_stepbystep

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: UWCrag_stepbystep
  • Participant: WaterlooClarke
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-22
  • Task: trec2024-rag-gen

weaviate_dense_base

Results | Participants | Input | Summary | Appendix

  • Run ID: weaviate_dense_base
  • Participant: buw
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-retrieval

webis-01

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-01
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

webis-02

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-02
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

webis-03

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-03
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

webis-04

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-04
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

webis-05

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-05
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-retrieval

webis-ag-run0-taskrag

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-ag-run0-taskrag
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

webis-ag-run1-taskrag

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-ag-run1-taskrag
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

webis-ag-run2-reuserag

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-ag-run2-reuserag
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

webis-ag-run3-reuserag

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-ag-run3-reuserag
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-auggen

webis-manual

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-manual
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

webis-rag-run0-taskrag

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-rag-run0-taskrag
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

webis-rag-run1-taskrag

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-rag-run1-taskrag
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

webis-rag-run3-taskrag

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-rag-run3-taskrag
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

webis-rag-run4-reuserag

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-rag-run4-reuserag
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

webis-rag-run5-reuserag

Results | Participants | Proceedings | Input | Summary | Appendix

  • Run ID: webis-rag-run5-reuserag
  • Participant: webis
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

zeph_test_rag24_doc_query_expansion+rrf

Results | Participants | Input | Summary | Appendix

  • Run ID: zeph_test_rag24_doc_query_expansion+rrf
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

zeph_test_rag24_doc_query_expansion+rrf_Rtask

Results | Participants | Input | Summary | Appendix

  • Run ID: zeph_test_rag24_doc_query_expansion+rrf_Rtask
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-retrieval

zeph_test_rag_rrf_expand_mistral_top_15

Results | Participants | Input | Summary | Appendix

  • Run ID: zeph_test_rag_rrf_expand_mistral_top_15
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

zeph_test_rag_rrf_expand_query

Results | Participants | Input | Summary | Appendix

  • Run ID: zeph_test_rag_rrf_expand_query
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

zeph_test_rag_rrf_expand_query_mistral

Results | Participants | Input | Summary | Appendix

  • Run ID: zeph_test_rag_rrf_expand_query_mistral
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

zeph_test_rag_rrf_expand_Rtask

Results | Participants | Input | Summary | Appendix

  • Run ID: zeph_test_rag_rrf_expand_Rtask
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-retrieval

zeph_test_rag_rrf_expand_top_10

Results | Participants | Input | Summary | Appendix

  • Run ID: zeph_test_rag_rrf_expand_top_10
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

zeph_test_rag_rrf_expand_top_5

Results | Participants | Input | Summary | Appendix

  • Run ID: zeph_test_rag_rrf_expand_top_5
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-26
  • Task: trec2024-rag-gen

zeph_test_rag_rrf_raw_query

Results | Participants | Input | Summary | Appendix

  • Run ID: zeph_test_rag_rrf_raw_query
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-gen

zeph_test_rag_rrf_raw_query_Rtrack

Results | Participants | Input | Summary | Appendix

  • Run ID: zeph_test_rag_rrf_raw_query_Rtrack
  • Participant: IITD-IRL
  • Track: Retrieval-Augmented Generation
  • Year: 2024
  • Submission: 2024-08-25
  • Task: trec2024-rag-retrieval