Skip to content

Runs - Interactive Knowledge Assistance Track (IKAT) 2025

agg_false-qrec-mse-sum-top10

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: agg_false-qrec-mse-sum-top10
  • Participant: guidance
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-auto
  • MD5: 65d0586c6ae14d4c411f07568ce619ba

agg_true-qrec-mse-sum-top10

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: agg_true-qrec-mse-sum-top10
  • Participant: guidance
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-auto
  • MD5: 533fec4381f1d36ec37408f024dd47a4

cfda-adarewriter-chiq-llm4cs-splade

Participants | Proceedings | Input | human_eval | retrieval_eval | Appendix

  • Run ID: cfda-adarewriter-chiq-llm4cs-splade
  • Participant: cfda
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: a344ef36b979111671b762c5519d4c38
  • Run description: Rewrites queries with AdaRewriter (CHIQ-AD + LLM4CS), retrieves passages via SPLADE, reranks top-2000 with DeBERTaV3 cross-encoder, then generates answers with GPT4o.

cfda-auto-1

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: cfda-auto-1
  • Participant: cfda
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-auto
  • MD5: 7fe3d2fa637d454af7566630b7feb0e3

cfda-auto-2

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: cfda-auto-2
  • Participant: cfda
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-auto
  • MD5: ffdcb34baf63d55fb2fff47a28276d7e

cfda-auto-3

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: cfda-auto-3
  • Participant: cfda
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-auto
  • MD5: 2caf0f92e09a3e43c5c63a515c6be9eb

cfda-auto-4

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: cfda-auto-4
  • Participant: cfda
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-auto
  • MD5: 5ccb4987a5b134e020b133c878fa1347

cfda-chiq-llm4cs-splade-rrf

Participants | Proceedings | Input | human_eval | retrieval_eval | Appendix

  • Run ID: cfda-chiq-llm4cs-splade-rrf
  • Participant: cfda
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: 376857d360e374f541a9702c6f2b5e38
  • Run description: Generates 2 rewrites each with CHIQ-AD and LLM4CS, retrieves passages with SPLADE, fuses results using RRF, then generates response with GPT-4o.

cfda-gen-only-1

Participants | Proceedings | Input | Appendix

  • Run ID: cfda-gen-only-1
  • Participant: cfda
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-gen
  • MD5: c4f6a5c9613a04001eb412d00b95f901

cfda-gen-only-2

Participants | Proceedings | Input | Appendix

  • Run ID: cfda-gen-only-2
  • Participant: cfda
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-gen
  • MD5: fdd927ee0c7d90f4fe422de1cd93334c

cosine-orconvqa-sum-top10

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: cosine-orconvqa-sum-top10
  • Participant: guidance
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-auto
  • MD5: 93106890394fc889cb71bd53f914d4db

disco-qrecc-norerank

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: disco-qrecc-norerank
  • Participant: uva
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-auto
  • MD5: cbc46a1a80257144efd95ece9176ee33

genaius-full-rewrite

Participants | Proceedings | Input | human_eval | retrieval_eval | Appendix

  • Run ID: genaius-full-rewrite
  • Participant: GenAIus
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: bd2366d1f6bfab2cf789308dbc385761
  • Run description: FullHistory-RewriteUtterance-BM25-GPT4o

genaius-genonly-full-gpt4o

Participants | Proceedings | Input | Appendix

  • Run ID: genaius-genonly-full-gpt4o
  • Participant: GenAIus
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-08-11
  • Task: trec2025-ikat-gen
  • MD5: 27294f6261fee4ee16986a1c30a669b0

genaius-genonly-summary-gpt4o

Participants | Proceedings | Input | Appendix

  • Run ID: genaius-genonly-summary-gpt4o
  • Participant: GenAIus
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-08-11
  • Task: trec2025-ikat-gen
  • MD5: 7792a03d36590932af832ee1bf4f903e

genaius-summary-rewrite

Participants | Proceedings | Input | human_eval | retrieval_eval | Appendix

  • Run ID: genaius-summary-rewrite
  • Participant: GenAIus
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: e64873d37e471ac648d7e83bb6c9ed70
  • Run description: SummaryHistory-RewriteUtterance-BM25-GPT4o

genonly-noptkb

Participants | Proceedings | Input | Appendix

  • Run ID: genonly-noptkb
  • Participant: uva
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-gen
  • MD5: 161835351a7bd49352d9d85f9d4d2a21

genonly-ptkb

Participants | Proceedings | Input | Appendix

  • Run ID: genonly-ptkb
  • Participant: uva
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-gen
  • MD5: aa586ada4afe5017a0a6e8ed5383a9d2

gpt-clarif-sum-top10

Participants | Proceedings | Input | Appendix

  • Run ID: gpt-clarif-sum-top10
  • Participant: guidance
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-08-20
  • Task: trec2025-ikat-gen
  • MD5: eef57a0f14dea073515944dbee82866a

grilllab-agentic-gpt4.1

Participants | Proceedings | Input | human_eval | retrieval_eval | Appendix

  • Run ID: grilllab-agentic-gpt4.1
  • Participant: grilllab
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: 1e094a6d0d08e0f37925399154a2d510
  • Run description: Agentic pipeline where an LLM decides an action to take based on the conversation context, manual orchestration is minimal. Agent has access to search engine as a tool.

grilllab-agentic-gpt4.1-larf

Participants | Proceedings | Input | human_eval | retrieval_eval | Appendix

  • Run ID: grilllab-agentic-gpt4.1-larf
  • Participant: grilllab
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: a5f541b4682f5e26fdb4859afb2a752b
  • Run description: Agentic pipeline where an LLM decides an action to take based on the conversation context, manual orchestration is minimal. Agent has access to a LARF based search engine as a tool.

grilllab-agentic-gpt4.1-larf-v2

Participants | Proceedings | Input | human_eval | retrieval_eval | Appendix

  • Run ID: grilllab-agentic-gpt4.1-larf-v2
  • Participant: grilllab
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: cfc76ab528016f3302a06db8da16f8fc
  • Run description: Agentic pipeline where an LLM decides an action to take based on the conversation context, manual orchestration is minimal. Agent has access to a LARF based search engine as a tool.

grilllab-larf-fine-tuned-judge

Participants | Proceedings | Input | human_eval | retrieval_eval | Appendix

  • Run ID: grilllab-larf-fine-tuned-judge
  • Participant: grilllab
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: cb856e45a5dcf0e3e1bc01550edf42eb
  • Run description: Three stage pipeline where we retrieve a candidate pool, expand the candidate pool with doc2query techniques, and refine the pool with an LLM. Each stage has a sub-step where we assess the candidate pool with respect to the query and filter out passages that are not relevant, followed by a reranking step.

grilllab-larf-finetuned

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: grilllab-larf-finetuned
  • Participant: grilllab
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-26
  • Task: trec2025-ikat-auto
  • MD5: fab1d2541e65507f297c4e34d16f0799

grilllab-larf-finetuned-10-rounds

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: grilllab-larf-finetuned-10-rounds
  • Participant: grilllab
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: 5db3ab94ffcb25fafe8a71c7022dbd61

grilllab-larf-finetuned-22-rounds

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: grilllab-larf-finetuned-22-rounds
  • Participant: grilllab
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-08-01
  • Task: trec2025-ikat-auto
  • MD5: 8774724a2dd8b0e6a249fd3d9b985eb4

grilllab-larf-finetuned-rankllm

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: grilllab-larf-finetuned-rankllm
  • Participant: grilllab
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: 4c76d63d95ef4063806d9a7acbe126bf

mq4cs-gpt41-bm25

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: mq4cs-gpt41-bm25
  • Participant: uva
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-auto
  • MD5: 3c705c684207c567b853e7433740e871

mq4cs-gpt41-splade

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: mq4cs-gpt41-splade
  • Participant: uva
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-auto
  • MD5: e593c3dc9f7123d02a30e54ad1d7ec28

mq4cs-llamaft-splade

Participants | Proceedings | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: mq4cs-llamaft-splade
  • Participant: uva
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-27
  • Task: trec2025-ikat-auto
  • MD5: 366953dffb654345f6c9b464322f600e

orga-gpt41mini-bm25-minilm-llama70b

Participants | Input | human_eval | retrieval_eval | Appendix

  • Run ID: orga-gpt41mini-bm25-minilm-llama70b
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: c9be418667ac8f32f966a3bedb6333be
  • Run description: The approach uses a RAG pipeline with Llama 70B as generation backbone, with gpt-4.1-mini for the rewrite, followed by bm25 and miniLM.

orga-gpt41mini-bm25-minilm-llama70b-nopersonal

Participants | Input | human_eval | retrieval_eval | Appendix

  • Run ID: orga-gpt41mini-bm25-minilm-llama70b-nopersonal
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: 520c4b24fe349d7b31b305a5413d44e5
  • Run description: This approach is not usign the PTKB. The approach uses a RAG pipeline with Llama 70B as generation backbone, with gpt-4.1-mini for the rewrite, followed by bm25 and miniLM.

orga-llama70b-bm25-minilm-llama70b

Participants | Input | human_eval | retrieval_eval | Appendix

  • Run ID: orga-llama70b-bm25-minilm-llama70b
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: e605353a848481ab72ed33abc82da26e
  • Run description: The approach uses a RAG pipeline with llama3.3 70B as generation backbone, with Llama 70B for the rewrite, followed by bm25 and miniLM.

orga-llama8b-bm25-minilm-llama8b-v2

Participants | Input | human_eval | retrieval_eval | Appendix

  • Run ID: orga-llama8b-bm25-minilm-llama8b-v2
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: 8e5511a8f5e1ed448ed7bc0f257207e7
  • Run description: The approach uses a RAG pipeline with llama3 8B as generation backbone, with Llama 8B for the rewrite, followed by bm25 and miniLM.

orga-no-no-no-gpt41mini

Participants | Input | human_eval | retrieval_eval | Appendix

  • Run ID: orga-no-no-no-gpt41mini
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: 6bf7cb77ac157606510dc73f2469ca3f
  • Run description: The approach uses gpt-4.1-mini as generation backbone, without retrieval or rewriting.

orga-no-no-no-llama70b

Participants | Input | human_eval | retrieval_eval | Appendix

  • Run ID: orga-no-no-no-llama70b
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: ab9b58b7d22f83cef0195c6992a8f4b5
  • Run description: The approach uses Llama 3.3 70B as generation backbone, without retrieval or rewriting.

orga-no-no-no-llama8b-v2

Participants | Input | human_eval | retrieval_eval | Appendix

  • Run ID: orga-no-no-no-llama8b-v2
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: 1d83bd02189404bb267c2ec1dd8b9d12
  • Run description: The approach uses Llama3 8B as generation backbone, without retrieval or rewriting.

organizers-baseline-gpt41mini-bm25-minilm-llama70b-gpt41mini

Participants | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: organizers-baseline-gpt41mini-bm25-minilm-llama70b-gpt41mini
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: 133734880aaf4ca42ca607e44df14d08

organizers-baseline-gpt41mini-bm25-minilm-llama70b-gpt41mini_nopersonal

Participants | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: organizers-baseline-gpt41mini-bm25-minilm-llama70b-gpt41mini_nopersonal
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: 92bd6916339c7ac19e2b45784bed8d71

organizers-baseline-gpto4mini-ance-norerank-llama70b-gpt41mini

Participants | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: organizers-baseline-gpto4mini-ance-norerank-llama70b-gpt41mini
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: ad05d65a3d825e7dd6aa5860cdfb2ae9

organizers-baseline-gpto4mini-splade-norerank-llama70b-gpt41mini

Participants | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: organizers-baseline-gpto4mini-splade-norerank-llama70b-gpt41mini
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: 96f15ee4d06f9c254a09a1d9b35a7d9b

organizers-baseline-llama70B-ance-minilm-llama70b-gpt41mini

Participants | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: organizers-baseline-llama70B-ance-minilm-llama70b-gpt41mini
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: fde833b38786a94a35f5938991665a7e

organizers-baseline-llama70B-splade-minilm-llama70b-gpt41mini

Participants | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: organizers-baseline-llama70B-splade-minilm-llama70b-gpt41mini
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: daeb061a471d9ddf00d0645377300660

organizers-baseline-manual-bm25-minilm-llama70b-gpt41mini

Participants | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: organizers-baseline-manual-bm25-minilm-llama70b-gpt41mini
  • Participant: coordinators
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: d8eb3b664ff531dbc095050f397ab509

ucsc-base-dynamicPTKB-trainedReranker

Participants | Input | human_eval | retrieval_eval | Appendix

  • Run ID: ucsc-base-dynamicPTKB-trainedReranker
  • Participant: ucsc
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: 41a772d9a3e896365521aeb3c91c0858
  • Run description: This approach utilizes LLMs to extract additional relevant PTKB statements from the conversation. Query generation is done using the base query, and the reranking is based on a model trained on previous TREC data.

UCSC-base-ensemble

Participants | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: UCSC-base-ensemble
  • Participant: ucsc
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: b5eb15ab46c76c28ad99db1b4e9cd733

UCSC-base-trained-MiniLM

Participants | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: UCSC-base-trained-MiniLM
  • Participant: ucsc
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: b6f42532fb382792b642908e255b636a

ucsc-SIMRAG-guidelineQuery-dynamicPTKB-trainedReranker

Participants | Input | human_eval | retrieval_eval | Appendix

  • Run ID: ucsc-SIMRAG-guidelineQuery-dynamicPTKB-trainedReranker
  • Participant: ucsc
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: fec055c382ce56b5adba6ca240e5b53a
  • Run description: This approach utilizes LLMs to extract additional relevant PTKB statements from the conversation. It then utilizes a trained SIMRAG model to obtain a good guideline-generated retrieval query, along with a good reranking query. The reranking is based on a model trained on previous TREC data.

UCSC-SIMRAG-keyword-ensemble

Participants | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: UCSC-SIMRAG-keyword-ensemble
  • Participant: ucsc
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: 15e5e21e25d043f3998ab76c13a3cccc

UCSC-SIMRAG-keyword-trained-MiniLM

Participants | Input | ptkb_trec_eval | docs_trec_eval | Appendix

  • Run ID: UCSC-SIMRAG-keyword-trained-MiniLM
  • Participant: ucsc
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-28
  • Task: trec2025-ikat-auto
  • MD5: aed20ff2358d5ce9a9bdc9fd26f45c22

ucsc-SIMRAG-keywordQuery-dynamicPTKB-ensembleReranker

Participants | Input | human_eval | retrieval_eval | Appendix

  • Run ID: ucsc-SIMRAG-keywordQuery-dynamicPTKB-ensembleReranker
  • Participant: ucsc
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: d8602007b2b8a199e998013a1eb1c964
  • Run description: This approach utilizes LLMs to extract additional relevant PTKB statements from the conversation. It then utilizes a trained SIMRAG model to obtain a good keyword retrieval query, along with a good reranking query. The reranking is based on an ensemble of five rerankers, reranking the top 100.

ucsc-SIMRAG-keywordQuery-dynamicPTKB-trainedReranker

Participants | Input | human_eval | retrieval_eval | Appendix

  • Run ID: ucsc-SIMRAG-keywordQuery-dynamicPTKB-trainedReranker
  • Participant: ucsc
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: b9da76dd67108ad88399283d2dc3ebba
  • Run description: This approach utilizes LLMs to extract additional relevant PTKB statements from the conversation. It then utilizes a trained SIMRAG model to obtain a good keyword retrieval query, along with a good reranking query. The reranking is based on a model trained on previous TREC data.

usiir_run1

Participants | Proceedings | Input | Appendix

  • Run ID: usiir_run1
  • Participant: usiir
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-29
  • Task: trec2025-ikat-gen
  • MD5: 14806efe08cb50a3f7556173bd3c8788

usiir_run2

Participants | Proceedings | Input | Appendix

  • Run ID: usiir_run2
  • Participant: usiir
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-07-29
  • Task: trec2025-ikat-gen
  • MD5: c4e2722b182487d125f2dd71320fd5f9

uva-gpt5-bm25-debertav3-gpt5

Participants | Proceedings | Input | human_eval | retrieval_eval | Appendix

  • Run ID: uva-gpt5-bm25-debertav3-gpt5
  • Participant: uva
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: 2d6ebf7d0843dd6bc00f5fd35313b337
  • Run description: The approach uses a RAG pipeline with gpt 5 as generation backbone, with gpt 5 for the rewrite, followed by bm25 and debertav3.

uva-gpt5-bm25-debertav3-gpt5mini-nopersonal

Participants | Proceedings | Input | human_eval | retrieval_eval | Appendix

  • Run ID: uva-gpt5-bm25-debertav3-gpt5mini-nopersonal
  • Participant: uva
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: b091860d0983e477ef8735bac48783df
  • Run description: The approach uses a RAG pipeline with gpt 5 mini as generation backbone, with gpt 5 mini for the rewrite, followed by bm25 and debertav3. This one doesn't use ptkb.

uva-gpt5mini-bm25-debertav3-gpt5mini

Participants | Proceedings | Input | human_eval | retrieval_eval | Appendix

  • Run ID: uva-gpt5mini-bm25-debertav3-gpt5mini
  • Participant: uva
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: 8aede87a1ab6fd6607a4670c722d9519
  • Run description: The approach uses a RAG pipeline with gpt 5 mini as generation backbone, with gpt 5 mini for the rewrite, followed by bm25 and debertav3.

uva-gpt5mini-no-no-gpt5mini

Participants | Proceedings | Input | human_eval | retrieval_eval | Appendix

  • Run ID: uva-gpt5mini-no-no-gpt5mini
  • Participant: uva
  • Track: Interactive Knowledge Assistance Track (IKAT)
  • Year: 2025
  • Submission: 2025-12-01
  • Type: interactive
  • Task: trec2025-ikat-sim
  • MD5: ce7373e3891db400af40070fac0a4ef0
  • Run description: The approach uses a closed-book pipeline with gpt 5 mini as generation backbone.