Data - Real-time Summarization 2016¶
trec.nist.gov: https://trec.nist.gov/data/rts2016.html
- Qrels:
Relevance judgments from NIST assessors for evaluation set (used by batch evaluation)|Scenario A mobile assessor judgments
Other: Clusters of equivalent relevant tweets as created by assessors (format is topic-id cluster-id tweet-id) | Clusters of equivalent relevant tweets in JSON format | Gloss of cluster intent (format is topic-id cluster-id gloss) | Epoch time file | Evaluation script for Scenario A runs using mobile assessors | Evaluation script for Scenario A batch evaluation | Evaluation script for Scenario B batch evaluation