topics-and-qrels.md

Topics and Qrels

All topics and qrels are stored in src/main/resources/topics-and-qrels/. Here are the original sources:

Disk12

• topics.51-100.txt: Topics 51-100 (TREC-1 Ad Hoc Track)
• topics.101-150.txt: Topics 101-150 (TREC-2 Ad Hoc Track)
• topics.151-200.txt: Topics 151-200 (TREC-3 Ad Hoc Track)
• qrels.51-100.txt: qrels for Topics 51-100 (TREC-1 Ad Hoc Track)
• qrels.101-150.txt: qrels for Topics 101-150 (TREC-2 Ad Hoc Track)
• qrels.151-200.txt: qrels for Topics 151-200 (TREC-3 Ad Hoc Track)

Robust04

• topics.robust04.301-450.601-700.txt: Topics 301-450&601-700 (TREC 2004 Robust Track)
• qrels.robust2004.txt: qrels for Topics 301-450&601-700 (TREC 2004 Robust Track)

Robust05

• topics.robust05.txt: Hard Topics of ROBUST04 (TREC 2005 Robust Track)
• qrels.robust2005.txt: qrels (TREC 2005 Robust Track)

WT2G

• topics.401-450.txt: Topics 401-450 (TREC-8 Ad Hoc Track)
• qrels.401-450.txt: qrels (TREC-8 Ad Hoc Track small web qrels)

WT10G

• topics.451-500.txt: Topics 451-500 (TREC-9 Web Track)
• topics.501-550.txt: Topics 501-550 (TREC 2001 Web Track)
• qrels.451-500.txt: qrels (TREC-9 Web Track)
• qrels.501-550.txt: qrels (TREC 2001 Web Track)

Gov2

• topics.701-750.txt: Topics 701-750 (TREC 2004 Terabyte Track)
• topics.751-800.txt: Topics 751-800 (TREC 2005 Terabyte Track)
• topics.801-850.txt: Topics 801-850 (TREC 2006 Terabyte Track)
• qrels.701-750.txt: qrels for Topics 701-750 (TREC 2004 Terabyte Track)
• qrels.751-800.txt: qrels for Topics 751-800 (TREC 2005 Terabyte Track)
• qrels.801-850.txt: qrels for Topics 801-850 (TREC 2006 Terabyte Track)

ClueWeb09

• topics.web.1-50.txt: Topics 1-50 (TREC 2009 Web Track)
• topics.web.51-100.txt: Topics 51-100 (TREC 2010 Web Track)
• topics.web.101-150.txt: Topics 101-150 (TREC 2011 Web Track)
• topics.web.151-200.txt: Topics 151-200 (TREC 2012 Web Track)
• qrels.web.1-50.txt: adhoc prels for category B runs for Topics 1-50 (TREC 2009 Web Track)
• qrels.web.51-100.txt: adhoc qrels for Topics 51-100 (TREC 2010 Web Track)
• qrels.web.101-150.txt: adhoc qrels for Topics 101-150 (TREC 2011 Web Track)
• qrels.web.151-200.txt: adhoc qrels for Topics 151-200 (TREC 2012 Web Track)

ClueWeb12

• topics.web.201-250.txt: Topics 201-250 (TREC 2013 Web Track)
• topics.web.251-300.txt: Topics 251-300 (TREC 2014 Web Track)
• qrels.web.201-250.txt: one aspect per topic qrels for Topics 201-250 (TREC 2013 Web Track)
• qrels.web.251-300.txt: one aspect per topic qrels for Topics 251-300 (TREC 2014 Web Track)