Loading map...
{"format":"openlayers","minzoom":false,"maxzoom":false,"limit":50,"offset":0,"link":"all","sort":[""],"order":[],"headers":"show","mainlabel":"","intro":"","outro":"","searchlabel":"... further results","default":"","width":"auto","height":"350px","centre":false,"title":"","label":"","icon":"","visitedicon":"","lines":[],"polygons":[],"circles":[],"rectangles":[],"wmsoverlay":false,"copycoords":false,"static":false,"zoom":false,"controls":["layerswitcher","mouseposition","autopanzoom","scaleline","navigation"],"layers":["new OpenLayers.Layer.OSM.Mapnik(\"OSM Mapnik\")","new OpenLayers.Layer.OSM.CycleMap(\"OSM Cycle Map\")"],"resizable":false,"overlays":[],"searchmarkers":"","kml":[],"showtitle":true,"hidenamespace":false,"template":"","userparam":"","activeicon":"","pagelabel":false,"ajaxcoordproperty":"","ajaxquery":"","locations":[{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_1992\" title=\"TREC 1992\"\u003ETREC 1992\u003C/a\u003E\u003C/b\u003E","title":"TREC 1992","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_1993\" title=\"TREC 1993\"\u003ETREC 1993\u003C/a\u003E\u003C/b\u003E","title":"TREC 1993","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_1994\" title=\"TREC 1994\"\u003ETREC 1994\u003C/a\u003E\u003C/b\u003E","title":"TREC 1994","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_1995\" title=\"TREC 1995\"\u003ETREC 1995\u003C/a\u003E\u003C/b\u003E","title":"TREC 1995","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_1996\" title=\"TREC 1996\"\u003ETREC 1996\u003C/a\u003E\u003C/b\u003E","title":"TREC 1996","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_1997\" title=\"TREC 1997\"\u003ETREC 1997\u003C/a\u003E\u003C/b\u003E","title":"TREC 1997","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_1998\" title=\"TREC 1998\"\u003ETREC 1998\u003C/a\u003E\u003C/b\u003E","title":"TREC 1998","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_1999\" title=\"TREC 1999\"\u003ETREC 1999\u003C/a\u003E\u003C/b\u003E","title":"TREC 1999","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2000\" title=\"TREC 2000\"\u003ETREC 2000\u003C/a\u003E\u003C/b\u003E","title":"TREC 2000","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2001\" title=\"TREC 2001\"\u003ETREC 2001\u003C/a\u003E\u003C/b\u003E","title":"TREC 2001","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2002\" title=\"TREC 2002\"\u003ETREC 2002\u003C/a\u003E\u003C/b\u003E","title":"TREC 2002","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2003\" title=\"TREC 2003\"\u003ETREC 2003\u003C/a\u003E\u003C/b\u003E","title":"TREC 2003","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2004\" title=\"TREC 2004\"\u003ETREC 2004\u003C/a\u003E\u003C/b\u003E","title":"TREC 2004","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2005\" title=\"TREC 2005\"\u003ETREC 2005\u003C/a\u003E\u003C/b\u003E","title":"TREC 2005","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2006\" title=\"TREC 2006\"\u003ETREC 2006\u003C/a\u003E\u003C/b\u003E","title":"TREC 2006","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2007\" title=\"TREC 2007\"\u003ETREC 2007\u003C/a\u003E\u003C/b\u003E","title":"TREC 2007","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2008\" title=\"TREC 2008\"\u003ETREC 2008\u003C/a\u003E\u003C/b\u003E","title":"TREC 2008","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2009\" title=\"TREC 2009\"\u003ETREC 2009\u003C/a\u003E\u003C/b\u003E","title":"TREC 2009","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2010\" title=\"TREC 2010\"\u003ETREC 2010\u003C/a\u003E\u003C/b\u003E","title":"TREC 2010","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2011\" title=\"TREC 2011\"\u003ETREC 2011\u003C/a\u003E\u003C/b\u003E","title":"TREC 2011","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2012\" title=\"TREC 2012\"\u003ETREC 2012\u003C/a\u003E\u003C/b\u003E","title":"TREC 2012","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2013\" title=\"TREC 2013\"\u003ETREC 2013\u003C/a\u003E\u003C/b\u003E","title":"TREC 2013","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2014\" title=\"TREC 2014\"\u003ETREC 2014\u003C/a\u003E\u003C/b\u003E","title":"TREC 2014","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2015\" title=\"TREC 2015\"\u003ETREC 2015\u003C/a\u003E\u003C/b\u003E","title":"TREC 2015","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2016\" title=\"TREC 2016\"\u003ETREC 2016\u003C/a\u003E\u003C/b\u003E","title":"TREC 2016","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""},{"text":"\u003Cb\u003E\u003Ca href=\"/wiki/TREC_2020\" title=\"TREC 2020\"\u003ETREC 2020\u003C/a\u003E\u003C/b\u003E","title":"TREC 2020","link":"","lat":39.143441666667,"lon":-77.201369444444,"icon":""}]}
including development of new evaluation techniques more applicable to current systems.
TREC is overseen by a program committee consisting of representatives from government, industry, and academia. For each TREC, NIST provides a test set of documents and questions. Participants run their own retrieval systems on the data, and return to NIST a list of the retrieved top-ranked documents. NIST pools the individual results, judges the retrieved documents for correctness, and evaluates the results. The TREC cycle ends with a workshop that is a forum for participants to share their experiences.
This evaluation effort has grown in both the number of participating systems and the number of tasks each year. Ninety-three groups representing 22 countries participated in TREC 2003. The TREC test collections and evaluation software are available to the retrieval research community at large, so organizations can evaluate their own retrieval systems at any time. TREC has successfully met its dual goals of improving the state-of-the-art in information retrieval and of facilitating technology transfer. Retrieval system effectiveness approximately doubled in the first six years of TREC.
TREC has also sponsored the first large-scale evaluations of the retrieval of non-English (Spanish and Chinese) documents, retrieval of recordings of speech, and retrieval across multiple languages. TREC has also introduced evaluations for open-domain question answering and content-based retrieval of digital video. The TREC test collections are large enough so that they realistically model operational settings. Most of today's commercial search engines include technology first developed in TREC.