1. Home
  2. Datasets
  3. The ClueWeb09 Dataset

The ClueWeb09 Dataset

The ClueWeb09 dataset was created to support research on information retrieval and related human language technologies. It consists of about 1 billion web pages in ten languages that were collected in January and February 2009. The dataset is used by several tracks of the TREC conference. 

1,040,809,705 web pages, in 10 languages
5 TB, compressed. (25 TB, uncompressed.)

Data and Resources

Additional Info

Field Value
Source http://www.lemurproject.org/clueweb09/
Author The Lemur Project
Version 2009
Last Updated June 14, 2011, 17:26 (UTC)
Created June 14, 2011, 15:57 (UTC)