Page tree

Versions Compared


  • This line was added.
  • This line was removed.
  • Formatting was changed.


We finished our 2013 broad crawl at the beginning of January, with a total of 1,628 jobs in NetarchiveSuite. We obtained a volume of 56.2 TB which is 70% more than last year because we did not have elections in 2013 and so we were able to allocate some of the budget for focused crawls to the broad crawl. We obtained 1.7 billion harvested URLs. We had some difficulties with the technical infrastructure, however we maintained a good harvesting speed with 8 URLs per second.


  • Working on extended Fields.
  • Domaincrawl was finished end of November. Now working on CDX-Index and Reports
  • Running Collection on Media & Politics Sites

Next meeting


Any other business?