Page tree

Versions Compared


  • This line was added.
  • This line was removed.
  • Formatting was changed.


Status of the production sites


  • We finalized the compression of the archive. The size is now 477 TB, before we started the compression process, the size was 793 TB (2017-09-17)
  • We upgraded our test environment to NAS 5.4.
  • We are just now upgrading the Blacklight search frontend to the newest version, hwich is supporting the new SOLR index.
  • We just started a campaign for the collection of Danish podcasts and ditto Youtubers. The big challenge is to identify them. We sent an email to all our colleagues in our institution and asked them to help us. Does any of you have experiences with identifying podcasts and Youtubers?
  • The collective negotiations on pay for public employees did come to a result. Our event crawl will finish, when all union members have given their votes for the agreement
  • The new functional lead for Netarchive will start at KB in Copenhagen on 18 May – he will join us at forthcoming meetings


At the beginning of May we had a meeting to prepare the programme of the 2018 broad crawl. We decided to put NetarchiveSuite 5.4 into production without any additional development except the management of TLDs. We'll contact the same registrars as last year to collect a similar number of seeds, but we'll try to be more attentive to the scope of the harvest: we met some problems with new TLDs like .museum which contained a lot of foreign web sites. We'll also review all our storage space and its managment. The launch of the broad crawl is scheduled for October.

In parallel, we have made an evolution to the system to check the validity of URLs in BCWeb, so that the version 5.3 can recognize all types of HTTPS. We are aiming to use this release before the summer.