Page History

We launched our second domain crawl for 2017; we still have problems with scheduling jobs. Jobs are hanging in the SUBMITTED queue, jobs are failing and zombie jobs are created outside the Gui. Before restarting, we have to empty the queue manually.

We have NFS performance problems with wayback.

We are migrating our documentation from 2005 – 2014 from a MoinMoin wiki to jira. There is a lot of important documentation for the selective crawls. This project takes time – we have to migrate the content manually.

Our developers want to implement shine in our freetext interface. In the next couple of weeks, the curators (hopefully) will have the possibility for testing shine – before the implementation!

We have started the preparation of our 2017 broad crawl. As we have a lot of work to do on our infrastructure (new server, new OS, new storage), we finally decided to not open any development work for the preparation of this crawl.

We are also working on full text indexing and search: our target collection is 12TB. We are currently redefining the structure of our Search application to enable user profiles and internationalization.