dk.netarkivet.wayback.indexer
Class FileNameHarvester

java.lang.Object
  dk.netarkivet.wayback.indexer.FileNameHarvester

public class FileNameHarvester
extends java.lang.Object

Constructor Summary

FileNameHarvester()

Method Summary

static void

harvest() This method harvests a list of all the files currently in the arcrepository and appends any new ones found to the ArchiveFile object store.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FileNameHarvester

public FileNameHarvester()

Method Detail

harvest

public static void harvest()

This method harvests a list of all the files currently in the arcrepository and appends any new ones found to the ArchiveFile object store. TODO there is a possible scaling issue because we get a list of every file in the archive every time. We could profitably use a more varied strategy where we retrieve all recent files several times a day but run a "catch-all" job once in while to read every filename in case we missed some due to machine outages.