public abstract class HeritrixLauncherAbstract extends Object
Modifier and Type | Field and Description |
---|---|
protected static int |
CRAWL_CONTROL_WAIT_PERIOD
The period to wait in seconds before checking if Heritrix3 has done anything.
|
Modifier | Constructor and Description |
---|---|
protected |
HeritrixLauncherAbstract(Heritrix3Files files)
Private HeritrixLauncher constructor.
|
|
HeritrixLauncherAbstract(Object... args)
Generic constructor to allow HeritrixLauncher to use any implementation of HeritrixController.
|
Modifier and Type | Method and Description |
---|---|
abstract void |
doCrawl()
Launches the crawl and monitors its progress.
|
protected Object[] |
getControllerArguments() |
protected Heritrix3Files |
getHeritrixFiles() |
static void |
makeTemplateReadyForHeritrix3(Heritrix3Files files)
This method prepares the crawler-beans.cxml file used by the Heritrix3 crawler.
|
void |
setupOrderfile(Heritrix3Files files) |
protected static final int CRAWL_CONTROL_WAIT_PERIOD
protected HeritrixLauncherAbstract(Heritrix3Files files) throws ArgumentNotValid
files
- Object encapsulating location of Heritrix3 crawldir and configuration files.ArgumentNotValid
- If either seedsfile or orderfile does not exist.public HeritrixLauncherAbstract(Object... args)
args
- the arguments to be passed to the constructor or non-static factory method of the HeritrixController
class specified in settingspublic abstract void doCrawl() throws IOFailure
IOFailure
protected Heritrix3Files getHeritrixFiles()
protected Object[] getControllerArguments()
public void setupOrderfile(Heritrix3Files files)
public static void makeTemplateReadyForHeritrix3(Heritrix3Files files) throws IOFailure
3. if deduplication is enabled in the order.xml, it writes the absolute path of the lucene index used by the deduplication processor.
IOFailure
- - When the orderfile could not be saved to diskIllegalState
- - When the orderfile is not a H3 templateCopyright © 2005–2015 The Royal Danish Library, the Danish State and University Library, the National Library of France and the Austrian National Library.. All rights reserved.