Package | Description |
---|---|
dk.netarkivet.harvester.distribute | |
dk.netarkivet.harvester.harvesting.distribute | |
dk.netarkivet.harvester.harvesting.monitor | |
dk.netarkivet.harvester.heritrix3 |
This module handles defining, scheduling, and execution of harvests.
|
dk.netarkivet.harvester.indexserver.distribute | |
dk.netarkivet.harvester.scheduler | |
dk.netarkivet.harvester.tools.dummy |
Modifier and Type | Class and Description |
---|---|
class |
HarvesterMessageHandler
This default message handler shields of all unimplemented methods from the HarvesterMessageVisitor interface.
|
Modifier and Type | Method and Description |
---|---|
abstract void |
HarvesterMessage.accept(HarvesterMessageVisitor v)
Should be implemented as a part of the visitor pattern.
|
void |
IndexReadyMessage.accept(HarvesterMessageVisitor v) |
Modifier and Type | Method and Description |
---|---|
void |
JobEndedMessage.accept(HarvesterMessageVisitor v) |
void |
DoOneCrawlMessage.accept(HarvesterMessageVisitor v)
Should be implemented as a part of the visitor pattern.
|
void |
HarvesterRegistrationResponse.accept(HarvesterMessageVisitor v) |
void |
HarvesterReadyMessage.accept(HarvesterMessageVisitor v) |
void |
CrawlStatusMessage.accept(HarvesterMessageVisitor v)
Should be implemented as a part of the visitor pattern.
|
void |
HarvesterRegistrationRequest.accept(HarvesterMessageVisitor v) |
void |
FrontierReportMessage.accept(HarvesterMessageVisitor v) |
void |
CrawlProgressMessage.accept(HarvesterMessageVisitor v) |
Modifier and Type | Class and Description |
---|---|
class |
HarvestMonitor
Listens for
CrawlProgressMessage s on the proper JMS channel, and stores information to be presented in the
monitoring console. |
Modifier and Type | Class and Description |
---|---|
class |
HarvestControllerServer
This class responds to JMS doOneCrawl messages from the HarvestScheduler and launches a Heritrix crawl with the
received job description.
|
Modifier and Type | Class and Description |
---|---|
class |
IndexRequestServer
Index request server singleton.
|
class |
TestIndexRequestServer
Index request server singleton.
|
Modifier and Type | Method and Description |
---|---|
void |
IndexRequestMessage.accept(HarvesterMessageVisitor v)
Calls visit on the visitor.
|
Modifier and Type | Class and Description |
---|---|
class |
HarvesterStatusReceiver
Handles the reception of status messages from the harvesters.
|
class |
HarvestSchedulerMonitorServer
Submitted harvesting jobs are registered by listening for CrawlStatusMessages on the
THE_SCHED queue and processes completed harvests.
|
Modifier and Type | Class and Description |
---|---|
class |
FaultyHarvestControllerServer
This class responds to JMS doOneCrawl messages from the HarvestScheduler and waits 10 minutes before failing the job.
|
Copyright © 2005–2018 The Royal Danish Library, the National Library of France and the Austrian National Library.. All rights reserved.