|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
ComponentLifeCycle
.
AggregationWorker
singleton contains the schedule and file
bookkeeping functionality needed in the aggregation of indexes.AggregationWorker
inside
Jetty.Constants.ARCDIRECTORY_NAME
.
ArcRepositoryClient.store(File)
.
LegacyHarvestReport
, but is intended to be used with a crawl order
that sets budget using "queue-total-budget" instead of the QuotaEnforcer
(@see HarvesterSettings.USE_QUOTA_ENFORCER
).BnfHeritrixController
.CrawlProgressMessage
instance.
HarvesterSettings.JOB_TIMEOUT_TIME
setting.
ComponentLifeCycle
better control over the component startup
and shutdown phases.FileBatchJob.processOnlyFilesMatching(String)
construct.Settings.SETTINGS_FILE_PROPERTY
is not set.
Document
instance.
HarvestMonitor
.FrontierReportLine
.HarvestMonitor
.HarvestReport
implementation defined by the setting
HarvesterSettings.HARVEST_REPORT_CLASS
.
HeritrixLauncher
implementation defined by the setting
dk.netarkivet.harvester.harvesting.heritrixLauncher.class .
DomainStats
object for that
domain, and if not found creates one with zero values.
CrawlProgressMessage
s.
HarvestReport
interface to be used.
HarvestControllerServer
periodically sends
HarvesterReadyMessage
s to the JobDispatcher
to notify
it whether it is available for processing a job or already processing one.HarvestJobManager
s lifecycle.
HarvestJobManager
application.CrawlProgressMessage
s on the proper JMS channel, and
stores information to be presented in the monitoring console.HarvestReport
.HeritrixLauncher
.BnfHeritrixController
insteadHarvestSchedulerMonitorServer
to the
HarvestMonitor
to notify it that a job ended and should not be
monitored anymore, and that any resource used to monitor this job
should be freed.JobSupervisor.start()
for details.JobIndexCache
-mechanism insteadLinkedHashMap
.HarvestJobManager
.
IndexAggregator
.
ArcFilesReportGenerator.ArcFileStatus
instance.
ScheduledThreadPoolExecutor
, allowing to
periodically run one or several Runnable
tasks
(fixed rate execution).ReplicaCacheDatabase
.DomainnameQueueAssignmentPolicy
where domainname returned is the domainname of the candidateURI
except where the domainname of the SeedURI is a different one.HarvesterReadyMessage
to the JobDispatcher
.
start()
method.
BitSet.size()
this does not return the
size in bytes used to represent this set.
ComponentLifeCycle
object.
StartedJobInfo
record to the persistent storage.
StartedJobInfo
record to the persistent storage.
HarvesterDatabaseTables
to the required
version.
CommonSettings.REMOTE_FILE_CLASS
.
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |