Package | Description |
---|---|
dk.netarkivet.harvester.harvesting |
This module handles defining, scheduling, and execution of harvests.
|
dk.netarkivet.harvester.harvesting.distribute | |
dk.netarkivet.harvester.harvesting.metadata | |
dk.netarkivet.harvester.heritrix3 |
This module handles defining, scheduling, and execution of harvests.
|
dk.netarkivet.harvester.scheduler |
Modifier and Type | Method and Description |
---|---|
HeritrixFiles |
HarvestController.writeHarvestFiles(File crawldir,
Job job,
HarvestDefinitionInfo hdi,
List<MetadataEntry> metadataEntries)
Writes the files involved with a harvests.
|
Modifier and Type | Method and Description |
---|---|
List<MetadataEntry> |
DoOneCrawlMessage.getMetadata() |
Constructor and Description |
---|
DoOneCrawlMessage(Job submittedJob,
ChannelID to,
HarvestDefinitionInfo harvestInfo,
List<MetadataEntry> metadata)
A NetarkivetMessage that contains a Job for Heritrix.
|
Modifier and Type | Method and Description |
---|---|
static MetadataEntry |
MetadataEntry.makeAliasMetadataEntry(List<AliasInfo> aliases,
Long origHarvestDefinitionID,
int harvestNum,
Long jobId)
Generate a MetadataEntry from a list of AliasInfo objects (VERSION 2) Expired aliases is skipped by this method.
|
static MetadataEntry |
MetadataEntry.makeDuplicateReductionMetadataEntry(List<Long> jobIDsForDuplicateReduction,
Long origHarvestDefinitionID,
int harvestNum,
Long jobId)
Generate a MetadataEntry from a list of job ids for duplicate reduction.
|
Modifier and Type | Method and Description |
---|---|
static List<MetadataEntry> |
MetadataEntry.getMetadataFromDisk(File sourceDir)
Retrieve a list of serialized metadata entries on disk.
|
Modifier and Type | Method and Description |
---|---|
static void |
MetadataEntry.storeMetadataToDisk(List<MetadataEntry> metadata,
File destinationDir)
Store a list of metadata entries to disk.
|
Modifier and Type | Method and Description |
---|---|
void |
HarvestJob.init(Job job,
HarvestDefinitionInfo origHarvestInfo,
List<MetadataEntry> metadataEntries)
Initialization of the harvestJob.
|
Heritrix3Files |
HarvestJob.writeHarvestFiles(File crawldir,
Job job,
HarvestDefinitionInfo hdi,
List<MetadataEntry> metadataEntries)
Writes the files needed to start a harvest..
|
Modifier and Type | Method and Description |
---|---|
void |
JobDispatcher.doOneCrawl(Job job,
String origHarvestName,
String origHarvestDesc,
String origHarvestSchedule,
HarvestChannel channel,
String origHarvestAudience,
List<MetadataEntry> metadata)
Submit an doOneCrawl request to a HarvestControllerServer.
|
Copyright © 2005–2016 The Royal Danish Library, the Danish State and University Library, the National Library of France and the Austrian National Library.. All rights reserved.