|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Job | |
---|---|
dk.netarkivet.harvester.datamodel | |
dk.netarkivet.harvester.harvesting | This module handles defining, scheduling, and execution of harvests. |
dk.netarkivet.harvester.harvesting.distribute | |
dk.netarkivet.harvester.harvesting.metadata | |
dk.netarkivet.harvester.harvesting.report | |
dk.netarkivet.harvester.scheduler | |
dk.netarkivet.harvester.scheduler.jobgen |
Uses of Job in dk.netarkivet.harvester.datamodel |
---|
Methods in dk.netarkivet.harvester.datamodel that return Job | |
---|---|
static Job |
Job.createJob(java.lang.Long harvestID,
HarvestChannel channel,
DomainConfiguration cfg,
int harvestNum)
Create new Job configured according to the properties of the supplied DomainConfiguration. |
static Job |
Job.createSnapShotJob(java.lang.Long harvestID,
HarvestChannel channel,
DomainConfiguration cfg,
long maxObjectsPerDomain,
long maxBytesPerDomain,
long maxJobRunningTime,
int harvestNum)
Create new instance of Job suitable for snapshot harvesting. |
abstract Job |
JobDAO.read(java.lang.Long jobID)
Reads a job from persistent storage. |
Job |
JobDBDAO.read(java.lang.Long jobID)
Read a single job from the job database. |
Methods in dk.netarkivet.harvester.datamodel that return types with arguments of type Job | |
---|---|
abstract java.util.Iterator<Job> |
JobDAO.getAll()
Return a list of all jobs . |
java.util.Iterator<Job> |
JobDBDAO.getAll()
Return a list of all jobs. |
abstract java.util.Iterator<Job> |
JobDAO.getAll(JobStatus status)
Return a list of all jobs with the given status. |
java.util.Iterator<Job> |
JobDBDAO.getAll(JobStatus status)
Return a list of all jobs with the given status, ordered by id. |
java.util.Iterator<Job> |
JobDAO.iterator()
Gets an iterator of all jobs. |
Methods in dk.netarkivet.harvester.datamodel with parameters of type Job | |
---|---|
abstract void |
JobDAO.create(Job job)
Creates an instance in persistent storage of the given job. |
void |
JobDBDAO.create(Job job)
Creates an instance in persistent storage of the given job. |
abstract HarvestInfo |
DomainDAO.getDomainJobInfo(Job job,
java.lang.String domainName,
java.lang.String configName)
Get the HarvestInfo object for a certain job and DomainConfiguration defined by domainName and configName. |
HarvestInfo |
DomainDBDAO.getDomainJobInfo(Job j,
java.lang.String domainName,
java.lang.String configName)
|
abstract void |
JobDAO.update(Job job)
Update a Job in persistent storage. |
void |
JobDBDAO.update(Job job)
Update a Job in persistent storage. |
Uses of Job in dk.netarkivet.harvester.harvesting |
---|
Methods in dk.netarkivet.harvester.harvesting with parameters of type Job | |
---|---|
java.lang.String |
LegacyNamingConvention.getPrefix(Job theJob)
|
java.lang.String |
ArchiveFileNaming.getPrefix(Job job)
Make a prefix to be used by Heritrix. |
java.lang.String |
CollectionPrefixNamingConvention.getPrefix(Job theJob)
|
HeritrixFiles |
HarvestController.writeHarvestFiles(java.io.File crawldir,
Job job,
PersistentJobData.HarvestDefinitionInfo hdi,
java.util.List<MetadataEntry> metadataEntries)
Writes the files involved with a harvests. |
Uses of Job in dk.netarkivet.harvester.harvesting.distribute |
---|
Methods in dk.netarkivet.harvester.harvesting.distribute that return Job | |
---|---|
Job |
DoOneCrawlMessage.getJob()
|
Constructors in dk.netarkivet.harvester.harvesting.distribute with parameters of type Job | |
---|---|
DoOneCrawlMessage(Job submittedJob,
ChannelID to,
PersistentJobData.HarvestDefinitionInfo harvestInfo,
java.util.List<MetadataEntry> metadata)
A NetarkivetMessage that contains a Job for Heritrix. |
Uses of Job in dk.netarkivet.harvester.harvesting.metadata |
---|
Methods in dk.netarkivet.harvester.harvesting.metadata with parameters of type Job | |
---|---|
void |
PersistentJobData.write(Job harvestJob,
PersistentJobData.HarvestDefinitionInfo hdi)
Write information about given Job to XML-structure. |
Uses of Job in dk.netarkivet.harvester.harvesting.report |
---|
Methods in dk.netarkivet.harvester.harvesting.report with parameters of type Job | |
---|---|
void |
HarvestReport.postProcess(Job job)
Post-processing happens on the scheduler side when ARC files have been uploaded. |
void |
LegacyHarvestReport.postProcess(Job job)
Post-processing happens on the scheduler side when ARC files have been uploaded. |
abstract void |
AbstractHarvestReport.postProcess(Job job)
Post-processing happens on the scheduler side when ARC files have been uploaded. |
void |
BnfHarvestReport.postProcess(Job job)
Post-processing happens on the scheduler side when ARC files have been uploaded. |
Uses of Job in dk.netarkivet.harvester.scheduler |
---|
Methods in dk.netarkivet.harvester.scheduler with parameters of type Job | |
---|---|
void |
JobDispatcher.doOneCrawl(Job job,
java.lang.String origHarvestName,
java.lang.String origHarvestDesc,
java.lang.String origHarvestSchedule,
HarvestChannel channel,
java.lang.String origHarvestAudience,
java.util.List<MetadataEntry> metadata)
Submit an doOneCrawl request to a HarvestControllerServer. |
Uses of Job in dk.netarkivet.harvester.scheduler.jobgen |
---|
Methods in dk.netarkivet.harvester.scheduler.jobgen that return Job | |
---|---|
static Job |
AbstractJobGenerator.getNewJob(HarvestDefinition harvest,
DomainConfiguration cfg)
Instantiates a new job. |
Methods in dk.netarkivet.harvester.scheduler.jobgen with parameters of type Job | |
---|---|
boolean |
AbstractJobGenerator.canAccept(Job job,
DomainConfiguration cfg)
|
boolean |
JobGenerator.canAccept(Job job,
DomainConfiguration cfg)
Tests if a configuration fits into this Job. |
protected boolean |
FixedDomainConfigurationCountJobGenerator.checkSpecificAcceptConditions(Job job,
DomainConfiguration cfg)
|
protected abstract boolean |
AbstractJobGenerator.checkSpecificAcceptConditions(Job job,
DomainConfiguration cfg)
Called by AbstractJobGenerator.canAccept(Job, DomainConfiguration) . |
protected boolean |
DefaultJobGenerator.checkSpecificAcceptConditions(Job job,
DomainConfiguration cfg)
|
protected void |
AbstractJobGenerator.editJobOrderXml(Job job)
Once the job has been filled with DomainConfiguration s, performs the
following operations:
Edit the harvest template to add/remove deduplicator configuration.
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |