public class DeduplicationCDXExtractionBatchJob extends ArchiveBatchJob
FileBatchJob.ExceptionOccurrence
noOfRecordsProcessed
batchJobTimeout, exceptions, filesFailed, noOfFilesProcessed
Constructor and Description |
---|
DeduplicationCDXExtractionBatchJob() |
Modifier and Type | Method and Description |
---|---|
void |
finish(OutputStream os)
Does nothing.
|
void |
initialize(OutputStream os)
Initializes various fields of this class.
|
void |
processRecord(ArchiveRecordBase record,
OutputStream os)
If the ArchiveRecord is a crawl-log entry then any duplicate entries in the crawl log are converted to CDX
entries and written to the output.
|
getFilter, processFile
getExceptionArray, handleException, handleOurException, noOfRecordsProcessed
addException, addFinishException, addInitializeException, getBatchJobTimeout, getExceptions, getFilenamePattern, getFilesFailed, getNoOfFilesProcessed, maxExceptionsReached, postProcess, processOnlyFileNamed, processOnlyFilesMatching, processOnlyFilesMatching, processOnlyFilesNamed, setBatchJobTimeout
public DeduplicationCDXExtractionBatchJob()
public void initialize(OutputStream os)
initialize
in class ArchiveBatchJobBase
os
- unused parameterpublic void processRecord(ArchiveRecordBase record, OutputStream os)
processRecord
in class ArchiveBatchJob
record
- The ArchiveRecord to be processedos
- the stream to which output is writtenpublic void finish(OutputStream os)
finish
in class ArchiveBatchJobBase
os
- an outputstreamCopyright © 2005–2015 The Royal Danish Library, the Danish State and University Library, the National Library of France and the Austrian National Library.. All rights reserved.