public class ContentSizeAnnotationPostProcessor extends org.archive.modules.Processor
Modifier and Type | Field and Description |
---|---|
static String |
CONTENT_SIZE_ANNOTATION_PREFIX
Prefix associated with annotations made by this processor.
|
Constructor and Description |
---|
ContentSizeAnnotationPostProcessor()
Constructor.
|
Modifier and Type | Method and Description |
---|---|
protected void |
innerProcess(org.archive.modules.CrawlURI crawlURI)
For each URI with a successful status code (status code > 0),
add annotation with content size.
|
protected boolean |
shouldProcess(org.archive.modules.CrawlURI arg0) |
doCheckpoint, finishCheckpoint, flattenVia, fromCheckpointJson, getBeanName, getEnabled, getKeyedProperties, getRecordedSize, getShouldProcessRule, getURICount, hasHttpAuthenticationCredential, innerProcessResult, innerRejectProcess, isRunning, isSuccess, process, report, setBeanName, setEnabled, setRecoveryCheckpoint, setShouldProcessRule, start, startCheckpoint, stop, toCheckpointJson
public static final String CONTENT_SIZE_ANNOTATION_PREFIX
public ContentSizeAnnotationPostProcessor()
Processor
protected void innerProcess(org.archive.modules.CrawlURI crawlURI) throws InterruptedException
innerProcess
in class org.archive.modules.Processor
crawlURI
- URI to add annotation for if successful.ArgumentNotValid
- if crawlURI is null.InterruptedException
- never.Processor
protected boolean shouldProcess(org.archive.modules.CrawlURI arg0)
shouldProcess
in class org.archive.modules.Processor
Copyright © 2005–2018 The Royal Danish Library, the National Library of France and the Austrian National Library.. All rights reserved.