Details
-
Improvement
-
Resolution: Fixed
-
Minor
-
None
-
None
Description
Make overriding of writeRequests, writeMetadata, writeMetadataOutlinks, writeRevisitForIdenticalDigests and writeRevisitForNotModified optional
We have added the parameters settings.harvester.harvesting.heritrix3.warc.warcParametersOverride and settings.harvester.harvesting.heritrix.warc.warcParametersOverride so the parameter can be in both <heritrix> or <heritrix3> tags.
We check if this parameter is present, and if it is and set to true, we override the parameters writeRequests, writeMetadata,writeMetadataOutlinks, writeRevisitForIdenticalDigests and writeRevisitForNotModified (by default, it is considered true). Otherwise, we keep the parameters set in the order template or crawler beans files.