Details
-
Bug
-
Resolution: Fixed
-
Minor
-
2.0
-
None
-
None
Description
example from harvestInfo with bad contents in field origHarvestDefinitionComments:
<harvestInfo>
<version>0.6</version>
<jobId>5401</jobId>
<channel>HIGHPRIORITY</channel>
<harvestNum>1</harvestNum>
<origHarvestDefinitionID>5651</origHarvestDefinitionID>
<maxBytesPerDomain>10000000</maxBytesPerDomain>
<maxObjectsPerDomain>100</maxObjectsPerDomain>
<templateName>webdanica_order</templateName>
<origHarvestDefinitionName>webdanica-trial-1527511626188</origHarvestDefinitionName>
<origHarvestDefinitionComments>Event harvest created by webdanica system at Mon May 28 14:47:06 CEST 2018. seed= https://twitter.com/intent/tweet?via=dmidk&url=http://beta.dmi.dk/en/hav/groenland-og-
arktis/iskort/oestgroenland/</origHarvestDefinitionComments>
<scheduleName>Once</scheduleName>
<harvestFilenamePrefix>5401-5651</harvestFilenamePrefix>
<jobSubmitDate>2018-05-28T12:51:21Z</jobSubmitDate>
<audience>Webdanica Curators</audience>
</harvestInfo>
The above is added to the heritrix configuration as part as of the warcWriter configuration
<property name="metadataItems"> <map> <entry key="harvestInfo.version" value="0.6"/> <entry key="harvestInfo.jobId" value="5401"/> <entry key="harvestInfo.channel" value="HIGHPRIORITY"/> <entry key="harvestInfo.harvestNum" value="1"/> <entry key="harvestInfo.origHarvestDefinitionID" value="5651"/> <entry key="harvestInfo.maxBytesPerDomain" value="10000000"/> <entry key="harvestInfo.maxObjectsPerDomain" value="100"/> <entry key="harvestInfo.templateName" value="webdanica_order"/> <entry key="harvestInfo.origHarvestDefinitionName" value="webdanica-trial-1527511626188"/> <entry key="harvestInfo.origHarvestDefinitionComments" value="Event harvest created by webdanica system at Mon May 28 14:47:06 CEST 2018. seed= https://twitter.com/intent/tweet?via=dmidk&url=http://beta.dm i.dk/en/hav/groenland-og-arktis/iskort/oestgroenland/"/> <entry key="harvestInfo.scheduleName" value="Once"/> <entry key="harvestInfo.harvestFilenamePrefix" value="5401-5651"/> <entry key="harvestInfo.jobSubmitDate" value="2018-05-28T12:51:21Z"/> <entry key="harvestInfo.audience" value="Webdanica Curators"/> </map>