Uploaded image for project: 'NetarchiveSuite'
  1. NetarchiveSuite
  2. NAS-2510

Compression is not currently a choice when building our metadata files

    XMLWordPrintable

Details

    • NAS 5.2
    • Hide

      use a deployment configuration which overrides the 

       settings.harvester.harvesting.metadata.compression

      setting:
      The beginning of the deploy configuration should look like this:

      <?xml version="1.0" encoding="UTF-8"?>
<deployGlobal>
  <deployClassPath>lib/netarchivesuite-monitor-core.jar</deployClassPath>
  <deployJavaOpt>-Xmx1024m</deployJavaOpt>
  <settings>
   ...
<harvester>
      <aliases>
        <timeout>31536000</timeout>
      </aliases>
      <harvesting>
        <deduplication>
          <enabled>true</enabled>
        </deduplication>
        <metadata>
          <compression>true</compression>
        </metadata>
       ...
       </harvesting>
        ..
       </harvester>
        ...
</settings>
      Show
      use a deployment configuration which overrides the settings.harvester.harvesting.metadata.compression setting: The beginning of the deploy configuration should look like this: <?xml version= "1.0" encoding= "UTF-8" ?> <deployGlobal> <deployClassPath>lib/netarchivesuite-monitor-core.jar</deployClassPath> <deployJavaOpt>-Xmx1024m</deployJavaOpt> <settings> ... <harvester> <aliases> <timeout>31536000</timeout> </aliases> <harvesting> <deduplication> <enabled> true </enabled> </deduplication> <metadata> <compression> true </compression> </metadata> ... </harvesting> .. </harvester> ... </settings>

    Description

      Currently, compression is not currently a choice when building our metadata files

      We should add a harvesting.metadata.compression setting
      and let this determine whether or not to compress our arc or warc-files
      The default should be false

      Attachments

        Activity

          People

            svc Søren Vejrup Carlsen (Inactive)
            svc Søren Vejrup Carlsen (Inactive)
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h 28m
                1h 28m