Uploaded image for project: 'NetarchiveSuite'
  1. NetarchiveSuite
  2. NAS-2510

Compression is not currently a choice when building our metadata files

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 5.1
    • Fix Version/s: 5.2
    • Labels:
      None
    • Sprint:
      NAS 5.2
    • Verification:
      Hide

      use a deployment configuration which overrides the

       settings.harvester.harvesting.metadata.compression
      

      setting:
      The beginning of the deploy configuration should look like this:

      <?xml version="1.0" encoding="UTF-8"?>
      <deployGlobal>
        <deployClassPath>lib/netarchivesuite-monitor-core.jar</deployClassPath>
        <deployJavaOpt>-Xmx1024m</deployJavaOpt>
        <settings>
         ...
      <harvester>
            <aliases>
              <timeout>31536000</timeout>
            </aliases>
            <harvesting>
              <deduplication>
                <enabled>true</enabled>
              </deduplication>
              <metadata>
                <compression>true</compression>
              </metadata>
             ...
             </harvesting>
              ..
             </harvester>
              ...
      </settings>
      
      Show
      use a deployment configuration which overrides the settings.harvester.harvesting.metadata.compression setting: The beginning of the deploy configuration should look like this: <?xml version= "1.0" encoding= "UTF-8" ?> <deployGlobal> <deployClassPath>lib/netarchivesuite-monitor-core.jar</deployClassPath> <deployJavaOpt>-Xmx1024m</deployJavaOpt> <settings> ... <harvester> <aliases> <timeout>31536000</timeout> </aliases> <harvesting> <deduplication> <enabled> true </enabled> </deduplication> <metadata> <compression> true </compression> </metadata> ... </harvesting> .. </harvester> ... </settings>

      Description

      Currently, compression is not currently a choice when building our metadata files

      We should add a harvesting.metadata.compression setting
      and let this determine whether or not to compress our arc or warc-files
      The default should be false

        Attachments

          Activity

            People

            • Assignee:
              svc Søren Vejrup Carlsen (Inactive)
              Reporter:
              svc Søren Vejrup Carlsen (Inactive)
            • Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h 28m
                1h 28m