Uploaded image for project: 'NetarchiveSuite'
  1. NetarchiveSuite
  2. NAS-2714

Add a prefix to (W)ARC metadata files

    XMLWordPrintable

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 5.3.1
    • Harvester Controller Server
    • None
    • BNF

    Description

      Add a prefix to (W)ARC metadata files

      We have added the parameter settings.harvester.harvesting.metadata.metadataFileNameFormat in HarvesterSettings.java and modify code so that if this parameter is "prefix", the metadata file name will be either 

      collectionName + "-" + jobID + "-" + harvestID + "-metadata-" + 1 + ."arc" + possibleGzSuffix

      or 

      collectionName + "-" + jobID + "-" + harvestID + "-metadata-" + 1 + ."warc" + possibleGzSuffix

      We also modify wherever it was necessary to handle this case (in particular in test classes).

      Attachments

        Issue Links

          related to

          Improvement - An improvement or enhancement to an existing feature or task. NAS-2713 Add a prefix to (W)ARC files

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. NAS-2712 Indexserver includes too much in the specifiedPattern used by RawMetadataCache#cacheData(Long id)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Ready for release test

          Improvement - An improvement or enhancement to an existing feature or task. NAS-2715 Make writing of outlinks in WARC metadata records optional

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. NAS-2716 Make overriding of writeRequests, writeMetadata, writeMetadataOutlinks, writeRevisitForIdenticalDigests and writeRevisitForNotModified optional

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              svc Søren Vejrup Carlsen (Inactive)
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: