Uploaded image for project: 'NetarchiveSuite'
  1. NetarchiveSuite
  2. NAS-2870

Integrate the latest H3 IIPC community version: 3.4.0-202010XX with the fix on WARC-Payload-Digest on revisit records

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • None
    • 6.0
    • Heritrix 3
    • None
    • BNF

    Description

      Revisit records produced by Iceland deduplication module are ALL missing the digest algorithm

      WARC-Type: revisit
      WARC-Target-URI: https://www.aacri.fr/image/cache/SS/Maillot-Japon-Domicile-Coupe-Du-Monde-2018-ML-165x165.jpg
      WARC-Date: 2020-10-07T23:24:13Z
      WARC-IP-Address: 185.212.174.252
      WARC-Profile: http://netpreserve.org/warc/1.0/revisit/identical-payload-digest
      WARC-Truncated: length
      WARC-Payload-Digest: JC5XU7JYIQDMKD7ZGEKMZ4VE4HKDVEMJ

      WARC-Type: revisit
      WARC-Target-URI: http://www.aare.fr/wp-content/uploads/meuble-complement-M-orme-massif-sur-mesure-aare-300x200.jpg
      WARC-Date: 2020-10-07T23:24:13Z
      WARC-IP-Address: 146.88.233.102
      WARC-Profile: http://netpreserve.org/warc/1.0/revisit/identical-payload-digest
      WARC-Truncated: length
      WARC-Payload-Digest: O5YQIPTBZ2AQ2F7DJRQSXVMVYRML7TFN

      Only the responses are correct :
      WARC/1.0
      WARC-Type: response
      WARC-Target-URI: https://www.a2mimmo.fr/fr/Vente%20villa%20La%20C%C3%B4te%20Bleue/location-saisonniere-studio-1-piece-carry-le-rouet-13620
      WARC-Date: 2020-10-07T23:37:09Z
      WARC-IP-Address: 212.129.35.41
      WARC-Payload-Digest: sha1:MSFV2JAY6YQ3FPFG2VZJMT2UTMP6KFWV

       

      ===> integrate the fix.

       

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              sara Sara Aubry
              Wiatrowski Wiatrowski (Inactive)
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: