Uploaded image for project: 'NetarchiveSuite'
  1. NetarchiveSuite
  2. NAS-1822

The generation of Snapshot indexes should be generated in advance

    XMLWordPrintable

Details

    • Rough
    • Hide

      Step 1: Make a small (1 Mbyte) snapshot harvest (SNH1) with 100 domains with previous hd=null, and activate it, and wait for it to finish.
      Step 2: Make another snapshot harvest(SNH2) (size 5 mbytes/domain); set previous hd=SNH1; and activate.
      Step 3; verify from the logs of the indexsersver and the JobharvestManager, that the jobs of SNH2 is not generated and submitted, before the indexserver has finished making the index.

      Show
      Step 1: Make a small (1 Mbyte) snapshot harvest (SNH1) with 100 domains with previous hd=null, and activate it, and wait for it to finish. Step 2: Make another snapshot harvest(SNH2) (size 5 mbytes/domain); set previous hd=SNH1; and activate. Step 3; verify from the logs of the indexsersver and the JobharvestManager, that the jobs of SNH2 is not generated and submitted, before the indexserver has finished making the index.

    Description

      The generation of Snapshot indexes should be generated in advance of the actual scheduling process.
      (1) send message to Indexserver asking to generate but not return a given index.
      (2) The Indexserver makes the index
      (3) When the indexserver has generated the correct index, the indexserver sends a message to the JobManager, which updates the record for the Harvesdefinition in question.

      Attachments

        Activity

          People

            svc Søren Vejrup Carlsen (Inactive)
            svc Søren Vejrup Carlsen (Inactive)
            Mikis Seth Sørensen Mikis Seth Sørensen (Inactive)
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 35h
                35h
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 14h Time Not Required
                14h