Uploaded image for project: 'NetarchiveSuite'
  1. NetarchiveSuite
  2. NAS-396

DomainSensitiveFrontier is slow and does not supply the wanted functionality

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • None
    • 0.5
    • None

    Description

      The DomainSensitiveFrontier has turned out to be slow on crawls with lots of
      seeds (e.g. 10.000)
      Further more is the max-docs setting applied on a pr. host basis instead of a
      pr. domain basis.
      Suggest we shift to the default BdbFrontier
      NOTE: This bug is originally from Bugzilla bug_id=395.

      Attachments

        Activity

          People

            bja Bjarne Andersen
            bja Bjarne Andersen
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: