Uploaded image for project: 'NetarchiveSuite'
  1. NetarchiveSuite
  2. NAS-2758

Multiple Metadatacache objects started by the IndexServerApplication

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Minor
    • None
    • 5.2.2, 5.3.1, 5.4
    • IndexServer
    • None

    Description

      During initial startup of the IndexServerApplication we get this

      018-05-25 18:42:43.252 INFO  d.n.h.indexserver.FileBasedCache - Metadata cache for 'cdxdata' uses directory '/home/test/QUICKSTART/cache/cdxdata'
      2018-05-25 18:42:43.254 INFO  d.n.c.distribute.JMSConnectionSunMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
      2018-05-25 18:42:43.256 INFO  d.n.c.distribute.JMSConnectionSunMQ - Establishing SunMQ JMS Connection to 'localhost:7676'
      2018-05-25 18:42:43.303 INFO  d.n.a.a.d.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 300000 milliseconds.
      2018-05-25 18:42:43.467 INFO  d.n.a.a.d.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'QUICKSTART_COMMON_THIS_REPOS_CLIENT_130_226_221_33_IS']'
      2018-05-25 18:42:43.488 INFO  d.n.h.indexserver.RawMetadataCache - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
      2018-05-25 18:42:43.490 INFO  d.n.h.indexserver.FileBasedCache - Metadata cache for 'cdxindex' uses directory '/home/test/QUICKSTART/cache/cdxindex'
      2018-05-25 18:42:43.509 INFO  d.n.h.indexserver.FileBasedCache - Metadata cache for 'crawllog' uses directory '/home/test/QUICKSTART/cache/crawllog'
      2018-05-25 18:42:43.515 INFO  d.n.h.indexserver.RawMetadataCache - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled
      2018-05-25 18:42:43.516 INFO  d.n.h.indexserver.FileBasedCache - Metadata cache for 'dedupcrawllogindex' uses directory '/home/test/QUICKSTART/cache/dedupcrawllogindex'
      2018-05-25 18:42:43.517 INFO  d.n.h.indexserver.FileBasedCache - Metadata cache for 'cdxdata' uses directory '/home/test/QUICKSTART/cache/cdxdata'
      2018-05-25 18:42:43.523 INFO  d.n.h.indexserver.RawMetadataCache - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
      2018-05-25 18:42:43.524 INFO  d.n.h.indexserver.FileBasedCache - Metadata cache for 'crawllog' uses directory '/home/test/QUICKSTART/cache/crawllog'
      2018-05-25 18:42:43.525 INFO  d.n.h.indexserver.RawMetadataCache - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled
      2018-05-25 18:42:43.525 INFO  d.n.h.indexserver.FileBasedCache - Metadata cache for 'fullcrawllogindex' uses directory '/home/test/QUICKSTART/cache/fullcrawllogindex'
      2018-05-25 18:42:43.526 INFO  d.n.h.indexserver.FileBasedCache - Metadata cache for 'cdxdata' uses directory '/home/test/QUICKSTART/cache/cdxdata'
      2018-05-25 18:42:43.528 INFO  d.n.h.indexserver.RawMetadataCache - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
      2018-05-25 18:42:43.538 INFO  d.n.h.indexserver.FileBasedCache - Generated index '/home/test/QUICKSTART/cache/cdxindex/empty-cache' of id '[]', request was for '[]'
      2018-05-25 18:42:43.546 INFO  d.n.h.indexserver.FileBasedCache - Generated index '/home/test/QUICKSTART/cache/dedupcrawllogindex/empty-cache' of id '[]', request was for '[]'
      2018-05-25 18:42:43.550 INFO  d.n.h.indexserver.FileBasedCache - Generated index '/home/test/QUICKSTART/cache/fullcrawllogindex/empty-cache' of id '[]', request was for '[]'
      2018-05-25 18:42:43.566 INFO  d.n.h.i.d.IndexRequestServer - Setting handler for RequestType: CDX
      2018-05-25 18:42:43.567 INFO  d.n.h.i.d.IndexRequestServer - Setting handler for RequestType: DEDUP_CRAWL_LOG
      2018-05-25 18:42:43.567 INFO  d.n.h.i.d.IndexRequestServer - Setting handler for RequestType: FULL_CRAWL_LOG
      2018-05-25 18:42:43.568 INFO  d.n.h.i.d.IndexRequestServer - 0 indexing jobs in progress that was stored in requestdir: /home/test/QUICKSTART/requests
      2018-05-25 18:42:43.569 INFO  d.n.h.i.d.IndexRequestServer - Enabling listening to the indexserver channel '[Queue 'QUICKSTART_COMMON_INDEX_SERVER']'
      

      It seems we have duplicate RawMetadataCache objects for each prefix

      Attachments

        Activity

          People

            Unassigned Unassigned
            svc Søren Vejrup Carlsen (Inactive)
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: