Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

You should see a list like

Code Block
    metadata://netarkivet.dk/crawl/setup/duplicatereductionjobs?majorversion=1&minorversion=0&harvestid=1&harvestnum=010&jobid=114
    metadata://netarkivet.dk/crawl/setup/crawlcrawler-manifestbeans.txtcxml?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/setup/harvestInfo.xml?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/setup/orderseeds.xmltxt?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/setupreports/seedsarchivefiles-report.txt?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/reports/arcfilescrawl-report.txt?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/reports/crawlfrontier-summary-report.txt?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/reports/frontierhosts-report.txt?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/reports/hostsmimetype-report.txt?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/reports/mimetypeprocessors-report.txt?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/reports/processorsresponsecode-report.txt?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/reports/responsecodeseeds-report.txt?heritrixVersion=1.14.43.3.0-LBS-2016-02&harvestid=1&jobid=14
metadata://netarkivet.dk/crawl/reports/source-report.txt?heritrixVersion=3.3.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/reports/seedsthreads-report.txt?heritrixVersion=1.14.43.3.0-LBS-2016-02&harvestid=1&jobid=14
metadata://netarkivet.dk/crawl/logs/alerts.log?heritrixVersion=3.3.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/logs/crawl.log?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/logs/heritrixheritrix3_err.outlog?heritrixVersion=1.14.43.3.0-LBS-2016-02&harvestid=1&jobid=14
metadata://netarkivet.dk/crawl/logs/heritrix3_out.log?heritrixVersion=3.3.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/logs/heritrix_dmesgout.log?heritrixVersion=1.14.43.3.0-LBS-2016-02&harvestid=1&jobid=14
metadata://netarkivet.dk/crawl/logs/job.log?heritrixVersion=3.3.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/logs/localnonfatal-errors.log?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/logs/progress-statistics.log?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/logs/runtime-errors.log?heritrixVersion=1.14.43.3.0-LBS-2016-02&harvestid=1&jobid=14
metadata://netarkivet.dk/crawl/logs/scope.log?heritrixVersion=3.3.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/logs/uri-errors.log?heritrixVersion=13.14.43.0-LBS-2016-02&harvestid=1&jobid=114
    metadata://netarkivet.dk/crawl/index/cdx?majorversion=12&minorversion=0&harvestid=1&jobid=1×tamp=2013081407301314&serialno=00000filename=14-1-20161101215537865-00000-ciblee_2015_sb-test-har-001.statsbiblioteket.dk.warc

Check that all the entries are present and browse each in turn. (Note that the HeritrixVersion, harvestIf, and jobId will differ). Some of the entries might be empty

...