[INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - heritrix1 controller 5.3-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix1-controller --- [INFO] Deleting /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix1-controller --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix1-controller --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 21 source files to /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix1-controller --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 104 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix1-controller --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 16 source files to /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/src/test/java/dk/netarkivet/externalsoftware/HeritrixTests.java: Some input files use unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/src/test/java/dk/netarkivet/externalsoftware/HeritrixTests.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ heritrix1-controller --- [INFO] Surefire report directory: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/surefire-reports ------------------------------------------------------- T E S T S ------------------------------------------------------- Running dk.netarkivet.harvester.harvesting.report.LegacyHarvestReportTester 00:05:59.687 [main] INFO d.n.h.h.r.HarvestReportGenerator - Starting pre-processing of harvest report for job 1 00:05:59.710 [main] INFO dk.netarkivet.common.utils.TLD - Did not found external public suffix list at '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/conf/public_suffix_list.dat'! Reading instead the public suffixes list from embedded file 'dk/netarkivet/common/utils/public_suffix_list.dat' in common-core.jar-VERSION.jar. 00:05:59.836 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.bd', ignoring 00:05:59.851 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.bn', ignoring 00:05:59.853 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.nom.br', ignoring 00:05:59.855 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ck', ignoring 00:05:59.856 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!www.ck', ignoring 00:05:59.874 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.er', ignoring 00:05:59.875 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.fj', ignoring 00:05:59.875 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.fk', ignoring 00:05:59.876 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.gu', ignoring 00:05:59.939 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.jm', ignoring 00:05:59.941 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kawasaki.jp', ignoring 00:05:59.941 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kitakyushu.jp', ignoring 00:05:59.941 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kobe.jp', ignoring 00:05:59.941 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.nagoya.jp', ignoring 00:05:59.941 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sapporo.jp', ignoring 00:05:59.942 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sendai.jp', ignoring 00:05:59.942 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.yokohama.jp', ignoring 00:05:59.943 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kawasaki.jp', ignoring 00:05:59.943 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kitakyushu.jp', ignoring 00:05:59.943 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kobe.jp', ignoring 00:05:59.943 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.nagoya.jp', ignoring 00:05:59.944 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.sapporo.jp', ignoring 00:05:59.944 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.sendai.jp', ignoring 00:05:59.944 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.yokohama.jp', ignoring 00:05:59.967 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ke', ignoring 00:05:59.968 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kh', ignoring 00:05:59.968 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kw', ignoring 00:05:59.969 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.mm', ignoring 00:05:59.974 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.mz', ignoring 00:05:59.974 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!teledata.mz', ignoring 00:05:59.979 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.np', ignoring 00:05:59.980 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.pg', ignoring 00:05:59.986 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sch.uk', ignoring 00:05:59.989 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ye', ignoring 00:05:59.990 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.zw', ignoring 00:06:00.001 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.compute.estate', ignoring 00:06:00.001 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.alces.network', ignoring 00:06:00.002 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.platform.sh', ignoring 00:06:00.003 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.cryptonomic.net', ignoring 00:06:00.006 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.api.githubcloud.com', ignoring 00:06:00.006 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ext.githubcloud.com', ignoring 00:06:00.006 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.githubcloudusercontent.com', ignoring 00:06:00.007 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.0emm.com', ignoring 00:06:00.008 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.magentosite.cloud', ignoring The list of loaded data settings is empty. Is this OK?00:06:00.020 [main] DEBUG dk.netarkivet.common.utils.TLD - No tlds found in settingsfiles 00:06:00.021 [main] INFO dk.netarkivet.common.utils.TLD - Did not found external public suffix list at '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/conf/public_suffix_list.dat'! Reading instead the public suffixes list from embedded file 'dk/netarkivet/common/utils/public_suffix_list.dat' in common-core.jar-VERSION.jar. 00:06:00.023 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.bd', ignoring 00:06:00.024 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.bn', ignoring 00:06:00.024 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.nom.br', ignoring 00:06:00.026 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ck', ignoring 00:06:00.026 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!www.ck', ignoring 00:06:00.028 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.er', ignoring 00:06:00.028 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.fj', ignoring 00:06:00.028 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.fk', ignoring 00:06:00.029 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.gu', ignoring 00:06:00.033 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.jm', ignoring 00:06:00.034 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kawasaki.jp', ignoring 00:06:00.034 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kitakyushu.jp', ignoring 00:06:00.034 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kobe.jp', ignoring 00:06:00.035 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.nagoya.jp', ignoring 00:06:00.035 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sapporo.jp', ignoring 00:06:00.036 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sendai.jp', ignoring 00:06:00.036 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.yokohama.jp', ignoring 00:06:00.037 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kawasaki.jp', ignoring 00:06:00.037 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kitakyushu.jp', ignoring 00:06:00.038 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kobe.jp', ignoring 00:06:00.038 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.nagoya.jp', ignoring 00:06:00.038 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.sapporo.jp', ignoring 00:06:00.039 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.sendai.jp', ignoring 00:06:00.039 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.yokohama.jp', ignoring 00:06:00.052 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ke', ignoring 00:06:00.053 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kh', ignoring 00:06:00.054 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kw', ignoring 00:06:00.055 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.mm', ignoring 00:06:00.059 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.mz', ignoring 00:06:00.060 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!teledata.mz', ignoring 00:06:00.065 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.np', ignoring 00:06:00.065 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.pg', ignoring 00:06:00.071 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sch.uk', ignoring 00:06:00.074 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ye', ignoring 00:06:00.075 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.zw', ignoring 00:06:00.084 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.compute.estate', ignoring 00:06:00.084 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.alces.network', ignoring 00:06:00.086 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.platform.sh', ignoring 00:06:00.087 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.cryptonomic.net', ignoring 00:06:00.090 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.api.githubcloud.com', ignoring 00:06:00.090 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ext.githubcloud.com', ignoring 00:06:00.090 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.githubcloudusercontent.com', ignoring 00:06:00.090 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.0emm.com', ignoring 00:06:00.091 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.magentosite.cloud', ignoring The list of loaded data settings is empty. Is this OK?00:06:00.094 [main] DEBUG dk.netarkivet.common.utils.TLD - No tlds found in settingsfiles 00:06:00.328 [main] INFO d.n.h.h.r.HarvestReportGenerator - Finished pre-processing of harvest report for job 1, operation took 00d 00:10:35 00:06:00.347 [main] INFO d.n.h.h.r.HarvestReportGenerator - Starting pre-processing of harvest report for job 1 00:06:00.364 [main] INFO d.n.h.h.r.HarvestReportGenerator - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:16 00:06:00.370 [main] INFO d.n.h.h.r.HarvestReportGenerator - Starting pre-processing of harvest report for job 1 00:06:00.379 [main] INFO d.n.h.h.r.HarvestReportGenerator - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:03 00:06:00.387 [main] INFO d.n.h.h.r.HarvestReportGenerator - Starting pre-processing of harvest report for job 1 00:06:00.400 [main] DEBUG d.n.h.h.r.HarvestReportGenerator - Invalid line in '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/LegacyHarvestReportTester/testIDNA/logs/crawl.log' line 1: 'metadata://netarkivet.dk/crawl/logs/crawl.log?heritrixVersion=1.14.4&harvestid=4&jobid=6 130.226.228.8 20120523150916 text/plain 412905'. Ignoring due to reason: Not enough fields for line in crawl.log: 'metadata://netarkivet.dk/crawl/logs/crawl.log?heritrixVersion=1.14.4&harvestid=4&jobid=6 130.226.228.8 20120523150916 text/plain 412905'. Was only 5 fields. Should have been at least 11 dk.netarkivet.common.exceptions.ArgumentNotValid: Not enough fields for line in crawl.log: 'metadata://netarkivet.dk/crawl/logs/crawl.log?heritrixVersion=1.14.4&harvestid=4&jobid=6 130.226.228.8 20120523150916 text/plain 412905'. Was only 5 fields. Should have been at least 11 at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.processHarvestLine(HarvestReportGenerator.java:255) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.parseCrawlLog(HarvestReportGenerator.java:219) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.preProcess(HarvestReportGenerator.java:148) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.<init>(HarvestReportGenerator.java:131) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.getDomainStatsReport(HarvestReportGenerator.java:402) [classes/:na] at dk.netarkivet.harvester.harvesting.report.LegacyHarvestReportTester.testIDNA(LegacyHarvestReportTester.java:229) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:02.140 [main] INFO d.n.h.h.r.HarvestReportGenerator - Finished pre-processing of harvest report for job 1, operation took 00d 00:29:12 00:06:02.165 [main] INFO d.n.h.h.r.HarvestReportGenerator - Starting pre-processing of harvest report for job 1 00:06:02.184 [main] INFO d.n.h.h.r.HarvestReportGenerator - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:19 00:06:02.200 [main] INFO d.n.h.h.r.HarvestReportGenerator - Starting pre-processing of harvest report for job 1 00:06:02.203 [main] DEBUG d.n.h.h.r.HarvestReportGenerator - Unable to extract a domain from the object URL found in field 4 of crawl.log: '000nourl000'. java.net.URISyntaxException: Invalid URI - relative URIs not allowed: 000nourl000 at org.jwat.common.Uri.<init>(Uri.java:158) ~[jwat-common-1.0.4.jar:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.getDomainNameFromURIString(HarvestReportGenerator.java:376) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.processHarvestLine(HarvestReportGenerator.java:291) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.parseCrawlLog(HarvestReportGenerator.java:219) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.preProcess(HarvestReportGenerator.java:148) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.<init>(HarvestReportGenerator.java:131) [classes/:na] at dk.netarkivet.harvester.harvesting.report.LegacyHarvestReportTester.testConstructorInvalidReportFile(LegacyHarvestReportTester.java:88) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:02.205 [main] DEBUG d.n.h.h.r.HarvestReportGenerator - Invalid line in '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/LegacyHarvestReportTester/testConstructorInvalidReportFile/logs/crawl.log' line 3: '2005-05-06T11:47:28.464Z 404 278 000nourl000 P http://www.netarkivet.dk/ text/html #028 20050506114728458+5 NYN2HPNQGIPJTPMGAV4QPBUCVJVNMM54 -'. Ignoring due to reason: Unable to find a domainName in the line: '2005-05-06T11:47:28.464Z 404 278 000nourl000 P http://www.netarkivet.dk/ text/html #028 20050506114728458+5 NYN2HPNQGIPJTPMGAV4QPBUCVJVNMM54 -'. dk.netarkivet.common.exceptions.ArgumentNotValid: Unable to find a domainName in the line: '2005-05-06T11:47:28.464Z 404 278 000nourl000 P http://www.netarkivet.dk/ text/html #028 20050506114728458+5 NYN2HPNQGIPJTPMGAV4QPBUCVJVNMM54 -'. at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.processHarvestLine(HarvestReportGenerator.java:302) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.parseCrawlLog(HarvestReportGenerator.java:219) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.preProcess(HarvestReportGenerator.java:148) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.<init>(HarvestReportGenerator.java:131) [classes/:na] at dk.netarkivet.harvester.harvesting.report.LegacyHarvestReportTester.testConstructorInvalidReportFile(LegacyHarvestReportTester.java:88) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:02.210 [main] DEBUG d.n.h.h.r.HarvestReportGenerator - Invalid line in '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/LegacyHarvestReportTester/testConstructorInvalidReportFile/logs/crawl.log' line 4: '2005-05-06T11:47:28.465Z 200 14 http://tooshortline/'. Ignoring due to reason: Not enough fields for line in crawl.log: '2005-05-06T11:47:28.465Z 200 14 http://tooshortline/'. Was only 4 fields. Should have been at least 11 dk.netarkivet.common.exceptions.ArgumentNotValid: Not enough fields for line in crawl.log: '2005-05-06T11:47:28.465Z 200 14 http://tooshortline/'. Was only 4 fields. Should have been at least 11 at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.processHarvestLine(HarvestReportGenerator.java:255) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.parseCrawlLog(HarvestReportGenerator.java:219) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.preProcess(HarvestReportGenerator.java:148) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.<init>(HarvestReportGenerator.java:131) [classes/:na] at dk.netarkivet.harvester.harvesting.report.LegacyHarvestReportTester.testConstructorInvalidReportFile(LegacyHarvestReportTester.java:88) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:02.211 [main] INFO d.n.h.h.r.HarvestReportGenerator - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:11 00:06:02.222 [main] INFO d.n.h.h.r.HarvestReportGenerator - Starting pre-processing of harvest report for job 1 00:06:02.231 [main] INFO d.n.h.h.r.HarvestReportGenerator - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:09 00:06:02.235 [main] INFO d.n.h.h.r.HarvestReportGenerator - Starting pre-processing of harvest report for job 1 00:06:02.238 [main] INFO d.n.h.h.r.HarvestReportGenerator - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:02 00:06:02.245 [main] INFO d.n.h.h.r.HarvestReportGenerator - Starting pre-processing of harvest report for job 1 00:06:02.250 [main] INFO d.n.h.h.r.HarvestReportGenerator - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:04 00:06:02.286 [main] INFO d.n.h.h.r.HarvestReportGenerator - Starting pre-processing of harvest report for job 1 00:06:02.288 [main] DEBUG d.n.h.h.r.HarvestReportGenerator - Unable to extract a domain from the object URL found in field 4 of crawl.log: '000nourl000'. java.net.URISyntaxException: Invalid URI - relative URIs not allowed: 000nourl000 at org.jwat.common.Uri.<init>(Uri.java:158) ~[jwat-common-1.0.4.jar:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.getDomainNameFromURIString(HarvestReportGenerator.java:376) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.processHarvestLine(HarvestReportGenerator.java:291) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.parseCrawlLog(HarvestReportGenerator.java:219) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.preProcess(HarvestReportGenerator.java:148) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.<init>(HarvestReportGenerator.java:131) [classes/:na] at dk.netarkivet.harvester.harvesting.report.LegacyHarvestReportTester.testConstructor(LegacyHarvestReportTester.java:98) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:02.289 [main] DEBUG d.n.h.h.r.HarvestReportGenerator - Invalid line in '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/LegacyHarvestReportTester/testConstructor/logs/crawl.log' line 3: '2005-05-06T11:47:28.464Z 404 278 000nourl000 P http://www.netarkivet.dk/ text/html #028 20050506114728458+5 NYN2HPNQGIPJTPMGAV4QPBUCVJVNMM54 -'. Ignoring due to reason: Unable to find a domainName in the line: '2005-05-06T11:47:28.464Z 404 278 000nourl000 P http://www.netarkivet.dk/ text/html #028 20050506114728458+5 NYN2HPNQGIPJTPMGAV4QPBUCVJVNMM54 -'. dk.netarkivet.common.exceptions.ArgumentNotValid: Unable to find a domainName in the line: '2005-05-06T11:47:28.464Z 404 278 000nourl000 P http://www.netarkivet.dk/ text/html #028 20050506114728458+5 NYN2HPNQGIPJTPMGAV4QPBUCVJVNMM54 -'. at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.processHarvestLine(HarvestReportGenerator.java:302) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.parseCrawlLog(HarvestReportGenerator.java:219) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.preProcess(HarvestReportGenerator.java:148) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.<init>(HarvestReportGenerator.java:131) [classes/:na] at dk.netarkivet.harvester.harvesting.report.LegacyHarvestReportTester.testConstructor(LegacyHarvestReportTester.java:98) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:02.291 [main] DEBUG d.n.h.h.r.HarvestReportGenerator - Invalid line in '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/LegacyHarvestReportTester/testConstructor/logs/crawl.log' line 4: '2005-05-06T11:47:28.465Z 200 14 http://tooshortline/'. Ignoring due to reason: Not enough fields for line in crawl.log: '2005-05-06T11:47:28.465Z 200 14 http://tooshortline/'. Was only 4 fields. Should have been at least 11 dk.netarkivet.common.exceptions.ArgumentNotValid: Not enough fields for line in crawl.log: '2005-05-06T11:47:28.465Z 200 14 http://tooshortline/'. Was only 4 fields. Should have been at least 11 at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.processHarvestLine(HarvestReportGenerator.java:255) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.parseCrawlLog(HarvestReportGenerator.java:219) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.preProcess(HarvestReportGenerator.java:148) [classes/:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportGenerator.<init>(HarvestReportGenerator.java:131) [classes/:na] at dk.netarkivet.harvester.harvesting.report.LegacyHarvestReportTester.testConstructor(LegacyHarvestReportTester.java:98) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:02.291 [main] INFO d.n.h.h.r.HarvestReportGenerator - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:05 Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.313 sec - in dk.netarkivet.harvester.harvesting.report.LegacyHarvestReportTester Running dk.netarkivet.harvester.harvesting.HeritrixLauncherTester 00:06:02.459 [main] DEBUG d.n.h.harvesting.HeritrixFiles - Writing order-file to disk as file: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/heritrix_out/order.xml 00:06:02.528 [main] INFO d.n.h.h.c.AbstractJMXHeritrixController - Starting Heritrix for job 42 of harvest 117 in target/test-output/heritrix_out 00:06:02.529 [main] WARN d.n.h.h.c.AbstractJMXHeritrixController - Failed to read the password file '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/conf/jmxremote.password'. It is possibly missing. 00:06:02.945 [main] DEBUG d.n.h.harvesting.HeritrixFiles - Writing order-file to disk as file: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/heritrix_out/order.xml 00:06:02.971 [main] INFO d.n.h.h.c.AbstractJMXHeritrixController - Starting Heritrix for job 42 of harvest 117 in target/test-output/heritrix_out 00:06:02.971 [main] WARN d.n.h.h.c.AbstractJMXHeritrixController - Failed to read the password file '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/conf/jmxremote.password'. It is possibly missing. 00:06:03.066 [main] DEBUG d.n.h.harvesting.HeritrixFiles - Writing order-file to disk as file: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/heritrix_out/order.xml 00:06:03.073 [main] INFO d.n.h.h.c.AbstractJMXHeritrixController - Starting Heritrix for job 42 of harvest 117 in target/test-output/heritrix_out 00:06:03.074 [main] WARN d.n.h.h.c.AbstractJMXHeritrixController - Failed to read the password file '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/conf/jmxremote.password'. It is possibly missing. Tests run: 15, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 0.783 sec - in dk.netarkivet.harvester.harvesting.HeritrixLauncherTester Running dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester 00:06:03.115 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.116 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.123 [main] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:03.127 [main] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:03.127 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.127 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.127 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.256 [main] INFO d.n.h.h.d.HarvestControllerServer - Starting HarvestControllerServer. 00:06:03.257 [main] INFO d.n.h.h.d.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 00:06:03.260 [main] WARN d.n.common.utils.ApplicationUtils - Non-existing directory created '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestControllerServerTester/testCreateServerDir/serverdir/server/server' 00:06:03.260 [main] INFO d.n.h.h.d.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestControllerServerTester/testCreateServerDir/serverdir/server/server' 00:06:03.260 [main] INFO d.n.h.h.d.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 00:06:03.275 [main] DEBUG d.n.h.h.d.HarvestControllerServer - Obtained JMS connection. 00:06:03.277 [main] DEBUG d.n.common.distribute.JMSConnection - Adding dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer@78365cfa as listener to DEV_COMMON_HCHAN_VAL_RESP 00:06:03.279 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ONE,TWO,THREE 00:06:03.308 [main] INFO d.n.h.h.d.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 00:06:03.309 [main] INFO d.n.h.h.d.HarvestControllerServer - Closing HarvestControllerServer. 00:06:03.309 [main] INFO d.n.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 00:06:03.309 [main] INFO d.n.h.h.d.HarvestControllerServer - Closed down HarvestControllerServer 00:06:03.310 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.327 [main] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:03.327 [main] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:03.328 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.328 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.328 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.338 [main] INFO d.n.h.h.d.HarvestControllerServer - Starting HarvestControllerServer. 00:06:03.338 [main] INFO d.n.h.h.d.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 00:06:03.339 [main] INFO d.n.h.h.d.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestControllerServerTester/testClose/serverdir' 00:06:03.339 [main] INFO d.n.h.h.d.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 00:06:03.340 [main] DEBUG d.n.h.h.d.HarvestControllerServer - Obtained JMS connection. 00:06:03.341 [main] DEBUG d.n.common.distribute.JMSConnection - Adding dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer@54d18072 as listener to DEV_COMMON_HCHAN_VAL_RESP 00:06:03.345 [main] INFO d.n.h.h.d.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 00:06:03.345 [main] INFO d.n.h.h.d.HarvestControllerServer - Closing HarvestControllerServer. 00:06:03.345 [main] INFO d.n.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 00:06:03.345 [main] INFO d.n.h.h.d.HarvestControllerServer - Closed down HarvestControllerServer 00:06:03.346 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.366 [main] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:03.366 [main] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:03.367 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.367 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.367 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.371 [main] INFO d.n.h.h.d.HarvestControllerServer - Starting HarvestControllerServer. 00:06:03.371 [main] INFO d.n.h.h.d.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 00:06:03.371 [main] INFO d.n.h.h.d.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestControllerServerTester/testIsSingleton' 00:06:03.372 [main] INFO d.n.h.h.d.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 00:06:03.373 [main] DEBUG d.n.h.h.d.HarvestControllerServer - Obtained JMS connection. 00:06:03.375 [main] DEBUG d.n.common.distribute.JMSConnection - Adding dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer@bf1ec20 as listener to DEV_COMMON_HCHAN_VAL_RESP 00:06:03.396 [main] INFO d.n.h.h.d.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 00:06:03.397 [main] INFO d.n.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 00:06:03.397 [main] INFO d.n.h.h.d.HarvestControllerServer - Closing HarvestControllerServer. 00:06:03.397 [main] INFO d.n.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 00:06:03.397 [main] INFO d.n.h.h.d.HarvestControllerServer - Closed down HarvestControllerServer 00:06:03.397 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.439 [main] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:03.440 [main] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:03.440 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.440 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.441 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:03.444 [main] INFO d.n.h.h.d.HarvestControllerServer - Starting HarvestControllerServer. 00:06:03.445 [main] INFO d.n.h.h.d.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 00:06:03.445 [main] INFO d.n.h.h.d.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestControllerServerTester/testMessagesSentByFailedJob/serverdir' 00:06:03.445 [main] INFO d.n.h.h.d.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 00:06:03.447 [main] DEBUG d.n.h.h.d.HarvestControllerServer - Obtained JMS connection. 00:06:03.449 [main] DEBUG d.n.common.distribute.JMSConnection - Adding dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer@4e858e0a as listener to DEV_COMMON_HCHAN_VAL_RESP 00:06:03.453 [main] INFO d.n.h.h.d.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 00:06:04.406 [main] DEBUG d.n.h.datamodel.H1HeritrixTemplate - WARC format selected to be used by Heritrix 00:06:04.608 [main] WARN d.n.h.datamodel.H1HeritrixTemplate - No attribute insertion is done for H1 templates 00:06:04.608 [main] DEBUG d.n.h.datamodel.H1HeritrixTemplate - In H1 templates we don't enable/disable deduplication. 00:06:04.611 [main] DEBUG d.n.common.distribute.JMSConnection - Adding dk.netarkivet.harvester.harvesting.distribute.CrawlStatusMessageListener@7927bd9f as listener to DEV_COMMON_THE_SCHED 00:06:04.611 [main] DEBUG d.n.h.h.d.HarvestControllerServer - No longer accepting jobs. 00:06:04.612 [main] INFO d.n.h.h.d.HarvestControllerServer - Received crawlrequest for job 1: 'UNIQUE_ID: To DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_NA ReplyTo DEV_COMMON_ERROR OK Job: Job 1 (state = DONE, HD = 1, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = 1000000000, forcemaxrunningtime = -1, orderxml = FullSite-order, numconfigs = 1, created = null), metadata: []' 00:06:04.613 [main] WARN d.n.h.h.d.HarvestControllerServer - Message 'UNIQUE_ID: To DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_NA ReplyTo DEV_COMMON_ERROR OK Job: Job 1 (state = DONE, HD = 1, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = 1000000000, forcemaxrunningtime = -1, orderxml = FullSite-order, numconfigs = 1, created = null), metadata: []' arrived with status DONE for job 1, should have been STATUS_SUBMITTED 00:06:04.615 [main] WARN d.n.h.d.HarvesterMessageHandler - Error processing message 'TestObjectMessage: UNIQUE_ID: To DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_NA ReplyTo DEV_COMMON_ERROR OK Job: Job 1 (state = DONE, HD = 1, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = 1000000000, forcemaxrunningtime = -1, orderxml = FullSite-order, numconfigs = 1, created = null), metadata: []' dk.netarkivet.common.exceptions.ArgumentNotValid: Message 'UNIQUE_ID: To DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_NA ReplyTo DEV_COMMON_ERROR OK Job: Job 1 (state = DONE, HD = 1, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = 1000000000, forcemaxrunningtime = -1, orderxml = FullSite-order, numconfigs = 1, created = null), metadata: []' arrived with status DONE for job 1, should have been STATUS_SUBMITTED at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.onDoOneCrawl(HarvestControllerServer.java:361) ~[classes/:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.visit(HarvestControllerServer.java:486) ~[classes/:na] at dk.netarkivet.harvester.harvesting.distribute.DoOneCrawlMessage.accept(DoOneCrawlMessage.java:101) ~[harvester-core-5.3-SNAPSHOT.jar:na] at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.onMessage(HarvesterMessageHandler.java:69) ~[harvester-core-5.3-SNAPSHOT.jar:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester.testMessagesSentByFailedJob(HarvestControllerServerTester.java:211) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:04.618 [main] INFO d.n.h.h.d.HarvestControllerServer - Closing HarvestControllerServer. 00:06:04.618 [main] INFO d.n.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 00:06:04.618 [main] INFO d.n.h.h.d.HarvestControllerServer - Closed down HarvestControllerServer 00:06:04.618 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.666 [main] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:04.666 [main] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:04.667 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.667 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.667 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.678 [main] INFO d.n.h.h.d.HarvestControllerServer - Starting HarvestControllerServer. 00:06:04.679 [main] INFO d.n.h.h.d.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 00:06:04.679 [main] INFO d.n.h.h.d.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestControllerServerTester/testServerStarting/serverdir' 00:06:04.679 [main] INFO d.n.h.h.d.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 00:06:04.686 [main] DEBUG d.n.h.h.d.HarvestControllerServer - Obtained JMS connection. 00:06:04.687 [main] DEBUG d.n.common.distribute.JMSConnection - Adding dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer@6970140a as listener to DEV_COMMON_HCHAN_VAL_RESP 00:06:04.692 [main] INFO d.n.h.h.d.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 00:06:04.692 [main] INFO d.n.h.h.d.HarvestControllerServer - Closing HarvestControllerServer. 00:06:04.693 [main] INFO d.n.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 00:06:04.693 [main] INFO d.n.h.h.d.HarvestControllerServer - Closed down HarvestControllerServer 00:06:04.693 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.733 [main] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:04.734 [main] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:04.735 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.735 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.735 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.737 [main] DEBUG d.n.common.distribute.JMSConnection - Adding dk.netarkivet.testutils.GenericMessageListener@5b800468 as listener to DEV_COMMON_THE_SCHED 00:06:04.738 [main] INFO d.n.h.h.d.HarvestControllerServer - Starting HarvestControllerServer. 00:06:04.738 [main] INFO d.n.h.h.d.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 00:06:04.738 [main] INFO d.n.h.h.d.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestControllerServerTester/testJobFailedOnBadMessage' 00:06:04.740 [main] INFO d.n.h.h.d.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 00:06:04.740 [main] DEBUG d.n.h.h.d.HarvestControllerServer - Obtained JMS connection. 00:06:04.741 [main] DEBUG d.n.common.distribute.JMSConnection - Adding dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer@2e185cd7 as listener to DEV_COMMON_HCHAN_VAL_RESP 00:06:04.745 [main] INFO d.n.h.h.d.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 00:06:04.856 [main] DEBUG d.n.h.datamodel.H1HeritrixTemplate - WARC format selected to be used by Heritrix 00:06:04.878 [main] WARN d.n.h.datamodel.H1HeritrixTemplate - No attribute insertion is done for H1 templates 00:06:04.879 [main] DEBUG d.n.h.datamodel.H1HeritrixTemplate - In H1 templates we don't enable/disable deduplication. 00:06:04.880 [main] DEBUG d.n.h.h.d.HarvestControllerServer - No longer accepting jobs. 00:06:04.881 [main] INFO d.n.h.h.d.HarvestControllerServer - Received crawlrequest for job 42: 'id1: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Job 42 (state = DONE, HD = 1, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = 1000000000, forcemaxrunningtime = -1, orderxml = FullSite-order, numconfigs = 1, created = null), metadata: []' 00:06:04.882 [main] WARN d.n.h.h.d.HarvestControllerServer - Message 'id1: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Job 42 (state = DONE, HD = 1, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = 1000000000, forcemaxrunningtime = -1, orderxml = FullSite-order, numconfigs = 1, created = null), metadata: []' arrived with status DONE for job 42, should have been STATUS_SUBMITTED 00:06:04.884 [main] WARN d.n.h.d.HarvesterMessageHandler - Error processing message 'TestObjectMessage: id1: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Job 42 (state = DONE, HD = 1, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = 1000000000, forcemaxrunningtime = -1, orderxml = FullSite-order, numconfigs = 1, created = null), metadata: []' dk.netarkivet.common.exceptions.ArgumentNotValid: Message 'id1: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Job 42 (state = DONE, HD = 1, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = 1000000000, forcemaxrunningtime = -1, orderxml = FullSite-order, numconfigs = 1, created = null), metadata: []' arrived with status DONE for job 42, should have been STATUS_SUBMITTED at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.onDoOneCrawl(HarvestControllerServer.java:361) ~[classes/:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.visit(HarvestControllerServer.java:486) ~[classes/:na] at dk.netarkivet.harvester.harvesting.distribute.DoOneCrawlMessage.accept(DoOneCrawlMessage.java:101) ~[harvester-core-5.3-SNAPSHOT.jar:na] at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.onMessage(HarvesterMessageHandler.java:69) ~[harvester-core-5.3-SNAPSHOT.jar:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester.testJobFailedOnBadMessage(HarvestControllerServerTester.java:266) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:04.885 [main] INFO d.n.h.h.d.HarvestControllerServer - Closing HarvestControllerServer. 00:06:04.885 [main] INFO d.n.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 00:06:04.885 [main] INFO d.n.h.h.d.HarvestControllerServer - Closed down HarvestControllerServer 00:06:04.885 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.923 [main] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:04.923 [main] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:04.923 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.923 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.924 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.925 [main] INFO d.n.h.h.d.HarvestControllerServer - Starting HarvestControllerServer. 00:06:04.926 [main] INFO d.n.h.h.d.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 00:06:04.928 [main] INFO d.n.h.h.d.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestControllerServerTester/testBug852' 00:06:04.929 [main] INFO d.n.h.h.d.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 00:06:04.930 [main] DEBUG d.n.h.h.d.HarvestControllerServer - Obtained JMS connection. 00:06:04.935 [main] DEBUG d.n.common.distribute.JMSConnection - Adding dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer@39ab59f8 as listener to DEV_COMMON_HCHAN_VAL_RESP 00:06:04.947 [main] INFO d.n.h.h.d.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 00:06:04.948 [main] INFO d.n.h.h.d.HarvestControllerServer - Closing HarvestControllerServer. 00:06:04.948 [main] INFO d.n.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 00:06:04.948 [main] INFO d.n.h.h.d.HarvestControllerServer - Closed down HarvestControllerServer 00:06:04.948 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.969 [main] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:04.970 [main] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:04.970 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.970 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.970 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:04.975 [main] INFO d.n.h.h.d.HarvestControllerServer - Starting HarvestControllerServer. 00:06:04.976 [main] INFO d.n.h.h.d.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 00:06:05.299 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ Tests run: 11, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 2.225 sec - in dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester Running dk.netarkivet.harvester.harvesting.IngestableFilesTester Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.326 sec - in dk.netarkivet.harvester.harvesting.IngestableFilesTester Running dk.netarkivet.harvester.harvesting.HeritrixControllerFactoryTester class dk.netarkivet.harvester.harvesting.HeritrixControllerFactoryTester$DummyHeritrixController Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.143 sec - in dk.netarkivet.harvester.harvesting.HeritrixControllerFactoryTester Running dk.netarkivet.harvester.harvesting.HarvestDocumentationTester 00:06:05.835 [main] DEBUG d.n.h.h.HarvestDocumentation - Creating an arcfiles-report.txt 00:06:05.839 [main] ERROR d.n.h.h.ArchiveFilesReportGenerator - java.io.FileNotFoundException: target/test-output/HarvestDocumentationTester/testDocumentHarvestBug722/heritrix.out (No such file or directory) at java.io.FileInputStream.open(Native Method) ~[na:1.8.0_11] at java.io.FileInputStream.<init>(FileInputStream.java:131) ~[na:1.8.0_11] at java.io.FileReader.<init>(FileReader.java:72) ~[na:1.8.0_11] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.parseHeritrixOut(ArchiveFilesReportGenerator.java:232) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.generateReport(ArchiveFilesReportGenerator.java:173) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.writeHarvestDetails(HarvestDocumentation.java:289) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:134) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testDocumentHarvestBug722(HarvestDocumentationTester.java:427) [test-classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:05.841 [main] DEBUG d.n.h.h.HarvestDocumentation - No logs dir found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestBug722 00:06:05.841 [main] DEBUG d.n.h.h.HarvestDocumentation - No settings directory found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestBug722 00:06:05.841 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testDocumentHarvestBug722/archivefiles-report.txt' to ARC file: 39 00:06:05.842 [main] INFO d.n.h.h.HarvestDocumentation - Looking for files not having harvestprefix '42-142' 00:06:05.843 [main] INFO d.n.h.h.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestBug722/arcs/42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc 00:06:05.846 [main] INFO d.n.h.h.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestBug722/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc 00:06:05.846 [main] WARN d.n.h.h.HarvestDocumentation - Found files not belonging to job 42, the following files have been stored for later: [oldjobs/lost-files-1486854365842/42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc, oldjobs/lost-files-1486854365842/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc] 00:06:05.848 [main] WARN d.n.common.utils.cdx.CDXUtils - Found no related arcfiles to process in the archive dir '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestBug722/arcs'. 00:06:05.848 [main] DEBUG d.n.h.h.metadata.MetadataFileWriter - Now inserting 0 files from /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestBug722/tmp-meta/cdx3038311383490427520.tmp'. 00:06:05.856 [main] WARN d.n.h.h.HarvestDocumentation - The metadata-file '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestBug722/metadata/42-metadata-1.arc' already exists, so we don't make another one! 00:06:05.859 [main] WARN dk.netarkivet.common.utils.FileUtils - Could not create directory '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/src/test/resources/originals/order.xml/metadata' 00:06:05.879 [main] INFO d.n.h.h.HarvestDocumentation - Looking for files not having harvestprefix '42-117' 00:06:05.879 [main] INFO d.n.h.h.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testMoveAwayForeignFiles/arcs/43-117-20051212141241-00000-sb-test-har-001.statsbiblioteket.dk.arc 00:06:05.880 [main] INFO d.n.h.h.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testMoveAwayForeignFiles/arcs/43-metadata-1.arc 00:06:05.880 [main] WARN d.n.h.h.HarvestDocumentation - Found files not belonging to job 42, the following files have been stored for later: [/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testMoveAwayForeignFiles/oddjobs/lost-files-1486854365879/43-117-20051212141241-00000-sb-test-har-001.statsbiblioteket.dk.arc, /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testMoveAwayForeignFiles/oddjobs/lost-files-1486854365879/43-metadata-1.arc] Locating lost-files directory /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testMoveAwayForeignFiles/oddjobs/lost-files-1486854365879 00:06:05.895 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Found 2 related arcfiles to process in the archive dir '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/src/test/resources/crawldir/arcs/realistically-named-arcs/arcs'. 00:06:05.897 [main] INFO d.n.c.utils.batch.BatchLocalFiles - The batchjob 'class dk.netarkivet.common.utils.cdx.ArchiveExtractCDXJob' has run for 0 seconds and has reached file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc', which is number 1 out of 1 00:06:05.897 [main] INFO d.n.c.utils.archive.ArchiveBatchJob - Processing archive file: 42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc 00:06:05.925 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Starting processing records in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:05.937 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:05.940 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:05.940 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #2 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:05.944 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #3 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:05.944 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #4 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:05.963 [main] DEBUG httpclient.wire.header - << "[\n]" 00:06:05.964 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #5 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:05.966 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #6 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:05.968 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #7 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. WARNING Premature EOF before end-of-record: {subject-uri=/www.pligtaflevering.dk/robots.txt, ip-address=130.226.231.6, length=476, absolute-offset=3140, creation-date=20051214154356, content-type=text/html, version=1.1} 00:06:05.969 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Created index of 8 records on file 'src/test/resources/crawldir/arcs/realistically-named-arcs/arcs/42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc' 00:06:05.972 [main] INFO d.n.c.utils.batch.BatchLocalFiles - The batchjob 'class dk.netarkivet.common.utils.cdx.ArchiveExtractCDXJob' has run for 0 seconds and has reached file '42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc', which is number 1 out of 1 00:06:05.973 [main] INFO d.n.c.utils.archive.ArchiveBatchJob - Processing archive file: 42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc 00:06:05.973 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Starting processing records in archive file '42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc'. Feb 12, 2017 12:06:05 AM org.archive.io.ArchiveReader$ArchiveRecordIterator next WARNING: Bad Record. Trying skip (Current offset 150): Failed parse of http status line. (Offset 150). 00:06:06.011 [main] DEBUG d.n.c.u.archive.ArchiveBatchJobBase - Caught exception while running batch job on file src/test/resources/crawldir/arcs/realistically-named-arcs/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc, position 0: java.lang.RuntimeException: After retry (Offset 150) 00:06:06.014 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Exceptions during generation of index on file 'src/test/resources/crawldir/arcs/realistically-named-arcs/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc': java.lang.RuntimeException: After retry (Offset 150) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:535) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:461) at dk.netarkivet.common.utils.archive.ArchiveBatchJob.processFile(ArchiveBatchJob.java:108) at dk.netarkivet.common.utils.batch.BatchLocalFiles.processFile(BatchLocalFiles.java:156) at dk.netarkivet.common.utils.batch.BatchLocalFiles.run(BatchLocalFiles.java:105) at dk.netarkivet.common.utils.cdx.CDXUtils.writeCDXInfo(CDXUtils.java:60) at dk.netarkivet.common.utils.cdx.CDXUtils.generateCDX(CDXUtils.java:114) at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testGenerateCDX(HarvestDocumentationTester.java:329) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) Caused by: java.io.IOException: Unparseable header line: [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] at org.archive.io.arc.ARCReader.getTokenizedHeaderLine(ARCReader.java:308) at org.archive.io.arc.ARCReader.createArchiveRecord(ARCReader.java:183) at org.archive.io.arc.ARCReader.createArchiveRecord(ARCReader.java:77) at org.archive.io.ArchiveReader.get(ArchiveReader.java:151) at org.archive.io.ArchiveReader$ArchiveRecordIterator.innerNext(ArchiveReader.java:585) at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:560) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:528) ... 33 more 00:06:06.014 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Created index of 0 records on file 'src/test/resources/crawldir/arcs/realistically-named-arcs/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc' 00:06:06.014 [main] INFO d.n.c.utils.batch.BatchLocalFiles - The batchjob 'class dk.netarkivet.common.utils.cdx.ArchiveExtractCDXJob' has run for 0 seconds and has reached file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc', which is number 1 out of 1 00:06:06.015 [main] INFO d.n.c.utils.archive.ArchiveBatchJob - Processing archive file: 42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc 00:06:06.015 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Starting processing records in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.017 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.023 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.023 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #2 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.024 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #3 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.024 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #4 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.025 [main] DEBUG httpclient.wire.header - << "[\n]" 00:06:06.025 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #5 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.026 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #6 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.026 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #7 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. WARNING Premature EOF before end-of-record: {subject-uri=/www.pligtaflevering.dk/robots.txt, ip-address=130.226.231.6, length=476, absolute-offset=3140, creation-date=20051214154356, content-type=text/html, version=1.1} 00:06:06.028 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Created index of 8 records on file 'src/test/resources/crawldir/arcs/realistically-named-arcs/arcs/42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc' 00:06:06.077 [main] INFO d.n.c.utils.batch.BatchLocalFiles - The batchjob 'class dk.netarkivet.common.utils.cdx.ArchiveExtractCDXJob' has run for 0 seconds and has reached file '42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc', which is number 1 out of 1 00:06:06.078 [main] INFO d.n.c.utils.archive.ArchiveBatchJob - Processing archive file: 42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc 00:06:06.078 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Starting processing records in archive file '42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc'. Feb 12, 2017 12:06:06 AM org.archive.io.ArchiveReader$ArchiveRecordIterator next WARNING: Bad Record. Trying skip (Current offset 150): Failed parse of http status line. (Offset 150). 00:06:06.083 [main] DEBUG d.n.c.u.archive.ArchiveBatchJobBase - Caught exception while running batch job on file src/test/resources/crawldir/arcs/realistically-named-arcs/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc, position 0: java.lang.RuntimeException: After retry (Offset 150) 00:06:06.084 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Exceptions during generation of index on file 'src/test/resources/crawldir/arcs/realistically-named-arcs/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc': java.lang.RuntimeException: After retry (Offset 150) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:535) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:461) at dk.netarkivet.common.utils.archive.ArchiveBatchJob.processFile(ArchiveBatchJob.java:108) at dk.netarkivet.common.utils.batch.BatchLocalFiles.processFile(BatchLocalFiles.java:156) at dk.netarkivet.common.utils.batch.BatchLocalFiles.run(BatchLocalFiles.java:105) at dk.netarkivet.common.utils.cdx.CDXUtils.writeCDXInfo(CDXUtils.java:60) at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testGenerateCDX(HarvestDocumentationTester.java:339) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) Caused by: java.io.IOException: Unparseable header line: [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] at org.archive.io.arc.ARCReader.getTokenizedHeaderLine(ARCReader.java:308) at org.archive.io.arc.ARCReader.createArchiveRecord(ARCReader.java:183) at org.archive.io.arc.ARCReader.createArchiveRecord(ARCReader.java:77) at org.archive.io.ArchiveReader.get(ArchiveReader.java:151) at org.archive.io.ArchiveReader$ArchiveRecordIterator.innerNext(ArchiveReader.java:585) at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:560) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:528) ... 32 more 00:06:06.085 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Created index of 0 records on file 'src/test/resources/crawldir/arcs/realistically-named-arcs/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc' 00:06:06.128 [main] DEBUG d.n.h.h.HarvestDocumentation - Creating an arcfiles-report.txt 00:06:06.129 [main] ERROR d.n.h.h.ArchiveFilesReportGenerator - java.io.FileNotFoundException: target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/heritrix.out (No such file or directory) at java.io.FileInputStream.open(Native Method) ~[na:1.8.0_11] at java.io.FileInputStream.<init>(FileInputStream.java:131) ~[na:1.8.0_11] at java.io.FileReader.<init>(FileReader.java:72) ~[na:1.8.0_11] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.parseHeritrixOut(ArchiveFilesReportGenerator.java:232) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.generateReport(ArchiveFilesReportGenerator.java:173) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.writeHarvestDetails(HarvestDocumentation.java:289) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:134) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testWriteHarvestDetails(HarvestDocumentationTester.java:460) [test-classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:06.135 [main] INFO d.n.h.h.HarvestDocumentation - Found Heritrix log file progress-statistics.log 00:06:06.136 [main] INFO d.n.h.h.HarvestDocumentation - Found Heritrix log file local-errors.log 00:06:06.136 [main] INFO d.n.h.h.HarvestDocumentation - Found Heritrix log file crawl.log 00:06:06.136 [main] INFO d.n.h.h.HarvestDocumentation - Found Heritrix log file runtime-errors.log 00:06:06.137 [main] INFO d.n.h.h.HarvestDocumentation - Found Heritrix log file uri-errors.log 00:06:06.138 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/crawl-manifest.txt' to ARC file: 1079 00:06:06.138 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/harvestInfo.xml' to ARC file: 635 00:06:06.138 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/order.xml' to ARC file: 10426 00:06:06.139 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/seeds.txt' to ARC file: 41 00:06:06.139 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/settings/dk/kb/settings.xml' to ARC file: 406 00:06:06.140 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/archivefiles-report.txt' to ARC file: 39 00:06:06.140 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/crawl-report.txt' to ARC file: 310 00:06:06.141 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/hosts-report.txt' to ARC file: 207 00:06:06.142 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/mimetype-report.txt' to ARC file: 510 00:06:06.143 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/processors-report.txt' to ARC file: 1105 00:06:06.143 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/responsecode-report.txt' to ARC file: 96 00:06:06.143 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/seeds-report.txt' to ARC file: 136 00:06:06.144 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/logs/crawl.log' to ARC file: 14863 00:06:06.145 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/logs/local-errors.log' to ARC file: 2121 00:06:06.145 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/logs/progress-statistics.log' to ARC file: 821 00:06:06.145 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/logs/runtime-errors.log' to ARC file: 0 00:06:06.146 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/logs/uri-errors.log' to ARC file: 2827 00:06:06.147 [main] INFO d.n.h.h.HarvestDocumentation - Looking for files not having harvestprefix '42-142' 00:06:06.147 [main] INFO d.n.h.h.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/arcs/NetarchiveSuite-netarkivet.arc.gz 00:06:06.149 [main] WARN d.n.h.h.HarvestDocumentation - Found files not belonging to job 42, the following files have been stored for later: [oldjobs/lost-files-1486854366147/NetarchiveSuite-netarkivet.arc.gz] 00:06:06.149 [main] WARN d.n.common.utils.cdx.CDXUtils - Found no related arcfiles to process in the archive dir '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/arcs'. 00:06:06.150 [main] DEBUG d.n.h.h.metadata.MetadataFileWriter - Now inserting 0 files from /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testWriteHarvestDetails/tmp-meta/cdx5899481038831033902.tmp'. 00:06:06.201 [main] DEBUG d.n.h.h.HarvestDocumentation - Creating an arcfiles-report.txt 00:06:06.203 [main] ERROR d.n.h.h.ArchiveFilesReportGenerator - java.io.FileNotFoundException: target/test-output/HarvestDocumentationTester/testDocumentHarvestExceptionalCases/heritrix.out (No such file or directory) at java.io.FileInputStream.open(Native Method) ~[na:1.8.0_11] at java.io.FileInputStream.<init>(FileInputStream.java:131) ~[na:1.8.0_11] at java.io.FileReader.<init>(FileReader.java:72) ~[na:1.8.0_11] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.parseHeritrixOut(ArchiveFilesReportGenerator.java:232) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.generateReport(ArchiveFilesReportGenerator.java:173) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.writeHarvestDetails(HarvestDocumentation.java:289) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:134) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testDocumentHarvestExceptionalCases(HarvestDocumentationTester.java:202) [test-classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:06.205 [main] DEBUG d.n.h.h.HarvestDocumentation - No logs dir found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestExceptionalCases 00:06:06.205 [main] DEBUG d.n.h.h.HarvestDocumentation - No settings directory found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestExceptionalCases 00:06:06.205 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testDocumentHarvestExceptionalCases/archivefiles-report.txt' to ARC file: 39 00:06:06.206 [main] INFO d.n.h.h.HarvestDocumentation - Looking for files not having harvestprefix '42-117' 00:06:06.206 [main] INFO d.n.h.h.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestExceptionalCases/arcs/43-117-20051212141241-00000-sb-test-har-001.statsbiblioteket.dk.arc 00:06:06.216 [main] WARN d.n.h.h.HarvestDocumentation - Found files not belonging to job 42, the following files have been stored for later: [oldjobs/lost-files-1486854366206/43-117-20051212141241-00000-sb-test-har-001.statsbiblioteket.dk.arc] 00:06:06.217 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Found 1 related arcfiles to process in the archive dir '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestExceptionalCases/arcs'. 00:06:06.218 [main] INFO d.n.c.utils.batch.BatchLocalFiles - The batchjob 'class dk.netarkivet.common.utils.cdx.ArchiveExtractCDXJob' has run for 0 seconds and has reached file '42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc', which is number 1 out of 1 00:06:06.218 [main] INFO d.n.c.utils.archive.ArchiveBatchJob - Processing archive file: 42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc 00:06:06.218 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Starting processing records in archive file '42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc'. Feb 12, 2017 12:06:06 AM org.archive.io.ArchiveReader$ArchiveRecordIterator next WARNING: Bad Record. Trying skip (Current offset 150): Failed parse of http status line. (Offset 150). 00:06:06.219 [main] DEBUG d.n.c.u.archive.ArchiveBatchJobBase - Caught exception while running batch job on file target/test-output/HarvestDocumentationTester/testDocumentHarvestExceptionalCases/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc, position 0: java.lang.RuntimeException: After retry (Offset 150) 00:06:06.222 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Exceptions during generation of index on file 'target/test-output/HarvestDocumentationTester/testDocumentHarvestExceptionalCases/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc': java.lang.RuntimeException: After retry (Offset 150) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:535) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:461) at dk.netarkivet.common.utils.archive.ArchiveBatchJob.processFile(ArchiveBatchJob.java:108) at dk.netarkivet.common.utils.batch.BatchLocalFiles.processFile(BatchLocalFiles.java:156) at dk.netarkivet.common.utils.batch.BatchLocalFiles.run(BatchLocalFiles.java:105) at dk.netarkivet.common.utils.cdx.CDXUtils.writeCDXInfo(CDXUtils.java:60) at dk.netarkivet.common.utils.cdx.CDXUtils.generateCDX(CDXUtils.java:114) at dk.netarkivet.harvester.harvesting.HarvestDocumentation.addCDXes(HarvestDocumentation.java:195) at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:160) at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testDocumentHarvestExceptionalCases(HarvestDocumentationTester.java:202) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) Caused by: java.io.IOException: Unparseable header line: [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] at org.archive.io.arc.ARCReader.getTokenizedHeaderLine(ARCReader.java:308) at org.archive.io.arc.ARCReader.createArchiveRecord(ARCReader.java:183) at org.archive.io.arc.ARCReader.createArchiveRecord(ARCReader.java:77) at org.archive.io.ArchiveReader.get(ArchiveReader.java:151) at org.archive.io.ArchiveReader$ArchiveRecordIterator.innerNext(ArchiveReader.java:585) at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:560) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:528) ... 35 more 00:06:06.223 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Created index of 0 records on file 'target/test-output/HarvestDocumentationTester/testDocumentHarvestExceptionalCases/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc' 00:06:06.223 [main] DEBUG d.n.h.h.metadata.MetadataFileWriter - Now inserting 1 files from /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestExceptionalCases/tmp-meta/cdx9174977076250634352.tmp'. 00:06:06.223 [main] DEBUG d.n.h.h.metadata.MetadataFileWriter - Inserting the file '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestExceptionalCases/tmp-meta/cdx9174977076250634352.tmp/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc.cdx' 00:06:06.223 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testDocumentHarvestExceptionalCases/tmp-meta/cdx9174977076250634352.tmp/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc.cdx' to ARC file: 0 00:06:06.273 [main] DEBUG d.n.h.h.HarvestDocumentation - Creating an arcfiles-report.txt 00:06:06.276 [main] ERROR d.n.h.h.ArchiveFilesReportGenerator - java.io.FileNotFoundException: target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase/heritrix.out (No such file or directory) at java.io.FileInputStream.open(Native Method) ~[na:1.8.0_11] at java.io.FileInputStream.<init>(FileInputStream.java:131) ~[na:1.8.0_11] at java.io.FileReader.<init>(FileReader.java:72) ~[na:1.8.0_11] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.parseHeritrixOut(ArchiveFilesReportGenerator.java:232) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.generateReport(ArchiveFilesReportGenerator.java:173) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.writeHarvestDetails(HarvestDocumentation.java:289) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:134) [classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testDocumentHarvestOrdinaryCase(HarvestDocumentationTester.java:130) [test-classes/:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.11.jar:na] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 00:06:06.277 [main] DEBUG d.n.h.h.HarvestDocumentation - No logs dir found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase 00:06:06.277 [main] DEBUG d.n.h.h.HarvestDocumentation - No settings directory found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase 00:06:06.278 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase/archivefiles-report.txt' to ARC file: 39 00:06:06.278 [main] INFO d.n.h.h.HarvestDocumentation - Looking for files not having harvestprefix '42-117' 00:06:06.279 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Found 2 related arcfiles to process in the archive dir '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase/arcs'. 00:06:06.279 [main] INFO d.n.c.utils.batch.BatchLocalFiles - The batchjob 'class dk.netarkivet.common.utils.cdx.ArchiveExtractCDXJob' has run for 0 seconds and has reached file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc', which is number 1 out of 1 00:06:06.279 [main] INFO d.n.c.utils.archive.ArchiveBatchJob - Processing archive file: 42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc 00:06:06.280 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Starting processing records in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.284 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.289 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.289 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #2 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.291 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #3 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.291 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #4 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.291 [main] DEBUG httpclient.wire.header - << "[\n]" 00:06:06.291 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #5 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.293 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #6 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 00:06:06.294 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Processing record #7 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. WARNING Premature EOF before end-of-record: {subject-uri=/www.pligtaflevering.dk/robots.txt, ip-address=130.226.231.6, length=476, absolute-offset=3140, creation-date=20051214154356, content-type=text/html, version=1.1} 00:06:06.294 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Created index of 8 records on file 'target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase/arcs/42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc' 00:06:06.295 [main] INFO d.n.c.utils.batch.BatchLocalFiles - The batchjob 'class dk.netarkivet.common.utils.cdx.ArchiveExtractCDXJob' has run for 0 seconds and has reached file '42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc', which is number 1 out of 1 00:06:06.296 [main] INFO d.n.c.utils.archive.ArchiveBatchJob - Processing archive file: 42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc 00:06:06.297 [main] DEBUG d.n.c.utils.archive.ArchiveBatchJob - Starting processing records in archive file '42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc'. Feb 12, 2017 12:06:06 AM org.archive.io.ArchiveReader$ArchiveRecordIterator next WARNING: Bad Record. Trying skip (Current offset 150): Failed parse of http status line. (Offset 150). 00:06:06.299 [main] DEBUG d.n.c.u.archive.ArchiveBatchJobBase - Caught exception while running batch job on file target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc, position 0: java.lang.RuntimeException: After retry (Offset 150) 00:06:06.310 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Exceptions during generation of index on file 'target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc': java.lang.RuntimeException: After retry (Offset 150) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:535) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:461) at dk.netarkivet.common.utils.archive.ArchiveBatchJob.processFile(ArchiveBatchJob.java:108) at dk.netarkivet.common.utils.batch.BatchLocalFiles.processFile(BatchLocalFiles.java:156) at dk.netarkivet.common.utils.batch.BatchLocalFiles.run(BatchLocalFiles.java:105) at dk.netarkivet.common.utils.cdx.CDXUtils.writeCDXInfo(CDXUtils.java:60) at dk.netarkivet.common.utils.cdx.CDXUtils.generateCDX(CDXUtils.java:114) at dk.netarkivet.harvester.harvesting.HarvestDocumentation.addCDXes(HarvestDocumentation.java:195) at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:160) at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testDocumentHarvestOrdinaryCase(HarvestDocumentationTester.java:130) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) Caused by: java.io.IOException: Unparseable header line: [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] at org.archive.io.arc.ARCReader.getTokenizedHeaderLine(ARCReader.java:308) at org.archive.io.arc.ARCReader.createArchiveRecord(ARCReader.java:183) at org.archive.io.arc.ARCReader.createArchiveRecord(ARCReader.java:77) at org.archive.io.ArchiveReader.get(ArchiveReader.java:151) at org.archive.io.ArchiveReader$ArchiveRecordIterator.innerNext(ArchiveReader.java:585) at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:560) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:528) ... 35 more 00:06:06.311 [main] DEBUG d.n.common.utils.cdx.CDXUtils - Created index of 0 records on file 'target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc' 00:06:06.311 [main] DEBUG d.n.h.h.metadata.MetadataFileWriter - Now inserting 2 files from /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase/tmp-meta/cdx3682945808025424605.tmp'. 00:06:06.311 [main] DEBUG d.n.h.h.metadata.MetadataFileWriter - Inserting the file '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase/tmp-meta/cdx3682945808025424605.tmp/42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc.cdx' 00:06:06.311 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase/tmp-meta/cdx3682945808025424605.tmp/42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc.cdx' to ARC file: 1287 00:06:06.312 [main] DEBUG d.n.h.h.metadata.MetadataFileWriter - Inserting the file '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase/tmp-meta/cdx3682945808025424605.tmp/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc.cdx' 00:06:06.312 [main] INFO d.n.h.h.m.MetadataFileWriterArc - Writing file 'target/test-output/HarvestDocumentationTester/testDocumentHarvestOrdinaryCase/tmp-meta/cdx3682945808025424605.tmp/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc.cdx' to ARC file: 0 Tests run: 18, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.555 sec - in dk.netarkivet.harvester.harvesting.HarvestDocumentationTester Running dk.netarkivet.harvester.harvesting.HarvestControllerTester 00:06:06.342 [main] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.342 [main] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.343 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.343 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.343 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.361 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.372 [main] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.372 [main] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.372 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.372 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.372 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.379 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.386 [main] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.386 [main] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.387 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.387 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.387 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.393 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.400 [main] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.400 [main] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.401 [main] INFO d.n.c.d.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.401 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.401 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.459 [main] DEBUG d.n.h.datamodel.H1HeritrixTemplate - WARC format selected to be used by Heritrix 00:06:06.494 [main] WARN d.n.h.datamodel.H1HeritrixTemplate - No attribute insertion is done for H1 templates 00:06:06.494 [main] DEBUG d.n.h.datamodel.H1HeritrixTemplate - In H1 templates we don't enable/disable deduplication. 00:06:06.507 [main] INFO d.n.a.a.d.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 300000 milliseconds. 00:06:06.508 [main] DEBUG d.n.common.distribute.JMSConnection - Adding dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient@42b21d99 as listener to DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_NA 00:06:06.508 [main] INFO d.n.a.a.d.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_NA']' 00:06:06.509 [main] DEBUG d.n.common.distribute.JMSConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionMockupMQ Tests run: 6, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.184 sec - in dk.netarkivet.harvester.harvesting.HarvestControllerTester Running dk.netarkivet.harvester.harvesting.ArchiveFilesReportGeneratorTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in dk.netarkivet.harvester.harvesting.ArchiveFilesReportGeneratorTest Running dk.netarkivet.harvester.tools.CreateCDXMetadataFileTester Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 0.005 sec - in dk.netarkivet.harvester.tools.CreateCDXMetadataFileTester Running dk.netarkivet.externalsoftware.HeritrixTests Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0 sec - in dk.netarkivet.externalsoftware.HeritrixTests Running dk.netarkivet.externalsoftware.Heritrix1ConstantsTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec - in dk.netarkivet.externalsoftware.Heritrix1ConstantsTester 00:06:06.556 [Thread-23] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.557 [Thread-23] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.557 [Thread-11] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.557 [Thread-11] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.558 [Thread-10] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.559 [Thread-7] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.559 [Thread-7] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.559 [Thread-8] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.559 [Thread-1] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.559 [Thread-1] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.560 [Thread-2] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.560 [Thread-4] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.560 [Thread-4] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.561 [Thread-15] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.561 [Thread-15] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.561 [Thread-36] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.561 [Thread-36] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.565 [Thread-41] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.565 [Thread-41] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.565 [Thread-18] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.566 [Thread-18] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.566 [Thread-23] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.566 [Thread-30] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.566 [Thread-30] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.565 [Thread-39] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.567 [Thread-34] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.567 [Thread-34] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.567 [Thread-40] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.567 [Thread-24] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.568 [Thread-24] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.568 [Thread-24] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.568 [Thread-27] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.569 [Thread-27] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.569 [Thread-5] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.569 [Thread-36] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.570 [Thread-37] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.570 [Thread-37] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.570 [Thread-26] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.570 [Thread-41] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.571 [Thread-41] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.571 [Thread-33] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.571 [Thread-18] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.572 [Thread-18] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.572 [Thread-39] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.573 [Thread-19] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.573 [Thread-19] INFO d.n.common.distribute.JMSConnection - Starting cleanup Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.573 [Thread-23] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.573 [Thread-16] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.573 [Thread-30] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.574 [Thread-31] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.575 [Thread-31] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.575 [Thread-11] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.575 [Thread-11] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.575 [Thread-34] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.575 [Thread-10] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.576 [Thread-10] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.576 [Thread-10] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.576 [Thread-7] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.577 [Thread-33] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.577 [Thread-1] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.578 [Thread-8] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.578 [Thread-8] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.578 [Thread-24] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.578 [Thread-2] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.578 [Thread-4] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.579 [Thread-27] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.579 [Thread-5] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.579 [Thread-5] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.580 [Thread-15] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.580 [Thread-26] INFO d.n.common.distribute.JMSConnection - Starting cleanup Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.580 [Thread-36] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.580 [Thread-16] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.580 [Thread-16] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.581 [Thread-16] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.582 [Thread-30] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.582 [Thread-34] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.582 [Thread-7] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.583 [Thread-1] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.583 [Thread-8] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.584 [Thread-2] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.584 [Thread-2] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.585 [Thread-4] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.585 [Thread-27] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.586 [Thread-5] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.586 [Thread-15] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.587 [Thread-37] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.587 [Thread-37] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.587 [Thread-19] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.587 [Thread-19] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.588 [Thread-31] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.589 [Thread-31] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.589 [Thread-33] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.589 [Thread-33] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.589 [Thread-26] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.590 [Thread-26] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.590 [Thread-39] INFO d.n.common.distribute.JMSConnection - Cleanup finished 00:06:06.591 [Thread-40] INFO d.n.common.distribute.JMSConnection - Starting cleanup 00:06:06.591 [Thread-40] INFO d.n.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.591 [Thread-40] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 00:06:06.591 [Thread-39] INFO d.n.c.d.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Results : Tests run: 81, Failures: 0, Errors: 0, Skipped: 17 [JENKINS] Recording test results [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix1-controller --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix1-controller --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/heritrix1-controller-5.3-SNAPSHOT.jar [INFO] [INFO] >>> maven-source-plugin:2.2.1:jar (attach-sources) @ heritrix1-controller >>> [WARNING] Failed to getClass for org.apache.maven.plugin.source.SourceJarMojo [INFO] [INFO] <<< maven-source-plugin:2.2.1:jar (attach-sources) @ heritrix1-controller <<< [INFO] [INFO] --- maven-source-plugin:2.2.1:jar (attach-sources) @ heritrix1-controller --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/heritrix1-controller-5.3-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-javadoc-plugin:2.10.3:jar (attach-javadocs) @ heritrix1-controller --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/heritrix1-controller-5.3-SNAPSHOT-javadoc.jar [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ heritrix1-controller --- [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/heritrix1-controller-5.3-SNAPSHOT.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/heritrix1-controller/5.3-SNAPSHOT/heritrix1-controller-5.3-SNAPSHOT.jar [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/pom.xml to /home/cibuild02/.m2/repository/org/netarchivesuite/heritrix1-controller/5.3-SNAPSHOT/heritrix1-controller-5.3-SNAPSHOT.pom [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/heritrix1-controller-5.3-SNAPSHOT-sources.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/heritrix1-controller/5.3-SNAPSHOT/heritrix1-controller-5.3-SNAPSHOT-sources.jar [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-controller/target/heritrix1-controller-5.3-SNAPSHOT-javadoc.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/heritrix1-controller/5.3-SNAPSHOT/heritrix1-controller-5.3-SNAPSHOT-javadoc.jar [JENKINS] Archiving disabled