[INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Harvest Scheduler 5.3-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvest-scheduler --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvest-scheduler/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvest-scheduler --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 13 source files to /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvest-scheduler/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvest-scheduler --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvest-scheduler/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvest-scheduler --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvest-scheduler --- [INFO] Surefire report directory: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvest-scheduler/target/surefire-reports ------------------------------------------------------- T E S T S ------------------------------------------------------- Running dk.netarkivet.harvester.scheduler.JobDispatcherTest 14:03:55.162 [main] INFO d.n.h.scheduler.JobDispatcher - Creating JobDispatcher 14:03:55.340 [main] DEBUG d.n.h.scheduler.JobDispatcher - Submitting new FOCUSED job 1 14:03:55.365 [main] INFO d.n.h.scheduler.JobDispatcher - Added duplicateReductionMetadataEntry metadataEntry for job 1 14:03:55.386 [main] INFO d.n.h.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template 14:03:55.389 [main] INFO d.n.h.scheduler.JobDispatcher - Job is a continuation of 0 so no need to replace WarcInfoMetadata The list of loaded data settings is empty. Is this OK?14:03:55.400 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ONE,TWO,THREE 14:03:55.429 [main] DEBUG d.n.h.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 1325124186, metadata: [URL= metadata://netarkivet.dk/crawl/setup/duplicatereductionjobs?majorversion=1&minorversion=0&harvestid=9&harvestnum=0&jobid=1 ; mimetype= text/plain ; data= 1] 14:03:55.434 [main] INFO d.n.h.scheduler.JobDispatcher - Job #1 submitted 14:03:55.453 [main] INFO d.n.h.scheduler.JobDispatcher - Creating JobDispatcher 14:03:55.503 [main] DEBUG d.n.h.scheduler.JobDispatcher - Submitting new FOCUSED job 1 14:03:55.506 [main] INFO d.n.h.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template 14:03:55.510 [main] INFO d.n.h.scheduler.JobDispatcher - Job is a continuation of 0 so no need to replace WarcInfoMetadata 14:03:55.512 [main] DEBUG d.n.h.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 341796579, metadata: [] 14:03:55.512 [main] INFO d.n.h.scheduler.JobDispatcher - Job #1 submitted 14:03:55.542 [main] DEBUG d.n.h.scheduler.JobDispatcher - Submitting new SNAPSHOT job 2 14:03:55.555 [main] INFO d.n.h.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template 14:03:55.555 [main] INFO d.n.h.scheduler.JobDispatcher - Job is a continuation of 0 so no need to replace WarcInfoMetadata 14:03:55.558 [main] DEBUG d.n.h.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_SNAPSHOT_SNAPSHOT ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 1164107853, metadata: [] 14:03:55.561 [main] INFO d.n.h.scheduler.JobDispatcher - Job #2 submitted 14:03:55.563 [main] INFO d.n.h.scheduler.JobDispatcher - Creating JobDispatcher 14:03:55.585 [main] DEBUG d.n.h.scheduler.JobDispatcher - Submitting new FOCUSED job 1 14:03:55.589 [main] INFO d.n.h.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template 14:03:55.592 [main] INFO d.n.h.scheduler.JobDispatcher - Job is a continuation of 0 so no need to replace WarcInfoMetadata 14:03:55.593 [main] DEBUG d.n.h.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 1661123505, metadata: [] 14:03:55.596 [main] INFO d.n.h.scheduler.JobDispatcher - Job #1 submitted 14:03:55.600 [main] INFO d.n.h.scheduler.JobDispatcher - Creating JobDispatcher 14:03:55.624 [main] DEBUG d.n.h.scheduler.JobDispatcher - Submitting new FOCUSED job 1 14:03:55.633 [main] INFO d.n.h.scheduler.JobDispatcher - Added alias metadataEntry for job 1 14:03:55.641 [main] INFO d.n.h.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template 14:03:55.642 [main] INFO d.n.h.scheduler.JobDispatcher - Job is a continuation of 0 so no need to replace WarcInfoMetadata 14:03:55.645 [main] DEBUG d.n.h.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 1297978429, metadata: [URL= metadata://netarkivet.dk/crawl/setup/aliases?majorversion=1&minorversion=0&harvestid=9&harvestnum=0&jobid=1 ; mimetype= text/plain ; data= netatarkivalias.dk is an alias for netarkiv.dk ] 14:03:55.645 [main] INFO d.n.h.scheduler.JobDispatcher - Job #1 submitted 14:03:55.647 [main] INFO d.n.h.scheduler.JobDispatcher - Creating JobDispatcher Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.373 sec - in dk.netarkivet.harvester.scheduler.JobDispatcherTest Running dk.netarkivet.harvester.scheduler.HarvesterStatusReceiverTest 14:03:55.699 [main] INFO d.n.h.s.HarvesterStatusReceiver - Reregistering the harvester 'Test' to channel 'FOCUSED' 14:03:55.699 [main] INFO d.n.h.s.HarvestChannelRegistry - Harvester Test registered on channel FOCUSED 14:03:55.700 [main] INFO d.n.h.s.HarvestChannelRegistry - HarvestChannelRegistry status: - FOCUSED { Test } 14:03:55.711 [main] WARN d.n.h.d.HarvesterMessageHandler - Error processing message 'TestObjectMessage: NO ID: To DEV_COMMON_HARVESTMON ReplyTo DEV_COMMON_ERROR OK' dk.netarkivet.common.exceptions.PermissionDenied: 'dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver@408d971b' provides no handling for NO ID: To DEV_COMMON_HARVESTMON ReplyTo DEV_COMMON_ERROR OK of type dk.netarkivet.harvester.harvesting.distribute.CrawlProgressMessage and should not be invoked! at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.deny(HarvesterMessageHandler.java:83) ~[harvester-core-5.3-SNAPSHOT.jar:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.visit(HarvesterMessageHandler.java:119) ~[harvester-core-5.3-SNAPSHOT.jar:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.harvesting.distribute.CrawlProgressMessage.accept(CrawlProgressMessage.java:338) ~[harvester-core-5.3-SNAPSHOT.jar:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.onMessage(HarvesterMessageHandler.java:69) ~[harvester-core-5.3-SNAPSHOT.jar:3f346df4e93d68218c8b4b9e39aa4dae9c36eadc] at dk.netarkivet.harvester.scheduler.HarvesterStatusReceiverTest.testInvalidMessageType(HarvesterStatusReceiverTest.java:66) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_121] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_121] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_121] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_121] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) [surefire-junit4-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.064 sec - in dk.netarkivet.harvester.scheduler.HarvesterStatusReceiverTest Running dk.netarkivet.harvester.scheduler.JobSupervisorTest 14:03:55.722 [main] INFO d.n.h.scheduler.JobSupervisor - 0 jobs has been resubmitted. 14:03:55.724 [main] WARN d.n.h.scheduler.JobSupervisor - Job 1 has exceeded its timeout of 0 minutes. Changing status to FAILED. 14:03:55.724 [main] WARN d.n.h.scheduler.JobSupervisor - Changed 1 jobs from STARTED to FAILED 14:03:55.731 [main] INFO d.n.h.scheduler.JobSupervisor - Resubmitting old job 1 as 0 14:03:55.731 [main] INFO d.n.h.scheduler.JobSupervisor - Resubmitting old job 3 as 0 14:03:55.731 [main] INFO d.n.h.scheduler.JobSupervisor - 2 jobs has been resubmitted. Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec - in dk.netarkivet.harvester.scheduler.JobSupervisorTest Running dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServerTest 14:03:55.793 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Received CrawlStatusMessage for job 1 with new status FAILED, current state is SUBMITTED 14:03:55.794 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = Some harvesterrors HarvestErrorDetails = Some harvestErrorDetails UploadErrors = Some uploadErrors UploadErrorDetails = Some uploadErrorDetails 14:03:55.802 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Received CrawlStatusMessage for job 1 with new status FAILED, current state is RESUBMITTED 14:03:55.804 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = Some harvesterrors HarvestErrorDetails = Some harvestErrorDetails UploadErrors = Some uploadErrors UploadErrorDetails = Some uploadErrorDetails 14:03:55.811 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = Some harvesterrors HarvestErrorDetails = Some harvestErrorDetails UploadErrors = Some uploadErrors UploadErrorDetails = Some uploadErrorDetails 14:03:55.814 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Received CrawlStatusMessage for job 1 with new status FAILED, current state is DONE. Marking job as FAILED 14:03:55.816 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Job 1 failed: Some harvesterrors Received CrawlStatusMessage for job 1 with new status FAILED, current state is DONE. Marking job as FAILED 14:03:55.828 [main] INFO d.n.h.s.HarvestSchedulerMonitorServer - Job #1 succesfully completed 14:03:55.832 [main] INFO d.n.h.s.HarvestSchedulerMonitorServer - Job #1 succesfully completed 14:03:55.839 [main] INFO d.n.h.s.HarvestSchedulerMonitorServer - Job #1 has been started by the harvester. 14:03:55.856 [main] INFO d.n.h.s.HarvestSchedulerMonitorServer - Job #1 succesfully completed 14:03:55.863 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = null HarvestErrorDetails = null UploadErrors = null UploadErrorDetails = null 14:03:55.865 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Received new status 'Started' for job 1 with current status DONE, ignoring. 14:03:55.871 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Received CrawlStatusMessage for job 1 with new status DONE, current state is NEW 14:03:55.872 [main] INFO d.n.h.s.HarvestSchedulerMonitorServer - Job #1 succesfully completed 14:03:55.875 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Received new status 'Started' for job 1 with current status STARTED, ignoring. 14:03:55.877 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Received new status 'Started' for job 1 with current status FAILED, ignoring. 14:03:55.885 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Received new status 'Started' for unsubmitted job 1 14:03:55.885 [main] INFO d.n.h.s.HarvestSchedulerMonitorServer - Job #1 has been started by the harvester. 14:03:55.895 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Received CrawlStatusMessage for job 1 with new status DONE, current state is SUBMITTED 14:03:55.895 [main] INFO d.n.h.s.HarvestSchedulerMonitorServer - Job #1 succesfully completed 14:03:55.899 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Received CrawlStatusMessage for job 1 with new status DONE, current state is SUBMITTED 14:03:55.900 [main] INFO d.n.h.s.HarvestSchedulerMonitorServer - Job #1 succesfully completed 14:03:55.906 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Received CrawlStatusMessage for job 1 with new status DONE, current state is RESUBMITTED 14:03:55.906 [main] INFO d.n.h.s.HarvestSchedulerMonitorServer - Job #1 succesfully completed 14:03:55.910 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Received CrawlStatusMessage for job 1 with new status FAILED, current state is NEW 14:03:55.914 [main] WARN d.n.h.s.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = Some harvesterrors HarvestErrorDetails = Some harvestErrorDetails UploadErrors = Some uploadErrors UploadErrorDetails = Some uploadErrorDetails Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.182 sec - in dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServerTest Results : Tests run: 29, Failures: 0, Errors: 0, Skipped: 0 [JENKINS] Recording test results [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvest-scheduler --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvest-scheduler --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvest-scheduler/target/harvest-scheduler-5.3-SNAPSHOT.jar [INFO] [INFO] >>> maven-source-plugin:2.2.1:jar (attach-sources) > generate-sources @ harvest-scheduler >>> [WARNING] Failed to getClass for org.apache.maven.plugin.source.SourceJarMojo [INFO] [INFO] <<< maven-source-plugin:2.2.1:jar (attach-sources) < generate-sources @ harvest-scheduler <<< [INFO] [INFO] --- maven-source-plugin:2.2.1:jar (attach-sources) @ harvest-scheduler --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvest-scheduler/target/harvest-scheduler-5.3-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-javadoc-plugin:2.10.3:jar (attach-javadocs) @ harvest-scheduler --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvest-scheduler/target/harvest-scheduler-5.3-SNAPSHOT-javadoc.jar [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ harvest-scheduler --- [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvest-scheduler/target/harvest-scheduler-5.3-SNAPSHOT.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/harvest-scheduler/5.3-SNAPSHOT/harvest-scheduler-5.3-SNAPSHOT.jar [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvest-scheduler/pom.xml to /home/cibuild02/.m2/repository/org/netarchivesuite/harvest-scheduler/5.3-SNAPSHOT/harvest-scheduler-5.3-SNAPSHOT.pom [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvest-scheduler/target/harvest-scheduler-5.3-SNAPSHOT-sources.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/harvest-scheduler/5.3-SNAPSHOT/harvest-scheduler-5.3-SNAPSHOT-sources.jar [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvest-scheduler/target/harvest-scheduler-5.3-SNAPSHOT-javadoc.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/harvest-scheduler/5.3-SNAPSHOT/harvest-scheduler-5.3-SNAPSHOT-javadoc.jar [JENKINS] Archiving disabled