[INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Harvest Scheduler 6.1-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvest-scheduler --- [INFO] Deleting /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/target [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ harvest-scheduler --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/../target/jacoco.exec,append=true [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ harvest-scheduler --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvest-scheduler --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvest-scheduler --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 14 source files to /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvest-scheduler --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvest-scheduler --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 5 source files to /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvest-scheduler --- [INFO] Surefire report directory: /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/target/surefire-reports [INFO] parallel='none', perCoreThreadCount=true, threadCount=0, useUnlimitedThreads=false, threadCountSuites=0, threadCountClasses=0, threadCountMethods=0, parallelOptimized=true ------------------------------------------------------- T E S T S ------------------------------------------------------- Running dk.netarkivet.harvester.scheduler.JobDispatcherTest 13:38:53.947 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Creating JobDispatcher 13:38:54.175 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Submitting new FOCUSED job 1 13:38:54.253 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Added duplicateReductionMetadataEntry metadataEntry for job 1 13:38:54.291 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template The list of loaded data settings is empty. Is this OK?13:38:54.395 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ONE,TWO,THREE 13:38:54.445 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 2037147839, metadata: [URL= metadata://netarkivet.dk/crawl/setup/duplicatereductionjobs?majorversion=1&minorversion=0&harvestid=9&harvestnum=0&jobid=1 ; mimetype= text/plain ; data= 1] 13:38:54.456 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Job #1 submitted 13:38:54.507 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Creating JobDispatcher 13:38:54.554 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Submitting new FOCUSED job 1 13:38:54.565 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template 13:38:54.583 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 1503844182, metadata: [] 13:38:54.585 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Job #1 submitted 13:38:54.626 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Submitting new SNAPSHOT job 2 13:38:54.634 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template 13:38:54.653 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_SNAPSHOT_SNAPSHOT ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 1697330995, metadata: [] 13:38:54.655 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Job #2 submitted 13:38:54.663 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Creating JobDispatcher 13:38:54.690 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Submitting new FOCUSED job 1 13:38:54.699 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template 13:38:54.719 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 749588470, metadata: [] 13:38:54.721 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Job #1 submitted 13:38:54.737 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Creating JobDispatcher 13:38:54.769 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Submitting new FOCUSED job 1 13:38:54.788 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Added alias metadataEntry for job 1 13:38:54.792 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template 13:38:54.803 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 1567903868, metadata: [URL= metadata://netarkivet.dk/crawl/setup/aliases?majorversion=1&minorversion=0&harvestid=9&harvestnum=0&jobid=1 ; mimetype= text/plain ; data= netatarkivalias.dk is an alias for netarkiv.dk ] 13:38:54.808 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Job #1 submitted 13:38:54.815 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Creating JobDispatcher Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.725 sec - in dk.netarkivet.harvester.scheduler.JobDispatcherTest Running dk.netarkivet.harvester.scheduler.HarvesterStatusReceiverTest 13:38:54.925 [main] INFO dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver - Reregistering the harvester 'Test' to channel 'FOCUSED' 13:38:54.931 [main] INFO dk.netarkivet.harvester.scheduler.HarvestChannelRegistry - Harvester Test registered on channel FOCUSED 13:38:54.932 [main] INFO dk.netarkivet.harvester.scheduler.HarvestChannelRegistry - HarvestChannelRegistry status: - FOCUSED { Test } 13:38:54.972 [main] WARN dk.netarkivet.harvester.distribute.HarvesterMessageHandler - Error processing message 'TestObjectMessage: NO ID: To DEV_COMMON_HARVESTMON ReplyTo DEV_COMMON_ERROR OK' dk.netarkivet.common.exceptions.PermissionDenied: 'dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver@6ff8e744' provides no handling for NO ID: To DEV_COMMON_HARVESTMON ReplyTo DEV_COMMON_ERROR OK of type dk.netarkivet.harvester.harvesting.distribute.CrawlProgressMessage and should not be invoked! at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.deny(HarvesterMessageHandler.java:83) at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.visit(HarvesterMessageHandler.java:119) at dk.netarkivet.harvester.harvesting.distribute.CrawlProgressMessage.accept(CrawlProgressMessage.java:341) at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.onMessage(HarvesterMessageHandler.java:69) at dk.netarkivet.harvester.scheduler.HarvesterStatusReceiverTest.testInvalidMessageType(HarvesterStatusReceiverTest.java:66) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.junit.runners.Suite.runChild(Suite.java:127) at org.junit.runners.Suite.runChild(Suite.java:26) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.junit.runner.JUnitCore.run(JUnitCore.java:160) at org.junit.runner.JUnitCore.run(JUnitCore.java:138) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.158 sec - in dk.netarkivet.harvester.scheduler.HarvesterStatusReceiverTest Running dk.netarkivet.harvester.scheduler.JobSupervisorTest 13:38:55.015 [main] INFO dk.netarkivet.harvester.scheduler.JobSupervisor - 0 jobs has been resubmitted. 13:38:55.022 [main] WARN dk.netarkivet.harvester.scheduler.JobSupervisor - Job 1 has exceeded its timeout of 0 minutes. Changing status to FAILED. 13:38:55.024 [main] WARN dk.netarkivet.harvester.scheduler.JobSupervisor - Changed 1 jobs from STARTED to FAILED 13:38:55.035 [main] INFO dk.netarkivet.harvester.scheduler.JobSupervisor - Resubmitting old job 1 as 0 13:38:55.036 [main] INFO dk.netarkivet.harvester.scheduler.JobSupervisor - Resubmitting old job 3 as 0 13:38:55.036 [main] INFO dk.netarkivet.harvester.scheduler.JobSupervisor - 2 jobs has been resubmitted. Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.081 sec - in dk.netarkivet.harvester.scheduler.JobSupervisorTest Running dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServerTest 13:38:55.122 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status FAILED, current state is SUBMITTED 13:38:55.124 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = Some harvesterrors HarvestErrorDetails = Some harvestErrorDetails UploadErrors = Some uploadErrors UploadErrorDetails = Some uploadErrorDetails 13:38:55.145 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status FAILED, current state is RESUBMITTED 13:38:55.148 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = Some harvesterrors HarvestErrorDetails = Some harvestErrorDetails UploadErrors = Some uploadErrors UploadErrorDetails = Some uploadErrorDetails 13:38:55.160 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = Some harvesterrors HarvestErrorDetails = Some harvestErrorDetails UploadErrors = Some uploadErrors UploadErrorDetails = Some uploadErrorDetails 13:38:55.166 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status FAILED, current state is DONE. Marking job as DONE. Reported harvestErrors on job: Some harvesterrors 13:38:55.202 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed 13:38:55.214 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed 13:38:55.223 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 has been started by the harvester. 13:38:55.258 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed 13:38:55.263 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = null HarvestErrorDetails = null UploadErrors = null UploadErrorDetails = null 13:38:55.270 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received new status 'Started' for job 1 with current status DONE, ignoring. 13:38:55.282 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status DONE, current state is NEW 13:38:55.283 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed 13:38:55.297 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received new status 'Started' for job 1 with current status STARTED, ignoring. 13:38:55.304 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received new status 'Started' for job 1 with current status FAILED, ignoring. 13:38:55.312 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received new status 'Started' for unsubmitted job 1 13:38:55.315 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 has been started by the harvester. 13:38:55.325 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status DONE, current state is SUBMITTED 13:38:55.326 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed 13:38:55.335 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status DONE, current state is SUBMITTED 13:38:55.336 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed 13:38:55.344 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status DONE, current state is RESUBMITTED 13:38:55.345 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed 13:38:55.353 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status FAILED, current state is NEW 13:38:55.354 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = Some harvesterrors HarvestErrorDetails = Some harvestErrorDetails UploadErrors = Some uploadErrors UploadErrorDetails = Some uploadErrorDetails Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.292 sec - in dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServerTest Results : Tests run: 29, Failures: 0, Errors: 0, Skipped: 0 [JENKINS] Recording test results [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ harvest-scheduler --- [INFO] Skipping JaCoCo execution due to missing execution data file. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvest-scheduler --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvest-scheduler --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/target/harvest-scheduler-6.1-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvest-scheduler --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/target/harvest-scheduler-6.1-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-javadoc-plugin:2.10.3:jar (attach-javadocs) @ harvest-scheduler --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/target/harvest-scheduler-6.1-SNAPSHOT-javadoc.jar [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ harvest-scheduler --- [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/target/harvest-scheduler-6.1-SNAPSHOT.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/harvest-scheduler/6.1-SNAPSHOT/harvest-scheduler-6.1-SNAPSHOT.jar [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/pom.xml to /home/cibuild02/.m2/repository/org/netarchivesuite/harvest-scheduler/6.1-SNAPSHOT/harvest-scheduler-6.1-SNAPSHOT.pom [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/target/harvest-scheduler-6.1-SNAPSHOT-sources.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/harvest-scheduler/6.1-SNAPSHOT/harvest-scheduler-6.1-SNAPSHOT-sources.jar [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-UnitTests-Colin/harvester/harvest-scheduler/target/harvest-scheduler-6.1-SNAPSHOT-javadoc.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/harvest-scheduler/6.1-SNAPSHOT/harvest-scheduler-6.1-SNAPSHOT-javadoc.jar [JENKINS] Archiving disabled