[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building NetarchiveSuite - Harvest Scheduler 5.7-IIPCH3-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvest-scheduler ---
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ harvest-scheduler ---
[INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/../target/jacoco.exec,append=true
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ harvest-scheduler ---
[INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/../target/jacoco.exec,append=true
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvest-scheduler ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvest-scheduler ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 14 source files to /home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/target/classes
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvest-scheduler ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/src/test/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvest-scheduler ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 5 source files to /home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/target/test-classes
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvest-scheduler ---
[INFO] Surefire report directory: /home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/target/surefire-reports
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running dk.netarkivet.harvester.scheduler.JobDispatcherTest
16:26:19.157 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Creating JobDispatcher
16:26:19.374 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Submitting new FOCUSED job 1
16:26:19.450 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Added duplicateReductionMetadataEntry metadataEntry for job 1
16:26:19.484 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template
The list of loaded data settings is empty. Is this OK?16:26:19.581 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ONE,TWO,THREE
16:26:19.621 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 124666386, metadata: [URL= metadata://netarkivet.dk/crawl/setup/duplicatereductionjobs?majorversion=1&minorversion=0&harvestid=9&harvestnum=0&jobid=1 ; mimetype= text/plain ; data= 1]
16:26:19.628 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Job #1 submitted
16:26:19.685 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Creating JobDispatcher
16:26:19.733 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Submitting new FOCUSED job 1
16:26:19.742 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template
16:26:19.759 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 1777030223, metadata: []
16:26:19.769 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Job #1 submitted
16:26:19.804 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Submitting new SNAPSHOT job 2
16:26:19.816 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template
16:26:19.825 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_SNAPSHOT_SNAPSHOT ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 1769640623, metadata: []
16:26:19.834 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Job #2 submitted
16:26:19.840 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Creating JobDispatcher
16:26:19.881 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Submitting new FOCUSED job 1
16:26:19.885 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template
16:26:19.896 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 142273642, metadata: []
16:26:19.902 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Job #1 submitted
16:26:19.917 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Creating JobDispatcher
16:26:19.944 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Submitting new FOCUSED job 1
16:26:19.959 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Added alias metadataEntry for job 1
16:26:19.967 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - As we're using WARC as archiveFormat WarcInfoMetadata is now added to the template
16:26:19.977 [main] DEBUG dk.netarkivet.harvester.scheduler.JobDispatcher - Send crawl request: NO ID: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Mock for Job, hashCode: 263969036, metadata: [URL= metadata://netarkivet.dk/crawl/setup/aliases?majorversion=1&minorversion=0&harvestid=9&harvestnum=0&jobid=1 ; mimetype= text/plain ; data= netatarkivalias.dk is an alias for netarkiv.dk
]
16:26:19.989 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Job #1 submitted
16:26:19.994 [main] INFO dk.netarkivet.harvester.scheduler.JobDispatcher - Creating JobDispatcher
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.275 sec - in dk.netarkivet.harvester.scheduler.JobDispatcherTest
Running dk.netarkivet.harvester.scheduler.HarvesterStatusReceiverTest
16:26:20.116 [main] INFO dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver - Reregistering the harvester 'Test' to channel 'FOCUSED'
16:26:20.119 [main] INFO dk.netarkivet.harvester.scheduler.HarvestChannelRegistry - Harvester Test registered on channel FOCUSED
16:26:20.122 [main] INFO dk.netarkivet.harvester.scheduler.HarvestChannelRegistry - HarvestChannelRegistry status:
- FOCUSED { Test }
16:26:20.161 [main] WARN dk.netarkivet.harvester.distribute.HarvesterMessageHandler - Error processing message 'TestObjectMessage: NO ID: To DEV_COMMON_HARVESTMON ReplyTo DEV_COMMON_ERROR OK'
dk.netarkivet.common.exceptions.PermissionDenied: 'dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver@ba0018e' provides no handling for NO ID: To DEV_COMMON_HARVESTMON ReplyTo DEV_COMMON_ERROR OK of type dk.netarkivet.harvester.harvesting.distribute.CrawlProgressMessage and should not be invoked!
at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.deny(HarvesterMessageHandler.java:83)
at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.visit(HarvesterMessageHandler.java:119)
at dk.netarkivet.harvester.harvesting.distribute.CrawlProgressMessage.accept(CrawlProgressMessage.java:341)
at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.onMessage(HarvesterMessageHandler.java:69)
at dk.netarkivet.harvester.scheduler.HarvesterStatusReceiverTest.testInvalidMessageType(HarvesterStatusReceiverTest.java:67)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.173 sec - in dk.netarkivet.harvester.scheduler.HarvesterStatusReceiverTest
Running dk.netarkivet.harvester.scheduler.JobSupervisorTest
16:26:20.200 [main] INFO dk.netarkivet.harvester.scheduler.JobSupervisor - 0 jobs has been resubmitted.
16:26:20.212 [main] WARN dk.netarkivet.harvester.scheduler.JobSupervisor - Job 1 has exceeded its timeout of 0 minutes. Changing status to FAILED.
16:26:20.213 [main] WARN dk.netarkivet.harvester.scheduler.JobSupervisor - Changed 1 jobs from STARTED to FAILED
16:26:20.230 [main] INFO dk.netarkivet.harvester.scheduler.JobSupervisor - Resubmitting old job 1 as 0
16:26:20.230 [main] INFO dk.netarkivet.harvester.scheduler.JobSupervisor - Resubmitting old job 3 as 0
16:26:20.230 [main] INFO dk.netarkivet.harvester.scheduler.JobSupervisor - 2 jobs has been resubmitted.
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.061 sec - in dk.netarkivet.harvester.scheduler.JobSupervisorTest
Running dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServerTest
16:26:20.367 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status FAILED, current state is SUBMITTED
16:26:20.369 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = Some harvesterrors
HarvestErrorDetails = Some harvestErrorDetails
UploadErrors = Some uploadErrors
UploadErrorDetails = Some uploadErrorDetails
16:26:20.396 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status FAILED, current state is RESUBMITTED
16:26:20.398 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = Some harvesterrors
HarvestErrorDetails = Some harvestErrorDetails
UploadErrors = Some uploadErrors
UploadErrorDetails = Some uploadErrorDetails
16:26:20.413 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = Some harvesterrors
HarvestErrorDetails = Some harvestErrorDetails
UploadErrors = Some uploadErrors
UploadErrorDetails = Some uploadErrorDetails
16:26:20.426 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status FAILED, current state is DONE. Marking job as DONE. Reported harvestErrors on job: Some harvesterrors
16:26:20.454 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed
16:26:20.472 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed
16:26:20.482 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 has been started by the harvester.
16:26:20.518 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed
16:26:20.525 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = null
HarvestErrorDetails = null
UploadErrors = null
UploadErrorDetails = null
16:26:20.531 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received new status 'Started' for job 1 with current status DONE, ignoring.
16:26:20.539 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status DONE, current state is NEW
16:26:20.540 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed
16:26:20.545 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received new status 'Started' for job 1 with current status STARTED, ignoring.
16:26:20.552 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received new status 'Started' for job 1 with current status FAILED, ignoring.
16:26:20.561 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received new status 'Started' for unsubmitted job 1
16:26:20.562 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 has been started by the harvester.
16:26:20.574 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status DONE, current state is SUBMITTED
16:26:20.575 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed
16:26:20.581 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status DONE, current state is SUBMITTED
16:26:20.582 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed
16:26:20.593 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status DONE, current state is RESUBMITTED
16:26:20.594 [main] INFO dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job #1 succesfully completed
16:26:20.603 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Received unexpected CrawlStatusMessage for job 1 with new status FAILED, current state is NEW
16:26:20.607 [main] WARN dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer - Job 1 failed: HarvestErrors = Some harvesterrors
HarvestErrorDetails = Some harvestErrorDetails
UploadErrors = Some uploadErrors
UploadErrorDetails = Some uploadErrorDetails
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.377 sec - in dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServerTest
Results :
Tests run: 29, Failures: 0, Errors: 0, Skipped: 0
[JENKINS] Recording test results
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ harvest-scheduler ---
[INFO] Skipping JaCoCo execution due to missing execution data file.
[INFO]
[INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvest-scheduler ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvest-scheduler ---
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/target/harvest-scheduler-5.7-IIPCH3-SNAPSHOT.jar
[INFO]
[INFO] >>> maven-source-plugin:2.2.1:jar (attach-sources) > generate-sources @ harvest-scheduler >>>
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ harvest-scheduler ---
[INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/../target/jacoco.exec,append=true
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ harvest-scheduler ---
[INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/../target/jacoco.exec,append=true
[WARNING] Failed to getClass for org.apache.maven.plugin.source.SourceJarMojo
[INFO]
[INFO] <<< maven-source-plugin:2.2.1:jar (attach-sources) < generate-sources @ harvest-scheduler <<<
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar (attach-sources) @ harvest-scheduler ---
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/target/harvest-scheduler-5.7-IIPCH3-SNAPSHOT-sources.jar
[INFO]
[INFO] --- maven-javadoc-plugin:2.10.3:jar (attach-javadocs) @ harvest-scheduler ---
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/target/harvest-scheduler-5.7-IIPCH3-SNAPSHOT-javadoc.jar
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ harvest-scheduler ---
[INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/target/harvest-scheduler-5.7-IIPCH3-SNAPSHOT.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/harvest-scheduler/5.7-IIPCH3-SNAPSHOT/harvest-scheduler-5.7-IIPCH3-SNAPSHOT.jar
[INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/pom.xml to /home/cibuild02/.m2/repository/org/netarchivesuite/harvest-scheduler/5.7-IIPCH3-SNAPSHOT/harvest-scheduler-5.7-IIPCH3-SNAPSHOT.pom
[INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/target/harvest-scheduler-5.7-IIPCH3-SNAPSHOT-sources.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/harvest-scheduler/5.7-IIPCH3-SNAPSHOT/harvest-scheduler-5.7-IIPCH3-SNAPSHOT-sources.jar
[INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-Rasmus-Test/harvester/harvest-scheduler/target/harvest-scheduler-5.7-IIPCH3-SNAPSHOT-javadoc.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/harvest-scheduler/5.7-IIPCH3-SNAPSHOT/harvest-scheduler-5.7-IIPCH3-SNAPSHOT-javadoc.jar
[JENKINS] Archiving disabled
Console Output
Help us localize this page