Notifying upstream projects of job completion Join notifier requires a CauseAction [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Netarchivesuite - harvester - test 5.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvester-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvester-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvester-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 551 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvester-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 153 source files to /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/src/test/java/dk/netarkivet/viewerproxy/distribute/HTTPControllerServerTester.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/src/test/java/dk/netarkivet/viewerproxy/distribute/HTTPControllerServerTester.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/harvesting/HarvestControllerTester.java: Some input files use unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/harvesting/HarvestControllerTester.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvester-test --- [INFO] Surefire report directory: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/target/surefire-reports [INFO] parallel='none', perCoreThreadCount=true, threadCount=0, useUnlimitedThreads=false, threadCountSuites=0, threadCountClasses=0, threadCountMethods=0, parallelOptimized=true ------------------------------------------------------- T E S T S ------------------------------------------------------- ------------------------------------------------------- T E S T S ------------------------------------------------------- Running dk.netarkivet.harvester.HarvesterSettingsTester Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.806 sec - in dk.netarkivet.harvester.HarvesterSettingsTester Running dk.netarkivet.harvester.harvesting.WARCWriterProcessorTester Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.866 sec - in dk.netarkivet.harvester.harvesting.WARCWriterProcessorTester Running dk.netarkivet.harvester.harvesting.LegacyHarvestReportTester 13:52:33.200 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:33.208 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:33.209 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:33.671 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 1 13:52:33.775 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.topLevelDomains.tld 13:52:33.881 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ac,ad,ae,aero,af,ag,ai,al,am,an,ao,aq,ar,arpa,as,gv.at,ac.at,or.at,co.at,biz.at,info.at,priv.at,at,au,aw,ax,az,ba,bb,bd,be,bf,bg,bh,bi,biz,bj,bm,bn,bo,br,bs,bt,bv,bw,by,bz,ca,cat,cc,cd,cf,cg,ch,ci,ck,cl,cm,cn,co,com,coop,cr,cs,cu,cv,cx,cy,cz,de,dj,dk,dm,do,dz,ec,edu,ee,eg,eh,er,es,et,eu,fi,fj,fk,fm,fo,aeroport.fr,asso.fr,avoues.fr,chambagri.fr,com.fr,gouv.fr,medecin.fr,nom.fr,pharmacien.fr,port.fr,prd.fr,presse.fr,tm.fr,fr,ga,gb,gd,ge,gf,gg,gh,gi,gl,gm,gn,gov,gp,gq,gr,gs,gt,gu,gw,gy,hk,hm,hn,hr,ht,hu,id,ie,il,im,in,info,int,io,iq,ir,is,it,je,jm,jo,jobs,jp,ke,kg,kh,ki,km,kn,kp,kr,kw,ky,kz,la,lb,lc,li,lk,lr,ls,lt,lu,lv,ly,ma,mc,md,me,mg,mh,mil,mk,ml,mm,mn,mo,mobi,mp,mq,mr,ms,mt,mu,museum,mv,mw,mx,my,mz,na,name,nc,ne,net,nf,ng,ni,nl,no,np,nr,nt,nu,nz,om,org,pa,pe,pf,pg,ph,pk,pl,pm,pn,pr,pro,ps,pt,pw,py,qa,asso.re,com.re,re,ro,ru,rw,sa,sb,sc,sd,se,sg,sh,si,sj,sk,sl,sm,sn,so,sr,st,su,sv,sy,sz,tc,td,at.tf,net.tf,tf,tg,th,tj,tk,tl,tm,tn,to,tp,tr,travel,tt,tv,tw,tz,ua,ug,ac.uk,co.uk,gov.uk,ltd.uk,me.uk,mod.uk,net.uk,nic.uk,nhs.uk,org.uk,plc.uk,police.uk,sch.uk,govt.uk,orgn.uk,lea.uk,mil.uk,nel.uk,uk,us,uy,uz,va,vc,ve,vg,vi,vn,vu,wien,wf,ws,ye,yt,yu,za,zm,zw 13:52:34.033 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Finished pre-processing of harvest report for job 1, operation took 00d 00:06:01 13:52:34.050 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:34.071 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:34.071 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:34.183 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 1 13:52:34.215 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:31 13:52:34.225 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:34.229 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:34.230 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:34.248 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 1 13:52:34.253 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:04 13:52:34.262 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:34.265 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:34.265 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:34.375 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 1 13:52:34.394 [main] DEBUG dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Invalid line in '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/logs/crawl.log' line 1: 'metadata://netarkivet.dk/crawl/logs/crawl.log?heritrixVersion=1.14.4&harvestid=4&jobid=6 130.226.228.8 20120523150916 text/plain 412905'. Ignoring due to reason: Not enough fields for line in crawl.log: 'metadata://netarkivet.dk/crawl/logs/crawl.log?heritrixVersion=1.14.4&harvestid=4&jobid=6 130.226.228.8 20120523150916 text/plain 412905'. Was only 5 fields. Should have been at least 11 dk.netarkivet.common.exceptions.ArgumentNotValid: Not enough fields for line in crawl.log: 'metadata://netarkivet.dk/crawl/logs/crawl.log?heritrixVersion=1.14.4&harvestid=4&jobid=6 130.226.228.8 20120523150916 text/plain 412905'. Was only 5 fields. Should have been at least 11 at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.processHarvestLine(AbstractHarvestReport.java:333) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.parseCrawlLog(AbstractHarvestReport.java:297) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.preProcess(AbstractHarvestReport.java:146) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.(AbstractHarvestReport.java:128) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.LegacyHarvestReport.(LegacyHarvestReport.java:66) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.LegacyHarvestReportTester.testIDNA(LegacyHarvestReportTester.java:213) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 13:52:35.934 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Finished pre-processing of harvest report for job 1, operation took 00d 00:25:57 13:52:35.939 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:35.941 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:35.941 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:35.950 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 1 13:52:35.957 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:07 13:52:35.961 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:35.962 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:35.962 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:35.972 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 1 13:52:35.979 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:06 13:52:35.982 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:35.984 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:35.985 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:35.992 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 1 13:52:35.995 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:02 13:52:35.998 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:35.999 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:35.999 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:36.007 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 1 13:52:36.067 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Finished pre-processing of harvest report for job 1, operation took 00d 00:01:00 13:52:36.093 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.094 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:36.095 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:36.104 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 1 13:52:36.106 [main] DEBUG dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Not possible to extract domainname from URL: 000nourl000 13:52:36.107 [main] DEBUG dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Invalid line in '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/logs/crawl.log' line 3: '2005-05-06T11:47:28.464Z 404 278 000nourl000 P http://www.netarkivet.dk/ text/html #028 20050506114728458+5 NYN2HPNQGIPJTPMGAV4QPBUCVJVNMM54 -'. Ignoring due to reason: Unable to find a domainName in the line: '2005-05-06T11:47:28.464Z 404 278 000nourl000 P http://www.netarkivet.dk/ text/html #028 20050506114728458+5 NYN2HPNQGIPJTPMGAV4QPBUCVJVNMM54 -'. dk.netarkivet.common.exceptions.ArgumentNotValid: Unable to find a domainName in the line: '2005-05-06T11:47:28.464Z 404 278 000nourl000 P http://www.netarkivet.dk/ text/html #028 20050506114728458+5 NYN2HPNQGIPJTPMGAV4QPBUCVJVNMM54 -'. at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.processHarvestLine(AbstractHarvestReport.java:380) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.parseCrawlLog(AbstractHarvestReport.java:297) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.preProcess(AbstractHarvestReport.java:146) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.(AbstractHarvestReport.java:128) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.LegacyHarvestReport.(LegacyHarvestReport.java:66) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.LegacyHarvestReportTester.testConstructor(LegacyHarvestReportTester.java:94) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 13:52:36.109 [main] DEBUG dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Invalid line in '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/logs/crawl.log' line 4: '2005-05-06T11:47:28.465Z 200 14 http://tooshortline/'. Ignoring due to reason: Not enough fields for line in crawl.log: '2005-05-06T11:47:28.465Z 200 14 http://tooshortline/'. Was only 4 fields. Should have been at least 11 dk.netarkivet.common.exceptions.ArgumentNotValid: Not enough fields for line in crawl.log: '2005-05-06T11:47:28.465Z 200 14 http://tooshortline/'. Was only 4 fields. Should have been at least 11 at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.processHarvestLine(AbstractHarvestReport.java:333) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.parseCrawlLog(AbstractHarvestReport.java:297) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.preProcess(AbstractHarvestReport.java:146) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.(AbstractHarvestReport.java:128) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.LegacyHarvestReport.(LegacyHarvestReport.java:66) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.LegacyHarvestReportTester.testConstructor(LegacyHarvestReportTester.java:94) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 13:52:36.111 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:07 13:52:36.113 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 1 13:52:36.117 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Finished pre-processing of harvest report for job 1, operation took 00d 00:00:04 13:52:36.120 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.736 sec - in dk.netarkivet.harvester.harvesting.LegacyHarvestReportTester 13:52:36.135 [Thread-6] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.138 [Thread-6] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:36.138 [Thread-6] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.140 [Thread-6] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.140 [Thread-18] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.141 [Thread-18] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:36.141 [Thread-18] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.142 [Thread-18] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.142 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.143 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:36.144 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.145 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:36.145 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.145 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.178 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.178 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:36.178 [Thread-16] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.179 [Thread-16] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:36.180 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.180 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:36.181 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.181 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.182 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.183 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:36.183 [Thread-12] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.184 [Thread-12] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:36.192 [Thread-19] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.192 [Thread-19] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:36.193 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:36.193 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:36.193 [Thread-16] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:36.194 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:36.194 [Thread-12] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:36.195 [Thread-19] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.195 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.197 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.198 [Thread-16] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.199 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.199 [Thread-12] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:36.201 [Thread-19] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.harvester.harvesting.extractor.ExtractorOAITest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.544 sec - in dk.netarkivet.harvester.harvesting.extractor.ExtractorOAITest Running dk.netarkivet.harvester.harvesting.DomainnameQueueAssignmentPolicyTester 13:52:38.824 [main] DEBUG d.n.harvester.harvesting.DomainnameQueueAssignmentPolicy - Heritrix broke getting class key candidate for 13:52:38.922 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.topLevelDomains.tld 13:52:39.027 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ac,ad,ae,aero,af,ag,ai,al,am,an,ao,aq,ar,arpa,as,gv.at,ac.at,or.at,co.at,biz.at,info.at,priv.at,at,au,aw,ax,az,ba,bb,bd,be,bf,bg,bh,bi,biz,bj,bm,bn,bo,br,bs,bt,bv,bw,by,bz,ca,cat,cc,cd,cf,cg,ch,ci,ck,cl,cm,cn,co,com,coop,cr,cs,cu,cv,cx,cy,cz,de,dj,dk,dm,do,dz,ec,edu,ee,eg,eh,er,es,et,eu,fi,fj,fk,fm,fo,aeroport.fr,asso.fr,avoues.fr,chambagri.fr,com.fr,gouv.fr,medecin.fr,nom.fr,pharmacien.fr,port.fr,prd.fr,presse.fr,tm.fr,fr,ga,gb,gd,ge,gf,gg,gh,gi,gl,gm,gn,gov,gp,gq,gr,gs,gt,gu,gw,gy,hk,hm,hn,hr,ht,hu,id,ie,il,im,in,info,int,io,iq,ir,is,it,je,jm,jo,jobs,jp,ke,kg,kh,ki,km,kn,kp,kr,kw,ky,kz,la,lb,lc,li,lk,lr,ls,lt,lu,lv,ly,ma,mc,md,me,mg,mh,mil,mk,ml,mm,mn,mo,mobi,mp,mq,mr,ms,mt,mu,museum,mv,mw,mx,my,mz,na,name,nc,ne,net,nf,ng,ni,nl,no,np,nr,nt,nu,nz,om,org,pa,pe,pf,pg,ph,pk,pl,pm,pn,pr,pro,ps,pt,pw,py,qa,asso.re,com.re,re,ro,ru,rw,sa,sb,sc,sd,se,sg,sh,si,sj,sk,sl,sm,sn,so,sr,st,su,sv,sy,sz,tc,td,at.tf,net.tf,tf,tg,th,tj,tk,tl,tm,tn,to,tp,tr,travel,tt,tv,tw,tz,ua,ug,ac.uk,co.uk,gov.uk,ltd.uk,me.uk,mod.uk,net.uk,nic.uk,nhs.uk,org.uk,plc.uk,police.uk,sch.uk,govt.uk,orgn.uk,lea.uk,mil.uk,nel.uk,uk,us,uy,uz,va,vc,ve,vg,vi,vn,vu,wien,wf,ws,ye,yt,yu,za,zm,zw 13:52:39.068 [main] DEBUG d.n.harvester.harvesting.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'default...' for '' 13:52:39.069 [main] DEBUG d.n.harvester.harvesting.DomainnameQueueAssignmentPolicy - Heritrix broke getting class key candidate for 13:52:39.069 [main] DEBUG d.n.harvester.harvesting.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'default...' for '' 13:52:39.070 [main] DEBUG d.n.harvester.harvesting.DomainnameQueueAssignmentPolicy - Heritrix broke getting class key candidate for null 13:52:39.070 [main] DEBUG d.n.harvester.harvesting.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'default...' for 'null' 13:52:39.071 [main] DEBUG d.n.harvester.harvesting.DomainnameQueueAssignmentPolicy - Heritrix broke getting class key candidate for 13:52:39.071 [main] DEBUG d.n.harvester.harvesting.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'default...' for '' 13:52:39.180 [main] DEBUG d.n.harvester.harvesting.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'x.fnord.bar' for 'http://x.fnord.bar/' 13:52:39.181 [main] DEBUG d.n.harvester.harvesting.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'default...' for 'about:blank' Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.941 sec - in dk.netarkivet.harvester.harvesting.DomainnameQueueAssignmentPolicyTester Running dk.netarkivet.harvester.harvesting.HeritrixLauncherTester 13:52:42.488 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.topLevelDomains.tld 13:52:42.548 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ac,ad,ae,aero,af,ag,ai,al,am,an,ao,aq,ar,arpa,as,gv.at,ac.at,or.at,co.at,biz.at,info.at,priv.at,at,au,aw,ax,az,ba,bb,bd,be,bf,bg,bh,bi,biz,bj,bm,bn,bo,br,bs,bt,bv,bw,by,bz,ca,cat,cc,cd,cf,cg,ch,ci,ck,cl,cm,cn,co,com,coop,cr,cs,cu,cv,cx,cy,cz,de,dj,dk,dm,do,dz,ec,edu,ee,eg,eh,er,es,et,eu,fi,fj,fk,fm,fo,aeroport.fr,asso.fr,avoues.fr,chambagri.fr,com.fr,gouv.fr,medecin.fr,nom.fr,pharmacien.fr,port.fr,prd.fr,presse.fr,tm.fr,fr,ga,gb,gd,ge,gf,gg,gh,gi,gl,gm,gn,gov,gp,gq,gr,gs,gt,gu,gw,gy,hk,hm,hn,hr,ht,hu,id,ie,il,im,in,info,int,io,iq,ir,is,it,je,jm,jo,jobs,jp,ke,kg,kh,ki,km,kn,kp,kr,kw,ky,kz,la,lb,lc,li,lk,lr,ls,lt,lu,lv,ly,ma,mc,md,me,mg,mh,mil,mk,ml,mm,mn,mo,mobi,mp,mq,mr,ms,mt,mu,museum,mv,mw,mx,my,mz,na,name,nc,ne,net,nf,ng,ni,nl,no,np,nr,nt,nu,nz,om,org,pa,pe,pf,pg,ph,pk,pl,pm,pn,pr,pro,ps,pt,pw,py,qa,asso.re,com.re,re,ro,ru,rw,sa,sb,sc,sd,se,sg,sh,si,sj,sk,sl,sm,sn,so,sr,st,su,sv,sy,sz,tc,td,at.tf,net.tf,tf,tg,th,tj,tk,tl,tm,tn,to,tp,tr,travel,tt,tv,tw,tz,ua,ug,ac.uk,co.uk,gov.uk,ltd.uk,me.uk,mod.uk,net.uk,nic.uk,nhs.uk,org.uk,plc.uk,police.uk,sch.uk,govt.uk,orgn.uk,lea.uk,mil.uk,nel.uk,uk,us,uy,uz,va,vc,ve,vg,vi,vn,vu,wien,wf,ws,ye,yt,yu,za,zm,zw 13:52:42.806 [main] WARN dk.netarkivet.common.utils.XmlUtils - Could not parse the file as XML: 'tests/dk/netarkivet/harvester/harvesting/data/working/heritrix_out/order.xml' org.dom4j.DocumentException: Error on line -1 of document : Premature end of file. Nested exception: Premature end of file. at org.dom4j.io.SAXReader.read(SAXReader.java:482) ~[dom4j-1.6.1.jar:1.6.1] at org.dom4j.io.SAXReader.read(SAXReader.java:264) ~[dom4j-1.6.1.jar:1.6.1] at dk.netarkivet.common.utils.XmlUtils.getXmlDoc(XmlUtils.java:79) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.HeritrixTemplate.makeOrderfileReadyForHeritrix(HeritrixTemplate.java:623) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HeritrixLauncher.setupOrderfile(HeritrixLauncher.java:100) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.controller.BnfHeritrixLauncher.doCrawl(BnfHeritrixLauncher.java:139) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HeritrixLauncherTester.testStartEmptyFile(HeritrixLauncherTester.java:275) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Tests run: 15, Failures: 0, Errors: 0, Skipped: 7, Time elapsed: 3.093 sec - in dk.netarkivet.harvester.harvesting.HeritrixLauncherTester Running dk.netarkivet.harvester.harvesting.distribute.JobEndedMessageTester 13:52:44.308 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:52:44.316 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.896 sec - in dk.netarkivet.harvester.harvesting.distribute.JobEndedMessageTester 13:52:45.687 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:52:45.693 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE Running dk.netarkivet.harvester.harvesting.distribute.PersistentJobDataTester 13:52:45.864 [main] WARN dk.netarkivet.harvester.datamodel.Job - HarvestnamePrefix not yet set for job 42. Set it by using the naming scheme. This should only happen for old jobs being read 13:52:45.868 [main] DEBUG dk.netarkivet.harvester.datamodel.Job - Applying the default ArchiveFileNaming class 'dk.netarkivet.harvester.harvesting.LegacyNamingConvention'. 13:52:45.868 [main] DEBUG dk.netarkivet.harvester.datamodel.Job - The harvestPrefix of this job is: 42-42 Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.36 sec - in dk.netarkivet.harvester.harvesting.distribute.PersistentJobDataTester 13:52:47.299 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:52:47.376 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE Running dk.netarkivet.harvester.harvesting.distribute.DoOneCrawlMessageTester Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.601 sec - in dk.netarkivet.harvester.harvesting.distribute.DoOneCrawlMessageTester Running dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester 13:52:49.452 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:49.464 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:49.465 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:49.465 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:49.487 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:52:49.494 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:52:49.691 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.topLevelDomains.tld 13:52:49.735 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ac,ad,ae,aero,af,ag,ai,al,am,an,ao,aq,ar,arpa,as,gv.at,ac.at,or.at,co.at,biz.at,info.at,priv.at,at,au,aw,ax,az,ba,bb,bd,be,bf,bg,bh,bi,biz,bj,bm,bn,bo,br,bs,bt,bv,bw,by,bz,ca,cat,cc,cd,cf,cg,ch,ci,ck,cl,cm,cn,co,com,coop,cr,cs,cu,cv,cx,cy,cz,de,dj,dk,dm,do,dz,ec,edu,ee,eg,eh,er,es,et,eu,fi,fj,fk,fm,fo,aeroport.fr,asso.fr,avoues.fr,chambagri.fr,com.fr,gouv.fr,medecin.fr,nom.fr,pharmacien.fr,port.fr,prd.fr,presse.fr,tm.fr,fr,ga,gb,gd,ge,gf,gg,gh,gi,gl,gm,gn,gov,gp,gq,gr,gs,gt,gu,gw,gy,hk,hm,hn,hr,ht,hu,id,ie,il,im,in,info,int,io,iq,ir,is,it,je,jm,jo,jobs,jp,ke,kg,kh,ki,km,kn,kp,kr,kw,ky,kz,la,lb,lc,li,lk,lr,ls,lt,lu,lv,ly,ma,mc,md,me,mg,mh,mil,mk,ml,mm,mn,mo,mobi,mp,mq,mr,ms,mt,mu,museum,mv,mw,mx,my,mz,na,name,nc,ne,net,nf,ng,ni,nl,no,np,nr,nt,nu,nz,om,org,pa,pe,pf,pg,ph,pk,pl,pm,pn,pr,pro,ps,pt,pw,py,qa,asso.re,com.re,re,ro,ru,rw,sa,sb,sc,sd,se,sg,sh,si,sj,sk,sl,sm,sn,so,sr,st,su,sv,sy,sz,tc,td,at.tf,net.tf,tf,tg,th,tj,tk,tl,tm,tn,to,tp,tr,travel,tt,tv,tw,tz,ua,ug,ac.uk,co.uk,gov.uk,ltd.uk,me.uk,mod.uk,net.uk,nic.uk,nhs.uk,org.uk,plc.uk,police.uk,sch.uk,govt.uk,orgn.uk,lea.uk,mil.uk,nel.uk,uk,us,uy,uz,va,vc,ve,vg,vi,vn,vu,wien,wf,ws,ye,yt,yu,za,zm,zw 13:52:49.786 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Starting HarvestControllerServer. 13:52:49.786 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 13:52:49.790 [main] WARN dk.netarkivet.common.utils.ApplicationUtils - Non-existing directory created '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/server/server/server' 13:52:49.790 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/server/server/server' 13:52:49.798 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 13:52:49.824 [main] DEBUG d.n.harvester.harvesting.distribute.HarvestControllerServer - Obtained JMS connection. 13:52:49.852 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 13:52:49.854 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closing HarvestControllerServer. 13:52:49.854 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 13:52:49.855 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closed down HarvestControllerServer 13:52:49.923 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:49.924 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:49.924 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:49.961 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Starting HarvestControllerServer. 13:52:49.962 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 13:52:49.962 [main] WARN dk.netarkivet.common.utils.ApplicationUtils - Non-existing directory created '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/server' 13:52:49.963 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/server' 13:52:49.965 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 13:52:49.969 [main] DEBUG d.n.harvester.harvesting.distribute.HarvestControllerServer - Obtained JMS connection. 13:52:49.995 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 13:52:49.995 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closing HarvestControllerServer. 13:52:49.995 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 13:52:49.996 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closed down HarvestControllerServer 13:52:50.018 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:50.019 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:50.019 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:50.074 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Starting HarvestControllerServer. 13:52:50.075 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 13:52:50.076 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working' 13:52:50.078 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 13:52:50.085 [main] DEBUG d.n.harvester.harvesting.distribute.HarvestControllerServer - Obtained JMS connection. 13:52:50.099 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 13:52:50.100 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 13:52:50.101 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closing HarvestControllerServer. 13:52:50.102 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 13:52:50.103 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closed down HarvestControllerServer 13:52:50.208 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:50.209 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:50.210 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:50.270 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Starting HarvestControllerServer. 13:52:50.271 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 13:52:50.275 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1' 13:52:50.277 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 13:52:50.286 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.arcrepositoryClient.fileDir 13:52:50.287 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/bitarchive1/TestArchive,/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/bitarchive1/TestArchive 13:52:50.289 [main] INFO d.n.common.distribute.arcrepository.LocalArcRepositoryClient - directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/bitarchive1/TestArchive' is part of this local archive repository 13:52:50.291 [main] INFO d.n.common.distribute.arcrepository.LocalArcRepositoryClient - directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/bitarchive1/TestArchive' is part of this local archive repository 13:52:50.293 [main] DEBUG d.n.harvester.harvesting.distribute.HarvestControllerServer - Obtained JMS connection. 13:52:50.295 [main] WARN d.n.harvester.harvesting.distribute.HarvestControllerServer - Found old unprocessed job data in dir '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir'. Crawl probably interrupted by shutdown of HarvestController. Processing data. [WARNING-Notification] Found old unprocessed job data in dir '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir'. Crawl probably interrupted by shutdown of HarvestController. Processing data. 13:52:50.301 [main] DEBUG d.n.harvester.harvesting.distribute.HarvestControllerServer - Post-processing files in '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir' 13:52:50.318 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Store files in directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir' from jobID: 42. 13:52:55.402 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - Creating an arcfiles-report.txt 13:52:55.413 [main] ERROR dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator - java.io.FileNotFoundException: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir/heritrix.out (No such file or directory) at java.io.FileInputStream.open(Native Method) ~[na:1.8.0_11] at java.io.FileInputStream.(FileInputStream.java:131) ~[na:1.8.0_11] at java.io.FileReader.(FileReader.java:72) ~[na:1.8.0_11] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.parseHeritrixOut(ArchiveFilesReportGenerator.java:232) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.generateReport(ArchiveFilesReportGenerator.java:173) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.writeHarvestDetails(HarvestDocumentation.java:387) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:150) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestController.storeFiles(HarvestController.java:315) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.processHarvestInfoFile(HarvestControllerServer.java:548) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.processOldJobs(HarvestControllerServer.java:281) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.(HarvestControllerServer.java:209) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.getInstance(HarvestControllerServer.java:229) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester.testProcessingOfLeftoverJobs(HarvestControllerServerTester.java:326) [test-classes/:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester.testProcessHarvestInfoFile(HarvestControllerServerTester.java:359) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 13:52:55.415 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - No logs dir found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir 13:52:55.415 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - No settings directory found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir 13:52:55.418 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir/harvestInfo.xml' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir/tmp-meta/42-metadata-1.arc'. 13:52:55.419 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir/archivefiles-report.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir/tmp-meta/42-metadata-1.arc'. 13:52:55.421 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - Looking for files not having harvestprefix '1-1' 13:52:55.421 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.ARC 13:52:55.422 [main] WARN dk.netarkivet.harvester.harvesting.HarvestDocumentation - Found files not belonging to job 42, the following files have been stored for later: [/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/oldjobs/lost-files-1411386775421/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.ARC] 13:52:55.493 [main] WARN dk.netarkivet.common.utils.cdx.CDXUtils - Found no related arcfiles to process in the archive dir '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir/arcs'. Sep 22, 2014 1:52:55 PM org.archive.io.WriterPoolMember close INFO: Closed /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir/tmp-meta/42-metadata-1.arc, size 1224 13:52:55.502 [main] WARN dk.netarkivet.harvester.harvesting.HarvestController - Probable error in Heritrix job setup. No arcfiles or warcfiles generated by Heritrix for job 42 [WARNING-Notification] Probable error in Heritrix job setup. No arcfiles or warcfiles generated by Heritrix for job 42 13:52:55.503 [main] INFO dk.netarkivet.harvester.harvesting.HarvestController - Uploading file '42-metadata-1.arc' to arcrepository. 13:52:55.563 [main] INFO dk.netarkivet.harvester.harvesting.HarvestController - File '42-metadata-1.arc' uploaded successfully to arcrepository. 13:52:55.672 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 42 13:52:55.687 [main] WARN d.n.harvester.harvesting.distribute.HarvestControllerServer - Trouble during postprocessing of files in '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir' dk.netarkivet.common.exceptions.ArgumentNotValid: Error creating singleton of class 'dk.netarkivet.harvester.harvesting.report.LegacyHarvestReport': at dk.netarkivet.common.utils.SettingsFactory.getInstance(SettingsFactory.java:91) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.HarvestReportFactory.generateHarvestReport(HarvestReportFactory.java:46) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestController.storeFiles(HarvestController.java:339) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.processHarvestInfoFile(HarvestControllerServer.java:548) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.processOldJobs(HarvestControllerServer.java:281) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.(HarvestControllerServer.java:209) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.getInstance(HarvestControllerServer.java:229) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester.testProcessingOfLeftoverJobs(HarvestControllerServerTester.java:326) [test-classes/:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester.testProcessHarvestInfoFile(HarvestControllerServerTester.java:359) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Caused by: dk.netarkivet.common.exceptions.IOFailure: Not a file or not readable: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir/logs/crawl.log at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.preProcess(AbstractHarvestReport.java:144) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.(AbstractHarvestReport.java:128) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.report.LegacyHarvestReport.(LegacyHarvestReport.java:66) ~[harvester-5.0-SNAPSHOT.jar:na] at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[na:1.8.0_11] at java.lang.reflect.Constructor.newInstance(Constructor.java:408) ~[na:1.8.0_11] at dk.netarkivet.common.utils.SettingsFactory.getInstance(SettingsFactory.java:88) ~[common-5.0-SNAPSHOT.jar:na] ... 44 common frames omitted [ERROR-Notification] Trouble during postprocessing of files in '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir'. Errors accumulated during the postprocessing: Error creating singleton of class 'dk.netarkivet.harvester.harvesting.report.LegacyHarvestReport': dk.netarkivet.common.exceptions.ArgumentNotValid: Error creating singleton of class 'dk.netarkivet.harvester.harvesting.report.LegacyHarvestReport': at dk.netarkivet.common.utils.SettingsFactory.getInstance(SettingsFactory.java:91) at dk.netarkivet.harvester.harvesting.report.HarvestReportFactory.generateHarvestReport(HarvestReportFactory.java:46) at dk.netarkivet.harvester.harvesting.HarvestController.storeFiles(HarvestController.java:339) at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.processHarvestInfoFile(HarvestControllerServer.java:548) at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.processOldJobs(HarvestControllerServer.java:281) at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.(HarvestControllerServer.java:209) at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.getInstance(HarvestControllerServer.java:229) at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester.testProcessingOfLeftoverJobs(HarvestControllerServerTester.java:326) at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester.testProcessHarvestInfoFile(HarvestControllerServerTester.java:359) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.junit.runners.Suite.runChild(Suite.java:127) at org.junit.runners.Suite.runChild(Suite.java:26) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.junit.runner.JUnitCore.run(JUnitCore.java:160) at org.junit.runner.JUnitCore.run(JUnitCore.java:138) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) Caused by: dk.netarkivet.common.exceptions.IOFailure: Not a file or not readable: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir/logs/crawl.log at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.preProcess(AbstractHarvestReport.java:144) at dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport.(AbstractHarvestReport.java:128) at dk.netarkivet.harvester.harvesting.report.LegacyHarvestReport.(LegacyHarvestReport.java:66) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:408) at dk.netarkivet.common.utils.SettingsFactory.getInstance(SettingsFactory.java:88) ... 44 more 13:52:55.724 [main] WARN d.n.harvester.harvesting.distribute.HarvestControllerServer - Job with ID 42 finished with status FAILED 13:52:55.804 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Cleanup after harvesting job with id: 42. 13:52:55.806 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Done post-processing files for job 42 in dir: '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working/testserverdir1/crawldir' 13:52:55.810 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 13:52:55.811 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closing HarvestControllerServer. 13:52:55.812 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 13:52:55.812 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closed down HarvestControllerServer 13:52:55.812 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THE_SCHED' 13:52:56.082 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:56.084 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:56.085 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:56.204 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Starting HarvestControllerServer. 13:52:56.205 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 13:52:56.206 [main] WARN dk.netarkivet.common.utils.ApplicationUtils - Non-existing directory created '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/server' 13:52:56.206 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/server' 13:52:56.207 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 13:52:56.213 [main] DEBUG d.n.harvester.harvesting.distribute.HarvestControllerServer - Obtained JMS connection. 13:52:56.234 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 13:52:56.317 [main] DEBUG d.n.harvester.harvesting.distribute.HarvestControllerServer - No longer accepting jobs. 13:52:56.318 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Received crawlrequest for job 1: 'UNIQUE_ID: To DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX ReplyTo DEV_COMMON_ERROR OK Job: Job 1 (state = DONE, HD = 42, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = -1, forcemaxrunningtime = 0, orderxml = default_orderxml, numconfigs = 0, created = null), metadata: []' 13:52:56.320 [main] WARN d.n.harvester.harvesting.distribute.HarvestControllerServer - Message 'UNIQUE_ID: To DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX ReplyTo DEV_COMMON_ERROR OK Job: Job 1 (state = DONE, HD = 42, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = -1, forcemaxrunningtime = 0, orderxml = default_orderxml, numconfigs = 0, created = null), metadata: []' arrived with status DONE for job 1, should have been STATUS_SUBMITTED 13:52:56.325 [main] WARN dk.netarkivet.harvester.distribute.HarvesterMessageHandler - Error processing message 'TestObjectMessage: UNIQUE_ID: To DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX ReplyTo DEV_COMMON_ERROR OK Job: Job 1 (state = DONE, HD = 42, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = -1, forcemaxrunningtime = 0, orderxml = default_orderxml, numconfigs = 0, created = null), metadata: []' dk.netarkivet.common.exceptions.ArgumentNotValid: Message 'UNIQUE_ID: To DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX ReplyTo DEV_COMMON_ERROR OK Job: Job 1 (state = DONE, HD = 42, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = -1, forcemaxrunningtime = 0, orderxml = default_orderxml, numconfigs = 0, created = null), metadata: []' arrived with status DONE for job 1, should have been STATUS_SUBMITTED at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.onDoOneCrawl(HarvestControllerServer.java:361) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.visit(HarvestControllerServer.java:486) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.DoOneCrawlMessage.accept(DoOneCrawlMessage.java:101) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.onMessage(HarvesterMessageHandler.java:69) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester.testMessagesSentByFailedJob(HarvestControllerServerTester.java:228) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 13:52:56.330 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closing HarvestControllerServer. 13:52:56.331 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 13:52:56.332 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closed down HarvestControllerServer 13:52:56.398 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:56.400 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:56.401 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:56.536 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Starting HarvestControllerServer. 13:52:56.537 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 13:52:56.539 [main] WARN dk.netarkivet.common.utils.ApplicationUtils - Non-existing directory created '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/server' 13:52:56.541 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/server' 13:52:56.555 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 13:52:56.562 [main] DEBUG d.n.harvester.harvesting.distribute.HarvestControllerServer - Obtained JMS connection. 13:52:56.573 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 13:52:56.573 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closing HarvestControllerServer. 13:52:56.574 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 13:52:56.575 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closed down HarvestControllerServer 13:52:56.770 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:56.771 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:56.772 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.074 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Starting HarvestControllerServer. 13:52:57.075 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 13:52:57.077 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working' 13:52:57.079 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 13:52:57.083 [main] DEBUG d.n.harvester.harvesting.distribute.HarvestControllerServer - Obtained JMS connection. 13:52:57.159 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 13:52:57.311 [main] DEBUG d.n.harvester.harvesting.distribute.HarvestControllerServer - No longer accepting jobs. 13:52:57.312 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Received crawlrequest for job 42: 'id1: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Job 42 (state = DONE, HD = 42, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = -1, forcemaxrunningtime = 0, orderxml = default_orderxml, numconfigs = 0, created = null), metadata: []' 13:52:57.313 [main] WARN d.n.harvester.harvesting.distribute.HarvestControllerServer - Message 'id1: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Job 42 (state = DONE, HD = 42, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = -1, forcemaxrunningtime = 0, orderxml = default_orderxml, numconfigs = 0, created = null), metadata: []' arrived with status DONE for job 42, should have been STATUS_SUBMITTED 13:52:57.319 [main] WARN dk.netarkivet.harvester.distribute.HarvesterMessageHandler - Error processing message 'TestObjectMessage: id1: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Job 42 (state = DONE, HD = 42, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = -1, forcemaxrunningtime = 0, orderxml = default_orderxml, numconfigs = 0, created = null), metadata: []' dk.netarkivet.common.exceptions.ArgumentNotValid: Message 'id1: To DEV_COMMON_JOB_PARTIAL_FOCUSED ReplyTo DEV_COMMON_ERROR OK Job: Job 42 (state = DONE, HD = 42, channel = FOCUSED, snapshot = false, forcemaxcount = -1, forcemaxbytes = -1, forcemaxrunningtime = 0, orderxml = default_orderxml, numconfigs = 0, created = null), metadata: []' arrived with status DONE for job 42, should have been STATUS_SUBMITTED at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.onDoOneCrawl(HarvestControllerServer.java:361) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.visit(HarvestControllerServer.java:486) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.DoOneCrawlMessage.accept(DoOneCrawlMessage.java:101) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.onMessage(HarvesterMessageHandler.java:69) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester.testJobFailedOnBadMessage(HarvestControllerServerTester.java:290) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 13:52:57.324 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closing HarvestControllerServer. 13:52:57.325 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 13:52:57.326 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closed down HarvestControllerServer 13:52:57.387 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.389 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:57.390 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.469 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Starting HarvestControllerServer. 13:52:57.470 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Bound to harvest channel 'FOCUSED' 13:52:57.472 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Serverdir: '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/distribute/data/working' 13:52:57.473 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Harvesting requires at least 400000000 bytes free. 13:52:57.477 [main] DEBUG d.n.harvester.harvesting.distribute.HarvestControllerServer - Obtained JMS connection. 13:52:57.544 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Requested to check the validity of harvest channel 'FOCUSED' 13:52:57.545 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closing HarvestControllerServer. 13:52:57.545 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_HCHAN_VAL_RESP' 13:52:57.545 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Closed down HarvestControllerServer 13:52:57.596 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.597 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:57.597 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.633 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Starting HarvestControllerServer. 13:52:57.634 [main] INFO d.n.harvester.harvesting.distribute.HarvestControllerServer - Bound to harvest channel 'FOCUSED' Tests run: 11, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 9.034 sec - in dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServerTester 13:52:57.651 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.652 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.652 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.652 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.652 [Thread-24] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.652 [Thread-24] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.653 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.653 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.653 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.653 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.653 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.654 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.654 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.654 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.654 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.654 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.654 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.654 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.654 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.655 [Thread-28] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.655 [Thread-28] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.655 [Thread-32] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.655 [Thread-32] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.656 [Thread-32] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.657 [Thread-32] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.657 [Thread-29] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.657 [Thread-33] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.658 [Thread-33] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.658 [Thread-31] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.658 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.659 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.659 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.662 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.662 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.662 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.662 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.663 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.663 [Thread-7] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.665 [Thread-7] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.665 [Thread-7] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.666 [Thread-7] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.666 [Thread-20] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.668 [Thread-20] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.668 [Thread-15] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.668 [Thread-15] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.669 [Thread-16] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.670 [Thread-21] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.671 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.671 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.672 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.672 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.673 [Thread-24] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.678 [Thread-24] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.678 [Thread-28] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:57.678 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.679 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.679 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.681 [Thread-33] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:57.683 [Thread-29] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.684 [Thread-29] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:57.684 [Thread-31] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.686 [Thread-31] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.687 [Thread-31] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.687 [Thread-20] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:52:57.687 [Thread-15] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.688 [Thread-15] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.689 [Thread-21] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.691 [Thread-21] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.691 [Thread-28] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.692 [Thread-16] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:52:57.692 [Thread-16] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.692 [Thread-16] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.693 [Thread-33] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.694 [Thread-29] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.695 [Thread-20] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:52:57.697 [Thread-21] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.harvester.harvesting.distribute.CrawlStatusMessageTester 13:52:59.177 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:52:59.184 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.051 sec - in dk.netarkivet.harvester.harvesting.distribute.CrawlStatusMessageTester Running dk.netarkivet.harvester.harvesting.distribute.MetadataEntryTester Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.888 sec - in dk.netarkivet.harvester.harvesting.distribute.MetadataEntryTester Running dk.netarkivet.harvester.harvesting.distribute.DomainStatsTester Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in dk.netarkivet.harvester.harvesting.distribute.DomainStatsTester Running dk.netarkivet.harvester.harvesting.distribute.CrawlProgressMessageTester 13:53:03.737 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:53:03.743 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.766 sec - in dk.netarkivet.harvester.harvesting.distribute.CrawlProgressMessageTester Running dk.netarkivet.harvester.harvesting.distribute.IntegrityTestsHCSJMSException Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.002 sec - in dk.netarkivet.harvester.harvesting.distribute.IntegrityTestsHCSJMSException Running dk.netarkivet.harvester.harvesting.distribute.IntegrityTests Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.001 sec - in dk.netarkivet.harvester.harvesting.distribute.IntegrityTests Running dk.netarkivet.harvester.harvesting.distribute.HangingListenerTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.002 sec - in dk.netarkivet.harvester.harvesting.distribute.HangingListenerTest Running dk.netarkivet.harvester.harvesting.HeritrixFilesTester 13:53:06.930 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:06.938 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:06.938 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:06.938 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:06.950 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:06.950 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:07.031 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.031 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.032 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:07.032 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.033 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.033 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:07.036 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.036 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.037 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:07.037 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.038 [main] DEBUG dk.netarkivet.harvester.harvesting.HeritrixFiles - Writing seeds to disk as file: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/heritrix_out/seeds.txt 13:53:07.039 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.039 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:07.044 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.045 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.046 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:07.046 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.072 [main] DEBUG dk.netarkivet.harvester.harvesting.HeritrixFiles - Writing order-file to disk as file: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/heritrix_out/order.xml 13:53:07.091 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.092 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:07.096 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.096 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.097 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:07.097 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.098 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.098 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:07.102 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.102 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.103 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:07.104 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.105 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.106 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.979 sec - in dk.netarkivet.harvester.harvesting.HeritrixFilesTester 13:53:07.128 [Thread-18] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.129 [Thread-18] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.129 [Thread-18] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.131 [Thread-18] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.131 [Thread-17] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.132 [Thread-17] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.132 [Thread-17] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.133 [Thread-17] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.133 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.134 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.134 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.134 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.135 [Thread-21] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.135 [Thread-21] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.135 [Thread-21] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.136 [Thread-21] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.137 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.137 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.137 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.138 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.139 [Thread-13] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.139 [Thread-13] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.140 [Thread-13] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.140 [Thread-13] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.144 [Thread-6] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.145 [Thread-6] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.145 [Thread-6] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.146 [Thread-6] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.146 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.147 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.147 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.147 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.148 [Thread-22] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.148 [Thread-22] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.148 [Thread-22] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.149 [Thread-22] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.149 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.149 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.149 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.151 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.153 [Thread-9] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.153 [Thread-9] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.154 [Thread-9] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.154 [Thread-9] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.155 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.156 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:07.156 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:07.157 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.harvester.harvesting.MetadataFileWriterTester Sep 22, 2014 1:53:08 PM org.archive.io.WriterPoolMember close INFO: Closed /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/metadata.warc, size 8552 13:53:08.471 [main] INFO d.n.harvester.harvesting.metadata.MetadataFileWriterWarc - tests/dk/netarkivet/harvester/harvesting/data/working/logs/recover.gz 4594 13:53:08.481 [main] INFO d.n.harvester.harvesting.metadata.MetadataFileWriterWarc - tests/dk/netarkivet/harvester/harvesting/data/working/logs/progress-statistics.log 821 13:53:08.482 [main] INFO d.n.harvester.harvesting.metadata.MetadataFileWriterWarc - tests/dk/netarkivet/harvester/harvesting/data/working/logs/local-errors.log 2121 13:53:08.483 [main] INFO d.n.harvester.harvesting.metadata.MetadataFileWriterWarc - tests/dk/netarkivet/harvester/harvesting/data/working/logs/crawl.log 14863 13:53:08.488 [main] INFO d.n.harvester.harvesting.metadata.MetadataFileWriterWarc - tests/dk/netarkivet/harvester/harvesting/data/working/logs/runtime-errors.log 0 13:53:08.489 [main] INFO d.n.harvester.harvesting.metadata.MetadataFileWriterWarc - tests/dk/netarkivet/harvester/harvesting/data/working/logs/uri-errors.log 2827 Sep 22, 2014 1:53:08 PM org.archive.io.WriterPoolMember close INFO: Closed /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/metadata.arc, size 8406 Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.873 sec - in dk.netarkivet.harvester.harvesting.MetadataFileWriterTester Running dk.netarkivet.harvester.harvesting.IngestableFilesTester Sep 22, 2014 1:53:10 PM org.archive.io.WriterPoolMember close INFO: Closed /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/1-metadata-1.arc, size 248 Sep 22, 2014 1:53:10 PM org.archive.io.WriterPoolMember close INFO: Closed /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/1-metadata-1.arc, size 248 Sep 22, 2014 1:53:10 PM org.archive.io.WriterPoolMember close INFO: Closed /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/1-metadata-1.arc, size 248 Sep 22, 2014 1:53:10 PM org.archive.io.WriterPoolMember close INFO: Closed /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/1-metadata-1.arc, size 248 Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.8 sec - in dk.netarkivet.harvester.harvesting.IngestableFilesTester Running dk.netarkivet.harvester.harvesting.HeritrixControllerFactoryTester class dk.netarkivet.harvester.harvesting.HeritrixControllerFactoryTester$DummyHeritrixController Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.836 sec - in dk.netarkivet.harvester.harvesting.HeritrixControllerFactoryTester Running dk.netarkivet.harvester.harvesting.HarvestDocumentationTester 13:53:13.885 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - Creating an arcfiles-report.txt 13:53:13.900 [main] ERROR dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator - java.io.FileNotFoundException: tests/dk/netarkivet/harvester/harvesting/data/working/heritrix.out (No such file or directory) at java.io.FileInputStream.open(Native Method) ~[na:1.8.0_11] at java.io.FileInputStream.(FileInputStream.java:131) ~[na:1.8.0_11] at java.io.FileReader.(FileReader.java:72) ~[na:1.8.0_11] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.parseHeritrixOut(ArchiveFilesReportGenerator.java:232) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.generateReport(ArchiveFilesReportGenerator.java:173) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.writeHarvestDetails(HarvestDocumentation.java:387) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:150) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testDocumentHarvestBug722(HarvestDocumentationTester.java:453) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 13:53:13.905 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - No logs dir found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working 13:53:13.906 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - No settings directory found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working 13:53:13.911 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/archivefiles-report.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:13.913 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - Looking for files not having harvestprefix '42-142' 13:53:13.914 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/arcs/42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc 13:53:13.915 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc 13:53:13.915 [main] WARN dk.netarkivet.harvester.harvesting.HarvestDocumentation - Found files not belonging to job 42, the following files have been stored for later: [oldjobs/lost-files-1411386793913/42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc, oldjobs/lost-files-1411386793913/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc] 13:53:14.022 [main] WARN dk.netarkivet.common.utils.cdx.CDXUtils - Found no related arcfiles to process in the archive dir '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/arcs'. Sep 22, 2014 1:53:14 PM org.archive.io.WriterPoolMember close INFO: Closed /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc, size 495 13:53:14.031 [main] WARN dk.netarkivet.harvester.harvesting.HarvestDocumentation - The metadata-file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/metadata/42-metadata-1.arc' already exists, so we don't make another one! 13:53:14.051 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - Looking for files not having harvestprefix '42-117' 13:53:14.051 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/arcs/43-117-20051212141241-00000-sb-test-har-001.statsbiblioteket.dk.arc 13:53:14.052 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/arcs/43-metadata-1.arc 13:53:14.052 [main] WARN dk.netarkivet.harvester.harvesting.HarvestDocumentation - Found files not belonging to job 42, the following files have been stored for later: [/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/oddjobs/lost-files-1411386794051/43-117-20051212141241-00000-sb-test-har-001.statsbiblioteket.dk.arc, /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/oddjobs/lost-files-1411386794051/43-metadata-1.arc] Locating lost-files directory /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/oddjobs/lost-files-1411386794051 13:53:14.115 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - Creating an arcfiles-report.txt 13:53:14.116 [main] ERROR dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator - java.io.FileNotFoundException: tests/dk/netarkivet/harvester/harvesting/data/working/heritrix.out (No such file or directory) at java.io.FileInputStream.open(Native Method) ~[na:1.8.0_11] at java.io.FileInputStream.(FileInputStream.java:131) ~[na:1.8.0_11] at java.io.FileReader.(FileReader.java:72) ~[na:1.8.0_11] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.parseHeritrixOut(ArchiveFilesReportGenerator.java:232) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.generateReport(ArchiveFilesReportGenerator.java:173) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.writeHarvestDetails(HarvestDocumentation.java:387) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:150) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testWriteHarvestDetails(HarvestDocumentationTester.java:488) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 13:53:14.120 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - Found Heritrix log file progress-statistics.log 13:53:14.122 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - Found Heritrix log file local-errors.log 13:53:14.123 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - Found Heritrix log file crawl.log 13:53:14.124 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - Found Heritrix log file runtime-errors.log 13:53:14.125 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - Found Heritrix log file uri-errors.log 13:53:14.127 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/crawl-manifest.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.128 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/harvestInfo.xml' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.161 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/order.xml' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.162 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/seeds.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.163 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/settings/dk/kb/settings.xml' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.164 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/archivefiles-report.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.165 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/crawl-report.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.165 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/hosts-report.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.167 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/mimetype-report.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.170 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/processors-report.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.171 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/responsecode-report.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.173 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/seeds-report.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.174 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/logs/crawl.log' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.175 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/logs/local-errors.log' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.176 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/logs/progress-statistics.log' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.178 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/logs/runtime-errors.log' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.189 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/logs/uri-errors.log' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.198 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - Looking for files not having harvestprefix '42-142' 13:53:14.199 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/arcs/NetarchiveSuite-netarkivet.arc.gz 13:53:14.201 [main] WARN dk.netarkivet.harvester.harvesting.HarvestDocumentation - Found files not belonging to job 42, the following files have been stored for later: [oldjobs/lost-files-1411386794198/NetarchiveSuite-netarkivet.arc.gz] 13:53:14.202 [main] WARN dk.netarkivet.common.utils.cdx.CDXUtils - Found no related arcfiles to process in the archive dir '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/arcs'. Sep 22, 2014 1:53:14 PM org.archive.io.WriterPoolMember close INFO: Closed /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc, size 38258 13:53:14.280 [main] WARN dk.netarkivet.common.utils.FileUtils - Could not create directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/launcher/originals/order.xml/metadata' 13:53:14.289 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - Creating an arcfiles-report.txt 13:53:14.292 [main] ERROR dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator - java.io.FileNotFoundException: tests/dk/netarkivet/harvester/harvesting/data/working/heritrix.out (No such file or directory) at java.io.FileInputStream.open(Native Method) ~[na:1.8.0_11] at java.io.FileInputStream.(FileInputStream.java:131) ~[na:1.8.0_11] at java.io.FileReader.(FileReader.java:72) ~[na:1.8.0_11] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.parseHeritrixOut(ArchiveFilesReportGenerator.java:232) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.generateReport(ArchiveFilesReportGenerator.java:173) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.writeHarvestDetails(HarvestDocumentation.java:387) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:150) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testDocumentHarvestExceptionalCases(HarvestDocumentationTester.java:202) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 13:53:14.298 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - No logs dir found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working 13:53:14.299 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - No settings directory found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working 13:53:14.300 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/archivefiles-report.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.314 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - Looking for files not having harvestprefix '42-117' 13:53:14.315 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - removing unidentified file /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/arcs/43-117-20051212141241-00000-sb-test-har-001.statsbiblioteket.dk.arc 13:53:14.315 [main] WARN dk.netarkivet.harvester.harvesting.HarvestDocumentation - Found files not belonging to job 42, the following files have been stored for later: [oldjobs/lost-files-1411386794314/43-117-20051212141241-00000-sb-test-har-001.statsbiblioteket.dk.arc] 13:53:14.318 [main] DEBUG dk.netarkivet.common.utils.cdx.CDXUtils - Found 1 related arcfiles to process in the archive dir '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/arcs'. 13:53:14.323 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc 13:53:14.323 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc'. Sep 22, 2014 1:53:14 PM org.archive.io.ArchiveReader$ArchiveRecordIterator next WARNING: Bad Record. Trying skip (Current offset 150): Failed parse of http status line. (Offset 150). 13:53:14.356 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJobBase - Caught exception while running batch job on file tests/dk/netarkivet/harvester/harvesting/data/working/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc, position 0: java.lang.RuntimeException: After retry (Offset 150) 13:53:14.367 [main] DEBUG dk.netarkivet.common.utils.cdx.CDXUtils - Exceptions during generation of index on file 'tests/dk/netarkivet/harvester/harvesting/data/working/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc': java.lang.RuntimeException: After retry (Offset 150) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:535) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:461) at dk.netarkivet.common.utils.archive.ArchiveBatchJob.processFile(ArchiveBatchJob.java:108) at dk.netarkivet.common.utils.batch.BatchLocalFiles.processFile(BatchLocalFiles.java:156) at dk.netarkivet.common.utils.batch.BatchLocalFiles.run(BatchLocalFiles.java:105) at dk.netarkivet.common.utils.cdx.CDXUtils.writeCDXInfo(CDXUtils.java:60) at dk.netarkivet.common.utils.cdx.CDXUtils.generateCDX(CDXUtils.java:114) at dk.netarkivet.harvester.harvesting.HarvestDocumentation.addCDXes(HarvestDocumentation.java:211) at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:176) at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testDocumentHarvestExceptionalCases(HarvestDocumentationTester.java:202) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.junit.runners.Suite.runChild(Suite.java:127) at org.junit.runners.Suite.runChild(Suite.java:26) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.junit.runner.JUnitCore.run(JUnitCore.java:160) at org.junit.runner.JUnitCore.run(JUnitCore.java:138) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) Caused by: java.io.IOException: Unparseable header line: [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] at org.archive.io.arc.ARCReader.getTokenizedHeaderLine(ARCReader.java:308) at org.archive.io.arc.ARCReader.createArchiveRecord(ARCReader.java:183) at org.archive.io.arc.ARCReader.createArchiveRecord(ARCReader.java:77) at org.archive.io.ArchiveReader.get(ArchiveReader.java:151) at org.archive.io.ArchiveReader$ArchiveRecordIterator.innerNext(ArchiveReader.java:585) at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:560) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:528) ... 45 more 13:53:14.373 [main] DEBUG dk.netarkivet.common.utils.cdx.CDXUtils - Created index of 0 records on file 'tests/dk/netarkivet/harvester/harvesting/data/working/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc' 13:53:14.374 [main] DEBUG dk.netarkivet.harvester.harvesting.metadata.MetadataFileWriter - Inserting the file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/cdx2986646303749483653.tmp/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc.cdx' Sep 22, 2014 1:53:14 PM org.archive.io.WriterPoolMember close INFO: Closed /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc, size 717 13:53:14.428 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - Creating an arcfiles-report.txt 13:53:14.430 [main] ERROR dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator - java.io.FileNotFoundException: tests/dk/netarkivet/harvester/harvesting/data/working/heritrix.out (No such file or directory) at java.io.FileInputStream.open(Native Method) ~[na:1.8.0_11] at java.io.FileInputStream.(FileInputStream.java:131) ~[na:1.8.0_11] at java.io.FileReader.(FileReader.java:72) ~[na:1.8.0_11] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.parseHeritrixOut(ArchiveFilesReportGenerator.java:232) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.ArchiveFilesReportGenerator.generateReport(ArchiveFilesReportGenerator.java:173) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.writeHarvestDetails(HarvestDocumentation.java:387) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:150) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testDocumentHarvestOrdinaryCase(HarvestDocumentationTester.java:127) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 13:53:14.432 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - No logs dir found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working 13:53:14.432 [main] DEBUG dk.netarkivet.harvester.harvesting.HarvestDocumentation - No settings directory found in crawldir: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working 13:53:14.433 [main] DEBUG d.netarkivet.harvester.harvesting.metadata.MetadataFileWriterArc - Wrote '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/archivefiles-report.txt' to '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc'. 13:53:14.435 [main] INFO dk.netarkivet.harvester.harvesting.HarvestDocumentation - Looking for files not having harvestprefix '42-117' 13:53:14.435 [main] DEBUG dk.netarkivet.common.utils.cdx.CDXUtils - Found 2 related arcfiles to process in the archive dir '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/arcs'. 13:53:14.436 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc 13:53:14.437 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 13:53:14.437 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 13:53:14.441 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 13:53:14.441 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #2 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 13:53:14.442 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #3 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 13:53:14.442 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #4 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 13:53:14.446 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #5 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 13:53:14.446 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #6 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 13:53:14.447 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #7 in archive file '42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc'. 13:53:14.447 [main] DEBUG dk.netarkivet.common.utils.cdx.CDXUtils - Created index of 8 records on file 'tests/dk/netarkivet/harvester/harvesting/data/working/arcs/42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc' 13:53:14.448 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc 13:53:14.449 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc'. Sep 22, 2014 1:53:14 PM org.archive.io.ArchiveReader$ArchiveRecordIterator next WARNING: Bad Record. Trying skip (Current offset 150): Failed parse of http status line. (Offset 150). 13:53:14.450 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJobBase - Caught exception while running batch job on file tests/dk/netarkivet/harvester/harvesting/data/working/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc, position 0: java.lang.RuntimeException: After retry (Offset 150) 13:53:14.453 [main] DEBUG dk.netarkivet.common.utils.cdx.CDXUtils - Exceptions during generation of index on file 'tests/dk/netarkivet/harvester/harvesting/data/working/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc': java.lang.RuntimeException: After retry (Offset 150) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:535) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:461) at dk.netarkivet.common.utils.archive.ArchiveBatchJob.processFile(ArchiveBatchJob.java:108) at dk.netarkivet.common.utils.batch.BatchLocalFiles.processFile(BatchLocalFiles.java:156) at dk.netarkivet.common.utils.batch.BatchLocalFiles.run(BatchLocalFiles.java:105) at dk.netarkivet.common.utils.cdx.CDXUtils.writeCDXInfo(CDXUtils.java:60) at dk.netarkivet.common.utils.cdx.CDXUtils.generateCDX(CDXUtils.java:114) at dk.netarkivet.harvester.harvesting.HarvestDocumentation.addCDXes(HarvestDocumentation.java:211) at dk.netarkivet.harvester.harvesting.HarvestDocumentation.documentHarvest(HarvestDocumentation.java:176) at dk.netarkivet.harvester.harvesting.HarvestDocumentationTester.testDocumentHarvestOrdinaryCase(HarvestDocumentationTester.java:127) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.junit.runners.Suite.runChild(Suite.java:127) at org.junit.runners.Suite.runChild(Suite.java:26) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.junit.runner.JUnitCore.run(JUnitCore.java:160) at org.junit.runner.JUnitCore.run(JUnitCore.java:138) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) Caused by: java.io.IOException: Unparseable header line: [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] at org.archive.io.arc.ARCReader.getTokenizedHeaderLine(ARCReader.java:308) at org.archive.io.arc.ARCReader.createArchiveRecord(ARCReader.java:183) at org.archive.io.arc.ARCReader.createArchiveRecord(ARCReader.java:77) at org.archive.io.ArchiveReader.get(ArchiveReader.java:151) at org.archive.io.ArchiveReader$ArchiveRecordIterator.innerNext(ArchiveReader.java:585) at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:560) at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:528) ... 45 more 13:53:14.453 [main] DEBUG dk.netarkivet.common.utils.cdx.CDXUtils - Created index of 0 records on file 'tests/dk/netarkivet/harvester/harvesting/data/working/arcs/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc' 13:53:14.454 [main] DEBUG dk.netarkivet.harvester.harvesting.metadata.MetadataFileWriter - Inserting the file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/cdx5926147484665783603.tmp/42-117-20051212141241-00001-sb-test-har-001.statsbiblioteket.dk.arc.cdx' 13:53:14.454 [main] DEBUG dk.netarkivet.harvester.harvesting.metadata.MetadataFileWriter - Inserting the file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/cdx5926147484665783603.tmp/42-117-20051212141240-00000-sb-test-har-001.statsbiblioteket.dk.arc.cdx' Sep 22, 2014 1:53:14 PM org.archive.io.WriterPoolMember close INFO: Closed /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/harvesting/data/working/tmp-meta/42-metadata-1.arc, size 2423 Tests run: 9, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.64 sec - in dk.netarkivet.harvester.harvesting.HarvestDocumentationTester Running dk.netarkivet.harvester.harvesting.monitor.StartedJobHistoryChartGenTest 13:53:16.302 [pool-1-thread-1] INFO com.mchange.v2.log.MLog - MLog clients using log4j logging. 13:53:16.525 [pool-1-thread-1] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.1 [built 16-January-2007 14:46:42; debug? true; trace: 10] 13:53:16.977 [pool-1-thread-1] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values: - minPoolSize=5 - maxPoolSize=10 - acquireIncrement=5 - maxStatements=0 - maxStatementsPerConnection=0 - idleConnTestPeriod=0 - idleConnTestQuery='null' - idleConnTestOnCheckin=false 13:53:17.145 [pool-1-thread-1] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, dataSourceName -> 10bbezp9417mba081vzk670|6c0c828b, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.apache.derby.jdbc.EmbeddedDriver, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 10bbezp9417mba081vzk670|6c0c828b, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:derby:harvestdefinitionbasedir/fullhddb;upgrade=true, lastAcquisitionFailureDefaultUser -> null, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 10, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, numThreadsAwaitingCheckoutDefaultUser -> 0, preferredTestQuery -> null, properties -> {}, propertyCycle -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false ] 13:53:18.162 [pool-1-thread-1] WARN com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@7e003cfa -- an attempt to checkout a resource was interrupted, and the pool is still live: some other thread must have either interrupted the Thread attempting checkout! java.lang.InterruptedException: null at java.lang.Object.wait(Native Method) ~[na:1.8.0_11] at com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1315) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:557) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:477) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:525) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128) [c3p0-0.9.1.jar:0.9.1] at dk.netarkivet.harvester.datamodel.HarvestDBConnection.get(HarvestDBConnection.java:99) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DBSpecifics.updateTable(DBSpecifics.java:109) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DBSpecifics.updateTables(DBSpecifics.java:670) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.HarvestDBConnection.get(HarvestDBConnection.java:95) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.RunningJobsInfoDBDAO.(RunningJobsInfoDBDAO.java:114) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.RunningJobsInfoDAO.getInstance(RunningJobsInfoDAO.java:57) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.monitor.StartedJobHistoryChartGen$ChartGen.run(StartedJobHistoryChartGen.java:166) [harvester-5.0-SNAPSHOT.jar:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_11] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_11] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_11] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_11] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_11] 13:53:18.164 [pool-1-thread-1] DEBUG com.mchange.v2.sql.SqlUtils - Converting Throwable to SQLException... java.lang.InterruptedException: null at java.lang.Object.wait(Native Method) ~[na:1.8.0_11] at com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1315) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:557) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:477) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:525) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128) [c3p0-0.9.1.jar:0.9.1] at dk.netarkivet.harvester.datamodel.HarvestDBConnection.get(HarvestDBConnection.java:99) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DBSpecifics.updateTable(DBSpecifics.java:109) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DBSpecifics.updateTables(DBSpecifics.java:670) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.HarvestDBConnection.get(HarvestDBConnection.java:95) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.RunningJobsInfoDBDAO.(RunningJobsInfoDBDAO.java:114) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.RunningJobsInfoDAO.getInstance(RunningJobsInfoDAO.java:57) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.monitor.StartedJobHistoryChartGen$ChartGen.run(StartedJobHistoryChartGen.java:166) [harvester-5.0-SNAPSHOT.jar:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_11] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_11] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_11] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_11] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_11] 13:53:18.166 [pool-1-thread-1] WARN dk.netarkivet.harvester.datamodel.HarvestDBConnection - Can't connect to database with DBurl: 'jdbc:derby:harvestdefinitionbasedir/fullhddb;upgrade=true' using driver 'org.apache.derby.jdbc.EmbeddedDriver' SQLException trace: SQL State:null Error Code:0 java.sql.SQLException: An SQLException was provoked by the following failure: java.lang.InterruptedException at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:106) at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:65) at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:62) at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:531) at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128) at dk.netarkivet.harvester.datamodel.HarvestDBConnection.get(HarvestDBConnection.java:99) at dk.netarkivet.harvester.datamodel.DBSpecifics.updateTable(DBSpecifics.java:109) at dk.netarkivet.harvester.datamodel.DBSpecifics.updateTables(DBSpecifics.java:670) at dk.netarkivet.harvester.datamodel.HarvestDBConnection.get(HarvestDBConnection.java:95) at dk.netarkivet.harvester.datamodel.RunningJobsInfoDBDAO.(RunningJobsInfoDBDAO.java:114) at dk.netarkivet.harvester.datamodel.RunningJobsInfoDAO.getInstance(RunningJobsInfoDAO.java:57) at dk.netarkivet.harvester.harvesting.monitor.StartedJobHistoryChartGen$ChartGen.run(StartedJobHistoryChartGen.java:166) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.InterruptedException at java.lang.Object.wait(Native Method) at com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1315) at com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:557) at com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:477) at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:525) ... 15 more End of SQLException trace java.sql.SQLException: An SQLException was provoked by the following failure: java.lang.InterruptedException at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:106) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:65) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:62) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:531) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128) ~[c3p0-0.9.1.jar:0.9.1] at dk.netarkivet.harvester.datamodel.HarvestDBConnection.get(HarvestDBConnection.java:99) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DBSpecifics.updateTable(DBSpecifics.java:109) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DBSpecifics.updateTables(DBSpecifics.java:670) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.HarvestDBConnection.get(HarvestDBConnection.java:95) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.RunningJobsInfoDBDAO.(RunningJobsInfoDBDAO.java:114) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.RunningJobsInfoDAO.getInstance(RunningJobsInfoDAO.java:57) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.monitor.StartedJobHistoryChartGen$ChartGen.run(StartedJobHistoryChartGen.java:166) [harvester-5.0-SNAPSHOT.jar:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_11] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_11] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_11] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_11] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_11] Caused by: java.lang.InterruptedException: null at java.lang.Object.wait(Native Method) ~[na:1.8.0_11] at com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1315) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:557) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:477) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:525) ~[c3p0-0.9.1.jar:0.9.1] ... 15 common frames omitted Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.96 sec - in dk.netarkivet.harvester.harvesting.monitor.StartedJobHistoryChartGenTest 13:53:18.233 [pool-3-thread-1] WARN com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@7e003cfa -- an attempt to checkout a resource was interrupted, and the pool is still live: some other thread must have either interrupted the Thread attempting checkout! java.lang.InterruptedException: null at java.lang.Object.wait(Native Method) ~[na:1.8.0_11] at com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1315) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:557) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:477) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:525) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128) [c3p0-0.9.1.jar:0.9.1] at dk.netarkivet.harvester.datamodel.HarvestDBConnection.get(HarvestDBConnection.java:99) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.RunningJobsInfoDBDAO.(RunningJobsInfoDBDAO.java:114) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.RunningJobsInfoDAO.getInstance(RunningJobsInfoDAO.java:57) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.monitor.StartedJobHistoryChartGen$ChartGen.run(StartedJobHistoryChartGen.java:166) [harvester-5.0-SNAPSHOT.jar:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_11] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_11] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_11] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_11] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_11] 13:53:18.235 [pool-3-thread-1] DEBUG com.mchange.v2.sql.SqlUtils - Converting Throwable to SQLException... java.lang.InterruptedException: null at java.lang.Object.wait(Native Method) ~[na:1.8.0_11] at com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1315) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:557) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:477) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:525) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128) [c3p0-0.9.1.jar:0.9.1] at dk.netarkivet.harvester.datamodel.HarvestDBConnection.get(HarvestDBConnection.java:99) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.RunningJobsInfoDBDAO.(RunningJobsInfoDBDAO.java:114) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.RunningJobsInfoDAO.getInstance(RunningJobsInfoDAO.java:57) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.monitor.StartedJobHistoryChartGen$ChartGen.run(StartedJobHistoryChartGen.java:166) [harvester-5.0-SNAPSHOT.jar:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_11] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_11] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_11] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_11] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_11] 13:53:18.237 [pool-3-thread-1] WARN dk.netarkivet.harvester.datamodel.HarvestDBConnection - Can't connect to database with DBurl: 'jdbc:derby:harvestdefinitionbasedir/fullhddb;upgrade=true' using driver 'org.apache.derby.jdbc.EmbeddedDriver' SQLException trace: SQL State:null Error Code:0 java.sql.SQLException: An SQLException was provoked by the following failure: java.lang.InterruptedException at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:106) at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:65) at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:62) at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:531) at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128) at dk.netarkivet.harvester.datamodel.HarvestDBConnection.get(HarvestDBConnection.java:99) at dk.netarkivet.harvester.datamodel.RunningJobsInfoDBDAO.(RunningJobsInfoDBDAO.java:114) at dk.netarkivet.harvester.datamodel.RunningJobsInfoDAO.getInstance(RunningJobsInfoDAO.java:57) at dk.netarkivet.harvester.harvesting.monitor.StartedJobHistoryChartGen$ChartGen.run(StartedJobHistoryChartGen.java:166) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.InterruptedException at java.lang.Object.wait(Native Method) at com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1315) at com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:557) at com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:477) at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:525) ... 12 more End of SQLException trace java.sql.SQLException: An SQLException was provoked by the following failure: java.lang.InterruptedException at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:106) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:65) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:62) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:531) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128) ~[c3p0-0.9.1.jar:0.9.1] at dk.netarkivet.harvester.datamodel.HarvestDBConnection.get(HarvestDBConnection.java:99) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.RunningJobsInfoDBDAO.(RunningJobsInfoDBDAO.java:114) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.RunningJobsInfoDAO.getInstance(RunningJobsInfoDAO.java:57) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.monitor.StartedJobHistoryChartGen$ChartGen.run(StartedJobHistoryChartGen.java:166) [harvester-5.0-SNAPSHOT.jar:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_11] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_11] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_11] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_11] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_11] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_11] Caused by: java.lang.InterruptedException: null at java.lang.Object.wait(Native Method) ~[na:1.8.0_11] at com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1315) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:557) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:477) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:525) ~[c3p0-0.9.1.jar:0.9.1] ... 12 common frames omitted Running dk.netarkivet.harvester.harvesting.HarvestControllerTester 13:53:20.107 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:20.125 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:20.126 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:20.127 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:20.551 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:53:20.553 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:53:20.555 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:53:20.593 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:53:20.622 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:53:20.639 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:20.639 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:20.640 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:20.726 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:20.726 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:20.726 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:20.756 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:20.756 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:20.757 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:20.785 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:20.786 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:20.786 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:20.807 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:53:20.807 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:53:20.812 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 1 13:53:20.887 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.topLevelDomains.tld 13:53:20.923 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ac,ad,ae,aero,af,ag,ai,al,am,an,ao,aq,ar,arpa,as,gv.at,ac.at,or.at,co.at,biz.at,info.at,priv.at,at,au,aw,ax,az,ba,bb,bd,be,bf,bg,bh,bi,biz,bj,bm,bn,bo,br,bs,bt,bv,bw,by,bz,ca,cat,cc,cd,cf,cg,ch,ci,ck,cl,cm,cn,co,com,coop,cr,cs,cu,cv,cx,cy,cz,de,dj,dk,dm,do,dz,ec,edu,ee,eg,eh,er,es,et,eu,fi,fj,fk,fm,fo,aeroport.fr,asso.fr,avoues.fr,chambagri.fr,com.fr,gouv.fr,medecin.fr,nom.fr,pharmacien.fr,port.fr,prd.fr,presse.fr,tm.fr,fr,ga,gb,gd,ge,gf,gg,gh,gi,gl,gm,gn,gov,gp,gq,gr,gs,gt,gu,gw,gy,hk,hm,hn,hr,ht,hu,id,ie,il,im,in,info,int,io,iq,ir,is,it,je,jm,jo,jobs,jp,ke,kg,kh,ki,km,kn,kp,kr,kw,ky,kz,la,lb,lc,li,lk,lr,ls,lt,lu,lv,ly,ma,mc,md,me,mg,mh,mil,mk,ml,mm,mn,mo,mobi,mp,mq,mr,ms,mt,mu,museum,mv,mw,mx,my,mz,na,name,nc,ne,net,nf,ng,ni,nl,no,np,nr,nt,nu,nz,om,org,pa,pe,pf,pg,ph,pk,pl,pm,pn,pr,pro,ps,pt,pw,py,qa,asso.re,com.re,re,ro,ru,rw,sa,sb,sc,sd,se,sg,sh,si,sj,sk,sl,sm,sn,so,sr,st,su,sv,sy,sz,tc,td,at.tf,net.tf,tf,tg,th,tj,tk,tl,tm,tn,to,tp,tr,travel,tt,tv,tw,tz,ua,ug,ac.uk,co.uk,gov.uk,ltd.uk,me.uk,mod.uk,net.uk,nic.uk,nhs.uk,org.uk,plc.uk,police.uk,sch.uk,govt.uk,orgn.uk,lea.uk,mil.uk,nel.uk,uk,us,uy,uz,va,vc,ve,vg,vi,vn,vu,wien,wf,ws,ye,yt,yu,za,zm,zw 13:53:21.006 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Finished pre-processing of harvest report for job 1, operation took 00d 00:03:14 13:53:21.010 [main] INFO dk.netarkivet.harvester.harvesting.report.AbstractHarvestReport - Starting pre-processing of harvest report for job 1 13:53:21.018 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:53:21.035 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.035 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:21.036 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.144 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:53:21.146 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' Tests run: 7, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 1.939 sec - in dk.netarkivet.harvester.harvesting.HarvestControllerTester 13:53:21.340 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.341 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.342 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.347 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.349 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.351 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.352 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.353 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.355 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.355 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.356 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.357 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.366 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.367 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.368 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.370 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.374 [Thread-7] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.375 [Thread-7] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.375 [Thread-7] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.377 [Thread-7] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.378 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.379 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.381 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.382 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.383 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.384 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.385 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.386 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.388 [Thread-13] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.389 [Thread-13] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.392 [Thread-13] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.393 [Thread-13] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.398 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.401 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.402 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.403 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.400 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.406 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.407 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.408 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.400 [Thread-18] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.412 [Thread-18] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.413 [Thread-18] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.414 [Thread-18] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.399 [Thread-19] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.416 [Thread-19] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.417 [Thread-19] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.418 [Thread-19] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.399 [Thread-17] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.423 [Thread-17] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:21.423 [Thread-17] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:21.424 [Thread-17] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.harvester.harvesting.ArchiveFilesReportGeneratorTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.826 sec - in dk.netarkivet.harvester.harvesting.ArchiveFilesReportGeneratorTest Running dk.netarkivet.harvester.harvesting.frontier.FrontierReportFilterTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 1.374 sec - in dk.netarkivet.harvester.harvesting.frontier.FrontierReportFilterTest Running dk.netarkivet.harvester.harvesting.frontier.InMemoryFrontierReportTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.222 sec - in dk.netarkivet.harvester.harvesting.frontier.InMemoryFrontierReportTest Running dk.netarkivet.harvester.harvesting.frontier.FullFrontierReportTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.364 sec - in dk.netarkivet.harvester.harvesting.frontier.FullFrontierReportTest Running dk.netarkivet.harvester.harvesting.frontier.FrontierReportLineTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.942 sec - in dk.netarkivet.harvester.harvesting.frontier.FrontierReportLineTest Running dk.netarkivet.harvester.harvesting.OnNSDomainsDecideRuleTester 13:53:55.972 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.topLevelDomains.tld 13:53:56.099 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ac,ad,ae,aero,af,ag,ai,al,am,an,ao,aq,ar,arpa,as,gv.at,ac.at,or.at,co.at,biz.at,info.at,priv.at,at,au,aw,ax,az,ba,bb,bd,be,bf,bg,bh,bi,biz,bj,bm,bn,bo,br,bs,bt,bv,bw,by,bz,ca,cat,cc,cd,cf,cg,ch,ci,ck,cl,cm,cn,co,com,coop,cr,cs,cu,cv,cx,cy,cz,de,dj,dk,dm,do,dz,ec,edu,ee,eg,eh,er,es,et,eu,fi,fj,fk,fm,fo,aeroport.fr,asso.fr,avoues.fr,chambagri.fr,com.fr,gouv.fr,medecin.fr,nom.fr,pharmacien.fr,port.fr,prd.fr,presse.fr,tm.fr,fr,ga,gb,gd,ge,gf,gg,gh,gi,gl,gm,gn,gov,gp,gq,gr,gs,gt,gu,gw,gy,hk,hm,hn,hr,ht,hu,id,ie,il,im,in,info,int,io,iq,ir,is,it,je,jm,jo,jobs,jp,ke,kg,kh,ki,km,kn,kp,kr,kw,ky,kz,la,lb,lc,li,lk,lr,ls,lt,lu,lv,ly,ma,mc,md,me,mg,mh,mil,mk,ml,mm,mn,mo,mobi,mp,mq,mr,ms,mt,mu,museum,mv,mw,mx,my,mz,na,name,nc,ne,net,nf,ng,ni,nl,no,np,nr,nt,nu,nz,om,org,pa,pe,pf,pg,ph,pk,pl,pm,pn,pr,pro,ps,pt,pw,py,qa,asso.re,com.re,re,ro,ru,rw,sa,sb,sc,sd,se,sg,sh,si,sj,sk,sl,sm,sn,so,sr,st,su,sv,sy,sz,tc,td,at.tf,net.tf,tf,tg,th,tj,tk,tl,tm,tn,to,tp,tr,travel,tt,tv,tw,tz,ua,ug,ac.uk,co.uk,gov.uk,ltd.uk,me.uk,mod.uk,net.uk,nic.uk,nhs.uk,org.uk,plc.uk,police.uk,sch.uk,govt.uk,orgn.uk,lea.uk,mil.uk,nel.uk,uk,us,uy,uz,va,vc,ve,vg,vi,vn,vu,wien,wf,ws,ye,yt,yu,za,zm,zw Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.9 sec - in dk.netarkivet.harvester.harvesting.OnNSDomainsDecideRuleTester Running dk.netarkivet.harvester.tools.CreateCDXMetadataFileTester Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 0.002 sec - in dk.netarkivet.harvester.tools.CreateCDXMetadataFileTester Running dk.netarkivet.harvester.tools.CreateIndexTester 13:53:58.433 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:58.441 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:58.441 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:58.442 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:58.447 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:53:58.450 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:53:59.738 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_INDEX_SERVER' 13:53:59.752 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:59.753 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:59.939 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:53:59.940 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:53:59.941 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:53:59.942 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:00.242 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_INDEX_SERVER' 13:54:00.250 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:00.250 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:00.287 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:00.287 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:00.288 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:00.288 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:00.418 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_INDEX_SERVER' 13:54:00.419 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:00.420 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:00.433 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:00.434 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:00.434 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:00.434 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:00.546 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_INDEX_SERVER' 13:54:00.548 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:00.549 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:00.610 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:00.611 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:00.611 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:00.612 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:00.726 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'DEDUP_CRAWL_LOG' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/dk/netarkivet/common/tools/working/cache/DEDUP_CRAWL_LOG' Creating DEDUP index for ids: [1] 13:54:00.728 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/dk/netarkivet/common/tools/working/cache/DEDUP_CRAWL_LOG/1-cache.working 13:54:00.728 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/dk/netarkivet/common/tools/working/cache/DEDUP_CRAWL_LOG/1-cache.working' (thread = main) 13:54:00.731 [main] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestClient - Requesting an index of type 'DEDUP_CRAWL_LOG' for the jobs [1] 13:54:00.740 [main] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestClient - Not using localftpserver as transport, because this application uses dk.netarkivet.common.distribute.NullRemoteFile as file transport class 13:54:00.773 [main] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestClient - Waiting 1 hour for the index 13:54:00.795 [main] DEBUG dk.netarkivet.common.distribute.Synchronizer - Received reply for message: msg1: To DEV_COMMON_INDEX_SERVER ReplyTo DEV_COMMON_THIS_INDEX_CLIENT_130_225_27_165_IS_XXX OK 13:54:00.796 [main] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestClient - Successfully received an index of type 'DEDUP_CRAWL_LOG' for the jobs [1] 13:54:00.840 [main] WARN d.netarkivet.harvester.indexserver.distribute.IndexRequestClient - IOFailure during unzipping of index dk.netarkivet.common.exceptions.IOFailure: Error ungzipping './tests/commontempdir/remotefile-unzip8680160540737506013.gz' at dk.netarkivet.common.utils.ZipUtils.gunzipFile(ZipUtils.java:274) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestClient.unzipAndDeleteRemoteFile(IndexRequestClient.java:256) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestClient.cacheData(IndexRequestClient.java:198) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestClient.cacheData(IndexRequestClient.java:63) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.FileBasedCache.cache(FileBasedCache.java:146) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.FileBasedCache.getIndex(FileBasedCache.java:203) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestClient.getIndex(IndexRequestClient.java:63) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.tools.CreateIndex.main(CreateIndex.java:113) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.tools.CreateIndexTester.testMain(CreateIndexTester.java:101) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Caused by: java.io.EOFException: null at java.util.zip.GZIPInputStream.readUByte(GZIPInputStream.java:268) ~[na:1.8.0_11] at java.util.zip.GZIPInputStream.readUShort(GZIPInputStream.java:258) ~[na:1.8.0_11] at java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:164) ~[na:1.8.0_11] at java.util.zip.GZIPInputStream.(GZIPInputStream.java:79) ~[na:1.8.0_11] at java.util.zip.GZIPInputStream.(GZIPInputStream.java:91) ~[na:1.8.0_11] at dk.netarkivet.common.utils.LargeFileGZIPInputStream.(LargeFileGZIPInputStream.java:51) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.common.utils.ZipUtils.gunzipFile(ZipUtils.java:271) ~[common-5.0-SNAPSHOT.jar:na] ... 44 common frames omitted 13:54:00.843 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@59fd97a8 13:54:00.843 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Requested index of type 'DEDUP_CRAWL_LOG' data '[1]' not available. Retrying with available subset '[]' 13:54:00.844 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/dk/netarkivet/common/tools/working/cache/DEDUP_CRAWL_LOG/empty-cache.working 13:54:00.844 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/dk/netarkivet/common/tools/working/cache/DEDUP_CRAWL_LOG/empty-cache.working' (thread = main) 13:54:00.844 [main] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestClient - Requesting an index of type 'DEDUP_CRAWL_LOG' for the jobs [] 13:54:00.845 [main] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestClient - Not using localftpserver as transport, because this application uses dk.netarkivet.common.distribute.NullRemoteFile as file transport class 13:54:00.846 [main] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestClient - Waiting 1 hour for the index 13:54:00.854 [main] DEBUG dk.netarkivet.common.distribute.Synchronizer - Received reply for message: msg3: To DEV_COMMON_INDEX_SERVER ReplyTo DEV_COMMON_THIS_INDEX_CLIENT_130_225_27_165_IS_XXX OK 13:54:00.854 [main] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestClient - Successfully received an index of type 'DEDUP_CRAWL_LOG' for the jobs [] 13:54:00.858 [main] WARN d.netarkivet.harvester.indexserver.distribute.IndexRequestClient - IOFailure during unzipping of index dk.netarkivet.common.exceptions.IOFailure: Error ungzipping './tests/commontempdir/remotefile-unzip8118623221870307511.gz' at dk.netarkivet.common.utils.ZipUtils.gunzipFile(ZipUtils.java:274) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestClient.unzipAndDeleteRemoteFile(IndexRequestClient.java:256) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestClient.cacheData(IndexRequestClient.java:198) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestClient.cacheData(IndexRequestClient.java:63) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.FileBasedCache.cache(FileBasedCache.java:146) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.FileBasedCache.getIndex(FileBasedCache.java:203) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestClient.getIndex(IndexRequestClient.java:63) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.tools.CreateIndex.main(CreateIndex.java:113) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.tools.CreateIndexTester.testMain(CreateIndexTester.java:101) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Caused by: java.io.EOFException: null at java.util.zip.GZIPInputStream.readUByte(GZIPInputStream.java:268) ~[na:1.8.0_11] at java.util.zip.GZIPInputStream.readUShort(GZIPInputStream.java:258) ~[na:1.8.0_11] at java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:164) ~[na:1.8.0_11] at java.util.zip.GZIPInputStream.(GZIPInputStream.java:79) ~[na:1.8.0_11] at java.util.zip.GZIPInputStream.(GZIPInputStream.java:91) ~[na:1.8.0_11] at dk.netarkivet.common.utils.LargeFileGZIPInputStream.(LargeFileGZIPInputStream.java:51) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.common.utils.ZipUtils.gunzipFile(ZipUtils.java:271) ~[common-5.0-SNAPSHOT.jar:na] ... 44 common frames omitted 13:54:00.860 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@123ef382 13:54:00.861 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Generated index '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/dk/netarkivet/common/tools/working/cache/DEDUP_CRAWL_LOG/empty-cache' of id '[]', request was for '[1]' 13:54:00.862 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:00.862 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:00.938 [Thread-22] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:00.988 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_INDEX_SERVER' 13:54:00.989 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:00.990 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:01.001 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.001 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.002 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:01.002 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.274 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_INDEX_SERVER' 13:54:01.275 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.275 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.583 sec - in dk.netarkivet.harvester.tools.CreateIndexTester 13:54:01.286 [Thread-17] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.286 [Thread-17] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.286 [Thread-17] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.287 [Thread-17] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.287 [Thread-27] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.288 [Thread-27] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.288 [Thread-9] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.288 [Thread-9] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.288 [Thread-9] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.289 [Thread-9] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.290 [Thread-6] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.292 [Thread-6] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.292 [Thread-6] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.292 [Thread-6] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.293 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.294 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.294 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.295 [Thread-10] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.297 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.298 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.299 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.306 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.307 [Thread-26] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.308 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.308 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.308 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.309 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.309 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.309 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.310 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.313 [Thread-5] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.313 [Thread-13] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.313 [Thread-13] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.313 [Thread-13] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.314 [Thread-13] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.314 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.315 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.315 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.315 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.316 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.316 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.316 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.317 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.317 [Thread-27] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.318 [Thread-27] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.318 [Thread-26] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:01.318 [Thread-26] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:01.319 [Thread-26] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.harvester.tools.HarvestdatabaseUpdateApplicationTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.001 sec - in dk.netarkivet.harvester.tools.HarvestdatabaseUpdateApplicationTester Running dk.netarkivet.harvester.distribute.ChannelIDTester 13:54:03.640 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:54:03.645 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.158 sec - in dk.netarkivet.harvester.distribute.ChannelIDTester Running dk.netarkivet.harvester.distribute.HarvesterMessageHandlerTester Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.891 sec - in dk.netarkivet.harvester.distribute.HarvesterMessageHandlerTester Running dk.netarkivet.harvester.distribute.IndexReadyMessageTester 13:54:07.543 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:54:07.601 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.068 sec - in dk.netarkivet.harvester.distribute.IndexReadyMessageTester Running dk.netarkivet.harvester.distribute.HarvesterChannelsTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.682 sec - in dk.netarkivet.harvester.distribute.HarvesterChannelsTester Running dk.netarkivet.harvester.indexserver.RawMetadataCacheTester 13:54:10.370 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:10.380 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:10.380 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:10.560 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:10.561 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:10.562 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:10.562 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:10.572 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'test1' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test1' 13:54:10.695 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:54:10.701 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:54:10.707 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:54:10.791 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:54:10.793 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'test1' is fetching metadata with urls matching '.*' and mimetype matching '.*' 13:54:10.803 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:10.804 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:10.837 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:10.838 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:54:10.902 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:10.903 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:10.968 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:10.969 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:10.970 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:10.971 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:10.975 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'test3' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test3' 13:54:10.980 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:54:10.981 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:54:10.982 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'test3' is fetching metadata with urls matching '.*index/cdx.*' and mimetype matching '.*' 13:54:10.983 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test3/test3-4-cache.working 13:54:10.984 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test3/test3-4-cache.working' (thread = main) 13:54:10.989 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Extract using a batchjob of type 'dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob' cachedata from files matching '4-metadata-[0-9]+.(w)?arc' on replica 'ONE' 13:54:10.991 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 4-metadata-1.arc 13:54:11.035 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '4-metadata-1.arc'. 13:54:11.141 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '4-metadata-1.arc'. 13:54:11.142 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - filedesc://4-metadata-1.arc - text/plain 13:54:11.145 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '4-metadata-1.arc'. 13:54:11.146 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - application/x-cdx 13:54:11.148 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #2 in archive file '4-metadata-1.arc'. 13:54:11.149 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - text/html 13:54:11.150 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #3 in archive file '4-metadata-1.arc'. 13:54:11.152 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/fnord?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - application/x-cdx 13:54:11.732 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Cached data for job '4' for 'test3' 13:54:11.732 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@9d5509a 13:54:11.738 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'test4' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test4' 13:54:11.739 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'test4' is fetching metadata with urls matching '.*' and mimetype matching 'application/.-cdx' 13:54:11.740 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test4/test4-4-cache.working 13:54:11.740 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test4/test4-4-cache.working' (thread = main) 13:54:11.742 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Extract using a batchjob of type 'dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob' cachedata from files matching '4-metadata-[0-9]+.(w)?arc' on replica 'ONE' 13:54:11.742 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 4-metadata-1.arc 13:54:11.743 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '4-metadata-1.arc'. 13:54:11.743 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '4-metadata-1.arc'. 13:54:11.744 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - filedesc://4-metadata-1.arc - text/plain 13:54:11.744 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '4-metadata-1.arc'. 13:54:11.744 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - application/x-cdx 13:54:11.745 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #2 in archive file '4-metadata-1.arc'. 13:54:11.745 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - text/html 13:54:11.746 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #3 in archive file '4-metadata-1.arc'. 13:54:11.746 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/fnord?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - application/x-cdx 13:54:11.800 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Cached data for job '4' for 'test4' 13:54:11.800 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@302552ec 13:54:11.801 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'test5' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test5' 13:54:11.834 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'test5' is fetching metadata with urls matching '.*/cdx\?.*' and mimetype matching '.*/x-cdx' 13:54:11.835 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test5/test5-4-cache.working 13:54:11.835 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test5/test5-4-cache.working' (thread = main) 13:54:11.836 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Extract using a batchjob of type 'dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob' cachedata from files matching '4-metadata-[0-9]+.(w)?arc' on replica 'ONE' 13:54:11.836 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 4-metadata-1.arc 13:54:11.837 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '4-metadata-1.arc'. 13:54:11.837 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '4-metadata-1.arc'. 13:54:11.838 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - filedesc://4-metadata-1.arc - text/plain 13:54:11.838 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '4-metadata-1.arc'. 13:54:11.838 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - application/x-cdx 13:54:11.839 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #2 in archive file '4-metadata-1.arc'. 13:54:11.839 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - text/html 13:54:11.840 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #3 in archive file '4-metadata-1.arc'. 13:54:11.840 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/fnord?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - application/x-cdx 13:54:11.850 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Cached data for job '4' for 'test5' 13:54:11.850 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@40005471 13:54:11.851 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test5/test5-5-cache.working 13:54:11.851 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test5/test5-5-cache.working' (thread = main) 13:54:11.852 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Extract using a batchjob of type 'dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob' cachedata from files matching '5-metadata-[0-9]+.(w)?arc' on replica 'ONE' 13:54:11.858 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - No data found for job '5' for 'test5' in local bitarchive 'ONE'. 13:54:11.858 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@2aceadd4 13:54:11.859 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'test6' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test6' 13:54:11.861 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'test6' is fetching metadata with urls matching '.*/cdx/.*' and mimetype matching '.*/x-cdx' 13:54:11.861 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test6/test6-4-cache.working 13:54:11.861 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test6/test6-4-cache.working' (thread = main) 13:54:11.862 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Extract using a batchjob of type 'dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob' cachedata from files matching '4-metadata-[0-9]+.(w)?arc' on replica 'ONE' 13:54:11.862 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 4-metadata-1.arc 13:54:11.864 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '4-metadata-1.arc'. 13:54:11.864 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '4-metadata-1.arc'. 13:54:11.865 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - filedesc://4-metadata-1.arc - text/plain 13:54:11.865 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '4-metadata-1.arc'. 13:54:11.867 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - application/x-cdx 13:54:11.867 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #2 in archive file '4-metadata-1.arc'. 13:54:11.867 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - text/html 13:54:11.868 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #3 in archive file '4-metadata-1.arc'. 13:54:11.869 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/fnord?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - application/x-cdx 13:54:11.870 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Cached data for job '4' for 'test6' 13:54:11.870 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@2a5c8d3f 13:54:11.876 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'test7' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test7' 13:54:11.877 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'test7' is fetching metadata with urls matching '.*index/cdx.*' and mimetype matching '.*' 13:54:11.878 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test7/test7-4-cache.working 13:54:11.878 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test7/test7-4-cache.working' (thread = main) 13:54:11.879 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Extract using a batchjob of type 'dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob' cachedata from files matching '4-metadata-[0-9]+.(w)?arc' on replica 'ONE' 13:54:11.879 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 4-metadata-1.arc 13:54:11.880 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '4-metadata-1.arc'. 13:54:11.881 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '4-metadata-1.arc'. 13:54:11.882 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - filedesc://4-metadata-1.arc - text/plain 13:54:11.882 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '4-metadata-1.arc'. 13:54:11.882 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - application/x-cdx 13:54:11.883 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #2 in archive file '4-metadata-1.arc'. 13:54:11.884 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - text/html 13:54:11.884 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #3 in archive file '4-metadata-1.arc'. 13:54:11.885 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/fnord?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - application/x-cdx 13:54:11.888 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Cached data for job '4' for 'test7' 13:54:11.888 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@5e5d171f 13:54:11.891 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test7/test7-4-cache.working 13:54:11.892 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test7/test7-4-cache.working' (thread = main) 13:54:11.892 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@24313fcc 13:54:11.892 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test7/test7-4-cache.working 13:54:11.893 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test7/test7-4-cache.working' (thread = main) 13:54:11.894 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Extract using a batchjob of type 'dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob' cachedata from files matching '4-metadata-[0-9]+.(w)?arc' on replica 'ONE' 13:54:11.895 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 4-metadata-1.arc 13:54:11.895 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '4-metadata-1.arc'. 13:54:11.896 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #4 in archive file '4-metadata-1.arc'. 13:54:11.896 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - filedesc://4-metadata-1.arc - text/plain 13:54:11.896 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #5 in archive file '4-metadata-1.arc'. 13:54:11.897 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - application/x-cdx 13:54:11.898 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #6 in archive file '4-metadata-1.arc'. 13:54:11.899 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - text/html 13:54:11.899 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #7 in archive file '4-metadata-1.arc'. 13:54:11.899 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/fnord?majorversion=1&minorversion=0&harvestid=2&jobid=4×tamp=20060329091236&serialno=00000 - application/x-cdx 13:54:11.913 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Cached data for job '4' for 'test7' 13:54:11.913 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@77f1baf5 13:54:11.914 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'test8' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test8' 13:54:11.915 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'test8' is fetching metadata with urls matching '.*/cdx\?.*' and mimetype matching '.*/x-cdx' 13:54:11.916 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test8/test8-4-cache.working 13:54:11.916 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test8/test8-4-cache.working' (thread = main) 13:54:11.917 [main] DEBUG dk.netarkivet.harvester.indexserver.RawMetadataCache - Extract using a batchjob of type 'dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob' cachedata from files matching '4-metadata-[0-9]+.(w)?arc' on replica 'ONE' 13:54:11.918 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - No data found for job '4' for 'test8' in local bitarchive 'ONE'. 13:54:11.918 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@41a2befb 13:54:11.919 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:11.919 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:11.930 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:11.931 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:54:11.937 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:11.937 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:11.951 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:11.951 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:11.952 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:11.952 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:11.952 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'test2' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test2' 13:54:11.955 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:54:11.956 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:54:11.956 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'test2' is fetching metadata with urls matching '.*' and mimetype matching '.*' 13:54:11.957 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:11.957 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:11.964 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:11.965 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.311 sec - in dk.netarkivet.harvester.indexserver.RawMetadataCacheTester 13:54:11.984 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:11.985 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:11.986 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:11.988 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:11.988 [Thread-26] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:11.989 [Thread-26] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:11.990 [Thread-26] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:11.991 [Thread-26] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.011 [Thread-7] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.011 [Thread-7] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:12.012 [Thread-7] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.012 [Thread-7] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.013 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.013 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:12.013 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.014 [Thread-8] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.015 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.017 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:12.017 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.017 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.018 [Thread-19] INFO dk.netarkivet.common.distribute.HTTPRemoteFileRegistry - Cleaning up dk.netarkivet.common.distribute.HTTPRemoteFileRegistry 13:54:12.106 [Thread-3] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.107 [Thread-3] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:12.107 [Thread-3] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.108 [Thread-3] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.113 [Thread-24] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.113 [Thread-24] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:12.113 [Thread-24] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:12.114 [Thread-24] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.HTTPRemoteFileRegistry 13:54:12.117 [Thread-19] INFO dk.netarkivet.common.distribute.HTTPRemoteFileRegistry - Cleaned up dk.netarkivet.common.distribute.HTTPRemoteFileRegistry Running dk.netarkivet.harvester.indexserver.DedupCrawlLogIndexCacheTester 13:54:13.486 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:13.494 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:13.495 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:13.547 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'crawllog' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/crawllog' 13:54:13.652 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:54:13.654 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:54:13.658 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:54:13.709 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:13.710 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:54:13.711 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain' 13:54:13.713 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'dedupcrawllogindex' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/dedupcrawllogindex' 13:54:13.716 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'cdxdata' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata' 13:54:13.717 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx' 13:54:13.756 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:54:13.769 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:13.770 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:13.790 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'crawllog' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/crawllog' 13:54:13.798 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:54:13.798 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:13.799 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:54:13.799 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain' 13:54:13.800 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'dedupcrawllogindex' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/dedupcrawllogindex' 13:54:13.800 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'cdxdata' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata' 13:54:13.803 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx' 13:54:13.804 [main] INFO dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Starting combine task #1. This combines a dataset with 2 crawl logs (thread = main) 13:54:14.127 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata/cdxdata-1-cache.working 13:54:14.128 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata/cdxdata-1-cache.working' (thread = main) 13:54:14.129 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@5fa07e12 13:54:14.130 [main] DEBUG dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Making subthread for indexing job 1 - task 1 out of 2 13:54:14.197 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata/cdxdata-4-cache.working 13:54:14.198 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata/cdxdata-4-cache.working' (thread = main) 13:54:14.202 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@3972a855 13:54:14.203 [main] DEBUG dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Making subthread for indexing job 4 - task 2 out of 2 13:54:14.204 [pool-1-thread-1] INFO dk.netarkivet.harvester.indexserver.DigestIndexerWorker - Starting subindexing task (1 out of 2) of data from job 1 13:54:14.229 [main] INFO dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Outstanding jobs in combine task #1 is now 2 13:54:14.251 [pool-1-thread-1] DEBUG dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Ingesting the crawl.log file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-1.log' related to job 1 13:54:14.258 [pool-1-thread-1] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata/cdxdata-1-cache -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/tmp/sorted1881558115648609445cdx with environment LANG=C 13:54:14.264 [pool-1-thread-2] INFO dk.netarkivet.harvester.indexserver.DigestIndexerWorker - Starting subindexing task (2 out of 2) of data from job 4 13:54:14.298 [pool-1-thread-2] DEBUG dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Ingesting the crawl.log file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-4.log' related to job 4 13:54:14.307 [pool-1-thread-1] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-1.log -k 4b -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/tmp/sorted4134618126066048206crawllog with environment LANG=C 13:54:14.310 [pool-1-thread-2] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata/cdxdata-4-cache -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/tmp/sorted2658957188975509636cdx with environment LANG=C 13:54:14.349 [pool-1-thread-2] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-4.log -k 4b -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/tmp/sorted6822941056981183261crawllog with environment LANG=C 13:54:14.886 [pool-1-thread-2] INFO dk.netarkivet.harvester.indexserver.DigestIndexerWorker - Completed subindexing task (2 out of 2) of data from job 4 w/ 9 index-entries) 13:54:14.889 [pool-1-thread-1] INFO dk.netarkivet.harvester.indexserver.DigestIndexerWorker - Completed subindexing task (1 out of 2) of data from job 1 w/ 15 index-entries) 13:54:19.243 [main] INFO dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Outstanding jobs in combine task #1 is now 2 13:54:24.261 [main] INFO dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Adding the final 2 subindices to main index. Forcing index to contain max 42 files (related to combine task #1) 13:54:24.403 [main] INFO dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Adding operation completed (combine task #1)! 13:54:24.424 [main] INFO dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Closed index (related to combine task #1 13:54:24.424 [main] INFO dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Gzip-compressing the individual 8 index files of combine task # 1 13:54:24.439 [main] INFO dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Completed combine task #1 that combined a dataset with 2 crawl logs (entries in combined index: 24) - compressed index has size 3.5 Kbytes 13:54:24.758 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:54:24.784 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:24.785 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:24.862 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'cdxdata' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata' 13:54:24.926 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:54:24.927 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:24.929 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:54:24.929 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx' 13:54:24.932 [main] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata/cdxdata-4-cache -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/tmp/sorted4673390112205729648cdx with environment LANG=C 13:54:24.974 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.405 sec - in dk.netarkivet.harvester.indexserver.DedupCrawlLogIndexCacheTester 13:54:25.088 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:25.090 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:25.091 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:25.093 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:26.330 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'Test' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/Test' Running dk.netarkivet.harvester.indexserver.MultiFileBasedCacheTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in dk.netarkivet.harvester.indexserver.MultiFileBasedCacheTester Running dk.netarkivet.harvester.indexserver.CDXOriginCrawlLogIteratorTester 13:54:28.062 [main] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-680.log -k 4b -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-680-sorted.log with environment LANG=C 13:54:28.217 [main] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata/cdxdata-680 -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata/cdxdata-sorted-680 with environment LANG=C 13:54:28.456 [main] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-9.log -k 4b -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-9-sorted.log with environment LANG=C 13:54:28.561 [main] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata/cdxdata-9-cache -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata/cdxdata-9-sorted-cache with environment LANG=C Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.92 sec - in dk.netarkivet.harvester.indexserver.CDXOriginCrawlLogIteratorTester Running dk.netarkivet.harvester.indexserver.distribute.IndexRequestServerTester 13:54:30.634 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'TEST' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/TEST' 13:54:30.713 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:30.718 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:30.719 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:30.719 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:30.831 [main] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Setting handler for RequestType: CDX 13:54:30.832 [main] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - 0 indexing jobs in progress that was stored in requestdir: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests 13:54:30.834 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:54:30.837 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:54:30.889 [Timer-1] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Enabling listening to the indexserver channel '[Queue 'DEV_COMMON_INDEX_SERVER']' 13:54:30.892 [main] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Storing message to /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests/irMsg1 13:54:30.932 [main] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Now 1 indexing jobs in progress 13:54:30.933 [Thread-5] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Request received for an index of type 'CDX' for the 5 jobs [16,32,2,4,8] 13:54:30.935 [Thread-5] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Waiting to enter the synchronization zone for the indexing job of size 5 with checksum '4b3af88e7b410e44632d2e984b9bf1c2' 13:54:30.935 [Thread-5] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - The indexing job of size 5 with checksum '4b3af88e7b410e44632d2e984b9bf1c2' is now in the synchronization zone 13:54:30.953 [Thread-5] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/TEST/2-4-8-16-58616840263d5925819c8738f0e1c980-cache.working 13:54:30.953 [Thread-5] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/TEST/2-4-8-16-58616840263d5925819c8738f0e1c980-cache.working' (thread = Thread-5) 13:54:30.955 [Thread-5] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@44726fd4 13:54:30.960 [Thread-5] WARN d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Unable to generate index for jobs [16,32,2,4,8] dk.netarkivet.common.exceptions.IOFailure: This is a failing testhandler! at dk.netarkivet.harvester.indexserver.MockupMultiFileBasedCache.cacheData(MockupMultiFileBasedCache.java:132) ~[test-classes/:na] at dk.netarkivet.harvester.indexserver.MockupMultiFileBasedCache.cacheData(MockupMultiFileBasedCache.java:38) ~[test-classes/:na] at dk.netarkivet.harvester.indexserver.FileBasedCache.cache(FileBasedCache.java:146) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.doProcessIndexRequestMessage(IndexRequestServer.java:336) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.access$000(IndexRequestServer.java:76) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer$2.run(IndexRequestServer.java:238) [harvester-5.0-SNAPSHOT.jar:na] 13:54:30.962 [Thread-5] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Trying to delete stored serialized message: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests/irMsg1 13:54:30.963 [Thread-5] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Sending failed reply for IndexRequestMessage back to sender '[Queue 'DEV_COMMON_THIS_INDEX_CLIENT_130_225_27_165_IS_XXX']'. 13:54:31.148 [main] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Storing message to /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests/irMsg2 13:54:31.150 [main] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Now 1 indexing jobs in progress 13:54:31.150 [Thread-7] WARN d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Unable to generate index for jobs [16,32,2,4,8] dk.netarkivet.common.exceptions.UnknownID: No handler known for requesttype DEDUP_CRAWL_LOG at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.checkMessage(IndexRequestServer.java:504) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.doProcessIndexRequestMessage(IndexRequestServer.java:315) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.access$000(IndexRequestServer.java:76) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer$2.run(IndexRequestServer.java:238) [harvester-5.0-SNAPSHOT.jar:na] 13:54:31.151 [Thread-7] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Trying to delete stored serialized message: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests/irMsg2 13:54:31.153 [Thread-7] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Sending failed reply for IndexRequestMessage back to sender '[Queue 'DEV_COMMON_THIS_INDEX_CLIENT_130_225_27_165_IS_XXX']'. 13:54:31.360 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_INDEX_SERVER' 13:54:31.363 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:31.364 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:31.371 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'TEST' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/TEST' 13:54:31.378 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:31.379 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:31.379 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:31.379 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:31.420 [main] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Setting handler for RequestType: CDX 13:54:31.421 [main] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - 0 indexing jobs in progress that was stored in requestdir: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests 13:54:31.421 [Timer-3] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Enabling listening to the indexserver channel '[Queue 'DEV_COMMON_INDEX_SERVER']' 13:54:31.636 [Thread-15] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Storing message to /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests/msg3 13:54:31.640 [Thread-15] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Now 1 indexing jobs in progress 13:54:31.641 [Thread-16] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Storing message to /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests/msg4 13:54:31.650 [Thread-17] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Request received for an index of type 'CDX' for the 5 jobs [16,32,2,4,8] 13:54:31.651 [Thread-17] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Waiting to enter the synchronization zone for the indexing job of size 5 with checksum '4b3af88e7b410e44632d2e984b9bf1c2' 13:54:31.652 [Thread-17] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - The indexing job of size 5 with checksum '4b3af88e7b410e44632d2e984b9bf1c2' is now in the synchronization zone 13:54:31.655 [Thread-17] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/TEST/2-4-8-16-58616840263d5925819c8738f0e1c980-cache.working 13:54:31.656 [Thread-17] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/TEST/2-4-8-16-58616840263d5925819c8738f0e1c980-cache.working' (thread = Thread-17) 13:54:31.657 [Thread-16] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Now 2 indexing jobs in progress 13:54:31.658 [Thread-18] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Request received for an index of type 'CDX' for the 5 jobs [1,3,7,15,31] 13:54:31.659 [Thread-18] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Waiting to enter the synchronization zone for the indexing job of size 5 with checksum 'cbbc3f6733516798854aaa2b5b49d1a5' 13:54:31.659 [Thread-18] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - The indexing job of size 5 with checksum 'cbbc3f6733516798854aaa2b5b49d1a5' is now in the synchronization zone 13:54:31.662 [Thread-18] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/TEST/1-3-7-15-cbbc3f6733516798854aaa2b5b49d1a5-cache.working 13:54:31.663 [Thread-18] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/TEST/1-3-7-15-cbbc3f6733516798854aaa2b5b49d1a5-cache.working' (thread = Thread-18) 13:54:31.664 [Thread-17] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@7b65cb32 13:54:31.666 [Thread-17] WARN d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Unable to generate index for jobs [16,32,2,4,8] dk.netarkivet.common.exceptions.ArgumentNotValid: The value of the variable 'Set foundJobs' must not be null. at dk.netarkivet.common.exceptions.ArgumentNotValid.checkNotNull(ArgumentNotValid.java:76) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestMessage.setFoundJobs(IndexRequestMessage.java:209) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.doProcessIndexRequestMessage(IndexRequestServer.java:337) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.access$000(IndexRequestServer.java:76) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer$2.run(IndexRequestServer.java:238) [harvester-5.0-SNAPSHOT.jar:na] 13:54:31.667 [Thread-17] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Trying to delete stored serialized message: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests/msg3 13:54:31.668 [Thread-17] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Sending failed reply for IndexRequestMessage back to sender '[Queue 'DEV_COMMON_THIS_INDEX_CLIENT_130_225_27_165_IS_XXX']'. 13:54:31.688 [Thread-18] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@6c36f185 13:54:31.689 [Thread-18] WARN d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Unable to generate index for jobs [1,3,7,15,31] dk.netarkivet.common.exceptions.ArgumentNotValid: The value of the variable 'Set foundJobs' must not be null. at dk.netarkivet.common.exceptions.ArgumentNotValid.checkNotNull(ArgumentNotValid.java:76) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestMessage.setFoundJobs(IndexRequestMessage.java:209) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.doProcessIndexRequestMessage(IndexRequestServer.java:337) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.access$000(IndexRequestServer.java:76) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer$2.run(IndexRequestServer.java:238) [harvester-5.0-SNAPSHOT.jar:na] 13:54:31.691 [Thread-18] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Trying to delete stored serialized message: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests/msg4 13:54:31.692 [Thread-18] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Sending failed reply for IndexRequestMessage back to sender '[Queue 'DEV_COMMON_THIS_INDEX_CLIENT_130_225_27_165_IS_XXX']'. 13:54:31.865 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_INDEX_SERVER' 13:54:31.896 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:31.896 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:31.929 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'TEST' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/TEST' 13:54:31.978 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:31.981 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:31.982 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:31.982 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:31.993 [main] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Setting handler for RequestType: CDX 13:54:31.994 [main] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - 0 indexing jobs in progress that was stored in requestdir: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests 13:54:31.994 [Timer-5] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Enabling listening to the indexserver channel '[Queue 'DEV_COMMON_INDEX_SERVER']' 13:54:32.212 [Thread-27] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Storing message to /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests/ID-0 13:54:32.216 [Thread-27] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Now 1 indexing jobs in progress 13:54:32.218 [Thread-28] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Request received for an index of type 'CDX' for the 5 jobs [16,32,2,4,8] 13:54:32.223 [Thread-28] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Waiting to enter the synchronization zone for the indexing job of size 5 with checksum '4b3af88e7b410e44632d2e984b9bf1c2' 13:54:32.224 [Thread-28] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - The indexing job of size 5 with checksum '4b3af88e7b410e44632d2e984b9bf1c2' is now in the synchronization zone 13:54:32.245 [Thread-28] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/TEST/2-4-8-16-58616840263d5925819c8738f0e1c980-cache.working 13:54:32.245 [Thread-28] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/TEST/2-4-8-16-58616840263d5925819c8738f0e1c980-cache.working' (thread = Thread-28) 13:54:32.246 [Thread-28] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@3cb85f84 13:54:32.248 [Thread-28] WARN d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Unable to generate index for jobs [16,32,2,4,8] dk.netarkivet.common.exceptions.ArgumentNotValid: The value of the variable 'Set foundJobs' must not be null. at dk.netarkivet.common.exceptions.ArgumentNotValid.checkNotNull(ArgumentNotValid.java:76) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestMessage.setFoundJobs(IndexRequestMessage.java:209) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.doProcessIndexRequestMessage(IndexRequestServer.java:337) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.access$000(IndexRequestServer.java:76) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer$2.run(IndexRequestServer.java:238) [harvester-5.0-SNAPSHOT.jar:na] 13:54:32.251 [Thread-28] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Trying to delete stored serialized message: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests/ID-0 13:54:32.252 [Thread-28] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Sending failed reply for IndexRequestMessage back to sender '[Queue 'DEV_COMMON_THIS_INDEX_CLIENT_130_225_27_165_IS_XXX']'. 13:54:32.430 [Thread-29] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Storing message to /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests/ID-1 13:54:32.435 [Thread-29] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Now 1 indexing jobs in progress 13:54:32.436 [Thread-30] WARN d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Unable to generate index for jobs [16,32,2,4,8] dk.netarkivet.common.exceptions.ArgumentNotValid: Message was not OK at dk.netarkivet.common.exceptions.ArgumentNotValid.checkTrue(ArgumentNotValid.java:158) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.checkMessage(IndexRequestServer.java:500) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.doProcessIndexRequestMessage(IndexRequestServer.java:315) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer.access$000(IndexRequestServer.java:76) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer$2.run(IndexRequestServer.java:238) [harvester-5.0-SNAPSHOT.jar:na] 13:54:32.437 [Thread-30] DEBUG d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Trying to delete stored serialized message: /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/./tests/commontempdir/requests/ID-1 13:54:32.441 [Thread-30] INFO d.netarkivet.harvester.indexserver.distribute.IndexRequestServer - Sending failed reply for IndexRequestMessage back to sender '[Queue 'DEV_COMMON_THIS_INDEX_CLIENT_130_225_27_165_IS_XXX']'. 13:54:32.644 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_INDEX_SERVER' 13:54:32.652 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:32.653 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:32.702 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'TEST' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/cache/TEST' 13:54:32.928 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:32.929 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:32.929 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:32.929 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:32.946 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_INDEX_SERVER' 13:54:32.947 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_INDEX_SERVER' 13:54:32.951 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:32.951 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Tests run: 6, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 2.971 sec - in dk.netarkivet.harvester.indexserver.distribute.IndexRequestServerTester 13:54:32.977 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:32.978 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:32.979 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:32.981 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:32.984 [Thread-12] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:32.986 [Thread-12] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:32.986 [Thread-12] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:32.989 [Thread-12] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:32.989 [Thread-24] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:32.990 [Thread-24] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:32.991 [Thread-24] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:32.993 [Thread-24] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:32.994 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:32.995 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:32.996 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.006 [Thread-11] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.007 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.008 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:33.008 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.009 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.012 [Thread-33] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.013 [Thread-33] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:33.013 [Thread-33] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.015 [Thread-33] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.017 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.018 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:33.018 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.019 [Thread-23] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.021 [Thread-34] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.023 [Thread-34] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:33.026 [Thread-34] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:33.028 [Thread-34] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.harvester.indexserver.distribute.IndexRequestClientTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.002 sec - in dk.netarkivet.harvester.indexserver.distribute.IndexRequestClientTester Running dk.netarkivet.harvester.indexserver.distribute.IndexRequestMessageTester 13:54:35.635 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:54:35.697 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:54:35.815 [main] DEBUG d.n.harvester.indexserver.distribute.IndexRequestMessage - Sending result containing 2 files 13:54:35.832 [main] DEBUG d.n.harvester.indexserver.distribute.IndexRequestMessage - Sending result containing 1 files Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.07 sec - in dk.netarkivet.harvester.indexserver.distribute.IndexRequestMessageTester Running dk.netarkivet.harvester.indexserver.FileBasedCacheTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.002 sec - in dk.netarkivet.harvester.indexserver.FileBasedCacheTester Running dk.netarkivet.harvester.indexserver.CombiningMultiFileBasedCacheTester 13:54:37.858 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:37.866 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:37.867 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:37.936 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'rawtest1' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/rawtest1' 13:54:37.938 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'test1' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test1' 13:54:37.941 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test1/1-4-cache.working 13:54:37.941 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test1/1-4-cache.working' (thread = main) 13:54:37.942 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-1.log.working 13:54:37.944 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-1.log.working' (thread = main) 13:54:37.944 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@6ac13091 13:54:37.945 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-4.log.working 13:54:37.945 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-4.log.working' (thread = main) 13:54:37.946 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@5e316c74 13:54:37.946 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@6d2a209c 13:54:37.947 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test1/1-4-cache.working 13:54:37.947 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test1/1-4-cache.working' (thread = main) 13:54:37.948 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@75329a49 13:54:37.949 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test1/1-5-cache.working 13:54:37.950 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/test1/1-5-cache.working' (thread = main) 13:54:37.950 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-1.log.working 13:54:37.950 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-1.log.working' (thread = main) 13:54:37.951 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@161479c6 13:54:37.951 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-5.log.working 13:54:37.951 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-5.log.working' (thread = main) 13:54:37.952 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@4313f5bc 13:54:37.953 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@7f010382 13:54:38.079 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:54:38.081 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:54:38.082 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:54:38.096 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:38.097 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:54:38.098 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.051 sec - in dk.netarkivet.harvester.indexserver.CombiningMultiFileBasedCacheTester 13:54:38.115 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:38.115 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:38.115 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:38.116 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.harvester.indexserver.CrawlLogIndexCacheTester 13:54:39.590 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:39.597 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:39.597 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:39.671 [main] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-1.log -k 4b -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/crawllogs/crawl-1.log.sorted with environment LANG=C 13:54:39.732 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:54:39.734 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:54:39.735 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:54:39.814 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:39.815 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:54:39.818 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:54:39.864 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:39.865 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:39.931 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'crawllog' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/crawllog' 13:54:39.949 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:54:39.950 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:39.951 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:54:39.951 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain' 13:54:39.953 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'fullcrawllogindex' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/fullcrawllogindex' 13:54:39.955 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'cdxdata' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata' 13:54:39.955 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx' 13:54:40.017 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'cdxdata' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata' 13:54:40.018 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx' 13:54:40.019 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'crawllog' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/crawllog' 13:54:40.021 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain' 13:54:40.021 [main] INFO dk.netarkivet.harvester.indexserver.CrawlLogIndexCache - Starting to generate fullcrawllogindex for the 1 jobs: [1] 13:54:40.022 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache-1.working 13:54:40.022 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache-1.working' (thread = main) 13:54:40.024 [main] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@291ae 13:54:40.031 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.21 sec - in dk.netarkivet.harvester.indexserver.CrawlLogIndexCacheTester 13:54:40.041 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:40.042 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:40.042 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:40.044 [Thread-4] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.harvester.indexserver.IndexServerTester 13:54:41.269 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:41.277 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:41.277 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:41.288 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.697 sec - in dk.netarkivet.harvester.indexserver.IndexServerTester 13:54:41.326 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:41.326 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:41.327 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:41.329 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:41.329 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:41.330 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:41.331 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:41.332 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJobTester 13:54:42.663 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 1-metadata-1.warc 13:54:42.731 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '1-metadata-1.warc'. 13:54:42.778 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '1-metadata-1.warc'. 13:54:42.780 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '1-metadata-1.warc'. 13:54:42.781 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/duplicatereductionjobs?majorversion=1&minorversion=0&harvestid=1&harvestnum=0&jobid=1 - null 13:54:42.784 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #2 in archive file '1-metadata-1.warc'. 13:54:42.784 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/crawl-manifest.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.786 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #3 in archive file '1-metadata-1.warc'. 13:54:42.786 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/harvestInfo.xml?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/xml 13:54:42.787 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #4 in archive file '1-metadata-1.warc'. 13:54:42.787 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/order.xml?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/xml 13:54:42.793 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #5 in archive file '1-metadata-1.warc'. 13:54:42.793 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/seeds.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.794 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #6 in archive file '1-metadata-1.warc'. 13:54:42.795 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/arcfiles-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.795 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #7 in archive file '1-metadata-1.warc'. 13:54:42.796 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/crawl-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.796 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #8 in archive file '1-metadata-1.warc'. 13:54:42.796 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/frontier-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.797 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #9 in archive file '1-metadata-1.warc'. 13:54:42.798 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/hosts-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.799 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #10 in archive file '1-metadata-1.warc'. 13:54:42.799 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/mimetype-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.801 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #11 in archive file '1-metadata-1.warc'. 13:54:42.803 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/processors-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.804 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #12 in archive file '1-metadata-1.warc'. 13:54:42.804 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/responsecode-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.804 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #13 in archive file '1-metadata-1.warc'. 13:54:42.805 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/seeds-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.805 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #14 in archive file '1-metadata-1.warc'. 13:54:42.806 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/source-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.812 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #15 in archive file '1-metadata-1.warc'. 13:54:42.813 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/crawl.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.815 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #16 in archive file '1-metadata-1.warc'. 13:54:42.816 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/heritrix.out?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.818 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #17 in archive file '1-metadata-1.warc'. 13:54:42.818 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/heritrix_dmesg.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.821 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #18 in archive file '1-metadata-1.warc'. 13:54:42.821 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/local-errors.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - null 13:54:42.823 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #19 in archive file '1-metadata-1.warc'. 13:54:42.823 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/progress-statistics.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.825 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #20 in archive file '1-metadata-1.warc'. 13:54:42.825 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/runtime-errors.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - null 13:54:42.828 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #21 in archive file '1-metadata-1.warc'. 13:54:42.828 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/uri-errors.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.829 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #22 in archive file '1-metadata-1.warc'. 13:54:42.829 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=1&jobid=1×tamp=20121219191833&serialno=00000 - application/x-cdx 13:54:42.894 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 1-metadata-1.arc 13:54:42.897 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '1-metadata-1.arc'. 13:54:42.902 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #23 in archive file '1-metadata-1.arc'. 13:54:42.902 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - filedesc://1-metadata-1.arc - text/plain 13:54:42.903 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #24 in archive file '1-metadata-1.arc'. 13:54:42.903 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/duplicatereductionjobs?majorversion=1&minorversion=0&harvestid=1&harvestnum=0&jobid=1 - text/plain 13:54:42.904 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #25 in archive file '1-metadata-1.arc'. 13:54:42.904 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/crawl-manifest.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.904 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #26 in archive file '1-metadata-1.arc'. 13:54:42.905 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/harvestInfo.xml?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/xml 13:54:42.905 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #27 in archive file '1-metadata-1.arc'. 13:54:42.905 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/order.xml?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/xml 13:54:42.908 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #28 in archive file '1-metadata-1.arc'. 13:54:42.908 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/seeds.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.908 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #29 in archive file '1-metadata-1.arc'. 13:54:42.909 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/arcfiles-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.909 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #30 in archive file '1-metadata-1.arc'. 13:54:42.910 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/crawl-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.911 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #31 in archive file '1-metadata-1.arc'. 13:54:42.911 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/frontier-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.911 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #32 in archive file '1-metadata-1.arc'. 13:54:42.911 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/hosts-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.912 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #33 in archive file '1-metadata-1.arc'. 13:54:42.912 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/mimetype-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.913 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #34 in archive file '1-metadata-1.arc'. 13:54:42.914 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/processors-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.915 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #35 in archive file '1-metadata-1.arc'. 13:54:42.915 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/responsecode-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.915 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #36 in archive file '1-metadata-1.arc'. 13:54:42.916 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/seeds-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.916 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #37 in archive file '1-metadata-1.arc'. 13:54:42.916 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/source-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.917 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #38 in archive file '1-metadata-1.arc'. 13:54:42.917 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/crawl.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.919 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #39 in archive file '1-metadata-1.arc'. 13:54:42.919 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/heritrix.out?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.920 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #40 in archive file '1-metadata-1.arc'. 13:54:42.920 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/heritrix_dmesg.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.920 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #41 in archive file '1-metadata-1.arc'. 13:54:42.921 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/local-errors.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.921 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #42 in archive file '1-metadata-1.arc'. 13:54:42.921 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/progress-statistics.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.922 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #43 in archive file '1-metadata-1.arc'. 13:54:42.922 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/runtime-errors.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.923 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #44 in archive file '1-metadata-1.arc'. 13:54:42.923 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/uri-errors.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.923 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #45 in archive file '1-metadata-1.arc'. 13:54:42.924 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=1&jobid=1×tamp=20121219172307&serialno=00000 - application/x-cdx 13:54:42.930 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 1-metadata-1.warc 13:54:42.930 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '1-metadata-1.warc'. 13:54:42.931 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '1-metadata-1.warc'. 13:54:42.932 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '1-metadata-1.warc'. 13:54:42.932 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/duplicatereductionjobs?majorversion=1&minorversion=0&harvestid=1&harvestnum=0&jobid=1 - null 13:54:42.933 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #2 in archive file '1-metadata-1.warc'. 13:54:42.933 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/crawl-manifest.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.935 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #3 in archive file '1-metadata-1.warc'. 13:54:42.937 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/harvestInfo.xml?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/xml 13:54:42.937 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #4 in archive file '1-metadata-1.warc'. 13:54:42.937 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/order.xml?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/xml 13:54:42.938 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #5 in archive file '1-metadata-1.warc'. 13:54:42.938 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/seeds.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.939 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #6 in archive file '1-metadata-1.warc'. 13:54:42.939 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/arcfiles-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.939 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #7 in archive file '1-metadata-1.warc'. 13:54:42.940 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/crawl-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.940 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #8 in archive file '1-metadata-1.warc'. 13:54:42.940 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/frontier-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.942 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #9 in archive file '1-metadata-1.warc'. 13:54:42.942 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/hosts-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.944 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #10 in archive file '1-metadata-1.warc'. 13:54:42.944 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/mimetype-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.945 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #11 in archive file '1-metadata-1.warc'. 13:54:42.945 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/processors-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.945 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #12 in archive file '1-metadata-1.warc'. 13:54:42.946 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/responsecode-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.946 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #13 in archive file '1-metadata-1.warc'. 13:54:42.946 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/seeds-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.947 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #14 in archive file '1-metadata-1.warc'. 13:54:42.947 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/source-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.947 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #15 in archive file '1-metadata-1.warc'. 13:54:42.948 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/crawl.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.949 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #16 in archive file '1-metadata-1.warc'. 13:54:42.950 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/heritrix.out?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.950 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #17 in archive file '1-metadata-1.warc'. 13:54:42.951 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/heritrix_dmesg.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.953 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #18 in archive file '1-metadata-1.warc'. 13:54:42.953 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/local-errors.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - null 13:54:42.953 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #19 in archive file '1-metadata-1.warc'. 13:54:42.953 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/progress-statistics.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.954 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #20 in archive file '1-metadata-1.warc'. 13:54:42.954 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/runtime-errors.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - null 13:54:42.955 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #21 in archive file '1-metadata-1.warc'. 13:54:42.956 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/uri-errors.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.957 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #22 in archive file '1-metadata-1.warc'. 13:54:42.959 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=1&jobid=1×tamp=20121219191833&serialno=00000 - application/x-cdx 13:54:42.960 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 1-metadata-1.arc 13:54:42.961 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '1-metadata-1.arc'. 13:54:42.962 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #23 in archive file '1-metadata-1.arc'. 13:54:42.962 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - filedesc://1-metadata-1.arc - text/plain 13:54:42.962 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #24 in archive file '1-metadata-1.arc'. 13:54:42.963 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/duplicatereductionjobs?majorversion=1&minorversion=0&harvestid=1&harvestnum=0&jobid=1 - text/plain 13:54:42.964 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #25 in archive file '1-metadata-1.arc'. 13:54:42.964 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/crawl-manifest.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.965 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #26 in archive file '1-metadata-1.arc'. 13:54:42.966 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/harvestInfo.xml?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/xml 13:54:42.966 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #27 in archive file '1-metadata-1.arc'. 13:54:42.966 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/order.xml?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/xml 13:54:42.967 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #28 in archive file '1-metadata-1.arc'. 13:54:42.967 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/setup/seeds.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.968 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #29 in archive file '1-metadata-1.arc'. 13:54:42.969 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/arcfiles-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.970 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #30 in archive file '1-metadata-1.arc'. 13:54:42.970 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/crawl-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.971 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #31 in archive file '1-metadata-1.arc'. 13:54:42.971 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/frontier-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.972 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #32 in archive file '1-metadata-1.arc'. 13:54:42.972 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/hosts-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.973 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #33 in archive file '1-metadata-1.arc'. 13:54:42.973 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/mimetype-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.973 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #34 in archive file '1-metadata-1.arc'. 13:54:42.974 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/processors-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.974 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #35 in archive file '1-metadata-1.arc'. 13:54:42.974 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/responsecode-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.975 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #36 in archive file '1-metadata-1.arc'. 13:54:42.975 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/seeds-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.975 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #37 in archive file '1-metadata-1.arc'. 13:54:42.976 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/reports/source-report.txt?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.976 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #38 in archive file '1-metadata-1.arc'. 13:54:42.976 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/crawl.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.978 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #39 in archive file '1-metadata-1.arc'. 13:54:42.978 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/heritrix.out?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.979 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #40 in archive file '1-metadata-1.arc'. 13:54:42.979 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/heritrix_dmesg.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.980 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #41 in archive file '1-metadata-1.arc'. 13:54:42.980 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/local-errors.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.980 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #42 in archive file '1-metadata-1.arc'. 13:54:42.981 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/progress-statistics.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.981 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #43 in archive file '1-metadata-1.arc'. 13:54:42.981 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/runtime-errors.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.982 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #44 in archive file '1-metadata-1.arc'. 13:54:42.983 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/logs/uri-errors.log?heritrixVersion=1.14.4&harvestid=1&jobid=1 - text/plain 13:54:42.984 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #45 in archive file '1-metadata-1.arc'. 13:54:42.984 [main] INFO dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJob - metadata://netarkivet.dk/crawl/index/cdx?majorversion=1&minorversion=0&harvestid=1&jobid=1×tamp=20121219172307&serialno=00000 - application/x-cdx Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.04 sec - in dk.netarkivet.harvester.indexserver.GetMetadataArchiveBatchJobTester Running dk.netarkivet.harvester.indexserver.CDXIndexCacheTester 13:54:44.309 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:44.318 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:44.319 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:54:44.429 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'cdxdata' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxdata' 13:54:44.462 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:54:44.464 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:54:44.467 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:54:44.497 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:44.499 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:54:44.499 [main] INFO dk.netarkivet.harvester.indexserver.RawMetadataCache - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx' 13:54:44.502 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'cdxindex' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxindex' 13:54:44.681 [main] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxindex/3-4-cache -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/indexserver/data/working/cache/cdxindex/3-4-cache.unsorted with environment LANG=C 13:54:44.726 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.114 sec - in dk.netarkivet.harvester.indexserver.CDXIndexCacheTester 13:54:44.753 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:44.753 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:54:44.753 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:54:44.754 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.harvester.datamodel.WeeklyFrequencyTester Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.665 sec - in dk.netarkivet.harvester.datamodel.WeeklyFrequencyTester Running dk.netarkivet.harvester.datamodel.DailyFrequencyTester Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.555 sec - in dk.netarkivet.harvester.datamodel.DailyFrequencyTester Running dk.netarkivet.harvester.datamodel.ConstantsTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.961 sec - in dk.netarkivet.harvester.datamodel.ConstantsTester Running dk.netarkivet.harvester.datamodel.extendedfield.ExtendedFieldOptionsTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in dk.netarkivet.harvester.datamodel.extendedfield.ExtendedFieldOptionsTester Running dk.netarkivet.harvester.datamodel.extendedfield.ExtendedFieldDefaultValuesTester 13:54:55.756 [main] DEBUG d.n.harvester.datamodel.extendedfield.ExtendedFieldDefaultValue - The string '' is not a valid Boolean value 13:54:55.759 [main] DEBUG d.n.harvester.datamodel.extendedfield.ExtendedFieldDefaultValue - The string 'foo' is not a valid Boolean value 13:54:55.759 [main] DEBUG d.n.harvester.datamodel.extendedfield.ExtendedFieldDefaultValue - The string 'bar' is not a valid Boolean value 13:54:55.760 [main] DEBUG d.n.harvester.datamodel.extendedfield.ExtendedFieldDefaultValue - Invalid NUMBER: a 13:54:55.760 [main] DEBUG d.n.harvester.datamodel.extendedfield.ExtendedFieldDefaultValue - Invalid TIMESTAMP: 12:08 13:54:55.760 [main] DEBUG d.n.harvester.datamodel.extendedfield.ExtendedFieldDefaultValue - Invalid TIMESTAMP: 12:03 Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.878 sec - in dk.netarkivet.harvester.datamodel.extendedfield.ExtendedFieldDefaultValuesTester Running dk.netarkivet.harvester.datamodel.MinuteFrequencyTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.455 sec - in dk.netarkivet.harvester.datamodel.MinuteFrequencyTest Running dk.netarkivet.harvester.datamodel.NumberUtilsTester Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec - in dk.netarkivet.harvester.datamodel.NumberUtilsTester Running dk.netarkivet.harvester.datamodel.HarvestDefinitionTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.004 sec - in dk.netarkivet.harvester.datamodel.HarvestDefinitionTester Running dk.netarkivet.harvester.datamodel.FrequencyTester 13:54:59.706 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a DAILY frequency. 13:54:59.711 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a DAILY frequency. 13:54:59.711 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a HOURLY frequency. 13:54:59.712 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a DAILY frequency. 13:54:59.713 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a HOURLY frequency. 13:54:59.713 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a DAILY frequency. 13:54:59.714 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a MONTHLY frequency. 13:54:59.714 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a WEEKLY frequency. 13:54:59.715 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a HOURLY frequency. 13:54:59.717 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a DAILY frequency. 13:54:59.717 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a WEEKLY frequency. 13:54:59.718 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a MONTHLY frequency. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.644 sec - in dk.netarkivet.harvester.datamodel.FrequencyTester Running dk.netarkivet.harvester.datamodel.RepeatingScheduleTester Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.475 sec - in dk.netarkivet.harvester.datamodel.RepeatingScheduleTester Running dk.netarkivet.harvester.datamodel.AliasInfoTester Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.969 sec - in dk.netarkivet.harvester.datamodel.AliasInfoTester Running dk.netarkivet.harvester.datamodel.DomainHistoryTester Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.603 sec - in dk.netarkivet.harvester.datamodel.DomainHistoryTester Running dk.netarkivet.harvester.datamodel.StopReasonTester Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.05 sec - in dk.netarkivet.harvester.datamodel.StopReasonTester Running dk.netarkivet.harvester.datamodel.TLDInfoTester Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in dk.netarkivet.harvester.datamodel.TLDInfoTester Running dk.netarkivet.harvester.datamodel.HarvestDBConnectionTester 13:55:20.564 [main] INFO com.mchange.v2.log.MLog - MLog clients using log4j logging. 13:55:20.618 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.1 [built 16-January-2007 14:46:42; debug? true; trace: 10] 13:55:20.728 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values: - minPoolSize=5 - maxPoolSize=10 - acquireIncrement=5 - maxStatements=0 - maxStatementsPerConnection=0 - idleConnTestPeriod=0 - idleConnTestQuery='null' - idleConnTestOnCheckin=false 13:55:20.799 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, dataSourceName -> 10bbezp9417mdxuiph53wt|5c18016b, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.apache.derby.jdbc.EmbeddedDriver, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 10bbezp9417mdxuiph53wt|5c18016b, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:derby:/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb;create=true, lastAcquisitionFailureDefaultUser -> null, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 10, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, numThreadsAwaitingCheckoutDefaultUser -> 0, preferredTestQuery -> null, properties -> {}, propertyCycle -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false ] 13:55:20.829 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:20.833 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:20.836 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:20.898 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'domains' from version '2' to version '3'. 13:55:20.900 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'domains' to version 3 13:55:21.015 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:21.017 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:21.322 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:21.324 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:21.325 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:21.327 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:21.333 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'harvestdefinitions' from version '2' to version '4'. 13:55:21.334 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestdefinitions' to version 3 13:55:21.356 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:21.370 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestdefinitions' to version 4 13:55:21.404 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'jobs' from version '8' to version '10'. 13:55:21.409 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'jobs' to version 9 13:55:21.423 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'jobs' to version 10 13:55:21.781 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'extendedfield' from version '1' to version '2'. 13:55:21.782 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'extendedfield' to version 2 13:55:21.813 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'extendedfieldvalue' from version '1' to version '2'. 13:55:21.814 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'extendedfieldvalue' to version 2 13:55:21.922 [main] WARN dk.netarkivet.common.utils.DBUtils - As yet unknown tablename 'harvestchannel' in table schemaversions. The table should be automatically created in the database when it is first needed. 13:55:21.923 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'harvestchannel' from version '0' to version '1'. 13:55:21.924 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestchannel' to version 1 13:55:23.666 [main] WARN dk.netarkivet.harvester.datamodel.DatabaseTestUtils - Expected SQL-exception when shutting down database: java.sql.SQLNonTransientConnectionException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at java.sql.DriverManager.getConnection(DriverManager.java:664) ~[na:1.8.0_11] at java.sql.DriverManager.getConnection(DriverManager.java:270) ~[na:1.8.0_11] at dk.netarkivet.harvester.datamodel.DatabaseTestUtils.dropDatabase(DatabaseTestUtils.java:178) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DatabaseTestUtils.dropHDDB(DatabaseTestUtils.java:210) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DataModelTestCase.tearDown(DataModelTestCase.java:116) [test-classes/:na] at dk.netarkivet.harvester.datamodel.HarvestDBConnectionTester.tearDown(HarvestDBConnectionTester.java:65) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Caused by: org.apache.derby.impl.jdbc.EmbedSQLException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source) ~[derby-10.10.1.1.jar:na] ... 51 common frames omitted Caused by: org.apache.derby.iapi.error.StandardException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.iapi.error.StandardException.newException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.shutdownDatabaseException(Unknown Source) ~[derby-10.10.1.1.jar:na] ... 46 common frames omitted Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.503 sec - in dk.netarkivet.harvester.datamodel.HarvestDBConnectionTester Running dk.netarkivet.harvester.datamodel.DomainDBDAOTester 13:55:38.287 [main] INFO com.mchange.v2.log.MLog - MLog clients using log4j logging. 13:55:38.335 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.1 [built 16-January-2007 14:46:42; debug? true; trace: 10] 13:55:38.452 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values: - minPoolSize=5 - maxPoolSize=10 - acquireIncrement=5 - maxStatements=0 - maxStatementsPerConnection=0 - idleConnTestPeriod=0 - idleConnTestQuery='null' - idleConnTestOnCheckin=false 13:55:38.543 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, dataSourceName -> 10bbezp9417mebirfq4hxt|43aaf813, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.apache.derby.jdbc.EmbeddedDriver, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 10bbezp9417mebirfq4hxt|43aaf813, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:derby:/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb;create=true, lastAcquisitionFailureDefaultUser -> null, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 10, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, numThreadsAwaitingCheckoutDefaultUser -> 0, preferredTestQuery -> null, properties -> {}, propertyCycle -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false ] 13:55:38.575 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:38.577 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:38.651 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'domains' from version '2' to version '3'. 13:55:38.656 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:38.659 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:38.668 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:38.669 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'domains' to version 3 13:55:39.118 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'harvestdefinitions' from version '2' to version '4'. 13:55:39.120 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestdefinitions' to version 3 13:55:39.202 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestdefinitions' to version 4 13:55:39.289 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'jobs' from version '8' to version '10'. 13:55:39.300 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'jobs' to version 9 13:55:39.339 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'jobs' to version 10 13:55:39.906 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'extendedfield' from version '1' to version '2'. 13:55:39.908 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'extendedfield' to version 2 13:55:39.952 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'extendedfieldvalue' from version '1' to version '2'. 13:55:39.954 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'extendedfieldvalue' to version 2 13:55:40.178 [main] WARN dk.netarkivet.common.utils.DBUtils - As yet unknown tablename 'harvestchannel' in table schemaversions. The table should be automatically created in the database when it is first needed. 13:55:40.179 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'harvestchannel' from version '0' to version '1'. 13:55:40.182 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestchannel' to version 1 13:55:41.122 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.topLevelDomains.tld 13:55:41.284 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ac,ad,ae,aero,af,ag,ai,al,am,an,ao,aq,ar,arpa,as,gv.at,ac.at,or.at,co.at,biz.at,info.at,priv.at,at,au,aw,ax,az,ba,bb,bd,be,bf,bg,bh,bi,biz,bj,bm,bn,bo,br,bs,bt,bv,bw,by,bz,ca,cat,cc,cd,cf,cg,ch,ci,ck,cl,cm,cn,co,com,coop,cr,cs,cu,cv,cx,cy,cz,de,dj,dk,dm,do,dz,ec,edu,ee,eg,eh,er,es,et,eu,fi,fj,fk,fm,fo,aeroport.fr,asso.fr,avoues.fr,chambagri.fr,com.fr,gouv.fr,medecin.fr,nom.fr,pharmacien.fr,port.fr,prd.fr,presse.fr,tm.fr,fr,ga,gb,gd,ge,gf,gg,gh,gi,gl,gm,gn,gov,gp,gq,gr,gs,gt,gu,gw,gy,hk,hm,hn,hr,ht,hu,id,ie,il,im,in,info,int,io,iq,ir,is,it,je,jm,jo,jobs,jp,ke,kg,kh,ki,km,kn,kp,kr,kw,ky,kz,la,lb,lc,li,lk,lr,ls,lt,lu,lv,ly,ma,mc,md,me,mg,mh,mil,mk,ml,mm,mn,mo,mobi,mp,mq,mr,ms,mt,mu,museum,mv,mw,mx,my,mz,na,name,nc,ne,net,nf,ng,ni,nl,no,np,nr,nt,nu,nz,om,org,pa,pe,pf,pg,ph,pk,pl,pm,pn,pr,pro,ps,pt,pw,py,qa,asso.re,com.re,re,ro,ru,rw,sa,sb,sc,sd,se,sg,sh,si,sj,sk,sl,sm,sn,so,sr,st,su,sv,sy,sz,tc,td,at.tf,net.tf,tf,tg,th,tj,tk,tl,tm,tn,to,tp,tr,travel,tt,tv,tw,tz,ua,ug,ac.uk,co.uk,gov.uk,ltd.uk,me.uk,mod.uk,net.uk,nic.uk,nhs.uk,org.uk,plc.uk,police.uk,sch.uk,govt.uk,orgn.uk,lea.uk,mil.uk,nel.uk,uk,us,uy,uz,va,vc,ve,vg,vi,vn,vu,wien,wf,ws,ye,yt,yu,za,zm,zw 13:55:41.743 [main] DEBUG dk.netarkivet.harvester.datamodel.DomainDBDAO - trying to create domain with name: venstre.dk 13:55:42.276 [main] DEBUG dk.netarkivet.harvester.datamodel.DomainDBDAO - trying to create domain with name: todo.dk 13:55:42.411 [main] DEBUG dk.netarkivet.harvester.datamodel.DomainDBDAO - trying to create domain with name: venstre.nu 13:55:42.419 [main] DEBUG dk.netarkivet.harvester.datamodel.DomainDBDAO - trying to create domain with name: sy-jonna.dk 13:55:42.434 [main] DEBUG dk.netarkivet.harvester.datamodel.DomainDBDAO - trying to create domain with name: one.com 13:55:42.554 [main] DEBUG dk.netarkivet.harvester.datamodel.DomainDBDAO - trying to create domain with name: two.com 13:55:42.645 [main] DEBUG dk.netarkivet.harvester.datamodel.DomainDBDAO - trying to create domain with name: one.net 13:55:42.712 [main] DEBUG dk.netarkivet.harvester.datamodel.DomainDBDAO - trying to create domain with name: two.net 13:55:43.436 [main] WARN dk.netarkivet.harvester.datamodel.DatabaseTestUtils - Expected SQL-exception when shutting down database: java.sql.SQLNonTransientConnectionException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at java.sql.DriverManager.getConnection(DriverManager.java:664) ~[na:1.8.0_11] at java.sql.DriverManager.getConnection(DriverManager.java:270) ~[na:1.8.0_11] at dk.netarkivet.harvester.datamodel.DatabaseTestUtils.dropDatabase(DatabaseTestUtils.java:178) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DatabaseTestUtils.dropHDDB(DatabaseTestUtils.java:210) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DataModelTestCase.tearDown(DataModelTestCase.java:116) [test-classes/:na] at dk.netarkivet.harvester.datamodel.DomainDBDAOTester.tearDown(DomainDBDAOTester.java:76) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Caused by: org.apache.derby.impl.jdbc.EmbedSQLException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source) ~[derby-10.10.1.1.jar:na] ... 51 common frames omitted Caused by: org.apache.derby.iapi.error.StandardException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.iapi.error.StandardException.newException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.shutdownDatabaseException(Unknown Source) ~[derby-10.10.1.1.jar:na] ... 46 common frames omitted Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.848 sec - in dk.netarkivet.harvester.datamodel.DomainDBDAOTester Running dk.netarkivet.harvester.datamodel.TimedScheduleTester Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.62 sec - in dk.netarkivet.harvester.datamodel.TimedScheduleTester Running dk.netarkivet.harvester.datamodel.HarvestTemplateApplicationTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.001 sec - in dk.netarkivet.harvester.datamodel.HarvestTemplateApplicationTester Running dk.netarkivet.harvester.datamodel.DomainTester 13:55:58.333 [main] INFO com.mchange.v2.log.MLog - MLog clients using log4j logging. 13:55:58.380 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.1 [built 16-January-2007 14:46:42; debug? true; trace: 10] 13:55:58.490 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values: - minPoolSize=5 - maxPoolSize=10 - acquireIncrement=5 - maxStatements=0 - maxStatementsPerConnection=0 - idleConnTestPeriod=0 - idleConnTestQuery='null' - idleConnTestOnCheckin=false 13:55:58.740 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, dataSourceName -> 10bbezp9417meqzk1q0rt1y|57ac5227, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.apache.derby.jdbc.EmbeddedDriver, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 10bbezp9417meqzk1q0rt1y|57ac5227, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:derby:/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb;create=true, lastAcquisitionFailureDefaultUser -> null, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 10, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, numThreadsAwaitingCheckoutDefaultUser -> 0, preferredTestQuery -> null, properties -> {}, propertyCycle -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false ] 13:55:58.813 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:58.823 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:58.838 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:58.900 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:58.931 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:55:59.016 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'domains' from version '2' to version '3'. 13:55:59.020 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'domains' to version 3 13:55:59.380 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'harvestdefinitions' from version '2' to version '4'. 13:55:59.382 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestdefinitions' to version 3 13:55:59.429 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestdefinitions' to version 4 13:55:59.456 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'jobs' from version '8' to version '10'. 13:55:59.461 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'jobs' to version 9 13:55:59.477 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'jobs' to version 10 13:55:59.981 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'extendedfield' from version '1' to version '2'. 13:55:59.982 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'extendedfield' to version 2 13:56:00.024 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'extendedfieldvalue' from version '1' to version '2'. 13:56:00.036 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'extendedfieldvalue' to version 2 13:56:00.256 [main] WARN dk.netarkivet.common.utils.DBUtils - As yet unknown tablename 'harvestchannel' in table schemaversions. The table should be automatically created in the database when it is first needed. 13:56:00.257 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'harvestchannel' from version '0' to version '1'. 13:56:00.259 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestchannel' to version 1 13:56:01.126 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.topLevelDomains.tld 13:56:01.247 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ac,ad,ae,aero,af,ag,ai,al,am,an,ao,aq,ar,arpa,as,gv.at,ac.at,or.at,co.at,biz.at,info.at,priv.at,at,au,aw,ax,az,ba,bb,bd,be,bf,bg,bh,bi,biz,bj,bm,bn,bo,br,bs,bt,bv,bw,by,bz,ca,cat,cc,cd,cf,cg,ch,ci,ck,cl,cm,cn,co,com,coop,cr,cs,cu,cv,cx,cy,cz,de,dj,dk,dm,do,dz,ec,edu,ee,eg,eh,er,es,et,eu,fi,fj,fk,fm,fo,aeroport.fr,asso.fr,avoues.fr,chambagri.fr,com.fr,gouv.fr,medecin.fr,nom.fr,pharmacien.fr,port.fr,prd.fr,presse.fr,tm.fr,fr,ga,gb,gd,ge,gf,gg,gh,gi,gl,gm,gn,gov,gp,gq,gr,gs,gt,gu,gw,gy,hk,hm,hn,hr,ht,hu,id,ie,il,im,in,info,int,io,iq,ir,is,it,je,jm,jo,jobs,jp,ke,kg,kh,ki,km,kn,kp,kr,kw,ky,kz,la,lb,lc,li,lk,lr,ls,lt,lu,lv,ly,ma,mc,md,me,mg,mh,mil,mk,ml,mm,mn,mo,mobi,mp,mq,mr,ms,mt,mu,museum,mv,mw,mx,my,mz,na,name,nc,ne,net,nf,ng,ni,nl,no,np,nr,nt,nu,nz,om,org,pa,pe,pf,pg,ph,pk,pl,pm,pn,pr,pro,ps,pt,pw,py,qa,asso.re,com.re,re,ro,ru,rw,sa,sb,sc,sd,se,sg,sh,si,sj,sk,sl,sm,sn,so,sr,st,su,sv,sy,sz,tc,td,at.tf,net.tf,tf,tg,th,tj,tk,tl,tm,tn,to,tp,tr,travel,tt,tv,tw,tz,ua,ug,ac.uk,co.uk,gov.uk,ltd.uk,me.uk,mod.uk,net.uk,nic.uk,nhs.uk,org.uk,plc.uk,police.uk,sch.uk,govt.uk,orgn.uk,lea.uk,mil.uk,nel.uk,uk,us,uy,uz,va,vc,ve,vg,vi,vn,vu,wien,wf,ws,ye,yt,yu,za,zm,zw 13:56:01.967 [main] WARN dk.netarkivet.harvester.datamodel.DatabaseTestUtils - Expected SQL-exception when shutting down database: java.sql.SQLNonTransientConnectionException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at java.sql.DriverManager.getConnection(DriverManager.java:664) ~[na:1.8.0_11] at java.sql.DriverManager.getConnection(DriverManager.java:270) ~[na:1.8.0_11] at dk.netarkivet.harvester.datamodel.DatabaseTestUtils.dropDatabase(DatabaseTestUtils.java:178) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DatabaseTestUtils.dropHDDB(DatabaseTestUtils.java:210) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DataModelTestCase.tearDown(DataModelTestCase.java:116) [test-classes/:na] at dk.netarkivet.harvester.datamodel.DomainTester.tearDown(DomainTester.java:79) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Caused by: org.apache.derby.impl.jdbc.EmbedSQLException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source) ~[derby-10.10.1.1.jar:na] ... 51 common frames omitted Caused by: org.apache.derby.iapi.error.StandardException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.iapi.error.StandardException.newException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.shutdownDatabaseException(Unknown Source) ~[derby-10.10.1.1.jar:na] ... 46 common frames omitted Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.634 sec - in dk.netarkivet.harvester.datamodel.DomainTester Running dk.netarkivet.harvester.datamodel.HourlyFrequencyTester Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.582 sec - in dk.netarkivet.harvester.datamodel.HourlyFrequencyTester Running dk.netarkivet.harvester.datamodel.MySQLSpecificsTester Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.774 sec - in dk.netarkivet.harvester.datamodel.MySQLSpecificsTester Running dk.netarkivet.harvester.datamodel.DomainOwnerInfoTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec - in dk.netarkivet.harvester.datamodel.DomainOwnerInfoTester Running dk.netarkivet.harvester.datamodel.MonthlyFrequencyTester Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.501 sec - in dk.netarkivet.harvester.datamodel.MonthlyFrequencyTester Running dk.netarkivet.harvester.datamodel.DomainDAOTester 13:56:20.671 [main] INFO com.mchange.v2.log.MLog - MLog clients using log4j logging. 13:56:20.722 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.1 [built 16-January-2007 14:46:42; debug? true; trace: 10] 13:56:20.828 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values: - minPoolSize=5 - maxPoolSize=10 - acquireIncrement=5 - maxStatements=0 - maxStatementsPerConnection=0 - idleConnTestPeriod=0 - idleConnTestQuery='null' - idleConnTestOnCheckin=false 13:56:20.906 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, dataSourceName -> 10bbezp9417mf886zpx2ht|33aeca0b, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.apache.derby.jdbc.EmbeddedDriver, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 10bbezp9417mf886zpx2ht|33aeca0b, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:derby:/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb;create=true, lastAcquisitionFailureDefaultUser -> null, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 10, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, numThreadsAwaitingCheckoutDefaultUser -> 0, preferredTestQuery -> null, properties -> {}, propertyCycle -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false ] 13:56:20.934 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:20.939 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:20.946 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:21.004 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'domains' from version '2' to version '3'. 13:56:21.006 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'domains' to version 3 13:56:21.119 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:21.131 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:21.361 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:21.363 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:21.365 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:21.366 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:21.374 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:21.396 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'harvestdefinitions' from version '2' to version '4'. 13:56:21.397 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestdefinitions' to version 3 13:56:21.426 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestdefinitions' to version 4 13:56:21.465 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'jobs' from version '8' to version '10'. 13:56:21.470 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'jobs' to version 9 13:56:21.488 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'jobs' to version 10 13:56:22.116 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'extendedfield' from version '1' to version '2'. 13:56:22.118 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'extendedfield' to version 2 13:56:22.166 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'extendedfieldvalue' from version '1' to version '2'. 13:56:22.196 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'extendedfieldvalue' to version 2 13:56:22.414 [main] WARN dk.netarkivet.common.utils.DBUtils - As yet unknown tablename 'harvestchannel' in table schemaversions. The table should be automatically created in the database when it is first needed. 13:56:22.415 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'harvestchannel' from version '0' to version '1'. 13:56:22.416 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestchannel' to version 1 13:56:24.207 [main] WARN dk.netarkivet.harvester.datamodel.DatabaseTestUtils - Expected SQL-exception when shutting down database: java.sql.SQLNonTransientConnectionException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at java.sql.DriverManager.getConnection(DriverManager.java:664) ~[na:1.8.0_11] at java.sql.DriverManager.getConnection(DriverManager.java:270) ~[na:1.8.0_11] at dk.netarkivet.harvester.datamodel.DatabaseTestUtils.dropDatabase(DatabaseTestUtils.java:178) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DatabaseTestUtils.dropHDDB(DatabaseTestUtils.java:210) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DataModelTestCase.tearDown(DataModelTestCase.java:116) [test-classes/:na] at dk.netarkivet.harvester.datamodel.DomainDAOTester.tearDown(DomainDAOTester.java:67) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Caused by: org.apache.derby.impl.jdbc.EmbedSQLException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source) ~[derby-10.10.1.1.jar:na] ... 51 common frames omitted Caused by: org.apache.derby.iapi.error.StandardException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.iapi.error.StandardException.newException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.shutdownDatabaseException(Unknown Source) ~[derby-10.10.1.1.jar:na] ... 46 common frames omitted Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.835 sec - in dk.netarkivet.harvester.datamodel.DomainDAOTester Running dk.netarkivet.harvester.datamodel.HeritrixTemplateTester 13:56:27.142 [main] DEBUG dk.netarkivet.harvester.datamodel.HeritrixTemplate - ARC format selected to be used by Heritrix 13:56:27.322 [main] DEBUG dk.netarkivet.harvester.datamodel.HeritrixTemplate - WARC format selected to be used by Heritrix Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.748 sec - in dk.netarkivet.harvester.datamodel.HeritrixTemplateTester Running dk.netarkivet.harvester.datamodel.JobStatusTester Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.573 sec - in dk.netarkivet.harvester.datamodel.JobStatusTester Running dk.netarkivet.harvester.scheduler.HarvesterStatusReceiverTest 13:56:35.865 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:56:35.871 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:56:35.924 [main] WARN dk.netarkivet.harvester.distribute.HarvesterMessageHandler - Error processing message 'TestObjectMessage: NO ID: To DEV_COMMON_HARVESTMON ReplyTo DEV_COMMON_ERROR OK' dk.netarkivet.common.exceptions.PermissionDenied: 'dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver@6f4a47c7' provides no handling for NO ID: To DEV_COMMON_HARVESTMON ReplyTo DEV_COMMON_ERROR OK of type dk.netarkivet.harvester.harvesting.distribute.CrawlProgressMessage and should not be invoked! at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.deny(HarvesterMessageHandler.java:83) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.visit(HarvesterMessageHandler.java:119) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.harvesting.distribute.CrawlProgressMessage.accept(CrawlProgressMessage.java:336) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.distribute.HarvesterMessageHandler.onMessage(HarvesterMessageHandler.java:69) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.scheduler.HarvesterStatusReceiverTest.testInvalidMessageType(HarvesterStatusReceiverTest.java:66) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.157 sec - in dk.netarkivet.harvester.scheduler.HarvesterStatusReceiverTest Running dk.netarkivet.harvester.scheduler.HarvestJobGeneratorTest 13:56:47.821 [main] INFO com.mchange.v2.log.MLog - MLog clients using log4j logging. 13:56:47.867 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.1 [built 16-January-2007 14:46:42; debug? true; trace: 10] 13:56:47.991 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values: - minPoolSize=5 - maxPoolSize=10 - acquireIncrement=5 - maxStatements=0 - maxStatementsPerConnection=0 - idleConnTestPeriod=0 - idleConnTestQuery='null' - idleConnTestOnCheckin=false 13:56:48.072 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, dataSourceName -> 10bbezp9417mft64dskamv|25bc0606, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.apache.derby.jdbc.EmbeddedDriver, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 10bbezp9417mft64dskamv|25bc0606, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:derby:/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb;create=true, lastAcquisitionFailureDefaultUser -> null, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 10, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, numThreadsAwaitingCheckoutDefaultUser -> 0, preferredTestQuery -> null, properties -> {}, propertyCycle -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false ] 13:56:48.098 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:48.161 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:48.166 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:48.168 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'domains' from version '2' to version '3'. 13:56:48.184 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:48.185 [com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1] INFO com.mchange.v2.c3p0.SQLWarnings - Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. java.sql.SQLWarning: Database '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' not created, connection made to existing database instead. at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.iapi.error.SQLWarningFactory.newSQLWarning(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at com.mchange.v2.c3p0.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:120) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:143) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.WrapperConnectionPoolDataSource.getPooledConnection(WrapperConnectionPoolDataSource.java:132) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.acquireResource(C3P0PooledConnectionPool.java:137) ~[c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.doAcquire(BasicResourcePool.java:1014) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool.access$800(BasicResourcePool.java:32) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.resourcepool.BasicResourcePool$AcquireTask.run(BasicResourcePool.java:1810) [c3p0-0.9.1.jar:0.9.1] at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) [c3p0-0.9.1.jar:0.9.1] 13:56:48.186 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'domains' to version 3 13:56:48.849 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'harvestdefinitions' from version '2' to version '4'. 13:56:48.851 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestdefinitions' to version 3 13:56:48.956 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestdefinitions' to version 4 13:56:49.019 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'jobs' from version '8' to version '10'. 13:56:49.030 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'jobs' to version 9 13:56:49.064 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'jobs' to version 10 13:56:49.687 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'extendedfield' from version '1' to version '2'. 13:56:49.690 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'extendedfield' to version 2 13:56:49.764 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'extendedfieldvalue' from version '1' to version '2'. 13:56:49.767 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'extendedfieldvalue' to version 2 13:56:50.039 [main] WARN dk.netarkivet.common.utils.DBUtils - As yet unknown tablename 'harvestchannel' in table schemaversions. The table should be automatically created in the database when it is first needed. 13:56:50.040 [main] INFO dk.netarkivet.harvester.datamodel.DBSpecifics - Trying to migrate table 'harvestchannel' from version '0' to version '1'. 13:56:50.043 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Updating table 'harvestchannel' to version 1 13:56:51.140 [main] DEBUG dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO - Reading harvestdefinition w/ id 42 13:56:52.035 [main] DEBUG dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO - Partialharvest found w/ id 42 13:56:52.261 [main] DEBUG dk.netarkivet.harvester.datamodel.ScheduleDBDAO - Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek, dayofmonth) = (2,true,1,null,null,null,null,) 13:56:52.262 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a DAILY frequency. 13:56:52.402 [main] DEBUG dk.netarkivet.harvester.datamodel.ScheduleDBDAO - Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek, dayofmonth) = (2,true,1,null,null,null,null,) 13:56:52.402 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a DAILY frequency. 13:56:52.465 [main] DEBUG dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO - 1 partialharvests records updated 13:56:52.492 [main] INFO dk.netarkivet.harvester.scheduler.HarvestChannelRegistry - Harvester registered on channel FOCUSED 13:56:52.492 [main] INFO dk.netarkivet.harvester.scheduler.HarvestChannelRegistry - HarvestChannelRegistry status: - FOCUSED { } 13:56:54.377 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.topLevelDomains.tld 13:56:54.546 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ac,ad,ae,aero,af,ag,ai,al,am,an,ao,aq,ar,arpa,as,gv.at,ac.at,or.at,co.at,biz.at,info.at,priv.at,at,au,aw,ax,az,ba,bb,bd,be,bf,bg,bh,bi,biz,bj,bm,bn,bo,br,bs,bt,bv,bw,by,bz,ca,cat,cc,cd,cf,cg,ch,ci,ck,cl,cm,cn,co,com,coop,cr,cs,cu,cv,cx,cy,cz,de,dj,dk,dm,do,dz,ec,edu,ee,eg,eh,er,es,et,eu,fi,fj,fk,fm,fo,aeroport.fr,asso.fr,avoues.fr,chambagri.fr,com.fr,gouv.fr,medecin.fr,nom.fr,pharmacien.fr,port.fr,prd.fr,presse.fr,tm.fr,fr,ga,gb,gd,ge,gf,gg,gh,gi,gl,gm,gn,gov,gp,gq,gr,gs,gt,gu,gw,gy,hk,hm,hn,hr,ht,hu,id,ie,il,im,in,info,int,io,iq,ir,is,it,je,jm,jo,jobs,jp,ke,kg,kh,ki,km,kn,kp,kr,kw,ky,kz,la,lb,lc,li,lk,lr,ls,lt,lu,lv,ly,ma,mc,md,me,mg,mh,mil,mk,ml,mm,mn,mo,mobi,mp,mq,mr,ms,mt,mu,museum,mv,mw,mx,my,mz,na,name,nc,ne,net,nf,ng,ni,nl,no,np,nr,nt,nu,nz,om,org,pa,pe,pf,pg,ph,pk,pl,pm,pn,pr,pro,ps,pt,pw,py,qa,asso.re,com.re,re,ro,ru,rw,sa,sb,sc,sd,se,sg,sh,si,sj,sk,sl,sm,sn,so,sr,st,su,sv,sy,sz,tc,td,at.tf,net.tf,tf,tg,th,tj,tk,tl,tm,tn,to,tp,tr,travel,tt,tv,tw,tz,ua,ug,ac.uk,co.uk,gov.uk,ltd.uk,me.uk,mod.uk,net.uk,nic.uk,nhs.uk,org.uk,plc.uk,police.uk,sch.uk,govt.uk,orgn.uk,lea.uk,mil.uk,nel.uk,uk,us,uy,uz,va,vc,ve,vg,vi,vn,vu,wien,wf,ws,ye,yt,yu,za,zm,zw 13:56:55.034 [main] DEBUG dk.netarkivet.harvester.datamodel.ScheduleDBDAO - Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek, dayofmonth) = (1,false,1,0,null,null,null,) 13:56:55.034 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a HOURLY frequency. 13:56:55.048 [main] DEBUG dk.netarkivet.harvester.datamodel.ScheduleDBDAO - Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek, dayofmonth) = (1,false,1,0,null,null,null,) 13:56:55.048 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a HOURLY frequency. 13:56:55.134 [main] DEBUG dk.netarkivet.harvester.datamodel.ScheduleDBDAO - Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek, dayofmonth) = (2,false,1,0,4,null,null,) 13:56:55.134 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a DAILY frequency. 13:56:55.149 [main] DEBUG dk.netarkivet.harvester.datamodel.ScheduleDBDAO - Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek, dayofmonth) = (2,false,1,0,4,null,null,) 13:56:55.149 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a DAILY frequency. 13:56:55.241 [main] INFO dk.netarkivet.harvester.scheduler.HarvestChannelRegistry - Harvester registered on channel FOCUSED 13:56:55.241 [main] INFO dk.netarkivet.harvester.scheduler.HarvestChannelRegistry - HarvestChannelRegistry status: - FOCUSED { } 13:56:56.262 [main] INFO dk.netarkivet.harvester.scheduler.HarvestChannelRegistry - Harvester registered on channel FOCUSED 13:56:56.262 [main] INFO dk.netarkivet.harvester.scheduler.HarvestChannelRegistry - HarvestChannelRegistry status: - FOCUSED { } 13:56:56.268 [main] DEBUG dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO - Reading harvestdefinition w/ id 44 13:56:56.270 [main] DEBUG dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO - Partialharvest found w/ id 44 13:56:56.285 [main] DEBUG dk.netarkivet.harvester.datamodel.ScheduleDBDAO - Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek, dayofmonth) = (1,false,1,0,null,null,null,) 13:56:56.286 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a HOURLY frequency. 13:56:56.313 [main] DEBUG dk.netarkivet.harvester.datamodel.ScheduleDBDAO - Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek, dayofmonth) = (1,false,1,0,null,null,null,) 13:56:56.314 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a HOURLY frequency. 13:56:56.339 [main] INFO dk.netarkivet.harvester.scheduler.HarvestJobGenerator - Starting to create jobs for harvest definition #44(Hele time) 13:56:56.344 [main] DEBUG dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO - Reading harvestdefinition w/ id 45 13:56:56.347 [main] DEBUG dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO - Partialharvest found w/ id 45 13:56:56.374 [main] DEBUG dk.netarkivet.harvester.datamodel.ScheduleDBDAO - Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek, dayofmonth) = (2,false,1,0,4,null,null,) 13:56:56.375 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a DAILY frequency. 13:56:56.379 [main] DEBUG dk.netarkivet.harvester.datamodel.ScheduleDBDAO - Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek, dayofmonth) = (2,false,1,0,4,null,null,) 13:56:56.380 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a DAILY frequency. 13:56:56.387 [main] INFO dk.netarkivet.harvester.scheduler.HarvestJobGenerator - Starting to create jobs for harvest definition #45(Kl. 4) 13:56:56.406 [JobGeneratorTask-44] INFO dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator - Generating jobs for harvestdefinition #44 13:56:56.410 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.scheduler.jobgen.DefaultJobGenerator - Adding domainconfigs with the same order.xml for harvest #44 13:56:56.432 [JobGeneratorTask-44] INFO dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator - No channel mapping registered for harvest id 44, will use default. 13:56:56.541 [JobGeneratorTask-45] INFO dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator - Generating jobs for harvestdefinition #45 13:56:56.543 [JobGeneratorTask-45] DEBUG dk.netarkivet.harvester.scheduler.jobgen.DefaultJobGenerator - Adding domainconfigs with the same order.xml for harvest #45 13:56:56.546 [JobGeneratorTask-45] INFO dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator - No channel mapping registered for harvest id 45, will use default. 13:56:56.876 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.datamodel.HeritrixTemplate - ARC format selected to be used by Heritrix 13:56:57.068 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.datamodel.JobDBDAO - Creating Job 2 (state = NEW, HD = 44, channel = FOCUSED, snapshot = false, forcemaxcount = 0, forcemaxbytes = 500000000, forcemaxrunningtime = 0, orderxml = FullSite-order, numconfigs = 1, created = Mon Sep 22 13:56:57 CEST 2014) 13:56:57.231 [JobGeneratorTask-45] DEBUG dk.netarkivet.harvester.datamodel.HeritrixTemplate - ARC format selected to be used by Heritrix 13:56:57.301 [JobGeneratorTask-44] WARN dk.netarkivet.harvester.datamodel.Job - HarvestnamePrefix not yet set for job 2. Set it by using the naming scheme. This should only happen for old jobs being read 13:56:57.304 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.datamodel.Job - Applying the default ArchiveFileNaming class 'dk.netarkivet.harvester.harvesting.LegacyNamingConvention'. 13:56:57.321 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.datamodel.Job - The harvestPrefix of this job is: 2-44 13:56:57.925 [JobGeneratorTask-45] DEBUG dk.netarkivet.harvester.datamodel.JobDBDAO - Creating Job 3 (state = NEW, HD = 45, channel = FOCUSED, snapshot = false, forcemaxcount = 0, forcemaxbytes = 500000000, forcemaxrunningtime = 0, orderxml = FullSite-order, numconfigs = 1, created = Mon Sep 22 13:56:57 CEST 2014) 13:56:57.928 [JobGeneratorTask-45] WARN dk.netarkivet.harvester.datamodel.Job - HarvestnamePrefix not yet set for job 3. Set it by using the naming scheme. This should only happen for old jobs being read 13:56:57.929 [JobGeneratorTask-45] DEBUG dk.netarkivet.harvester.datamodel.Job - Applying the default ArchiveFileNaming class 'dk.netarkivet.harvester.harvesting.LegacyNamingConvention'. 13:56:57.929 [JobGeneratorTask-45] DEBUG dk.netarkivet.harvester.datamodel.Job - The harvestPrefix of this job is: 3-45 13:56:57.993 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.scheduler.jobgen.DefaultJobGenerator - Created 1 jobs for harvest #44 13:56:57.995 [JobGeneratorTask-44] INFO dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator - Finished generating 1 jobs for harvestdefinition #44 13:56:58.008 [JobGeneratorTask-44] INFO dk.netarkivet.harvester.scheduler.HarvestJobGenerator - Created 1 jobs for harvest definition (Hele time) 13:56:58.537 [JobGeneratorTask-45] DEBUG dk.netarkivet.harvester.scheduler.jobgen.DefaultJobGenerator - Created 1 jobs for harvest #45 13:56:58.537 [JobGeneratorTask-45] INFO dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator - Finished generating 1 jobs for harvestdefinition #45 13:56:58.537 [JobGeneratorTask-45] INFO dk.netarkivet.harvester.scheduler.HarvestJobGenerator - Created 1 jobs for harvest definition (Kl. 4) 13:56:58.541 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO - 1 partialharvests records updated 13:56:58.566 [JobGeneratorTask-45] DEBUG dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO - 1 partialharvests records updated 13:56:58.591 [JobGeneratorTask-45] DEBUG dk.netarkivet.harvester.scheduler.HarvestJobGenerator - Removed HD #45(Kl. 4) from list of harvestdefinitions to be scheduled. Harvestdefinitions still to be scheduled: [44] 13:56:58.607 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.scheduler.HarvestJobGenerator - Removed HD #44(Hele time) from list of harvestdefinitions to be scheduled. Harvestdefinitions still to be scheduled: [] 13:56:59.039 [main] INFO dk.netarkivet.harvester.scheduler.HarvestChannelRegistry - Harvester registered on channel FOCUSED 13:56:59.039 [main] INFO dk.netarkivet.harvester.scheduler.HarvestChannelRegistry - HarvestChannelRegistry status: - FOCUSED { } 13:56:59.053 [main] DEBUG dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO - Reading harvestdefinition w/ id 44 13:56:59.063 [main] DEBUG dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO - Partialharvest found w/ id 44 13:56:59.089 [main] DEBUG dk.netarkivet.harvester.datamodel.ScheduleDBDAO - Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek, dayofmonth) = (1,false,1,0,null,null,null,) 13:56:59.091 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a HOURLY frequency. 13:56:59.096 [main] DEBUG dk.netarkivet.harvester.datamodel.ScheduleDBDAO - Creating frequency for (timeunit,anytime,numtimeunits,hour, minute, dayofweek, dayofmonth) = (1,false,1,0,null,null,null,) 13:56:59.096 [main] DEBUG dk.netarkivet.harvester.datamodel.Frequency - Creating a HOURLY frequency. 13:56:59.102 [main] INFO dk.netarkivet.harvester.scheduler.HarvestJobGenerator - Starting to create jobs for harvest definition #44(Hele time) 13:56:59.104 [JobGeneratorTask-44] INFO dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator - Generating jobs for harvestdefinition #44 13:56:59.105 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.scheduler.jobgen.DefaultJobGenerator - Adding domainconfigs with the same order.xml for harvest #44 13:56:59.109 [JobGeneratorTask-44] INFO dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator - No channel mapping registered for harvest id 44, will use default. 13:56:59.602 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.datamodel.HeritrixTemplate - ARC format selected to be used by Heritrix 13:56:59.680 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.datamodel.JobDBDAO - Creating Job 4 (state = NEW, HD = 44, channel = FOCUSED, snapshot = false, forcemaxcount = 0, forcemaxbytes = 500000000, forcemaxrunningtime = 0, orderxml = FullSite-order, numconfigs = 1, created = Mon Sep 22 13:56:59 CEST 2014) 13:56:59.719 [JobGeneratorTask-44] WARN dk.netarkivet.harvester.datamodel.Job - HarvestnamePrefix not yet set for job 4. Set it by using the naming scheme. This should only happen for old jobs being read 13:56:59.721 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.datamodel.Job - Applying the default ArchiveFileNaming class 'dk.netarkivet.harvester.harvesting.LegacyNamingConvention'. 13:56:59.722 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.datamodel.Job - The harvestPrefix of this job is: 4-44 13:56:59.811 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.scheduler.jobgen.DefaultJobGenerator - Created 1 jobs for harvest #44 13:56:59.812 [JobGeneratorTask-44] INFO dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator - Finished generating 1 jobs for harvestdefinition #44 13:56:59.813 [JobGeneratorTask-44] INFO dk.netarkivet.harvester.scheduler.HarvestJobGenerator - Created 1 jobs for harvest definition (Hele time) 13:56:59.821 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO - 1 partialharvests records updated 13:56:59.841 [JobGeneratorTask-44] DEBUG dk.netarkivet.harvester.scheduler.HarvestJobGenerator - Removed HD #44(Hele time) from list of harvestdefinitions to be scheduled. Harvestdefinitions still to be scheduled: [] 13:57:01.344 [main] WARN dk.netarkivet.harvester.datamodel.DatabaseTestUtils - Expected SQL-exception when shutting down database: java.sql.SQLNonTransientConnectionException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.EmbedConnection40.(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.Driver20.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) ~[derby-10.10.1.1.jar:na] at java.sql.DriverManager.getConnection(DriverManager.java:664) ~[na:1.8.0_11] at java.sql.DriverManager.getConnection(DriverManager.java:270) ~[na:1.8.0_11] at dk.netarkivet.harvester.datamodel.DatabaseTestUtils.dropDatabase(DatabaseTestUtils.java:178) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DatabaseTestUtils.dropHDDB(DatabaseTestUtils.java:210) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.datamodel.DataModelTestCase.tearDown(DataModelTestCase.java:116) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Caused by: org.apache.derby.impl.jdbc.EmbedSQLException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source) ~[derby-10.10.1.1.jar:na] ... 50 common frames omitted Caused by: org.apache.derby.iapi.error.StandardException: Database './tests/dk/netarkivet/harvester/datamodel/data/working/fullhddb' shutdown. at org.apache.derby.iapi.error.StandardException.newException(Unknown Source) ~[derby-10.10.1.1.jar:na] at org.apache.derby.impl.jdbc.TransactionResourceImpl.shutdownDatabaseException(Unknown Source) ~[derby-10.10.1.1.jar:na] ... 45 common frames omitted Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.141 sec - in dk.netarkivet.harvester.scheduler.HarvestJobGeneratorTest Running dk.netarkivet.harvester.webinterface.SnapshotHarvestDefinitionTester 13:57:06.962 [main] WARN dk.netarkivet.common.utils.I18n - I18n bundle 'dk.netarkivet.common.Translations' is missing label 'errormsg;harvest.definition.0.already.exists' java.util.MissingResourceException: Can't find resource for bundle java.util.PropertyResourceBundle, key errormsg;harvest.definition.0.already.exists at java.util.ResourceBundle.getObject(ResourceBundle.java:450) ~[na:1.8.0_11] at java.util.ResourceBundle.getObject(ResourceBundle.java:444) ~[na:1.8.0_11] at java.util.ResourceBundle.getString(ResourceBundle.java:407) ~[na:1.8.0_11] at dk.netarkivet.common.utils.I18n.getString(I18n.java:95) [common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.common.utils.I18n.getString(I18n.java:70) [common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.common.webinterface.HTMLUtils.forwardWithErrorMessage(HTMLUtils.java:576) [common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.webinterface.SnapshotHarvestDefinition.processRequest(SnapshotHarvestDefinition.java:122) [harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.harvester.webinterface.SnapshotHarvestDefinitionTester.testExistingHarvestDefinition(SnapshotHarvestDefinitionTester.java:107) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.272 sec - in dk.netarkivet.harvester.webinterface.SnapshotHarvestDefinitionTester Running dk.netarkivet.harvester.webinterface.HistorySiteSectionTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.799 sec - in dk.netarkivet.harvester.webinterface.HistorySiteSectionTester Running dk.netarkivet.harvester.webinterface.ScheduleDefinitionTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.001 sec - in dk.netarkivet.harvester.webinterface.ScheduleDefinitionTester Running dk.netarkivet.common.webinterface.HTMLUtilsTester 13:57:10.819 [main] DEBUG dk.netarkivet.common.webinterface.HTMLUtils - Loaded URL '/HarvestDefinition/Definitions-selective-harvests.jsp' with title 'TestTitle' 13:57:10.829 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:10.880 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:10.983 [main] DEBUG dk.netarkivet.common.webinterface.HTMLUtils - Loaded URL 'HarvestDefinition/Definitions-selective-harvests.jsp' with title 'TestTitle' 13:57:10.984 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:10.985 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:10.996 [main] DEBUG dk.netarkivet.common.webinterface.HTMLUtils - Loaded URL 'http://foo.bar/History/Harveststatus-jobdetails.jsp' with title 'Details for Job' 13:57:11.004 [main] DEBUG dk.netarkivet.common.webinterface.HTMLUtils - Loaded URL 'http://foo.bar/History/Harveststatus-jobdetails.jsp' with title 'Jobdetaljer' Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.41 sec - in dk.netarkivet.common.webinterface.HTMLUtilsTester Running dk.netarkivet.common.webinterface.GUIWebServerTester 13:57:12.885 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:12.905 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:12.906 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:12.970 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.webapplication 13:57:12.974 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: tests/dk/netarkivet/common/webinterface/data/jsp 13:57:12.974 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:12.977 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: dk.netarkivet.common.webinterface.TestSiteSection 13:57:12.978 [main] INFO dk.netarkivet.common.webinterface.GUIWebServer - Starting webserver. Port: 4242 deployment directories: 'tests/dk/netarkivet/common/webinterface/data/jsp' classes: 'dk.netarkivet.common.webinterface.TestSiteSection' 13:57:13.182 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:13.184 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: dk.netarkivet.common.webinterface.TestSiteSection 13:57:13.395 [main] INFO dk.netarkivet.common.webinterface.GUIWebServer - The web application 'tests/dk/netarkivet/common/webinterface/data/jsp' is now deployed at '/jsp' 13:57:14.271 [main] INFO dk.netarkivet.common.webinterface.GUIWebServer - HTTP server has been stopped. 13:57:14.273 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.307 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:14.307 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:14.324 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.359 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:14.368 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:14.387 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.webapplication 13:57:14.387 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: /not_found_because_it_doesnt_exist 13:57:14.387 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:14.388 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: dk.netarkivet.common.webinterface.TestSiteSection 13:57:14.388 [main] INFO dk.netarkivet.common.webinterface.GUIWebServer - Starting webserver. Port: 4242 deployment directories: '/not_found_because_it_doesnt_exist' classes: 'dk.netarkivet.common.webinterface.TestSiteSection' 13:57:14.390 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.434 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:14.435 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:14.444 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.webapplication 13:57:14.444 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: tests/dk/netarkivet/common/webinterface/data/jsp 13:57:14.445 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:14.445 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: dk.netarkivet.common.webinterface.TestSiteSection 13:57:14.445 [main] INFO dk.netarkivet.common.webinterface.GUIWebServer - Starting webserver. Port: 4242 deployment directories: 'tests/dk/netarkivet/common/webinterface/data/jsp' classes: 'dk.netarkivet.common.webinterface.TestSiteSection' 13:57:14.447 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:14.447 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: dk.netarkivet.common.webinterface.TestSiteSection 13:57:14.450 [main] INFO dk.netarkivet.common.webinterface.GUIWebServer - The web application 'tests/dk/netarkivet/common/webinterface/data/jsp' is now deployed at '/jsp' 13:57:14.558 [main] INFO dk.netarkivet.common.webinterface.GUIWebServer - HTTP server has been stopped. 13:57:14.559 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.891 sec - in dk.netarkivet.common.webinterface.GUIWebServerTester 13:57:14.567 [Thread-31] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.569 [Thread-31] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:14.569 [Thread-31] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.570 [Thread-31] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.570 [Thread-16] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.571 [Thread-16] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:14.571 [Thread-16] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.572 [Thread-16] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.572 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.573 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:14.573 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.573 [Thread-14] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.574 [Thread-12] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.574 [Thread-12] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:14.574 [Thread-12] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.575 [Thread-12] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.576 [Thread-30] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.577 [Thread-30] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:14.578 [Thread-30] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:14.581 [Thread-30] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.common.webinterface.SiteSectionTester 13:57:16.854 [Thread-0] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.053 [Thread-0] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.116 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.118 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.133 [Thread-1000] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.134 [Thread-1000] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.218 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.221 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.243 [Thread-2000] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.245 [Thread-2000] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.295 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.298 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.322 [Thread-3000] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.330 [Thread-3000] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.458 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.464 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.509 [Thread-4000] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.511 [Thread-4000] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.578 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.580 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.589 [Thread-5000] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.594 [Thread-5000] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.694 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.697 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.708 [Thread-6000] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.714 [Thread-6000] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.820 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.824 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.913 [Thread-7000] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.915 [Thread-7000] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:17.991 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:17.995 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:18.008 [Thread-8000] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:18.010 [Thread-8000] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:18.055 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:18.057 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:18.065 [Thread-9000] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:18.067 [Thread-9000] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:18.150 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.webinterface.siteSection.class 13:57:18.155 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.archive.webinterface.BitPreservationSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 13:57:18.248 [main] WARN dk.netarkivet.common.utils.I18n - I18n bundle 'dk.netarkivet.harvester.Translations' is missing label 'title1' java.util.MissingResourceException: Can't find resource for bundle java.util.PropertyResourceBundle, key title1 at java.util.ResourceBundle.getObject(ResourceBundle.java:450) ~[na:1.8.0_11] at java.util.ResourceBundle.getObject(ResourceBundle.java:444) ~[na:1.8.0_11] at java.util.ResourceBundle.getString(ResourceBundle.java:407) ~[na:1.8.0_11] at dk.netarkivet.common.utils.I18n.getString(I18n.java:95) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.common.webinterface.SiteSection.getTitle(SiteSection.java:119) [common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.common.webinterface.SiteSectionTester.testGetTitle(SiteSectionTester.java:60) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 13:57:18.275 [main] WARN dk.netarkivet.common.utils.I18n - I18n bundle 'dk.netarkivet.harvester.Translations' is missing label 'title1' java.util.MissingResourceException: Can't find resource for bundle java.util.PropertyResourceBundle, key title1 at java.util.ResourceBundle.getObject(ResourceBundle.java:450) ~[na:1.8.0_11] at java.util.ResourceBundle.getObject(ResourceBundle.java:444) ~[na:1.8.0_11] at java.util.ResourceBundle.getString(ResourceBundle.java:407) ~[na:1.8.0_11] at dk.netarkivet.common.utils.I18n.getString(I18n.java:95) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.common.webinterface.SiteSection.generateNavigationTree(SiteSection.java:154) [common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.common.webinterface.SiteSectionTester.testGenerateNavigationTree(SiteSectionTester.java:308) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] 13:57:18.278 [main] WARN dk.netarkivet.common.utils.I18n - I18n bundle 'dk.netarkivet.harvester.Translations' is missing label 'title1' java.util.MissingResourceException: Can't find resource for bundle java.util.PropertyResourceBundle, key title1 at java.util.ResourceBundle.getObject(ResourceBundle.java:450) ~[na:1.8.0_11] at java.util.ResourceBundle.getObject(ResourceBundle.java:444) ~[na:1.8.0_11] at java.util.ResourceBundle.getString(ResourceBundle.java:407) ~[na:1.8.0_11] at dk.netarkivet.common.utils.I18n.getString(I18n.java:95) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.common.webinterface.SiteSection.generateNavigationTree(SiteSection.java:154) [common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.common.webinterface.SiteSectionTester.testGenerateNavigationTree(SiteSectionTester.java:320) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_11] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_11] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_11] at java.lang.reflect.Method.invoke(Method.java:483) ~[na:1.8.0_11] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) [junit-4.11.jar:na] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.11.jar:na] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) [junit-4.11.jar:na] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) [junit-4.11.jar:na] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:127) [junit-4.11.jar:na] at org.junit.runners.Suite.runChild(Suite.java:26) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [junit-4.11.jar:na] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [junit-4.11.jar:na] at org.junit.runners.ParentRunner.run(ParentRunner.java:309) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:160) [junit-4.11.jar:na] at org.junit.runner.JUnitCore.run(JUnitCore.java:138) [junit-4.11.jar:na] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:113) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:85) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:134) [surefire-junit47-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.17.jar:2.17] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.17.jar:2.17] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.15 sec - in dk.netarkivet.common.webinterface.SiteSectionTester Running dk.netarkivet.viewerproxy.URIObserverTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in dk.netarkivet.viewerproxy.URIObserverTester Running dk.netarkivet.viewerproxy.CrawlLogLinesMatchingRegexpTester 13:57:20.572 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 1-metadata-1.warc 13:57:20.633 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '1-metadata-1.warc'. 13:57:20.674 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '1-metadata-1.warc'. 13:57:20.731 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 1-metadata-1.arc 13:57:20.734 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '1-metadata-1.arc'. 13:57:20.745 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '1-metadata-1.arc'. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.037 sec - in dk.netarkivet.viewerproxy.CrawlLogLinesMatchingRegexpTester Running dk.netarkivet.viewerproxy.distribute.HTTPControllerServerTester 13:57:23.120 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:23.133 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:23.133 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:23.327 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:57:23.331 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:57:23.337 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:57:23.398 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:23.400 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:57:23.454 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/startRecordingURIs?returnURL=http%3A%2F%2Ffoo.bar 13:57:23.457 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/startRecordingURIs?returnURL=http%3A%2F%2Ffoo.bar 13:57:23.458 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:57:23.465 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:23.465 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:23.471 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:57:23.472 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:23.473 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:57:23.483 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:57:23.490 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:23.490 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:23.502 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:57:23.505 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:23.506 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:57:23.510 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/startRecordingURIs?returnURL=http%3A%2F%2Ffoo.bar 13:57:23.511 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/stopRecordingURIs?returnURL=http%3A%2F%2Ffoo.bar 13:57:23.513 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/clearRecordedURIs 13:57:23.513 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/getRecordedURIs 13:57:23.514 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/changeIndex?jobID=1&label=myTestLabel&returnURL=http%3A%2F%2Ffoo.bar 13:57:23.515 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/changeIndex?jobID=1&label=myTestLabel&returnURL=http%3A%2F%2Ffoo.bar 13:57:23.527 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/startRecordingURIs?fnidder=fnadder 13:57:23.528 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/stopRecordingURIs?fnidder=fnadder 13:57:23.529 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/clearRecordedURIs?fnidder=fnadder 13:57:23.530 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/changeIndex?returnURL=http%3A%2F%2Ffoo.bar 13:57:23.530 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/changeIndex?jobID=1 13:57:23.532 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/changeIndex?label=foobar 13:57:23.533 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/changeIndex?label=foobar&returnURL=http%3A%2F%2Ffoo.bar 13:57:23.534 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/changeIndex?label=foobar&jobID=1 13:57:23.534 [main] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/changeIndex?returnURL=http%3A%2F%2Ffoo.bar&jobID=1 13:57:23.536 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.155 sec - in dk.netarkivet.viewerproxy.distribute.HTTPControllerServerTester 13:57:23.544 [Thread-3] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:23.548 [Thread-3] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:23.548 [Thread-3] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:23.549 [Thread-3] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.viewerproxy.distribute.HTTPControllerClientTester Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.586 sec - in dk.netarkivet.viewerproxy.distribute.HTTPControllerClientTester Running dk.netarkivet.viewerproxy.GetDataResolverTester 13:57:26.684 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:26.707 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:26.708 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:26.710 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:26.865 [main] DEBUG dk.netarkivet.viewerproxy.GetDataResolver - Executing command http://netarchivesuite.viewerproxy.invalid/getFile?arcFile=fyensdk.arc 13:57:26.931 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:57:26.946 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:57:27.200 [main] DEBUG dk.netarkivet.viewerproxy.GetDataResolver - Executing command http://netarchivesuite.viewerproxy.invalid/getFile?arcFile=dummyNotFound 13:57:27.254 [main] DEBUG dk.netarkivet.viewerproxy.GetDataResolver - Executing command http://netarchivesuite.viewerproxy.invalid/getRecord?arcFile=fyensdk.arc&arcOffset=104 13:57:27.488 [main] DEBUG dk.netarkivet.viewerproxy.GetDataResolver - Executing command http://netarchivesuite.viewerproxy.invalid/getRecord?arcFile=fyensdk.arc&arcOffset=136 13:57:27.594 [main] DEBUG dk.netarkivet.common.distribute.arcrepository.BitarchiveRecord - Bytes stored in objectBuffer: 6669 13:57:27.659 [main] DEBUG dk.netarkivet.common.distribute.arcrepository.BitarchiveRecord - Reading 6669 bytes from objectBuffer 13:57:27.661 [main] DEBUG dk.netarkivet.viewerproxy.GetDataResolver - Executing command http://netarchivesuite.viewerproxy.invalid/getMetadata?jobID=2 13:57:28.480 [main] DEBUG dk.netarkivet.viewerproxy.GetDataResolver - Executing command http://netarchivesuite.viewerproxy.invalid/getMetadata?jobID=3 13:57:28.484 [main] DEBUG dk.netarkivet.viewerproxy.GetDataResolver - Executing command http://netarchivesuite.viewerproxy.invalid/getMetadata?jobID=2 13:57:28.515 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:28.516 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.129 sec - in dk.netarkivet.viewerproxy.GetDataResolverTester 13:57:28.622 [Thread-13] INFO dk.netarkivet.common.distribute.HTTPRemoteFileRegistry - Cleaning up dk.netarkivet.common.distribute.HTTPRemoteFileRegistry 13:57:28.670 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:28.670 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:28.670 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:28.671 [Thread-2] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:28.672 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:28.672 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:28.672 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:28.673 [Thread-1] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Cleaned up dk.netarkivet.common.distribute.HTTPRemoteFileRegistry 13:57:28.676 [Thread-13] INFO dk.netarkivet.common.distribute.HTTPRemoteFileRegistry - Cleaned up dk.netarkivet.common.distribute.HTTPRemoteFileRegistry Running dk.netarkivet.viewerproxy.DelegatingControllerTester 13:57:30.052 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:30.062 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:30.062 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:30.131 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:30.132 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:30.132 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:30.141 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:30.141 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:30.141 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:30.147 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:30.147 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:30.148 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:30.155 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:30.156 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:30.156 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:30.159 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:30.160 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:30.160 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:30.168 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:30.168 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:30.168 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:30.172 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:30.172 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:30.173 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:30.176 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:30.176 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:30.176 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:30.180 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:30.182 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:30.183 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:30.186 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:30.186 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:30.187 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:30.203 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:30.204 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:30.204 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.985 sec - in dk.netarkivet.viewerproxy.DelegatingControllerTester Running dk.netarkivet.viewerproxy.CommandResolverTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in dk.netarkivet.viewerproxy.CommandResolverTester Running dk.netarkivet.viewerproxy.MissingURIRecorderTester Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in dk.netarkivet.viewerproxy.MissingURIRecorderTester Running dk.netarkivet.viewerproxy.UnknownCommandResolverTester 13:57:32.656 [main] DEBUG dk.netarkivet.viewerproxy.UnknownCommandResolver - Blocking unknown command http://netarchivesuite.viewerproxy.invalid/get Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.592 sec - in dk.netarkivet.viewerproxy.UnknownCommandResolverTester Running dk.netarkivet.viewerproxy.ViewerProxyTester 13:57:34.097 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:34.106 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:34.106 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:34.243 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:57:34.245 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.replicas.replica.replicaId 13:57:34.248 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in loaded data: ONE,TWO,THREE 13:57:34.299 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:34.300 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:57:34.329 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'FULL_CRAWL_LOG' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/cachedir/FULL_CRAWL_LOG' 13:57:34.415 [main] INFO dk.netarkivet.viewerproxy.WebProxy - Starting viewerproxy jetty on port 7076 13:57:34.679 [qtp1961945640-15] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/changeIndex?returnURL=http://foo/&label=hest&jobID=2&jobID=3 13:57:34.686 [qtp1961945640-15] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/cachedir/FULL_CRAWL_LOG/2-3-cache.working 13:57:34.687 [qtp1961945640-15] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/cachedir/FULL_CRAWL_LOG/2-3-cache.working' (thread = qtp1961945640-15) 13:57:34.688 [qtp1961945640-15] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@7c9623db 13:57:34.689 [qtp1961945640-15] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Generated index '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/cachedir/FULL_CRAWL_LOG/2-3-cache' of id '[2, 3]', request was for '[2, 3]' 13:57:34.870 [qtp1961945640-16] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found 0 hits for uri: http://foo/ 13:57:34.871 [qtp1961945640-16] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found 0 hits for uri: http://foo/ 13:57:34.872 [qtp1961945640-16] DEBUG dk.netarkivet.viewerproxy.ARCArchiveAccess - Missing URL: 'http://foo/' 13:57:34.890 [main] WARN org.apache.commons.httpclient.HttpMethodBase - Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 13:57:34.890 [main] DEBUG httpclient.wire.content - << "5" 13:57:34.890 [main] DEBUG httpclient.wire.content - << "A" 13:57:34.891 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:34.891 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:34.892 [main] DEBUG httpclient.wire.content - << "Not foundCan't find URL: http://foo/" 13:57:34.892 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:34.892 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:34.892 [main] DEBUG httpclient.wire.content - << "0" 13:57:34.893 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:34.893 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:34.893 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:34.893 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:34.901 [qtp1961945640-14] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/startRecordingURIs?returnURL=/ 13:57:34.928 [qtp1961945640-14] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/ 13:57:34.929 [qtp1961945640-14] DEBUG dk.netarkivet.viewerproxy.GetDataResolver - Executing command http://netarchivesuite.viewerproxy.invalid/ 13:57:34.929 [qtp1961945640-14] DEBUG dk.netarkivet.viewerproxy.UnknownCommandResolver - Blocking unknown command http://netarchivesuite.viewerproxy.invalid/ 13:57:34.938 [qtp1961945640-14] WARN dk.netarkivet.viewerproxy.WebProxy - Exception for : http://netarchivesuite.viewerproxy.invalid/ dk.netarkivet.common.exceptions.IOFailure: Bad request: 'http://netarchivesuite.viewerproxy.invalid/': Unknown command at dk.netarkivet.viewerproxy.UnknownCommandResolver.executeCommand(UnknownCommandResolver.java:63) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:72) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.WebProxy.handle(WebProxy.java:123) ~[harvester-5.0-SNAPSHOT.jar:na] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.server.Server.handle(Server.java:485) [jetty-server-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:290) [jetty-server-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248) [jetty-server-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) [jetty-io-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:606) [jetty-util-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:535) [jetty-util-9.2.2.v20140723.jar:9.2.2.v20140723] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_11] 13:57:34.939 [main] WARN org.apache.commons.httpclient.HttpMethodBase - Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 13:57:34.942 [main] DEBUG httpclient.wire.content - << "4" 13:57:34.942 [main] DEBUG httpclient.wire.content - << "E" 13:57:34.942 [main] DEBUG httpclient.wire.content - << "3" 13:57:34.942 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:34.943 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:34.944 [main] DEBUG httpclient.wire.content - << "Internal Server ErrorInternal server error for: http://netarchivesuite.viewerproxy.invalid/[\n]" 13:57:34.944 [main] DEBUG httpclient.wire.content - << "
dk.netarkivet.common.exceptions.IOFailure: Bad request: 'http://netarchivesuite.viewerproxy.invalid/':[\n]"
13:57:34.944 [main] DEBUG httpclient.wire.content - << "Unknown command[\n]"
13:57:34.944 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.UnknownCommandResolver.executeCommand(UnknownCommandResolver.java:63)[\n]"
13:57:34.945 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:72)[\n]"
13:57:34.945 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74)[\n]"
13:57:34.945 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74)[\n]"
13:57:34.945 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.WebProxy.handle(WebProxy.java:123)[\n]"
13:57:34.946 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)[\n]"
13:57:34.946 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.server.Server.handle(Server.java:485)[\n]"
13:57:34.948 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:290)[\n]"
13:57:34.949 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248)[\n]"
13:57:34.949 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)[\n]"
13:57:34.952 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:606)[\n]"
13:57:34.952 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:535)[\n]"
13:57:34.952 [main] DEBUG httpclient.wire.content - << "[0x9]at java.lang.Thread.run(Thread.java:745)[\n]"
13:57:34.952 [main] DEBUG httpclient.wire.content - << "
" 13:57:34.954 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:34.954 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:34.954 [main] DEBUG httpclient.wire.content - << "0" 13:57:34.954 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:34.954 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:34.955 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:34.958 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:34.964 [qtp1961945640-13] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found 0 hits for uri: http://www.nonexistingdomain.test/nonexistingfile.html 13:57:34.965 [qtp1961945640-13] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found 0 hits for uri: http://www.nonexistingdomain.test/nonexistingfile.html 13:57:34.965 [qtp1961945640-13] DEBUG dk.netarkivet.viewerproxy.ARCArchiveAccess - Missing URL: 'http://www.nonexistingdomain.test/nonexistingfile.html' 13:57:34.968 [main] WARN org.apache.commons.httpclient.HttpMethodBase - Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 13:57:34.968 [main] DEBUG httpclient.wire.content - << "8" 13:57:34.968 [main] DEBUG httpclient.wire.content - << "5" 13:57:34.968 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:34.969 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:34.969 [main] DEBUG httpclient.wire.content - << "Not foundCan't find URL: http://www.nonexistingdomain.test/nonexistingfile.html" 13:57:34.969 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:34.969 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:34.970 [main] DEBUG httpclient.wire.content - << "0" 13:57:34.970 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:34.971 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:34.972 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:34.973 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:34.976 [qtp1961945640-18] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/getRecordedURIs 13:57:34.978 [main] DEBUG httpclient.wire.content - << "http://www.nonexistingdomain.test/nonexistingfile.html[\n]" 13:57:34.991 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:57:35.023 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:35.024 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:35.062 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:57:35.068 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:35.068 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:57:35.069 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'FULL_CRAWL_LOG' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/cachedir/FULL_CRAWL_LOG' 13:57:35.071 [main] INFO dk.netarkivet.viewerproxy.WebProxy - Starting viewerproxy jetty on port 7076 13:57:35.085 [qtp40075281-27] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/unknown 13:57:35.086 [qtp40075281-27] DEBUG dk.netarkivet.viewerproxy.GetDataResolver - Executing command http://netarchivesuite.viewerproxy.invalid/unknown 13:57:35.086 [qtp40075281-27] DEBUG dk.netarkivet.viewerproxy.UnknownCommandResolver - Blocking unknown command http://netarchivesuite.viewerproxy.invalid/unknown 13:57:35.087 [qtp40075281-27] WARN dk.netarkivet.viewerproxy.WebProxy - Exception for : http://netarchivesuite.viewerproxy.invalid/unknown dk.netarkivet.common.exceptions.IOFailure: Bad request: 'http://netarchivesuite.viewerproxy.invalid/unknown': Unknown command at dk.netarkivet.viewerproxy.UnknownCommandResolver.executeCommand(UnknownCommandResolver.java:63) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:72) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.WebProxy.handle(WebProxy.java:123) ~[harvester-5.0-SNAPSHOT.jar:na] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.server.Server.handle(Server.java:485) [jetty-server-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:290) [jetty-server-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248) [jetty-server-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) [jetty-io-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:606) [jetty-util-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:535) [jetty-util-9.2.2.v20140723.jar:9.2.2.v20140723] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_11] 13:57:35.089 [main] WARN org.apache.commons.httpclient.HttpMethodBase - Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 13:57:35.090 [main] DEBUG httpclient.wire.content - << "4" 13:57:35.090 [main] DEBUG httpclient.wire.content - << "F" 13:57:35.090 [main] DEBUG httpclient.wire.content - << "1" 13:57:35.090 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.091 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.091 [main] DEBUG httpclient.wire.content - << "Internal Server ErrorInternal server error for: http://netarchivesuite.viewerproxy.invalid/unknown[\n]" 13:57:35.092 [main] DEBUG httpclient.wire.content - << "
dk.netarkivet.common.exceptions.IOFailure: Bad request: 'http://netarchivesuite.viewerproxy.invalid/unknown':[\n]"
13:57:35.093 [main] DEBUG httpclient.wire.content - << "Unknown command[\n]"
13:57:35.093 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.UnknownCommandResolver.executeCommand(UnknownCommandResolver.java:63)[\n]"
13:57:35.093 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:72)[\n]"
13:57:35.094 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74)[\n]"
13:57:35.094 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74)[\n]"
13:57:35.094 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.WebProxy.handle(WebProxy.java:123)[\n]"
13:57:35.094 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)[\n]"
13:57:35.095 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.server.Server.handle(Server.java:485)[\n]"
13:57:35.095 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:290)[\n]"
13:57:35.095 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248)[\n]"
13:57:35.095 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)[\n]"
13:57:35.096 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:606)[\n]"
13:57:35.096 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:535)[\n]"
13:57:35.097 [main] DEBUG httpclient.wire.content - << "[0x9]at java.lang.Thread.run(Thread.java:745)[\n]"
13:57:35.097 [main] DEBUG httpclient.wire.content - << "
" 13:57:35.098 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.099 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.100 [main] DEBUG httpclient.wire.content - << "0" 13:57:35.100 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.101 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.101 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.101 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.136 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:57:35.158 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:35.158 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:35.194 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:57:35.200 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:35.200 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:57:35.201 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'FULL_CRAWL_LOG' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/cachedir/FULL_CRAWL_LOG' 13:57:35.204 [main] INFO dk.netarkivet.viewerproxy.WebProxy - Starting viewerproxy jetty on port 7076 13:57:35.252 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:57:35.254 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' 13:57:35.273 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:35.273 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished 13:57:35.306 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepositoryClient will retry a store 3 times and timeout on each try after 3600000 milliseconds, and timeout on each getrequest after 2000 milliseconds. 13:57:35.313 [main] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Creating instance of dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:35.314 [main] INFO d.n.archive.arcrepository.distribute.JMSArcRepositoryClient - JMSArcRepository listens for replies on channel '[Queue 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX']' 13:57:35.315 [main] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Metadata cache for 'FULL_CRAWL_LOG' uses directory '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/cachedir/FULL_CRAWL_LOG' 13:57:35.316 [main] INFO dk.netarkivet.viewerproxy.WebProxy - Starting viewerproxy jetty on port 7076 13:57:35.365 [qtp794075965-54] WARN dk.netarkivet.viewerproxy.WebProxy - Exception for : http://www.nonexistingdomain.test/nonexistingfile.html dk.netarkivet.common.exceptions.IOFailure: No index set while searching for 'http://www.nonexistingdomain.test/nonexistingfile.html' at dk.netarkivet.common.distribute.arcrepository.ARCLookup.luceneLookup(ARCLookup.java:190) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.common.distribute.arcrepository.ARCLookup.lookup(ARCLookup.java:141) ~[common-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.ARCArchiveAccess.lookup(ARCArchiveAccess.java:124) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.NotifyingURIResolver.lookup(NotifyingURIResolver.java:71) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74) ~[harvester-5.0-SNAPSHOT.jar:na] at dk.netarkivet.viewerproxy.WebProxy.handle(WebProxy.java:123) ~[harvester-5.0-SNAPSHOT.jar:na] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.server.Server.handle(Server.java:485) [jetty-server-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:290) [jetty-server-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248) [jetty-server-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) [jetty-io-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:606) [jetty-util-9.2.2.v20140723.jar:9.2.2.v20140723] at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:535) [jetty-util-9.2.2.v20140723.jar:9.2.2.v20140723] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_11] 13:57:35.367 [main] WARN org.apache.commons.httpclient.HttpMethodBase - Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 13:57:35.368 [main] DEBUG httpclient.wire.content - << "5" 13:57:35.368 [main] DEBUG httpclient.wire.content - << "F" 13:57:35.368 [main] DEBUG httpclient.wire.content - << "5" 13:57:35.368 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.368 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.369 [main] DEBUG httpclient.wire.content - << "Internal Server ErrorInternal server error for: http://www.nonexistingdomain.test/nonexistingfile.html[\n]" 13:57:35.369 [main] DEBUG httpclient.wire.content - << "
dk.netarkivet.common.exceptions.IOFailure: No index set while searching for 'http://www.nonexistingdomain.test/nonexistingfile.html'[\n]"
13:57:35.369 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.common.distribute.arcrepository.ARCLookup.luceneLookup(ARCLookup.java:190)[\n]"
13:57:35.369 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.common.distribute.arcrepository.ARCLookup.lookup(ARCLookup.java:141)[\n]"
13:57:35.370 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.ARCArchiveAccess.lookup(ARCArchiveAccess.java:124)[\n]"
13:57:35.370 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.NotifyingURIResolver.lookup(NotifyingURIResolver.java:71)[\n]"
13:57:35.370 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74)[\n]"
13:57:35.371 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74)[\n]"
13:57:35.371 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.CommandResolver.lookup(CommandResolver.java:74)[\n]"
13:57:35.371 [main] DEBUG httpclient.wire.content - << "[0x9]at dk.netarkivet.viewerproxy.WebProxy.handle(WebProxy.java:123)[\n]"
13:57:35.371 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)[\n]"
13:57:35.371 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.server.Server.handle(Server.java:485)[\n]"
13:57:35.372 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:290)[\n]"
13:57:35.373 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248)[\n]"
13:57:35.373 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)[\n]"
13:57:35.373 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:606)[\n]"
13:57:35.374 [main] DEBUG httpclient.wire.content - << "[0x9]at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:535)[\n]"
13:57:35.374 [main] DEBUG httpclient.wire.content - << "[0x9]at java.lang.Thread.run(Thread.java:745)[\n]"
13:57:35.374 [main] DEBUG httpclient.wire.content - << "
" 13:57:35.375 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.375 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.376 [main] DEBUG httpclient.wire.content - << "0" 13:57:35.376 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.376 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.377 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.377 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.392 [qtp794075965-56] DEBUG dk.netarkivet.viewerproxy.distribute.HTTPControllerServer - Executing command http://netarchivesuite.viewerproxy.invalid/changeIndex?returnURL=http://foo/&label=hest&jobID=2&jobID=3 13:57:35.410 [qtp794075965-56] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - Waiting to enter synchronization on /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/cachedir/FULL_CRAWL_LOG/2-3-cache.working 13:57:35.411 [qtp794075965-56] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - locking filechannel for file '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/cachedir/FULL_CRAWL_LOG/2-3-cache.working' (thread = qtp794075965-56) 13:57:35.411 [qtp794075965-56] DEBUG dk.netarkivet.harvester.indexserver.FileBasedCache - release lock on filechannel sun.nio.ch.FileChannelImpl@3e70182b 13:57:35.411 [qtp794075965-56] INFO dk.netarkivet.harvester.indexserver.FileBasedCache - Generated index '/home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/cachedir/FULL_CRAWL_LOG/2-3-cache' of id '[2, 3]', request was for '[2, 3]' 13:57:35.422 [qtp794075965-58] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found 0 hits for uri: http://foo/ 13:57:35.423 [qtp794075965-58] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found 0 hits for uri: http://foo/ 13:57:35.423 [qtp794075965-58] DEBUG dk.netarkivet.viewerproxy.ARCArchiveAccess - Missing URL: 'http://foo/' 13:57:35.425 [main] WARN org.apache.commons.httpclient.HttpMethodBase - Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 13:57:35.425 [main] DEBUG httpclient.wire.content - << "5" 13:57:35.426 [main] DEBUG httpclient.wire.content - << "A" 13:57:35.426 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.426 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.426 [main] DEBUG httpclient.wire.content - << "Not foundCan't find URL: http://foo/" 13:57:35.427 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.427 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.427 [main] DEBUG httpclient.wire.content - << "0" 13:57:35.427 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.427 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.428 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.428 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.435 [qtp794075965-54] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found 0 hits for uri: http://www.nonexistingdomain.test/nonexistingfile.html 13:57:35.435 [qtp794075965-54] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found 0 hits for uri: http://www.nonexistingdomain.test/nonexistingfile.html 13:57:35.436 [qtp794075965-54] DEBUG dk.netarkivet.viewerproxy.ARCArchiveAccess - Missing URL: 'http://www.nonexistingdomain.test/nonexistingfile.html' 13:57:35.438 [main] WARN org.apache.commons.httpclient.HttpMethodBase - Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 13:57:35.438 [main] DEBUG httpclient.wire.content - << "8" 13:57:35.438 [main] DEBUG httpclient.wire.content - << "5" 13:57:35.438 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.439 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.439 [main] DEBUG httpclient.wire.content - << "Not foundCan't find URL: http://www.nonexistingdomain.test/nonexistingfile.html" 13:57:35.439 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.439 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.440 [main] DEBUG httpclient.wire.content - << "0" 13:57:35.440 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.440 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.440 [main] DEBUG httpclient.wire.content - << "[\r]" 13:57:35.441 [main] DEBUG httpclient.wire.content - << "[\n]" 13:57:35.460 [main] INFO dk.netarkivet.common.distribute.JMSConnection - Removing listener from channel 'DEV_COMMON_THIS_REPOS_CLIENT_130_225_27_165_IS_XXX' Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.223 sec - in dk.netarkivet.viewerproxy.ViewerProxyTester 13:57:35.514 [Thread-40] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaning up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:35.516 [Thread-40] INFO dk.netarkivet.common.distribute.JMSConnection - Starting cleanup 13:57:35.516 [Thread-40] INFO dk.netarkivet.common.distribute.JMSConnection - Cleanup finished Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ 13:57:35.517 [Thread-40] INFO dk.netarkivet.common.distribute.JMSConnectionMockupMQ - Cleaned up dk.netarkivet.common.distribute.JMSConnectionMockupMQ Running dk.netarkivet.viewerproxy.NotifyingURIResolverTester Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in dk.netarkivet.viewerproxy.NotifyingURIResolverTester Running dk.netarkivet.viewerproxy.ARCArchiveAccessTester 13:57:38.543 [main] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found 2 hits for uri: http://netarkivet.dk/netarchive_alm/billeder/spacer.gif 13:57:38.583 [main] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found document with origin: 2-2-20060731110420-00000-sb-test-har-001.statsbiblioteket.dk.arc,73269 13:57:38.667 [main] DEBUG dk.netarkivet.common.distribute.arcrepository.BitarchiveRecord - Bytes stored in objectBuffer: 162 13:57:38.669 [main] DEBUG dk.netarkivet.common.distribute.arcrepository.BitarchiveRecord - Reading 162 bytes from objectBuffer 13:57:39.124 [main] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found 0 hits for uri: http://does.not.exist 13:57:39.130 [main] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found 0 hits for uri: http://does.not.exist 13:57:39.130 [main] DEBUG dk.netarkivet.viewerproxy.ARCArchiveAccess - Missing URL: 'http://does.not.exist' 13:57:39.314 [main] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found 2 hits for uri: http://netarkivet.dk/netarchive_alm/billeder/spacer.gif 13:57:39.315 [main] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - Found document with origin: 2-2-20060731110420-00000-sb-test-har-001.statsbiblioteket.dk.arc,73269 13:57:39.316 [main] DEBUG dk.netarkivet.common.distribute.arcrepository.ARCLookup - ARC file '2-2-20060731110420-00000-sb-test-har-001.statsbiblioteket.dk.arc' mentioned in index file was not found by arc repository. This may mean we have a timeout, or that the index is wrong; or it may mean we have lost a record in the bitarchives. Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.822 sec - in dk.netarkivet.viewerproxy.ARCArchiveAccessTester Running dk.netarkivet.viewerproxy.WebProxyTester 13:57:41.402 [main] INFO dk.netarkivet.viewerproxy.WebProxy - Starting viewerproxy jetty on port 7076 13:57:41.574 [main] INFO dk.netarkivet.viewerproxy.WebProxy - Starting viewerproxy jetty on port 7076 13:57:41.642 [main] INFO dk.netarkivet.viewerproxy.WebProxy - Starting viewerproxy jetty on port 7076 13:57:41.799 [main] DEBUG httpclient.wire.content - << "Test" 13:57:41.808 [main] DEBUG httpclient.wire.content - >> "a=x&a=y" 13:57:41.853 [main] DEBUG httpclient.wire.content - << "Test" 13:57:41.858 [main] DEBUG httpclient.wire.content - << "Test" 13:57:41.888 [main] INFO dk.netarkivet.viewerproxy.WebProxy - Starting viewerproxy jetty on port 7076 Tests run: 7, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 1.814 sec - in dk.netarkivet.viewerproxy.WebProxyTester Running dk.netarkivet.viewerproxy.webinterface.ReportingTester 13:57:44.396 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 2-metadata-1.arc 13:57:44.421 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '2-metadata-1.arc'. 13:57:44.437 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '2-metadata-1.arc'. 13:57:44.437 [main] INFO d.n.viewerproxy.webinterface.HarvestedUrlsForDomainBatchJob - looking for crawl-log lines for domain: netarkivet.dk 13:57:44.454 [main] DEBUG dk.netarkivet.common.utils.Settings - Searching for a setting for key: settings.common.topLevelDomains.tld 13:57:44.501 [main] DEBUG dk.netarkivet.common.utils.Settings - Value found in classpath data: ac,ad,ae,aero,af,ag,ai,al,am,an,ao,aq,ar,arpa,as,gv.at,ac.at,or.at,co.at,biz.at,info.at,priv.at,at,au,aw,ax,az,ba,bb,bd,be,bf,bg,bh,bi,biz,bj,bm,bn,bo,br,bs,bt,bv,bw,by,bz,ca,cat,cc,cd,cf,cg,ch,ci,ck,cl,cm,cn,co,com,coop,cr,cs,cu,cv,cx,cy,cz,de,dj,dk,dm,do,dz,ec,edu,ee,eg,eh,er,es,et,eu,fi,fj,fk,fm,fo,aeroport.fr,asso.fr,avoues.fr,chambagri.fr,com.fr,gouv.fr,medecin.fr,nom.fr,pharmacien.fr,port.fr,prd.fr,presse.fr,tm.fr,fr,ga,gb,gd,ge,gf,gg,gh,gi,gl,gm,gn,gov,gp,gq,gr,gs,gt,gu,gw,gy,hk,hm,hn,hr,ht,hu,id,ie,il,im,in,info,int,io,iq,ir,is,it,je,jm,jo,jobs,jp,ke,kg,kh,ki,km,kn,kp,kr,kw,ky,kz,la,lb,lc,li,lk,lr,ls,lt,lu,lv,ly,ma,mc,md,me,mg,mh,mil,mk,ml,mm,mn,mo,mobi,mp,mq,mr,ms,mt,mu,museum,mv,mw,mx,my,mz,na,name,nc,ne,net,nf,ng,ni,nl,no,np,nr,nt,nu,nz,om,org,pa,pe,pf,pg,ph,pk,pl,pm,pn,pr,pro,ps,pt,pw,py,qa,asso.re,com.re,re,ro,ru,rw,sa,sb,sc,sd,se,sg,sh,si,sj,sk,sl,sm,sn,so,sr,st,su,sv,sy,sz,tc,td,at.tf,net.tf,tf,tg,th,tj,tk,tl,tm,tn,to,tp,tr,travel,tt,tv,tw,tz,ua,ug,ac.uk,co.uk,gov.uk,ltd.uk,me.uk,mod.uk,net.uk,nic.uk,nhs.uk,org.uk,plc.uk,police.uk,sch.uk,govt.uk,orgn.uk,lea.uk,mil.uk,nel.uk,uk,us,uy,uz,va,vc,ve,vg,vi,vn,vu,wien,wf,ws,ye,yt,yu,za,zm,zw 13:57:44.968 [main] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/commontempdir/temp2602250608113191680d3bad64e-f9e5-4171-bcb0-a09c5b8a696c.txt -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/commontempdir/temp3100249636485066153d3bad64e-f9e5-4171-bcb0-a09c5b8a696c-sorted.txt with environment LANG=C 13:57:45.038 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 2-metadata-1.arc 13:57:45.039 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '2-metadata-1.arc'. 13:57:45.042 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '2-metadata-1.arc'. 13:57:45.042 [main] INFO d.n.viewerproxy.webinterface.HarvestedUrlsForDomainBatchJob - looking for crawl-log lines for domain: kaarefc.dk 13:57:45.174 [main] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/commontempdir/temp259697121465665927804662315-8add-4e7e-9b43-c87222e782d5.txt -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/commontempdir/temp588142438897329062804662315-8add-4e7e-9b43-c87222e782d5-sorted.txt with environment LANG=C 13:57:45.221 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 2-metadata-1.arc 13:57:45.222 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '2-metadata-1.arc'. 13:57:45.224 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '2-metadata-1.arc'. 13:57:45.224 [main] INFO d.n.viewerproxy.webinterface.HarvestedUrlsForDomainBatchJob - looking for crawl-log lines for domain: doesnotexist.dk 13:57:45.350 [main] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/commontempdir/temp13002906612555035567b801c3a-c9b7-424c-a6d8-9bd2039075f2.txt -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/commontempdir/temp70156173959800786787b801c3a-c9b7-424c-a6d8-9bd2039075f2-sorted.txt with environment LANG=C 13:57:45.369 [main] DEBUG dk.netarkivet.common.utils.ProcessUtils - Running external program: sort /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/commontempdir/temp7782137720006598035a3f5d401-c8f1-4f88-8962-cc3950e3c519.txt -o /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/tests/dk/netarkivet/viewerproxy/data/working/commontempdir/temp3598712035880047176a3f5d401-c8f1-4f88-8962-cc3950e3c519-sorted.txt with environment LANG=C 13:57:45.454 [main] INFO dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing archive file: 2-metadata-1.arc 13:57:45.455 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Starting processing records in archive file '2-metadata-1.arc'. 13:57:45.456 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #0 in archive file '2-metadata-1.arc'. 13:57:45.457 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #1 in archive file '2-metadata-1.arc'. 13:57:45.459 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #2 in archive file '2-metadata-1.arc'. 13:57:45.459 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #3 in archive file '2-metadata-1.arc'. 13:57:45.460 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #4 in archive file '2-metadata-1.arc'. 13:57:45.461 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #5 in archive file '2-metadata-1.arc'. 13:57:45.461 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #6 in archive file '2-metadata-1.arc'. 13:57:45.462 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #7 in archive file '2-metadata-1.arc'. 13:57:45.463 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #8 in archive file '2-metadata-1.arc'. 13:57:45.463 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #9 in archive file '2-metadata-1.arc'. 13:57:45.463 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #10 in archive file '2-metadata-1.arc'. 13:57:45.464 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #11 in archive file '2-metadata-1.arc'. 13:57:45.468 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #12 in archive file '2-metadata-1.arc'. 13:57:45.469 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #13 in archive file '2-metadata-1.arc'. 13:57:45.471 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #14 in archive file '2-metadata-1.arc'. 13:57:45.471 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #15 in archive file '2-metadata-1.arc'. 13:57:45.472 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #16 in archive file '2-metadata-1.arc'. 13:57:45.473 [main] DEBUG dk.netarkivet.common.utils.archive.ArchiveBatchJob - Processing record #17 in archive file '2-metadata-1.arc'. Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.786 sec - in dk.netarkivet.viewerproxy.webinterface.ReportingTester 13:57:45.582 [Thread-9] INFO dk.netarkivet.common.distribute.HTTPRemoteFileRegistry - Cleaning up dk.netarkivet.common.distribute.HTTPRemoteFileRegistry Cleaned up dk.netarkivet.common.distribute.HTTPRemoteFileRegistry 13:57:48.339 [Thread-9] INFO dk.netarkivet.common.distribute.HTTPRemoteFileRegistry - Cleaned up dk.netarkivet.common.distribute.HTTPRemoteFileRegistry Results : Tests run: 325, Failures: 0, Errors: 0, Skipped: 29 [JENKINS] Recording test results [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvester-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources) @ harvester-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] --- maven-javadoc-plugin:2.9.1:jar (attach-javadocs) @ harvester-test --- [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ harvester-test --- [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/target/harvester-test-5.0-SNAPSHOT.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/harvester-test/5.0-SNAPSHOT/harvester-test-5.0-SNAPSHOT.jar [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-template/harvester/harvester-test/pom.xml to /home/cibuild02/.m2/repository/org/netarchivesuite/harvester-test/5.0-SNAPSHOT/harvester-test-5.0-SNAPSHOT.pom