946/org.jacoco.agent-0.7.5.201505241946-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Peter-1-Click/hadoop-uber-jar/target/jacoco.exec
[WARNING] Failed to getClass for org.apache.maven.plugin.source.SourceJarMojo
[INFO]
[INFO] <<< maven-source-plugin:2.2.1:jar (attach-sources) < generate-sources @ hadoop-uber-jar <<<
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar (attach-sources) @ hadoop-uber-jar ---
[INFO] No sources in project. Archive not created.
[INFO]
[INFO] --- maven-javadoc-plugin:2.10.3:jar (attach-javadocs) @ hadoop-uber-jar ---
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hadoop-uber-jar ---
[INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-Peter-1-Click/hadoop-uber-jar/target/hadoop-uber-jar-5.7-IIPCH3-SNAPSHOT.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/hadoop-uber-jar/5.7-IIPCH3-SNAPSHOT/hadoop-uber-jar-5.7-IIPCH3-SNAPSHOT.jar
[INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-Peter-1-Click/hadoop-uber-jar/pom.xml to /home/cibuild02/.m2/repository/org/netarchivesuite/hadoop-uber-jar/5.7-IIPCH3-SNAPSHOT/hadoop-uber-jar-5.7-IIPCH3-SNAPSHOT.pom
[INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-Peter-1-Click/hadoop-uber-jar/target/hadoop-uber-jar-5.7-IIPCH3-SNAPSHOT-shaded.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/hadoop-uber-jar/5.7-IIPCH3-SNAPSHOT/hadoop-uber-jar-5.7-IIPCH3-SNAPSHOT-shaded.jar
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] NetarchiveSuite .................................... SUCCESS [ 3.261 s]
[INFO] NetarchiveSuite - build-tools ...................... SUCCESS [ 1.430 s]
[INFO] NetarchiveSuite - common ........................... SUCCESS [ 0.424 s]
[INFO] NetarchiveSuite - test utils ....................... SUCCESS [ 3.442 s]
[INFO] NetarchiveSuite - common - core .................... SUCCESS [ 13.859 s]
[INFO] NetarchiveSuite - common - test .................... SUCCESS [ 7.145 s]
[INFO] NetarchiveSuite - archive .......................... SUCCESS [ 0.447 s]
[INFO] NetarchiveSuite - archive - core ................... SUCCESS [ 7.804 s]
[INFO] NetarchiveSuite - harvester ........................ SUCCESS [ 0.439 s]
[INFO] NetarchiveSuite - harvester - core ................. SUCCESS [ 11.264 s]
[INFO] NetarchiveSuite - archive - test ................... SUCCESS [ 2.718 s]
[INFO] NetarchiveSuite - bitpreservation - webapp ......... SUCCESS [ 1.074 s]
[INFO] NetarchiveSuite - Harvest Scheduler ................ SUCCESS [ 4.503 s]
[INFO] NetarchiveSuite - monitor .......................... SUCCESS [ 0.482 s]
[INFO] NetarchiveSuite - monitor - core ................... SUCCESS [ 4.071 s]
[INFO] NetarchiveSuite - wayback .......................... SUCCESS [ 0.834 s]
[INFO] NetarchiveSuite - wayback - indexer ................ SUCCESS [ 4.889 s]
[INFO] NetarchiveSuite - deploy ........................... SUCCESS [ 0.408 s]
[INFO] NetarchiveSuite - deploy - core .................... SUCCESS [ 5.397 s]
[INFO] NetarchiveSuite - harvester - heritrix3 ............ SUCCESS [ 0.429 s]
[INFO] NetarchiveSuite - Heritrix3 Extensions ............. SUCCESS [ 6.430 s]
[INFO] NetarchiveSuite - heritrix3 controller ............. SUCCESS [ 5.351 s]
[INFO] NetarchiveSuite - Status - Webapp .................. SUCCESS [ 1.212 s]
[INFO] NetarchiveSuite - qa - webapp ...................... SUCCESS [ 0.762 s]
[INFO] NetarchiveSuite - history - webapp ................. SUCCESS [ 1.572 s]
[INFO] NetarchiveSuite - harvestDefinition - webapp ....... SUCCESS [ 1.187 s]
[INFO] NetarchiveSuite - harvestChannel - webapp .......... SUCCESS [ 0.755 s]
[INFO] NetarchiveSuite - heritrix3 monitor ................ SUCCESS [ 16.398 s]
[INFO] NetarchiveSuite - deploy - distribution ............ SUCCESS [ 13.277 s]
[INFO] NetarchiveSuite - deploy - test .................... SUCCESS [ 2.080 s]
[INFO] NetarchiveSuite - Heritrix3 Bundler ................ SUCCESS [ 11.597 s]
[INFO] NetarchiveSuite - harvester - test ................. SUCCESS [ 3.034 s]
[INFO] NetarchiveSuite - monitor - test ................... SUCCESS [ 1.294 s]
[INFO] NetarchiveSuite - wayback resourceStore ............ SUCCESS [ 3.964 s]
[INFO] NetarchiveSuite - wayback - test ................... SUCCESS [ 1.621 s]
[INFO] NetarchiveSuite - integration tests ................ SUCCESS [ 0.421 s]
[INFO] NetarchiveSuite System test ........................ SUCCESS [ 1.435 s]
[INFO] hadoop-uber-jar .................................... SUCCESS [ 10.387 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:49 min
[INFO] Finished at: 2021-02-11T11:29:36+01:00
[INFO] Final Memory: 136M/342M
[INFO] ------------------------------------------------------------------------
channel stopped
[NetarchiveSuite-Peter-1-Click] $ /bin/bash /tmp/hudson8393478255204747013.sh
Do a total cleanup of system Test7
start tunning cleanup script
end part of script
running cleanup_bitmag
Resetting Collection Test7
Delete content in collection=Test7
11:29:46.389 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
11:29:46.712 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
11:29:46.758 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
11:29:47.341 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
11:29:47.359 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
11:29:47.360 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
11:29:47.563 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@4218d6a3[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
11:29:47.564 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
11:29:48.530 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
11:29:48.609 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@4218d6a3[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
11:29:48.610 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-26374]
11:29:48.612 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
11:29:48.612 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@2fd1433e' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26374' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
11:29:48.612 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26374' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@2fd1433e'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26374#802243390'.
11:29:48.612 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26374#802243390'.
Checksum: Count: FileID:
11:29:48.635 INFO o.b.a.g.ConversationBasedGetChecksumsClient - Requesting the checksums for file '' with the specifications 'org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@5403f35f[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)]null' with query [ContributorQuery{componentID='netarkiv-tape-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-disk-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-disk-devel-02, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-checksum-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-kbh-disk-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}].
11:29:48.644 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
11:29:49.131 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent IdentifyPillarsForGetChecksumsRequest(134d2442) collectionID Test7, destination topic://netarkiv-devel: FileIDs=AllFiles
11:29:49.132 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 134d2442: GET_CHECKSUMS: IDENTIFY_REQUEST_SENT: , Identifying pillars for GetChecksums
11:29:49.436 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(134d2442) collectionID Test7, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(Checksum operation available.)
11:29:49.457 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 134d2442: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01
11:29:49.457 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
11:29:49.458 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01]
11:29:49.676 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(134d2442) collectionID Test7, from netarkiv-disk-devel-02: IDENTIFICATION_POSITIVE(Checksum operation available.)
11:29:49.677 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 134d2442: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-02
11:29:49.677 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-02
11:29:49.677 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01]
11:29:50.063 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(134d2442) collectionID Test7, from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
11:29:50.068 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 134d2442: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01
11:29:50.068 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01
11:29:50.068 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-disk-devel-01]
11:29:50.280 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(134d2442) collectionID Test7, from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.)
11:29:50.286 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 134d2442: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01
11:29:50.286 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
11:29:50.286 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-01]
11:29:50.478 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(134d2442) collectionID Test7, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
11:29:50.480 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 134d2442: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01
11:29:50.480 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01
11:29:50.480 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: []
11:29:50.480 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 134d2442: GET_CHECKSUMS: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01, netarkiv-checksum-devel-01, netarkiv-disk-devel-02, netarkiv-tape-devel-01]
11:29:50.481 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 134d2442: GET_CHECKSUMS: REQUEST_SENT: ContributorID [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], Sending GetFileIDsRequest's
11:29:50.699 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(134d2442) collectionID Test7, destination queue://netarkiv-tape-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@5403f35f[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
11:29:51.028 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(134d2442) collectionID Test7, destination queue://netarkiv-disk-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@5403f35f[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
11:29:51.335 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(134d2442) collectionID Test7, from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS)
11:29:51.491 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(134d2442) collectionID Test7, destination topic://netarkiv-devel.netarkiv-disk-devel-02: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@5403f35f[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
11:29:51.799 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(134d2442) collectionID Test7, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@5403f35f[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
11:29:51.885 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(134d2442) collectionID Test7, from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@51c6a9d6[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
11:29:52.527 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(134d2442) collectionID Test7, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@5403f35f[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
11:29:52.528 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01
11:29:52.529 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01]
11:29:52.529 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 134d2442: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS
11:29:52.566 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(134d2442) collectionID Test7, from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS)
11:29:52.576 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 134d2442: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS
11:29:52.758 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(134d2442) collectionID Test7, from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@46872166[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
11:29:52.767 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01
11:29:52.767 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-kbh-disk-devel-01]
11:29:52.971 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(134d2442) collectionID Test7, from netarkiv-disk-devel-02: OPERATION_COMPLETED(Completed checksum retrieval.), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@2457cbb6[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
11:29:52.983 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-02
11:29:52.983 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-kbh-disk-devel-01]
11:29:53.179 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(134d2442) collectionID Test7, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS(Starting to calculate checksums.)
11:29:53.187 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 134d2442: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-checksum-devel-01, Starting to calculate checksums.
11:29:53.380 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(134d2442) collectionID Test7, from netarkiv-checksum-devel-01: OPERATION_COMPLETED, NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3c5a0210[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
11:29:53.386 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
11:29:53.395 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-kbh-disk-devel-01]
11:29:53.558 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(134d2442) collectionID Test7, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(Completed checksum retrieval.), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@168ec28a[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
11:29:53.559 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
11:29:53.559 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: []
Deleting file FileID: with checksum Checksum: in collection Test7 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-disk-devel-02 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01
11:29:54.838 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
11:29:54.941 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
11:29:55.274 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
11:29:55.322 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
11:29:55.896 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
11:29:55.911 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
11:29:55.916 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
11:29:56.086 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
11:29:56.087 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
11:29:56.992 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
11:29:57.068 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
11:29:57.069 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-26409]
11:29:57.071 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
11:29:57.071 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3514a4c0' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26409' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
11:29:57.072 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26409' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3514a4c0'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26409#890545344'.
11:29:57.072 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26409#890545344'.
11:29:57.087 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
java.lang.IllegalArgumentException: String hexString, 'Checksum:', must be an even number of characters.
at org.bitrepository.common.ArgumentValidator.checkTrue(ArgumentValidator.java:160)
at org.bitrepository.common.utils.Base16Utils.encodeBase16(Base16Utils.java:64)
at org.bitrepository.commandline.CommandLineClient.getChecksumDataForDeleteValidation(CommandLineClient.java:302)
at org.bitrepository.commandline.DeleteFileCmd.deleteTheFile(DeleteFileCmd.java:125)
at org.bitrepository.commandline.DeleteFileCmd.performOperation(DeleteFileCmd.java:107)
at org.bitrepository.commandline.CommandLineClient.runCommand(CommandLineClient.java:68)
at org.bitrepository.commandline.DeleteFileCmd.main(DeleteFileCmd.java:47)
xargs: ssh: exited with status 255; aborting
Now deleting actual files on Windows hosts for Test7
Nothing to delete in e:kbhpillar\collection-Test7 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in f:kbhpillar\collection-Test7 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in g:kbhpillar\collection-Test7 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in h:kbhpillar\collection-Test7 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in i:kbhpillar\collection-Test7 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in j:kbhpillar\collection-Test7 on kb-test-bar-01.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Permission denied ().
Nothing to delete in e:kbhpillar\collection-Test7 on kb-test-bar-016.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Permission denied ().
Nothing to delete in f:kbhpillar\collection-Test7 on kb-test-bar-016.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Permission denied ().
Nothing to delete in g:kbhpillar\collection-Test7 on kb-test-bar-016.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Permission denied ().
Nothing to delete in h:kbhpillar\collection-Test7 on kb-test-bar-016.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Permission denied ().
Nothing to delete in i:kbhpillar\collection-Test7 on kb-test-bar-016.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Permission denied ().
Nothing to delete in j:kbhpillar\collection-Test7 on kb-test-bar-016.bitarkiv.kb.dk
calling cleanup_hosts
running cleanup_hosts
Removing installation on sb-test-har-001.statsbiblioteket.dk
Removing installation on kb-test-har-003.kb.dk
Removing installation on kb-test-har-004.kb.dk
Removing installation on kb-test-har-005.kb.dk
Removing installation on kb-test-adm-001.kb.dk
Removing installation on kb-test-acs-001.kb.dk
Removing installation on kb-test-way-001.kb.dk
calling cleanup_linuxbarhosts
running cleanup_linuxbarhosts
Removing installation on sb-test-bar-001.statsbiblioteket.dk
Removing bitarchive on sb-test-bar-001.statsbiblioteket.dk
Calling cleanup_windowsbarhosts
running cleanup_windowsbarhosts
Removing C:\bitarkiv\Test7 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing E:\bitarchive_1\Test7 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing F:\bitarchive_2\Test7 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing g:\bitarchive_3\Test7 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing C:\bitarkiv\Test7 on kb-test-bar-016.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Received disconnect from 10.17.0.56: 11: Locked out due to too many failed login attempts.
Removing E:\bitarchive_1\Test7 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Removing F:\bitarchive_2\Test7 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Removing g:\bitarchive_3\Test7 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
TESTX=Test7
PORT=8079
MAILRECEIVERS=pch@kb.dk
VERSION=PCH
DEPLOYCONF=deploy_config_bitmag.xml
H3ZIP=PCH
BITMAGCONF=/home/devel/bitmag_test_config/client_config
Using bundler file /home/devel/nas_versions/bundler/NetarchiveSuite-heritrix3-bundler-PCH.zip
Creating distribution files in /home/devel/prepared_software/Test7.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/prepared_software/Test7/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/prepared_software/Test7/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
Will read source files using encoding 'UTF-8' (defaulted)
Branch in settings not found: common.warcRecordService
Branch in settings not found: common.arcrepositoryClient.bitrepository
Branch in settings not found: common.hadoop
Branch in settings not found: common.useBitmagHadoopBackend
Branch in settings not found: common.fileResolver
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Machine 'kb-test-adm-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-har-003.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test7/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test7/h3server.jks
Machine 'kb-test-har-005.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test7/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test7/h3server.jks
Machine 'kb-test-har-004.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test7/NetarchiveSuite-heritrix3-bundler.zip
Machine 'kb-test-acs-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-way-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'sb-test-har-001.statsbiblioteket.dk' configured with encoding 'UTF-8' (defaulted)
/home/devel/prepared_software/Test7/NetarchiveSuite-heritrix3-bundler.zip -> /home/netarkdv/Test7/NetarchiveSuite-heritrix3-bundler.zip
11:31:21.691 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
11:31:21.696 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
11:31:21.698 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
11:31:21.698 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
11:31:21.700 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
11:31:21.700 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
11:31:21.701 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
11:31:21.701 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
11:31:21.702 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
11:31:21.702 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
11:31:21.703 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
11:31:21.703 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
11:31:21.798 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
11:31:21.799 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-adm-001.kb.dk
copying NetarchiveSuite-PCH.zip to:kb-test-adm-001.kb.dk
deleting devel@kb-test-adm-001.kb.dk:/home/devel/Test7/lib
unzipping NetarchiveSuite-PCH.zip at:kb-test-adm-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-003.kb.dk
copying NetarchiveSuite-PCH.zip to:kb-test-har-003.kb.dk
deleting devel@kb-test-har-003.kb.dk:/home/devel/Test7/lib
unzipping NetarchiveSuite-PCH.zip at:kb-test-har-003.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-005.kb.dk
copying NetarchiveSuite-PCH.zip to:kb-test-har-005.kb.dk
deleting devel@kb-test-har-005.kb.dk:/home/devel/Test7/lib
unzipping NetarchiveSuite-PCH.zip at:kb-test-har-005.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-004.kb.dk
copying NetarchiveSuite-PCH.zip to:kb-test-har-004.kb.dk
deleting devel@kb-test-har-004.kb.dk:/home/devel/Test7/lib
unzipping NetarchiveSuite-PCH.zip at:kb-test-har-004.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-acs-001.kb.dk
copying NetarchiveSuite-PCH.zip to:kb-test-acs-001.kb.dk
deleting devel@kb-test-acs-001.kb.dk:/home/devel/Test7/lib
unzipping NetarchiveSuite-PCH.zip at:kb-test-acs-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-way-001.kb.dk
copying NetarchiveSuite-PCH.zip to:kb-test-way-001.kb.dk
deleting devel@kb-test-way-001.kb.dk:/home/devel/Test7/lib
unzipping NetarchiveSuite-PCH.zip at:kb-test-way-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
--------------------------------------------
INSTALLING TO MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
copying NetarchiveSuite-PCH.zip to:sb-test-har-001.statsbiblioteket.dk
deleting netarkdv@sb-test-har-001.statsbiblioteket.dk:/home/netarkdv/Test7/lib
unzipping NetarchiveSuite-PCH.zip at:sb-test-har-001.statsbiblioteket.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
Copying secondary installation scripts out to the machines where they need to be executed
scp '/home/devel/devel-config/scripts/link_bitmag.sh' 'netarkdv@sb-test-bar-001.statsbiblioteket.dk:Test7'
Linking Bitmag kbh-pillar and NAS bitarkiv directories on KBH
scp: Test7/link_kbh_bar_01.bat: Error writing file: Insufficient free space on the filesystem.
ssh_exchange_identification: Connection closed by remote host
lost connection
Linking bitmag and netarkivet storage directories on SB
ssh 'netarkdv@sb-test-bar-001.statsbiblioteket.dk' 'Test7/link_bitmag.sh Test7'
bash: Test7/link_bitmag.sh: Not a directory
Linking Bitmag kbh-pillar and NAS bitarkiv directories on KBH
ssh_exchange_identification: Connection closed by remote host
Initializing database for system Test7
+ host=devel@kb-test-adm-001
+ scp -p /home/devel/devel-config/scripts/db/setup_admindb.sh /home/devel/devel-config/scripts/db/setup_harvestdb.sh /home/devel/devel-config/scripts/db/teardown_admindb.sh /home/devel/devel-config/scripts/db/teardown_harvestdb.sh /home/devel/devel-config/scripts/../resources/harvestdb.testdata.sql /home/devel/devel-config/scripts/../resources/default_orderxml.cxml devel@kb-test-adm-001:bin/
+ ssh devel@kb-test-adm-001
Pseudo-terminal will not be allocated because stdin is not a terminal.
Destroying test7_admindb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
DROP DATABASE
Creating empty test7_admindb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
CREATE DATABASE
Initialising test7_admindb
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "replica_pkey" for table "replica"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "replica_replica_id_key" for table "replica"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "replica_replica_name_key" for table "replica"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "replicafileinfo_pkey" for table "replicafileinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "file_pkey" for table "file"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "segment_pkey" for table "segment"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
Destroying test7_harvestdb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
DROP DATABASE
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
CREATE DATABASE
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "domains_pkey" for table "domains"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "domains_name_key" for table "domains"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "configurations_pkey" for table "configurations"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "config_passwords_pkey" for table "config_passwords"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "config_seedlists_pkey" for table "config_seedlists"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "seedlists_pkey" for table "seedlists"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "passwords_pkey" for table "passwords"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "ownerinfo_pkey" for table "ownerinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "historyinfo_pkey" for table "historyinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvestdefinitions_pkey" for table "harvestdefinitions"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "harvestdefinitions_name_key" for table "harvestdefinitions"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "fullharvests_pkey" for table "fullharvests"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "partialharvests_pkey" for table "partialharvests"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvest_configs_pkey" for table "harvest_configs"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "schedules_pkey" for table "schedules"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "schedules_name_key" for table "schedules"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "ordertemplates_pkey" for table "ordertemplates"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "ordertemplates_name_key" for table "ordertemplates"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "jobs_pkey" for table "jobs"
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "job_configs_pkey" for table "job_configs"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "global_crawler_trap_lists_pkey" for table "global_crawler_trap_lists"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "global_crawler_trap_lists_name_key" for table "global_crawler_trap_lists"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "global_crawler_trap_expressions_pkey" for table "global_crawler_trap_expressions"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "pkrunningjobshistory" for table "runningjobshistory"
CREATE TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "pkrunningjobsmonitor" for table "runningjobsmonitor"
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / UNIQUE will create implicit index "pkfrontierreportlines" for table "frontierreportmonitor"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfieldtype_pkey" for table "extendedfieldtype"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfield_pkey" for table "extendedfield"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfieldvalue_pkey" for table "extendedfieldvalue"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
INSERT 0 1
INSERT 0 1
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvestchannel_pkey" for table "harvestchannel"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "harvestchannel_name_key" for table "harvestchannel"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE TABLE
NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index "eav_type_attribute_pkey" for table "eav_type_attribute"
ALTER TABLE
CREATE INDEX
CREATE SEQUENCE
CREATE TABLE
NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index "eav_attribute_pkey" for table "eav_attribute"
ALTER TABLE
CREATE INDEX
GRANT
GRANT
GRANT
INSERT 0 1
INSERT 0 1
INSERT 0 1
SET
SET
SET
SET
SET
SET
SET
SET
SET
setval
--------
17
(1 row)
setval
--------
17
(1 row)
setval
--------
17
(1 row)
setval
--------
5
(1 row)
setval
--------
4
(1 row)
setval
--------
17
(1 row)
11:32:52.354 [main] INFO com.mchange.v2.log.MLog - MLog clients using log4j logging.
11:32:52.681 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.2.1 [built 20-March-2013 10:47:27 +0000; debug? true; trace: 10]
11:32:52.789 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52af144vizrdf2dbv|afc191,name=10bdx52af144vizrdf2dbv|afc191 registered.
11:32:52.865 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52af144vizrdf2dbv|afc191,name=10bdx52af144vizrdf2dbv|afc191 unregistered, in order to be reregistered after update.
11:32:52.866 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52af144vizrdf2dbv|afc191,name=10bdx52af144vizrdf2dbv|afc191 registered.
11:32:52.893 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
11:32:52.998 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, dataSourceName -> 10bdx52af144vizrdf2dbv|afc191, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 10bdx52af144vizrdf2dbv|afc191, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost:5432/test7_harvestdb, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 3600, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, preferredTestQuery -> null, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ]
11:32:53.027 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 1
11:32:53.027 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [1], attempts_remaining: 30
11:32:53.027 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@5b461a
11:32:53.028 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 2
11:32:53.028 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [2], attempts_remaining: 30
11:32:53.028 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@c1c010
11:32:53.028 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 3
11:32:53.028 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [3], attempts_remaining: 30
11:32:53.028 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@17f23d9
11:32:53.029 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 4
11:32:53.029 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [4], attempts_remaining: 30
11:32:53.029 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@1d47554
11:32:53.029 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 5
11:32:53.029 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [5], attempts_remaining: 30
11:32:53.030 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@1b794e2
11:32:53.037 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@1200884 config: [start -> 3; min -> 5; max -> 20; inc -> 5; num_acq_attempts -> 30; acq_attempt_delay -> 1000; check_idle_resources_delay -> 0; mox_resource_age -> 3600000; max_idle_time -> 0; excess_max_idle_time -> 0; destroy_unreturned_resc_time -> 0; expiration_enforcement_delay -> 900000; break_on_acquisition_failure -> false; debug_store_checkout_exceptions -> false]
11:32:53.037 [main] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPoolManager - Created new pool for auth, username (masked): 'de******'.
11:32:53.038 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - acquire test -- pool size: 0; target_pool_size: 5; desired target? 1
11:32:53.038 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - awaitAvailable(): [unknown]
11:32:53.038 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 0, unused: 0, excluded: 0]
11:32:53.198 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#0] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@f9c38a.acquireResource() returning.
11:32:53.198 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 1, unused: 1, excluded: 0]
11:32:53.198 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 4
11:32:53.198 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [4], attempts_remaining: 30
11:32:53.199 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 1, unused: 0, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@ce17ba)
11:32:53.198 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#2] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@f9c38a.acquireResource() returning.
11:32:53.206 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 2, unused: 1, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@ce17ba)
11:32:53.206 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 3
11:32:53.206 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [3], attempts_remaining: 30
11:32:53.207 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#1] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@f9c38a.acquireResource() returning.
11:32:53.207 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 3, unused: 2, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@ce17ba)
11:32:53.207 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 2
11:32:53.209 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [2], attempts_remaining: 30
11:32:53.210 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#0] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@f9c38a.acquireResource() returning.
11:32:53.210 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 4, unused: 3, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@ce17ba)
11:32:53.210 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 1
11:32:53.210 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [1], attempts_remaining: 30
11:32:53.217 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#2] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@f9c38a.acquireResource() returning.
11:32:53.217 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@ce17ba)
11:32:53.217 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 0
11:32:53.217 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af144vizrdf2dbv|afc191]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [0], attempts_remaining: 30
11:32:53.257 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@1bc39f8 closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@a434c8
11:32:53.260 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@8bf312
11:32:53.260 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@ce17ba)
11:32:53.269 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@ce17ba)
11:32:53.271 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@1083305 closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@e677af
11:32:53.271 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@e0379d
11:32:53.271 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@ce17ba)
11:32:53.356 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@ce17ba)
11:32:53.360 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@1b485ba closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@11c7bf6
11:32:53.434 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@14b199c
11:32:53.435 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@ce17ba)
11:32:53.437 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyConnection - com.mchange.v2.c3p0.impl.NewProxyConnection@d3d15a: close() called more than once.
The template 'default_orderxml' has now been updated.
+ set +x
--------------------------------------------
STARTING MACHINE: devel@kb-test-adm-001.kb.dk
Starting all applications on: kb-test-adm-001.kb.dk
Starting linux application: GUIApplication
Starting linux application: ArcRepositoryApplication
Starting linux application: HarvestJobManagerApplication
11:32:55,225 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test7/conf/logback_ArcRepositoryApplication.xml] at [file:/home/devel/Test7/conf/logback_ArcRepositoryApplication.xml]
11:32:55,999 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:32:56,000 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:32:56,027 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:32:56,093 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:32:56,320 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:32:56,338 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:32:56,472 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@8086380 - No compression will be used
11:32:56,473 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@8086380 - Will use the pattern ./log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log for the active file
11:32:56,504 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1dd4eda - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log'.
11:32:56,504 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1dd4eda - Roll-over at midnight.
11:32:56,533 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1dd4eda - Setting initial period to Thu Feb 11 11:32:56 CET 2021
11:32:56,534 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1dd4eda - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:32:56,534 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1dd4eda - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:32:56,536 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:32:56,555 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ArcRepositoryApplication.log
11:32:56,555 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ArcRepositoryApplication.log]
11:32:56,557 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:32:57,800 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:32:57,818 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:32:57,818 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:32:57,824 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:32:57,824 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:32:57,825 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:32:57,825 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:32:57,826 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@611244 - Registering current configuration as safe fallback point
2021-02-11 11:32:57.840 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
2021-02-11 11:32:57.857 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
Java VM: 1.8.0_20
2021-02-11 11:32:57.861 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_20
java.home: /usr/java/jdk1.8.0_20/jre
2021-02-11 11:32:57.862 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/java/jdk1.8.0_20/jre
Working dir: /home/devel/Test7
2021-02-11 11:32:57.862 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test7
2021-02-11 11:32:57.862 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test7/conf/settings_ArcRepositoryApplication.xml'
2021-02-11 11:32:58.151 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8181/8281
2021-02-11 11:32:58.152 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8181 communicating on port 8281 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8281/jndi/rmi://kb-test-adm-001.kb.dk:8181/jmxrmi
dk.netarkivet.archive.arcrepository.ArcRepository Running
2021-02-11 11:32:58.182 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.archive.arcrepository.ArcRepository Running
2021-02-11 11:32:58.211 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:32:58.211 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:32:58.212 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-11 11:32:58.759 INFO d.n.a.a.ArchiveDBConnection.initDataSource - Using jdbc url: jdbc:postgresql://localhost:5432/test7_admindb
2021-02-11 11:32:58.765 INFO d.n.a.a.ArchiveDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=10
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=30
- idleConnTestQuery='SELECT COUNT(*) FROM replica'
- idleConnTestOnCheckin=false
11:32:54,658 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test7/conf/logback_GUIApplication.xml] at [file:/home/devel/Test7/conf/logback_GUIApplication.xml]
11:32:55,319 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:32:55,320 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:32:55,329 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:32:55,354 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:32:55,440 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:32:55,447 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:32:55,487 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@12779761 - No compression will be used
11:32:55,489 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@12779761 - Will use the pattern ./log/GUIApplication.%d{yyyy-MM-dd}.%i.log for the active file
11:32:55,493 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@2cd91f - The date pattern is 'yyyy-MM-dd' from file name pattern './log/GUIApplication.%d{yyyy-MM-dd}.%i.log'.
11:32:55,493 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@2cd91f - Roll-over at midnight.
11:32:55,500 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@2cd91f - Setting initial period to Thu Feb 11 11:32:55 CET 2021
11:32:55,502 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@2cd91f - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:32:55,502 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@2cd91f - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:32:55,505 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:32:55,512 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/GUIApplication.log
11:32:55,512 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/GUIApplication.log]
11:32:55,513 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:32:56,702 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:32:56,713 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:32:56,714 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:32:56,715 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:32:56,715 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:32:56,716 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:32:56,716 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:32:56,718 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3f1134 - Registering current configuration as safe fallback point
2021-02-11 11:32:56.736 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
2021-02-11 11:32:56.765 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
Java VM: 1.8.0_20
2021-02-11 11:32:56.774 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_20
java.home: /usr/java/jdk1.8.0_20/jre
2021-02-11 11:32:56.776 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/java/jdk1.8.0_20/jre
Working dir: /home/devel/Test7
2021-02-11 11:32:56.776 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test7
2021-02-11 11:32:56.776 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test7/conf/settings_GUIApplication.xml'
2021-02-11 11:32:57.067 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8180/8280
2021-02-11 11:32:57.068 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8180 communicating on port 8280 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8280/jndi/rmi://kb-test-adm-001.kb.dk:8180/jmxrmi
dk.netarkivet.common.webinterface.GUIWebServer Running
2021-02-11 11:32:57.070 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.common.webinterface.GUIWebServer Running
2021-02-11 11:32:57.071 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war
2021-02-11 11:32:57.077 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection
2021-02-11 11:32:57.077 INFO d.n.common.webinterface.GUIWebServer.<init> - Starting webserver. Port: 8079 deployment directories: 'webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war' classes: 'dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection'
2021-02-11 11:32:57.083 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:32:57.084 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:32:57.094 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-11 11:32:57.107 DEBUG d.n.common.webinterface.GUIWebServer.<init> - GUI using tempdir /home/devel/Test7/tmpdircommon
2021-02-11 11:32:57.112 DEBUG d.n.common.webinterface.GUIWebServer.<init> - GUI using basedir /home/devel/Test7
2021-02-11 11:32:57.114 INFO d.n.common.webinterface.GUIWebServer.<init> - Deleted existing tempdir '/home/devel/Test7/tmpdircommon'
2021-02-11 11:32:57.330 INFO d.n.common.webinterface.GUIWebServer.<init> - Scanning for taglibs is disabled as tomcat.util.scan.StandardJarScanFilter.jarsToSkip is unset.
2021-02-11 11:32:57.345 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection
2021-02-11 11:32:57.351 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading 5 site section(s).
2021-02-11 11:32:57.351 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.harvester.webinterface.DefinitionsSiteSection.
2021-02-11 11:32:57.353 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.harvester.webinterface.HistorySiteSection.
2021-02-11 11:32:57.354 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection.
2021-02-11 11:32:57.355 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.viewerproxy.webinterface.QASiteSection.
2021-02-11 11:32:57.355 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.monitor.webinterface.StatusSiteSection.
2021-02-11 11:32:57.915 INFO d.n.h.datamodel.HarvestDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
2021-02-11 11:32:58.578 INFO d.n.h.h.monitor.HarvestMonitor.<init> - Initializing HarvestMonitor with refreshInterval=60 seconds
2021-02-11 11:32:58.621 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.harvesting.monitor.HarvestMonitor@127a732 as listener to Test7_COMMON_HARVESTMON
2021-02-11 11:32:58.636 INFO d.n.h.h.monitor.HarvestMonitor.<init> - Started listening to queue [Queue 'Test7_COMMON_HARVESTMON']
2021-02-11 11:32:58.637 INFO d.n.common.webinterface.GUIWebServer.<init> - Deploying webapp with context /HarvestDefinition at docbase /home/devel/Test7/webpages/HarvestDefinition.war.
Feb 11, 2021 11:32:58 AM org.apache.catalina.core.StandardContext setPath
WARNING: A context path must either be an empty string or start with a '/' and do not end with a '/'. The path [/] does not meet these criteria and has been changed to []
2021-02-11 11:32:58.743 INFO d.n.common.webinterface.GUIWebServer.<init> - Deploying webapp with context /History at docbase /home/devel/Test7/webpages/History.war.
2021-02-11 11:32:58.758 INFO d.n.common.webinterface.GUIWebServer.<init> - Deploying webapp with context /HarvestChannel at docbase /home/devel/Test7/webpages/HarvestChannel.war.
2021-02-11 11:32:58.760 INFO d.n.common.webinterface.GUIWebServer.<init> - Deploying webapp with context /QA at docbase /home/devel/Test7/webpages/QA.war.
2021-02-11 11:32:58.761 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.monitor.registry.distribute.MonitorRegistryServer@b62d79 as listener to Test7_COMMON_MONITOR_TOPIC
2021-02-11 11:32:58.764 INFO d.n.m.r.d.MonitorRegistryServer.<init> - MonitorRegistryServer listening for messages on channel '[Topic 'Test7_COMMON_MONITOR_TOPIC']'
2021-02-11 11:32:58.766 INFO d.n.common.webinterface.GUIWebServer.<init> - Deploying webapp with context /Status at docbase /home/devel/Test7/webpages/Status.war.
11:32:55,029 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test7/conf/logback_HarvestJobManagerApplication.xml] at [file:/home/devel/Test7/conf/logback_HarvestJobManagerApplication.xml]
11:32:55,768 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:32:55,770 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:32:55,781 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:32:55,809 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:32:55,890 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:32:55,897 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:32:55,941 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@17315878 - No compression will be used
11:32:55,942 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@17315878 - Will use the pattern ./log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log for the active file
11:32:55,946 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5fece7 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log'.
11:32:55,946 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5fece7 - Roll-over at midnight.
11:32:55,954 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5fece7 - Setting initial period to Thu Feb 11 11:32:55 CET 2021
11:32:55,954 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5fece7 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:32:55,954 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5fece7 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:32:55,957 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:32:55,963 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestJobManagerApplication.log
11:32:55,963 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestJobManagerApplication.log]
11:32:55,965 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:32:56,687 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:32:56,694 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:32:56,694 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:32:56,695 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:32:56,696 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:32:56,697 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:32:56,697 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:32:56,703 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@c300f1 - Registering current configuration as safe fallback point
2021-02-11 11:32:56.716 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
2021-02-11 11:32:56.761 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:32:56.763 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:32:56.763 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-11 11:32:57.386 INFO d.n.h.datamodel.HarvestDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
2021-02-11 11:32:57.906 INFO d.n.h.scheduler.JobDispatcher.<init> - Creating JobDispatcher
Starting dk.netarkivet.harvester.scheduler.HarvestJobManager
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
2021-02-11 11:32:58.022 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.scheduler.HarvestJobManager
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
2021-02-11 11:32:58.024 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test7/conf/settings_HarvestJobManagerApplication.xml'
2021-02-11 11:32:58.286 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 9184/9284
2021-02-11 11:32:58.286 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 9184 communicating on port 9284 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:9284/jndi/rmi://kb-test-adm-001.kb.dk:9184/jmxrmi
2021-02-11 11:32:58.287 DEBUG d.n.c.lifecycle.LifeCycleComponent.start - Starting dk.netarkivet.harvester.scheduler.HarvestJobManager@a7bfbc
2021-02-11 11:32:58.296 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver@1b266b3 as listener to Test7_COMMON_HARVESTER_STATUS_TOPIC
2021-02-11 11:32:58.363 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver@1b266b3 as listener to Test7_COMMON_HCHAN_VAL_REQ
2021-02-11 11:32:58.368 INFO d.n.h.s.HarvesterStatusReceiver.start - limitSubmittedJobsInQueue: true
2021-02-11 11:32:58.368 INFO d.n.h.s.HarvesterStatusReceiver.start - submittedJobsInQueueThreshold: 1
2021-02-11 11:32:58.393 INFO d.n.h.scheduler.HarvestJobGenerator.start - JobGeneratorTask set to run every 60 seconds
2021-02-11 11:32:58.394 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer@c8eb05 as listener to Test7_COMMON_THE_SCHED
dk.netarkivet.harvester.scheduler.HarvestJobManager Running
2021-02-11 11:32:58.406 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.scheduler.HarvestJobManager Running
2021-02-11 11:32:58.424 INFO d.n.h.scheduler.JobSupervisor.rescheduleLeftOverJobs - 0 jobs has been resubmitted.
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-003.kb.dk
Starting all applications on: kb-test-har-003.kb.dk
Starting linux application: HarvestControllerApplication_kblow001_h3
11:32:59,893 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test7/conf/logback_HarvestControllerApplication_kblow001_h3.xml] at [file:/home/devel/Test7/conf/logback_HarvestControllerApplication_kblow001_h3.xml]
11:33:00,098 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:33:00,101 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:33:00,108 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:33:00,125 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:00,180 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:33:00,184 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:33:00,208 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2025221430 - No compression will be used
11:33:00,210 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2025221430 - Will use the pattern ./log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log for the active file
11:33:00,212 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log'.
11:33:00,212 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - Roll-over at midnight.
11:33:00,216 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - Setting initial period to Thu Feb 11 11:33:00 CET 2021
11:33:00,218 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:33:00,218 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:33:00,220 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:00,222 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow001_h3.log
11:33:00,222 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow001_h3.log]
11:33:00,223 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:33:00,688 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:33:00,690 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:33:00,690 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:33:00,691 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:33:00,691 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:33:00,691 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:33:00,691 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:33:00,692 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@bef2d72 - Registering current configuration as safe fallback point
2021-02-11 11:33:00.697 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
2021-02-11 11:33:00.703 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
Java VM: 1.8.0_282
2021-02-11 11:33:00.704 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-11 11:33:00.704 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test7
2021-02-11 11:33:00.705 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test7
2021-02-11 11:33:00.705 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test7/conf/settings_HarvestControllerApplication_kblow001_h3.xml'
2021-02-11 11:33:00.840 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-003.kb.dk' and JMX/RMI ports 8180/8280
2021-02-11 11:33:00.841 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8180 communicating on port 8280 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-003.kb.dk:8280/jndi/rmi://kb-test-har-003.kb.dk:8180/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-11 11:33:00.856 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-11 11:33:00.862 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:00.863 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:00.864 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-11 11:33:00.905 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-11 11:33:00.906 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2021-02-11 11:33:00.906 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2021-02-11 11:33:00.907 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-11 11:33:01.035 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-003.kb.dk
2021-02-11 11:33:02.512 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2021-02-11 11:33:02.513 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@522a32b1 as listener to Test7_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3
2021-02-11 11:33:02.522 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test7_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3']'
2021-02-11 11:33:02.522 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test7/conf/bitmag_client_config
2021-02-11 11:33:02.523 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test7
2021-02-11 11:33:02.530 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-11 11:33:02.685 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2021-02-11 11:33:02.686 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2021-02-11 11:33:02.686 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_low'
2021-02-11 11:33:02.687 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@5dd91bca as listener to Test7_COMMON_HCHAN_VAL_RESP
2021-02-11 11:33:02.703 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'LOWPRIORITY'
2021-02-11 11:33:02.795 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'LOWPRIORITY' is valid.
2021-02-11 11:33:02.798 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test7_COMMON_JOB_SNAPSHOT_LOWPRIORITY']'
2021-02-11 11:33:02.799 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@5dd91bca as listener to Test7_COMMON_JOB_SNAPSHOT_LOWPRIORITY
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-005.kb.dk
Starting all applications on: kb-test-har-005.kb.dk
Starting linux application: HarvestControllerApplication_kbumbra_1
Starting linux application: HarvestControllerApplication_kbumbra_2
11:33:05,428 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test7/conf/logback_HarvestControllerApplication_kbumbra_1.xml] at [file:/home/devel/Test7/conf/logback_HarvestControllerApplication_kbumbra_1.xml]
11:33:05,768 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:33:05,787 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:33:05,794 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:33:05,818 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:05,926 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:33:05,929 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:33:05,982 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2025221430 - No compression will be used
11:33:05,983 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2025221430 - Will use the pattern ./log/HarvestControllerApplication_kbumbra_1.%d{yyyy-MM-dd}.%i.log for the active file
11:33:05,998 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbumbra_1.%d{yyyy-MM-dd}.%i.log'.
11:33:05,998 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - Roll-over at midnight.
11:33:06,002 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - Setting initial period to Thu Feb 11 11:33:05 CET 2021
11:33:06,002 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:33:06,002 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:33:06,004 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:06,013 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbumbra_1.log
11:33:06,013 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbumbra_1.log]
11:33:06,014 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:33:06,711 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:33:06,713 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:33:06,713 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:33:06,713 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:33:06,713 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:33:06,714 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:33:06,714 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:33:06,715 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@bef2d72 - Registering current configuration as safe fallback point
2021-02-11 11:33:06.719 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
2021-02-11 11:33:06.728 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
Java VM: 1.8.0_282
2021-02-11 11:33:06.729 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-11 11:33:06.729 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test7
2021-02-11 11:33:06.729 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test7
2021-02-11 11:33:06.729 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test7/conf/settings_HarvestControllerApplication_kbumbra_1.xml'
2021-02-11 11:33:06.912 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8180/8280
2021-02-11 11:33:06.913 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8180 communicating on port 8280 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8280/jndi/rmi://kb-test-har-005.kb.dk:8180/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-11 11:33:06.917 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-11 11:33:06.936 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-11 11:33:06.937 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'UMBRA'
2021-02-11 11:33:06.937 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:06.937 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_umbra_1'
2021-02-11 11:33:06.937 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:06.938 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-11 11:33:06.938 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-11 11:33:07.129 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk
2021-02-11 11:33:09.110 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2021-02-11 11:33:09.110 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@522a32b1 as listener to Test7_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_KBUMBRA_1
2021-02-11 11:33:09.148 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test7_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_KBUMBRA_1']'
2021-02-11 11:33:09.148 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test7/conf/bitmag_client_config
2021-02-11 11:33:09.149 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test7
2021-02-11 11:33:09.153 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-11 11:33:09.361 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2021-02-11 11:33:09.362 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2021-02-11 11:33:09.370 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_umbra_1'
2021-02-11 11:33:09.370 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@5dd91bca as listener to Test7_COMMON_HCHAN_VAL_RESP
2021-02-11 11:33:09.400 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'UMBRA'
2021-02-11 11:33:09.472 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'UMBRA' is valid.
2021-02-11 11:33:09.474 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test7_COMMON_JOB_PARTIAL_UMBRA']'
2021-02-11 11:33:09.474 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@5dd91bca as listener to Test7_COMMON_JOB_PARTIAL_UMBRA
11:33:05,411 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test7/conf/logback_HarvestControllerApplication_kbumbra_2.xml] at [file:/home/devel/Test7/conf/logback_HarvestControllerApplication_kbumbra_2.xml]
11:33:05,740 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:33:05,743 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:33:05,776 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:33:05,818 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:05,980 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:33:05,987 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:33:06,034 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2025221430 - No compression will be used
11:33:06,035 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2025221430 - Will use the pattern ./log/HarvestControllerApplication_kbumbra_2.%d{yyyy-MM-dd}.%i.log for the active file
11:33:06,038 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbumbra_2.%d{yyyy-MM-dd}.%i.log'.
11:33:06,038 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - Roll-over at midnight.
11:33:06,041 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - Setting initial period to Thu Feb 11 11:33:06 CET 2021
11:33:06,042 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:33:06,042 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:33:06,048 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:06,050 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbumbra_2.log
11:33:06,051 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbumbra_2.log]
11:33:06,051 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:33:06,749 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:33:06,750 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:33:06,751 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:33:06,751 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:33:06,751 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:33:06,752 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:33:06,752 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:33:06,752 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@bef2d72 - Registering current configuration as safe fallback point
2021-02-11 11:33:06.771 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
2021-02-11 11:33:06.776 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
Java VM: 1.8.0_282
2021-02-11 11:33:06.777 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-11 11:33:06.777 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test7
2021-02-11 11:33:06.777 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test7
2021-02-11 11:33:06.777 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test7/conf/settings_HarvestControllerApplication_kbumbra_2.xml'
2021-02-11 11:33:07.014 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8185/8285
2021-02-11 11:33:07.015 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8185 communicating on port 8285 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8285/jndi/rmi://kb-test-har-005.kb.dk:8185/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-11 11:33:07.019 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-11 11:33:07.026 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:07.026 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:07.026 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-11 11:33:07.055 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-11 11:33:07.056 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'UMBRA'
2021-02-11 11:33:07.056 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_umbra_2'
2021-02-11 11:33:07.057 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-11 11:33:07.166 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk
2021-02-11 11:33:09.111 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2021-02-11 11:33:09.111 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@522a32b1 as listener to Test7_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_KBUMBRA_2
2021-02-11 11:33:09.137 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test7_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_KBUMBRA_2']'
2021-02-11 11:33:09.138 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test7/conf/bitmag_client_config
2021-02-11 11:33:09.138 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test7
2021-02-11 11:33:09.142 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-11 11:33:09.362 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2021-02-11 11:33:09.363 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2021-02-11 11:33:09.363 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_umbra_2'
2021-02-11 11:33:09.363 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@5dd91bca as listener to Test7_COMMON_HCHAN_VAL_RESP
2021-02-11 11:33:09.401 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'UMBRA'
2021-02-11 11:33:09.434 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'UMBRA' is valid.
2021-02-11 11:33:09.436 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test7_COMMON_JOB_PARTIAL_UMBRA']'
2021-02-11 11:33:09.436 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@5dd91bca as listener to Test7_COMMON_JOB_PARTIAL_UMBRA
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-004.kb.dk
Starting all applications on: kb-test-har-004.kb.dk
Starting linux application: HarvestControllerApplication_kblow002_h3
Starting linux application: HarvestControllerApplication_kbhigh_h3
11:33:11,188 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test7/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] at [file:/home/devel/Test7/conf/logback_HarvestControllerApplication_kbhigh_h3.xml]
11:33:11,563 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:33:11,582 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:33:11,599 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:33:11,627 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:11,719 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:33:11,725 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:33:11,768 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@349420578 - No compression will be used
11:33:11,770 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@349420578 - Will use the pattern ./log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
11:33:11,773 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
11:33:11,773 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - Roll-over at midnight.
11:33:11,779 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - Setting initial period to Thu Feb 11 11:33:11 CET 2021
11:33:11,780 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:33:11,780 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:33:11,782 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:11,791 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbhigh_h3.log
11:33:11,791 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbhigh_h3.log]
11:33:11,792 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:33:12,460 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:33:12,469 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:33:12,469 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:33:12,470 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:33:12,470 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:33:12,473 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:33:12,473 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:33:12,474 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4c1d9d4b - Registering current configuration as safe fallback point
2021-02-11 11:33:12.483 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
2021-02-11 11:33:12.496 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
Java VM: 1.8.0_25
2021-02-11 11:33:12.503 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2021-02-11 11:33:12.504 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test7
2021-02-11 11:33:12.505 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test7
2021-02-11 11:33:12.506 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test7/conf/settings_HarvestControllerApplication_kbhigh_h3.xml'
2021-02-11 11:33:12.668 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8182/8282
2021-02-11 11:33:12.668 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8182 communicating on port 8282 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8282/jndi/rmi://kb-test-har-004.kb.dk:8182/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-11 11:33:12.673 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-11 11:33:12.688 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:12.688 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:12.689 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-11 11:33:12.696 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-11 11:33:12.697 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2021-02-11 11:33:12.698 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2021-02-11 11:33:12.698 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-11 11:33:12.863 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
11:33:11,190 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test7/conf/logback_HarvestControllerApplication_kblow002_h3.xml] at [file:/home/devel/Test7/conf/logback_HarvestControllerApplication_kblow002_h3.xml]
11:33:11,590 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:33:11,600 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:33:11,615 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:33:11,648 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:11,716 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:33:11,723 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:33:11,759 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@349420578 - No compression will be used
11:33:11,760 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@349420578 - Will use the pattern ./log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log for the active file
11:33:11,764 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log'.
11:33:11,764 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - Roll-over at midnight.
11:33:11,773 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - Setting initial period to Thu Feb 11 11:33:11 CET 2021
11:33:11,773 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:33:11,774 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:33:11,776 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:11,781 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow002_h3.log
11:33:11,782 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow002_h3.log]
11:33:11,782 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:33:12,465 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:33:12,477 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:33:12,477 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:33:12,478 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:33:12,478 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:33:12,479 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:33:12,479 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:33:12,480 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4c1d9d4b - Registering current configuration as safe fallback point
2021-02-11 11:33:12.485 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
2021-02-11 11:33:12.504 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
Java VM: 1.8.0_25
2021-02-11 11:33:12.505 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2021-02-11 11:33:12.506 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test7
2021-02-11 11:33:12.507 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test7
2021-02-11 11:33:12.507 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test7/conf/settings_HarvestControllerApplication_kblow002_h3.xml'
2021-02-11 11:33:12.710 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8180/8280
2021-02-11 11:33:12.712 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8180 communicating on port 8280 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8280/jndi/rmi://kb-test-har-004.kb.dk:8180/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-11 11:33:12.734 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-11 11:33:12.734 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:12.743 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:12.744 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-11 11:33:12.768 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-11 11:33:12.771 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2021-02-11 11:33:12.772 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2021-02-11 11:33:12.772 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-11 11:33:12.982 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
--------------------------------------------
STARTING MACHINE: devel@kb-test-acs-001.kb.dk
Starting all applications on: kb-test-acs-001.kb.dk
Starting linux application: IndexServerApplication
Starting linux application: ViewerProxyApplication
11:33:17,558 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test7/conf/logback_IndexServerApplication.xml] at [file:/home/devel/Test7/conf/logback_IndexServerApplication.xml]
11:33:18,222 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:33:18,223 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:33:18,236 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:33:18,282 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:18,408 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:33:18,414 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:33:18,507 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@597190999 - No compression will be used
11:33:18,510 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@597190999 - Will use the pattern ./log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log for the active file
11:33:18,515 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - The date pattern is 'yyyy-MM-dd' from file name pattern './log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log'.
11:33:18,515 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - Roll-over at midnight.
11:33:18,522 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - Setting initial period to Thu Feb 11 11:33:18 CET 2021
11:33:18,523 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:33:18,523 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:33:18,526 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:18,531 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/IndexServerApplication.log
11:33:18,531 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/IndexServerApplication.log]
11:33:18,533 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:33:19,549 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:33:19,551 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:33:19,551 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:33:19,552 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:33:19,552 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:33:19,552 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:33:19,552 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:33:19,554 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@1e730495 - Registering current configuration as safe fallback point
2021-02-11 11:33:19.559 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
2021-02-11 11:33:19.569 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
Java VM: 1.8.0_282
2021-02-11 11:33:19.569 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-11 11:33:19.570 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test7
2021-02-11 11:33:19.570 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test7
2021-02-11 11:33:19.570 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test7/conf/settings_IndexServerApplication.xml'
2021-02-11 11:33:19.922 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8381/8481
2021-02-11 11:33:19.923 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8381 communicating on port 8481 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8481/jndi/rmi://kb-test-acs-001.kb.dk:8381/jmxrmi
dk.netarkivet.harvester.indexserver.IndexServer Running
2021-02-11 11:33:19.938 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.indexserver.IndexServer Running
2021-02-11 11:33:19.950 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:19.951 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:19.952 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-11 11:33:19.963 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test7/cache/cdxdata'
2021-02-11 11:33:20.011 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
11:33:17,558 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test7/conf/logback_ViewerProxyApplication.xml] at [file:/home/devel/Test7/conf/logback_ViewerProxyApplication.xml]
11:33:18,213 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:33:18,214 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:33:18,220 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:33:18,281 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:18,402 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:33:18,406 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:33:18,505 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@597190999 - No compression will be used
11:33:18,507 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@597190999 - Will use the pattern ./log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log for the active file
11:33:18,512 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log'.
11:33:18,512 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - Roll-over at midnight.
11:33:18,517 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - Setting initial period to Thu Feb 11 11:33:18 CET 2021
11:33:18,517 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:33:18,517 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:33:18,520 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:18,529 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ViewerProxyApplication.log
11:33:18,529 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ViewerProxyApplication.log]
11:33:18,531 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:33:19,521 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:33:19,523 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:33:19,523 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:33:19,524 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:33:19,524 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:33:19,537 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:33:19,537 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:33:19,538 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@1e730495 - Registering current configuration as safe fallback point
2021-02-11 11:33:19.562 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
2021-02-11 11:33:19.568 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
Java VM: 1.8.0_282
2021-02-11 11:33:19.569 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-11 11:33:19.570 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test7
2021-02-11 11:33:19.570 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test7
2021-02-11 11:33:19.570 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test7/conf/settings_ViewerProxyApplication.xml'
2021-02-11 11:33:19.921 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8380/8480
2021-02-11 11:33:19.922 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8380 communicating on port 8480 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8480/jndi/rmi://kb-test-acs-001.kb.dk:8380/jmxrmi
dk.netarkivet.viewerproxy.ViewerProxy Running
2021-02-11 11:33:19.925 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.viewerproxy.ViewerProxy Running
2021-02-11 11:33:19.944 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:19.945 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:19.946 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-11 11:33:19.988 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
--------------------------------------------
STARTING MACHINE: devel@kb-test-way-001.kb.dk
Starting all applications on: kb-test-way-001.kb.dk
Starting linux application: WaybackIndexerApplication
Starting linux application: AggregatorApplication
--------------------------------------------
--------------------------------------------
STARTING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
Starting all applications on: sb-test-har-001.statsbiblioteket.dk
Starting linux application: HarvestControllerApplication_sbhigh_h3
11:33:27,243 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/netarkdv/Test7/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] at [file:/home/netarkdv/Test7/conf/logback_HarvestControllerApplication_sbhigh_h3.xml]
11:33:27,359 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:33:27,362 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:33:27,368 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:33:27,378 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:27,419 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:33:27,421 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:33:27,433 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1543148593 - No compression will be used
11:33:27,434 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1543148593 - Will use the pattern ./log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
11:33:27,436 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5db250b4 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
11:33:27,436 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5db250b4 - Roll-over at midnight.
11:33:27,440 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5db250b4 - Setting initial period to Thu Feb 11 11:33:27 CET 2021
11:33:27,440 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5db250b4 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:33:27,440 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5db250b4 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:33:27,442 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:33:27,444 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_sbhigh_h3.log
11:33:27,444 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_sbhigh_h3.log]
11:33:27,447 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:33:27,655 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:33:27,656 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:33:27,656 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:33:27,657 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:33:27,657 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:33:27,657 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:33:27,657 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:33:27,658 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@223f3642 - Registering current configuration as safe fallback point
2021-02-11 11:33:27.661 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
2021-02-11 11:33:27.665 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/17f8adcee82e1913dd75440c5763cebbff7102dc)
Java VM: 1.8.0_232
2021-02-11 11:33:27.665 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_232
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
2021-02-11 11:33:27.666 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
Working dir: /home/netarkdv/Test7
2021-02-11 11:33:27.666 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/netarkdv/Test7
2021-02-11 11:33:27.666 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/netarkdv/Test7/conf/settings_HarvestControllerApplication_sbhigh_h3.xml'
2021-02-11 11:33:27.800 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'sb-test-har-001.statsbiblioteket.dk' and JMX/RMI ports 8180/8280
2021-02-11 11:33:27.801 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8180 communicating on port 8280 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://sb-test-har-001.statsbiblioteket.dk:8280/jndi/rmi://sb-test-har-001.statsbiblioteket.dk:8180/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-11 11:33:27.804 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-11 11:33:27.810 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:27.810 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-11 11:33:27.811 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-11 11:33:27.816 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-11 11:33:27.817 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2021-02-11 11:33:27.818 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2021-02-11 11:33:27.818 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-11 11:33:27.971 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): sb-test-har-001.statsbiblioteket.dk
2021-02-11 11:33:28.817 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2021-02-11 11:33:28.819 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@4c2cc639 as listener to Test7_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3
2021-02-11 11:33:28.836 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test7_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3']'
2021-02-11 11:33:28.838 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/netarkdv/Test7/conf/bitmag_client_config
2021-02-11 11:33:28.842 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test7
2021-02-11 11:33:28.851 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-11 11:33:28.932 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2021-02-11 11:33:28.936 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2021-02-11 11:33:28.936 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_high'
2021-02-11 11:33:28.938 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@5a7005d as listener to Test7_COMMON_HCHAN_VAL_RESP
2021-02-11 11:33:28.971 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'HIGHPRIORITY'
2021-02-11 11:33:29.030 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'HIGHPRIORITY' is valid.
2021-02-11 11:33:29.033 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test7_COMMON_JOB_PARTIAL_HIGHPRIORITY']'
2021-02-11 11:33:29.033 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@5a7005d as listener to Test7_COMMON_JOB_PARTIAL_HIGHPRIORITY
--------------------------------------------
Completed the script all_test.sh
Finished: SUCCESS
Console Output
Help us localize this page