tory/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/../target/jacoco.exec,append=true
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-resourcestore ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-resourcestore ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 7 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/classes
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-resourcestore ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/src/test/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-resourcestore ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 4 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/test-classes
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-resourcestore ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ wayback-resourcestore ---
[INFO] Skipping JaCoCo execution due to missing execution data file.
[INFO]
[INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-resourcestore ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-resourcestore ---
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/wayback-resourcestore-7.3-SNAPSHOT.jar
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-resourcestore ---
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/wayback-resourcestore-7.3-SNAPSHOT-sources.jar
[JENKINS] Archiving disabled
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building NetarchiveSuite - wayback - test 7.3-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback-test ---
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ wayback-test ---
[INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/../target/jacoco.exec,append=true
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ wayback-test ---
[INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/../target/jacoco.exec,append=true
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-test ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-test ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-test ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 28 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-test ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 17 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/target/test-classes
[WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/test/java/dk/netarkivet/wayback/hadoop/CDXJobTest.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/test/java/dk/netarkivet/wayback/hadoop/CDXJobTest.java uses or overrides a deprecated API.
[WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/test/java/dk/netarkivet/wayback/hadoop/CDXJobTest.java: Recompile with -Xlint:deprecation for details.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-test ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ wayback-test ---
[INFO] Skipping JaCoCo execution due to missing execution data file.
[INFO]
[INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-test ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-test ---
[WARNING] JAR will be empty - no content was marked for inclusion!
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/target/wayback-test-7.3-SNAPSHOT.jar
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-test ---
[INFO] No sources in project. Archive not created.
[JENKINS] Archiving disabled
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building NetarchiveSuite - integration tests 7.3-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ integration-test ---
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.5.201505241946:prepare-agent (default) @ integration-test ---
[INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.5.201505241946/org.jacoco.agent-0.7.5.201505241946-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/target/jacoco.exec
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.5.201505241946:report (report) @ integration-test ---
[INFO] Skipping JaCoCo execution due to missing execution data file:/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/target/jacoco.exec
[INFO]
[INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ integration-test ---
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ integration-test ---
[JENKINS] Archiving disabled
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building NetarchiveSuite System test 7.3-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ system-test ---
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.5.201505241946:prepare-agent (default) @ system-test ---
[INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.5.201505241946/org.jacoco.agent-0.7.5.201505241946-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/target/jacoco.exec
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ system-test ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ system-test ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ system-test ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 22 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ system-test ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 34 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/target/test-classes
[WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java uses unchecked or unsafe operations.
[WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java: Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ system-test ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.5.201505241946:report (report) @ system-test ---
[INFO] Skipping JaCoCo execution due to missing execution data file:/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/target/jacoco.exec
[INFO]
[INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ system-test ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ system-test ---
[WARNING] JAR will be empty - no content was marked for inclusion!
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/target/system-test-7.3-SNAPSHOT.jar
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ system-test ---
[INFO] No sources in project. Archive not created.
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] NetarchiveSuite .................................... SUCCESS [ 2.412 s]
[INFO] NetarchiveSuite - build-tools ...................... SUCCESS [ 1.328 s]
[INFO] NetarchiveSuite - common ........................... SUCCESS [ 0.243 s]
[INFO] NetarchiveSuite - test utils ....................... SUCCESS [ 1.769 s]
[INFO] NetarchiveSuite - common - core .................... SUCCESS [ 8.735 s]
[INFO] NetarchiveSuite - common - test .................... SUCCESS [ 4.456 s]
[INFO] NetarchiveSuite - archive .......................... SUCCESS [ 0.235 s]
[INFO] NetarchiveSuite - archive - core ................... SUCCESS [ 4.353 s]
[INFO] NetarchiveSuite - harvester ........................ SUCCESS [ 0.246 s]
[INFO] NetarchiveSuite - harvester - core ................. SUCCESS [ 4.861 s]
[INFO] NetarchiveSuite - archive - test ................... SUCCESS [ 2.757 s]
[INFO] NetarchiveSuite - bitpreservation - webapp ......... SUCCESS [ 1.052 s]
[INFO] NetarchiveSuite - Harvest Scheduler ................ SUCCESS [ 2.456 s]
[INFO] NetarchiveSuite - monitor .......................... SUCCESS [ 0.255 s]
[INFO] NetarchiveSuite - monitor - core ................... SUCCESS [ 1.853 s]
[INFO] NetarchiveSuite - wayback .......................... SUCCESS [ 1.161 s]
[INFO] NetarchiveSuite - wayback - indexer ................ SUCCESS [ 2.224 s]
[INFO] NetarchiveSuite - deploy ........................... SUCCESS [ 0.251 s]
[INFO] NetarchiveSuite - deploy - core .................... SUCCESS [ 2.635 s]
[INFO] NetarchiveSuite - harvester - heritrix3 ............ SUCCESS [ 0.225 s]
[INFO] NetarchiveSuite - Heritrix3 Extensions ............. SUCCESS [ 3.474 s]
[INFO] NetarchiveSuite - heritrix3 controller ............. SUCCESS [ 2.684 s]
[INFO] hadoop-uber-jar .................................... SUCCESS [ 9.010 s]
[INFO] hadoop-uber-jar-invoker ............................ SUCCESS [ 8.265 s]
[INFO] NetarchiveSuite - Status - Webapp .................. SUCCESS [ 1.116 s]
[INFO] NetarchiveSuite - qa - webapp ...................... SUCCESS [ 0.572 s]
[INFO] NetarchiveSuite - history - webapp ................. SUCCESS [ 1.714 s]
[INFO] NetarchiveSuite - harvestDefinition - webapp ....... SUCCESS [ 1.271 s]
[INFO] NetarchiveSuite - harvestChannel - webapp .......... SUCCESS [ 0.579 s]
[INFO] NetarchiveSuite - heritrix3 monitor ................ SUCCESS [ 17.214 s]
[INFO] NetarchiveSuite - deploy - distribution ............ SUCCESS [ 18.059 s]
[INFO] NetarchiveSuite - deploy - test .................... SUCCESS [ 2.773 s]
[INFO] NetarchiveSuite - Heritrix3 Bundler ................ SUCCESS [ 15.004 s]
[INFO] NetarchiveSuite - harvester - test ................. SUCCESS [ 3.329 s]
[INFO] NetarchiveSuite - monitor - test ................... SUCCESS [ 1.750 s]
[INFO] NetarchiveSuite - wayback resourceStore ............ SUCCESS [ 1.634 s]
[INFO] NetarchiveSuite - wayback - test ................... SUCCESS [ 2.126 s]
[INFO] NetarchiveSuite - integration tests ................ SUCCESS [ 0.232 s]
[INFO] NetarchiveSuite System test ........................ SUCCESS [ 1.842 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:30 min
[INFO] Finished at: 2021-11-25T12:51:44+01:00
[INFO] Final Memory: 134M/320M
[INFO] ------------------------------------------------------------------------
channel stopped
[NetarchiveSuite-Colin-1-Click] $ /bin/bash /tmp/hudson8000421044354988065.sh
Do a total cleanup of system Test6
start tunning cleanup script
end part of script
--------------------------------------------
KILLING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
bash: /home/netarkdv/Test6/conf/killall.sh: No such file or directory
--------------------------------------------
--------------------------------------------
KILLING MACHINE: devel@kb-test-adm-001.kb.dk
bash: /home/devel/Test6/conf/killall.sh: No such file or directory
--------------------------------------------
KILLING MACHINE: devel@kb-test-har-003.kb.dk
bash: /home/devel/Test6/conf/killall.sh: No such file or directory
--------------------------------------------
KILLING MACHINE: devel@kb-test-har-005.kb.dk
bash: /home/devel/Test6/conf/killall.sh: No such file or directory
--------------------------------------------
KILLING MACHINE: devel@kb-test-har-004.kb.dk
bash: /home/devel/Test6/conf/killall.sh: No such file or directory
--------------------------------------------
KILLING MACHINE: devel@kb-test-acs-001.kb.dk
bash: /home/devel/Test6/conf/killall.sh: No such file or directory
--------------------------------------------
KILLING MACHINE: devel@kb-test-way-001.kb.dk
bash: /home/devel/Test6/conf/killall.sh: No such file or directory
--------------------------------------------
running cleanup_bitmag
Resetting Collection Test6
Delete content in collection=Test6
12:51:59.760 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
12:52:00.067 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
12:52:00.117 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
12:52:00.755 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
12:52:00.772 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
12:52:00.773 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
12:52:00.933 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:52:00.934 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
12:52:01.887 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
12:52:01.988 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:52:01.991 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-2269]
12:52:01.995 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
12:52:01.995 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-2269' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
12:52:01.996 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-2269' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-2269#1249875355'.
12:52:01.996 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-2269#1249875355'.
Checksum: Count: FileID:
12:52:02.034 INFO o.b.a.g.ConversationBasedGetChecksumsClient - Requesting the checksums for file '' with the specifications 'org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@73e22a3d[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)]null' with query [ContributorQuery{componentID='netarkiv-tape-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-disk-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-disk-devel-02, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-checksum-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-kbh-disk-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}].
12:52:02.053 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
12:52:02.928 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent IdentifyPillarsForGetChecksumsRequest(96c14810) collectionID Test6, destination topic://netarkiv-devel: FileIDs=AllFiles
12:52:02.929 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 96c14810: GET_CHECKSUMS: IDENTIFY_REQUEST_SENT: , Identifying pillars for GetChecksums
12:52:03.414 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(96c14810) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(Checksum operation available.)
12:52:03.422 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 96c14810: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01
12:52:03.423 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
12:52:03.423 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01]
12:52:03.845 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(96c14810) collectionID Test6, from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
12:52:03.848 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 96c14810: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01
12:52:03.848 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01
12:52:03.849 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-disk-devel-01]
12:52:04.071 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(96c14810) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
12:52:04.078 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 96c14810: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01
12:52:04.078 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01
12:52:04.078 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01]
12:52:04.354 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(96c14810) collectionID Test6, from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.)
12:52:04.355 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 96c14810: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01
12:52:04.355 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
12:52:04.355 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02]
12:52:12.050 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 96c14810: GET_CHECKSUMS: IDENTIFY_TIMEOUT: , Time has run out for looking up contributors
The following contributors didn't respond: [netarkiv-disk-devel-02]
12:52:12.051 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 96c14810: GET_CHECKSUMS: COMPONENT_FAILED: ContributorID netarkiv-disk-devel-02 ResponseCode: null, Timeout for identifying contributor
12:52:12.052 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 96c14810: GET_CHECKSUMS: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01]
12:52:12.054 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 96c14810: GET_CHECKSUMS: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], Sending GetFileIDsRequest's
12:52:12.401 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(96c14810) collectionID Test6, destination queue://netarkiv-tape-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@73e22a3d[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
12:52:12.795 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(96c14810) collectionID Test6, destination queue://netarkiv-disk-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@73e22a3d[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
12:52:13.141 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(96c14810) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS)
12:52:13.147 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 96c14810: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS
12:52:13.273 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(96c14810) collectionID Test6, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@73e22a3d[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
12:52:13.721 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(96c14810) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@305d1cec[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
12:52:13.723 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01
12:52:13.723 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01]
12:52:13.855 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(96c14810) collectionID Test6, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@73e22a3d[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
12:52:14.025 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(96c14810) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS)
12:52:14.041 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 96c14810: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS
12:52:14.223 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(96c14810) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@340cebeb[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
12:52:14.228 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01
12:52:14.228 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-kbh-disk-devel-01]
12:52:14.411 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(96c14810) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS(Starting to calculate checksums.)
12:52:14.419 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 96c14810: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-checksum-devel-01, Starting to calculate checksums.
12:52:14.589 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(96c14810) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_COMPLETED, NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@6c3ad25f[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
12:52:14.593 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
12:52:14.593 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-kbh-disk-devel-01]
12:52:14.774 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(96c14810) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(Completed checksum retrieval.), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@4668b8e4[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
12:52:14.775 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
12:52:14.775 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: []
Deleting file FileID: with checksum Checksum: in collection Test6 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01
12:52:16.003 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
12:52:16.105 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
12:52:16.524 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
12:52:16.580 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
12:52:17.445 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
12:52:17.468 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
12:52:17.469 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
12:52:17.790 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@3754a4bf[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:52:17.791 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
12:52:18.798 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
12:52:18.901 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@3754a4bf[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:52:18.904 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-2301]
12:52:18.907 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
12:52:18.908 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3e84448c' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-2301' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
12:52:18.908 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-2301' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3e84448c'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-2301#1048855692'.
12:52:18.909 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-2301#1048855692'.
12:52:18.930 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
java.lang.IllegalArgumentException: String hexString, 'Checksum:', must be an even number of characters.
at org.bitrepository.common.ArgumentValidator.checkTrue(ArgumentValidator.java:160)
at org.bitrepository.common.utils.Base16Utils.encodeBase16(Base16Utils.java:64)
at org.bitrepository.commandline.CommandLineClient.getChecksumDataForDeleteValidation(CommandLineClient.java:302)
at org.bitrepository.commandline.DeleteFileCmd.deleteTheFile(DeleteFileCmd.java:125)
at org.bitrepository.commandline.DeleteFileCmd.performOperation(DeleteFileCmd.java:107)
at org.bitrepository.commandline.CommandLineClient.runCommand(CommandLineClient.java:68)
at org.bitrepository.commandline.DeleteFileCmd.main(DeleteFileCmd.java:47)
xargs: ssh: exited with status 255; aborting
calling cleanup_hosts
running cleanup_hosts
Removing installation on sb-test-har-001.statsbiblioteket.dk
Removing installation on kb-test-har-003.kb.dk
Removing installation on kb-test-har-004.kb.dk
Removing installation on kb-test-har-005.kb.dk
Removing installation on kb-test-adm-001.kb.dk
Removing installation on kb-test-acs-001.kb.dk
Removing installation on kb-test-way-001.kb.dk
calling cleanup_linuxbarhosts
running cleanup_linuxbarhosts
Removing installation on sb-test-bar-001.statsbiblioteket.dk
Removing bitarchive on sb-test-bar-001.statsbiblioteket.dk
Calling cleanup_windowsbarhosts
running cleanup_windowsbarhosts
Removing C:\bitarkiv\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing E:\bitarchive_1\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing F:\bitarchive_2\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing g:\bitarchive_3\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing C:\Users\ba-devel\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
TESTX=Test6
PORT=8078
MAILRECEIVERS=csr@kb.dk
VERSION=CSR
DEPLOYCONF=deploy_config_bitmag.xml
H3ZIP=CSR
BITMAGCONF=/home/devel/bitmag_test_config/client_config
Using bundler file /home/devel/nas_versions/bundler/NetarchiveSuite-heritrix3-bundler-CSR.zip
Creating distribution files in /home/devel/prepared_software/Test6.
Will read source files using encoding 'UTF-8' (defaulted)
Branch in settings not found: common.warcRecordService
Branch in settings not found: common.arcrepositoryClient.bitrepository.getFileIDsMaxResults
Branch in settings not found: common.hadoop.kerberos
Branch in settings not found: common.hadoop.username
Branch in settings not found: common.hadoop.mapred.hadoopUberJar
Branch in settings not found: common.hadoop.mapred.inputFilesParentDir
Branch in settings not found: common.hadoop.mapred.cdxJob
Branch in settings not found: common.hadoop.mapred.metadataExtractionJob
Branch in settings not found: common.hadoop.mapred.metadataCDXExtractionJob
Branch in settings not found: common.hadoop.mapred.crawlLogExtractionJob
Branch in settings not found: common.fileResolver.baseUrl
Branch in settings not found: common.fileResolver.keyfile
Branch in settings not found: common.webinterface.metadata_cache_dir
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Machine 'kb-test-adm-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-har-003.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks
Machine 'kb-test-har-005.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks
Machine 'kb-test-har-004.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
Machine 'kb-test-acs-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-way-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'sb-test-har-001.statsbiblioteket.dk' configured with encoding 'UTF-8' (defaulted)
/home/devel/prepared_software/Test6/NetarchiveSuite-heritrix3-bundler.zip -> /home/netarkdv/Test6/NetarchiveSuite-heritrix3-bundler.zip
12:57:46.494 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:57:46.502 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:57:46.504 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:57:46.505 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:57:46.506 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:57:46.506 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:57:46.507 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:57:46.507 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:57:46.508 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:57:46.508 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:57:46.509 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:57:46.510 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:57:46.617 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:57:46.617 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-adm-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-adm-001.kb.dk
deleting devel@kb-test-adm-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-adm-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-003.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-003.kb.dk
deleting devel@kb-test-har-003.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-003.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-005.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-005.kb.dk
deleting devel@kb-test-har-005.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-005.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-004.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-004.kb.dk
deleting devel@kb-test-har-004.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-004.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-acs-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-acs-001.kb.dk
deleting devel@kb-test-acs-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-acs-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-way-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-way-001.kb.dk
deleting devel@kb-test-way-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-way-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
--------------------------------------------
INSTALLING TO MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
copying NetarchiveSuite-CSR.zip to:sb-test-har-001.statsbiblioteket.dk
deleting netarkdv@sb-test-har-001.statsbiblioteket.dk:/home/netarkdv/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:sb-test-har-001.statsbiblioteket.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
Initializing database for system Test6
+ host=devel@kb-test-adm-001
+ scp -p /home/devel/devel-config/scripts/db/setup_admindb.sh /home/devel/devel-config/scripts/db/setup_harvestdb.sh /home/devel/devel-config/scripts/db/teardown_admindb.sh /home/devel/devel-config/scripts/db/teardown_harvestdb.sh /home/devel/devel-config/scripts/../resources/harvestdb.testdata.sql /home/devel/devel-config/scripts/../resources/default_orderxml.cxml devel@kb-test-adm-001:bin/
+ ssh devel@kb-test-adm-001
Pseudo-terminal will not be allocated because stdin is not a terminal.
Destroying test6_admindb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
DROP DATABASE
Creating empty test6_admindb
CREATE DATABASE
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
Initialising test6_admindb
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "replica_pkey" for table "replica"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "replica_replica_id_key" for table "replica"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "replica_replica_name_key" for table "replica"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "replicafileinfo_pkey" for table "replicafileinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "file_pkey" for table "file"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "segment_pkey" for table "segment"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
Destroying test6_harvestdb
DROP DATABASE
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
CREATE DATABASE
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "domains_pkey" for table "domains"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "domains_name_key" for table "domains"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "configurations_pkey" for table "configurations"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "config_passwords_pkey" for table "config_passwords"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "config_seedlists_pkey" for table "config_seedlists"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "seedlists_pkey" for table "seedlists"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "passwords_pkey" for table "passwords"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "ownerinfo_pkey" for table "ownerinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "historyinfo_pkey" for table "historyinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvestdefinitions_pkey" for table "harvestdefinitions"
CREATE TABLE
NOTICE: CREATE TABLE / UNIQUE will create implicit index "harvestdefinitions_name_key" for table "harvestdefinitions"
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "fullharvests_pkey" for table "fullharvests"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "partialharvests_pkey" for table "partialharvests"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvest_configs_pkey" for table "harvest_configs"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "schedules_pkey" for table "schedules"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "schedules_name_key" for table "schedules"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "ordertemplates_pkey" for table "ordertemplates"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "ordertemplates_name_key" for table "ordertemplates"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "jobs_pkey" for table "jobs"
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "job_configs_pkey" for table "job_configs"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "global_crawler_trap_lists_pkey" for table "global_crawler_trap_lists"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "global_crawler_trap_lists_name_key" for table "global_crawler_trap_lists"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "global_crawler_trap_expressions_pkey" for table "global_crawler_trap_expressions"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "pkrunningjobshistory" for table "runningjobshistory"
CREATE TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "pkrunningjobsmonitor" for table "runningjobsmonitor"
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / UNIQUE will create implicit index "pkfrontierreportlines" for table "frontierreportmonitor"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfieldtype_pkey" for table "extendedfieldtype"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfield_pkey" for table "extendedfield"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfieldvalue_pkey" for table "extendedfieldvalue"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
INSERT 0 1
INSERT 0 1
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvestchannel_pkey" for table "harvestchannel"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "harvestchannel_name_key" for table "harvestchannel"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE TABLE
NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index "eav_type_attribute_pkey" for table "eav_type_attribute"
ALTER TABLE
CREATE INDEX
CREATE SEQUENCE
CREATE TABLE
NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index "eav_attribute_pkey" for table "eav_attribute"
ALTER TABLE
CREATE INDEX
GRANT
GRANT
GRANT
INSERT 0 1
INSERT 0 1
INSERT 0 1
SET
SET
SET
SET
SET
SET
SET
SET
SET
setval
--------
17
(1 row)
setval
--------
17
(1 row)
setval
--------
17
(1 row)
setval
--------
5
(1 row)
setval
--------
4
(1 row)
setval
--------
17
(1 row)
12:59:44.303 [MLog-Init-Reporter] INFO com.mchange.v2.log.MLog - MLog clients using slf4j logging.
12:59:44.323 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - Reading VM config for path list /com/mchange/v2/log/default-mchange-log.properties, /mchange-commons.properties, /c3p0.properties, hocon:/reference,/application,/c3p0,/, /mchange-log.properties, /
12:59:44.323 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
12:59:44.323 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
12:59:44.324 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
12:59:44.324 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
12:59:44.332 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
12:59:44.334 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
12:59:44.334 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
12:59:44.334 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
12:59:44.598 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.5.4 [built 23-March-2019 23:00:48 -0700; debug? true; trace: 10]
12:59:44.693 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52alo4oe1pscm7nv|1416310,name=10bdx52alo4oe1pscm7nv|1416310 registered.
12:59:44.773 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52alo4oe1pscm7nv|1416310,name=10bdx52alo4oe1pscm7nv|1416310 unregistered, in order to be reregistered after update.
12:59:44.773 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52alo4oe1pscm7nv|1416310,name=10bdx52alo4oe1pscm7nv|1416310 registered.
12:59:44.808 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
12:59:44.901 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, dataSourceName -> 10bdx52alo4oe1pscm7nv|1416310, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, extensions -> {}, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, forceUseNamedDriverClass -> false, identityToken -> 10bdx52alo4oe1pscm7nv|1416310, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost:5432/test6_harvestdb, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 3600, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, preferredTestQuery -> null, privilegeSpawnedThreads -> false, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ]
12:59:44.951 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
12:59:44.952 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
12:59:44.952 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
12:59:44.952 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
12:59:44.953 [main] WARN com.mchange.v2.resourcepool.BasicResourcePool - Bad pool size config, start 3 < min 5. Using 5 as start.
12:59:44.969 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@1f82230 config: [start -> 5; min -> 5; max -> 20; inc -> 5; num_acq_attempts -> 30; acq_attempt_delay -> 1000; check_idle_resources_delay -> 0; max_resource_age -> 3600000; max_idle_time -> 0; excess_max_idle_time -> 0; destroy_unreturned_resc_time -> 0; expiration_enforcement_delay -> 900000; break_on_acquisition_failure -> false; debug_store_checkout_exceptions -> false; force_synchronous_checkins -> false]
12:59:44.969 [main] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPoolManager - Created new pool for auth, username (masked): 'de******'.
12:59:44.970 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - acquire test -- pool size: 0; target_pool_size: 5; desired target? 1
12:59:44.970 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - awaitAvailable(): [unknown]
12:59:45.345 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@1301423 [wrapping: SELECT version FROM schemaversions WHERE tablename = 'ordertemplates'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@9d0b9d [wrapping: null]
12:59:45.359 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@b0404f [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@19c5f1a [wrapping: null]
12:59:45.383 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@fa0f47 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@1677d1 [wrapping: null]
The template 'default_orderxml' has now been updated.
+ set +x
--------------------------------------------
STARTING MACHINE: devel@kb-test-adm-001.kb.dk
Starting all applications on: kb-test-adm-001.kb.dk
Starting linux application: GUIApplication
Starting linux application: ArcRepositoryApplication
Starting linux application: HarvestJobManagerApplication
12:59:47,023 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_ArcRepositoryApplication.xml] at [file:/home/devel/Test6/conf/logback_ArcRepositoryApplication.xml]
12:59:47,514 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:59:47,514 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:59:47,534 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:59:47,561 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:59:47,706 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:59:47,725 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:59:47,807 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@10292125 - No compression will be used
12:59:47,810 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@10292125 - Will use the pattern ./log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:59:47,824 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1301423 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log'.
12:59:47,824 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1301423 - Roll-over at midnight.
12:59:47,840 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1301423 - Setting initial period to Thu Nov 25 12:59:47 CET 2021
12:59:47,840 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1301423 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:59:47,840 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1301423 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:59:47,848 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:59:47,860 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ArcRepositoryApplication.log
12:59:47,860 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ArcRepositoryApplication.log]
12:59:47,861 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:59:48,942 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:59:48,947 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:59:48,947 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:59:48,948 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:59:48,948 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:59:48,956 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:59:48,956 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:59:48,957 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@1112965 - Registering current configuration as safe fallback point
2021-11-25 12:59:48.974 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2021-11-25 12:59:48.994 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_20
2021-11-25 12:59:49.003 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_20
java.home: /usr/java/jdk1.8.0_20/jre
2021-11-25 12:59:49.004 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/java/jdk1.8.0_20/jre
Working dir: /home/devel/Test6
2021-11-25 12:59:49.004 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2021-11-25 12:59:49.005 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_ArcRepositoryApplication.xml'
2021-11-25 12:59:49.315 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8171/8271
2021-11-25 12:59:49.316 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8171 communicating on port 8271 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8271/jndi/rmi://kb-test-adm-001.kb.dk:8171/jmxrmi
dk.netarkivet.archive.arcrepository.ArcRepository Running
2021-11-25 12:59:49.321 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.archive.arcrepository.ArcRepository Running
2021-11-25 12:59:49.360 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 12:59:49.360 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 12:59:49.361 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-11-25 12:59:49.808 INFO d.n.a.a.ArchiveDBConnection.initDataSource - Using jdbc url: jdbc:postgresql://localhost:5432/test6_admindb
2021-11-25 12:59:49.810 INFO d.n.a.a.ArchiveDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=10
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=30
- idleConnTestQuery='SELECT COUNT(*) FROM replica'
- idleConnTestOnCheckin=false
2021-11-25 12:59:49.874 WARN c.m.v.resourcepool.BasicResourcePool.log - Bad pool size config, start 3 < min 5. Using 5 as start.
2021-11-25 12:59:50.079 DEBUG d.n.a.a.ReplicaCacheDatabase.initialiseDB - IDs for replicas already in the database:
2021-11-25 12:59:50.080 INFO d.n.a.a.ReplicaCacheDatabase.initialiseDB - Inserting replica 'BITARCHIVEReplica (SB) SBN' in database.
2021-11-25 12:59:50.081 DEBUG d.n.a.a.ReplicaCacheHelpers.insertReplicaIntoDB - Executing insert, conditional on SB not already existing in the database.
2021-11-25 12:59:50.088 DEBUG d.n.a.a.ReplicaCacheHelpers.insertReplicaIntoDB - Insert statement for SB returned 1
2021-11-25 12:59:50.090 INFO d.n.a.a.ReplicaCacheDatabase.initialiseDB - Inserting replica 'BITARCHIVEReplica (KB) KBN' in database.
2021-11-25 12:59:50.090 DEBUG d.n.a.a.ReplicaCacheHelpers.insertReplicaIntoDB - Executing insert, conditional on KB not already existing in the database.
2021-11-25 12:59:50.092 DEBUG d.n.a.a.ReplicaCacheHelpers.insertReplicaIntoDB - Insert statement for KB returned 1
2021-11-25 12:59:50.096 INFO d.n.a.a.ReplicaCacheDatabase.<init> - Initialization of database successful
2021-11-25 12:59:50.111 INFO d.n.a.a.d.ArcRepositoryServer.<init> - Listening for arc repository messages on channel '[Queue 'Test6_COMMON_THE_REPOS']'
2021-11-25 12:59:50.112 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.ArcRepositoryServer@1883b97 as listener to Test6_COMMON_THE_REPOS
2021-11-25 12:59:50.126 INFO d.n.a.arcrepository.ArcRepository.<init> - Starting the ArcRepository
12:59:46,655 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_GUIApplication.xml] at [file:/home/devel/Test6/conf/logback_GUIApplication.xml]
12:59:47,215 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:59:47,222 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:59:47,237 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:59:47,283 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:59:47,380 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:59:47,386 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:59:47,423 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@3333740 - No compression will be used
12:59:47,425 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@3333740 - Will use the pattern ./log/GUIApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:59:47,428 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@92d9cc - The date pattern is 'yyyy-MM-dd' from file name pattern './log/GUIApplication.%d{yyyy-MM-dd}.%i.log'.
12:59:47,428 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@92d9cc - Roll-over at midnight.
12:59:47,439 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@92d9cc - Setting initial period to Thu Nov 25 12:59:47 CET 2021
12:59:47,439 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@92d9cc - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:59:47,439 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@92d9cc - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:59:47,443 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:59:47,450 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/GUIApplication.log
12:59:47,450 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/GUIApplication.log]
12:59:47,451 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:59:48,359 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:59:48,365 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:59:48,365 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:59:48,365 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:59:48,365 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:59:48,366 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:59:48,366 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:59:48,367 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@1f32542 - Registering current configuration as safe fallback point
2021-11-25 12:59:48.389 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2021-11-25 12:59:48.415 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_20
2021-11-25 12:59:48.415 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_20
java.home: /usr/java/jdk1.8.0_20/jre
2021-11-25 12:59:48.415 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/java/jdk1.8.0_20/jre
Working dir: /home/devel/Test6
2021-11-25 12:59:48.425 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2021-11-25 12:59:48.426 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_GUIApplication.xml'
2021-11-25 12:59:48.718 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8170/8270
2021-11-25 12:59:48.719 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8270/jndi/rmi://kb-test-adm-001.kb.dk:8170/jmxrmi
dk.netarkivet.common.webinterface.GUIWebServer Running
2021-11-25 12:59:48.720 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.common.webinterface.GUIWebServer Running
2021-11-25 12:59:48.720 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war
2021-11-25 12:59:48.720 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection
2021-11-25 12:59:48.721 INFO d.n.common.webinterface.GUIWebServer.<init> - Starting webserver. Port: 8078 deployment directories: 'webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war' classes: 'dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection'
2021-11-25 12:59:48.753 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 12:59:48.753 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 12:59:48.754 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-11-25 12:59:48.755 DEBUG d.n.common.webinterface.GUIWebServer.<init> - GUI using tempdir /home/devel/Test6/tmpdircommon
2021-11-25 12:59:48.755 DEBUG d.n.common.webinterface.GUIWebServer.<init> - GUI using basedir /home/devel/Test6
2021-11-25 12:59:48.777 INFO d.n.common.webinterface.GUIWebServer.<init> - Deleted existing tempdir '/home/devel/Test6/tmpdircommon'
2021-11-25 12:59:48.933 INFO d.n.common.webinterface.GUIWebServer.<init> - Scanning for taglibs is disabled as tomcat.util.scan.StandardJarScanFilter.jarsToSkip is unset.
2021-11-25 12:59:49.731 WARN o.a.hadoop.util.NativeCodeLoader.<clinit> - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2021-11-25 12:59:50.191 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection
2021-11-25 12:59:50.194 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading 5 site section(s).
2021-11-25 12:59:50.195 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.harvester.webinterface.DefinitionsSiteSection.
2021-11-25 12:59:50.196 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.harvester.webinterface.HistorySiteSection.
2021-11-25 12:59:50.197 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection.
2021-11-25 12:59:50.198 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.viewerproxy.webinterface.QASiteSection.
2021-11-25 12:59:50.199 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.monitor.webinterface.StatusSiteSection.
2021-11-25 12:59:50.403 INFO d.n.h.datamodel.HarvestDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
2021-11-25 12:59:50.479 WARN c.m.v.resourcepool.BasicResourcePool.log - Bad pool size config, start 3 < min 5. Using 5 as start.
12:59:46,522 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestJobManagerApplication.xml] at [file:/home/devel/Test6/conf/logback_HarvestJobManagerApplication.xml]
12:59:46,712 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:59:46,713 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:59:46,738 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:59:46,764 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:59:46,883 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:59:46,893 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:59:46,940 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@27086697 - No compression will be used
12:59:46,943 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@27086697 - Will use the pattern ./log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:59:46,948 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1c43f4e - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log'.
12:59:46,948 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1c43f4e - Roll-over at midnight.
12:59:46,954 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1c43f4e - Setting initial period to Thu Nov 25 12:59:46 CET 2021
12:59:46,954 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1c43f4e - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:59:46,954 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1c43f4e - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:59:46,958 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:59:46,963 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestJobManagerApplication.log
12:59:46,963 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestJobManagerApplication.log]
12:59:46,966 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:59:47,836 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:59:47,838 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:59:47,839 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:59:47,839 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:59:47,839 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:59:47,840 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:59:47,840 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:59:47,843 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@10dbf45 - Registering current configuration as safe fallback point
2021-11-25 12:59:47.848 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
2021-11-25 12:59:47.880 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 12:59:47.891 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 12:59:47.891 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-11-25 12:59:48.413 INFO d.n.h.datamodel.HarvestDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
2021-11-25 12:59:48.552 WARN c.m.v.resourcepool.BasicResourcePool.log - Bad pool size config, start 3 < min 5. Using 5 as start.
2021-11-25 12:59:48.996 INFO d.n.h.scheduler.JobDispatcher.<init> - Creating JobDispatcher
Starting dk.netarkivet.harvester.scheduler.HarvestJobManager
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2021-11-25 12:59:49.095 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.scheduler.HarvestJobManager
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2021-11-25 12:59:49.101 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestJobManagerApplication.xml'
2021-11-25 12:59:49.324 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 9174/9274
2021-11-25 12:59:49.325 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 9174 communicating on port 9274 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:9274/jndi/rmi://kb-test-adm-001.kb.dk:9174/jmxrmi
2021-11-25 12:59:49.325 DEBUG d.n.c.lifecycle.LifeCycleComponent.start - Starting dk.netarkivet.harvester.scheduler.HarvestJobManager@83dc97
2021-11-25 12:59:49.327 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver@15ef5 as listener to Test6_COMMON_HARVESTER_STATUS_TOPIC
2021-11-25 12:59:49.367 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver@15ef5 as listener to Test6_COMMON_HCHAN_VAL_REQ
2021-11-25 12:59:49.378 INFO d.n.h.s.HarvesterStatusReceiver.start - limitSubmittedJobsInQueue: true
2021-11-25 12:59:49.379 INFO d.n.h.s.HarvesterStatusReceiver.start - submittedJobsInQueueThreshold: 1
2021-11-25 12:59:49.408 INFO d.n.h.scheduler.HarvestJobGenerator.start - JobGeneratorTask set to run every 60 seconds
2021-11-25 12:59:49.408 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.scheduler.HarvestSchedulerMonitorServer@16d585c as listener to Test6_COMMON_THE_SCHED
dk.netarkivet.harvester.scheduler.HarvestJobManager Running
2021-11-25 12:59:49.420 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.scheduler.HarvestJobManager Running
2021-11-25 12:59:49.423 INFO d.n.h.scheduler.JobSupervisor.rescheduleLeftOverJobs - 0 jobs has been resubmitted.
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-003.kb.dk
Starting all applications on: kb-test-har-003.kb.dk
Starting linux application: HarvestControllerApplication_kblow001_h3
12:59:51,968 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml]
12:59:52,245 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:59:52,248 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:59:52,255 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:59:52,266 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:59:52,314 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:59:52,320 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:59:52,345 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1107024580 - No compression will be used
12:59:52,347 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1107024580 - Will use the pattern ./log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log for the active file
12:59:52,350 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log'.
12:59:52,350 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - Roll-over at midnight.
12:59:52,355 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - Setting initial period to Thu Nov 25 12:59:52 CET 2021
12:59:52,355 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:59:52,355 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:59:52,357 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:59:52,360 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow001_h3.log
12:59:52,360 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow001_h3.log]
12:59:52,361 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:59:53,043 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:59:53,048 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:59:53,048 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:59:53,049 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:59:53,049 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:59:53,050 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:59:53,050 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:59:53,052 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@35ef1869 - Registering current configuration as safe fallback point
2021-11-25 12:59:53.063 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2021-11-25 12:59:53.077 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_312
2021-11-25 12:59:53.078 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2021-11-25 12:59:53.079 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2021-11-25 12:59:53.080 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2021-11-25 12:59:53.088 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow001_h3.xml'
2021-11-25 12:59:53.334 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-003.kb.dk' and JMX/RMI ports 8170/8270
2021-11-25 12:59:53.335 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-003.kb.dk:8270/jndi/rmi://kb-test-har-003.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-11-25 12:59:53.346 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-11-25 12:59:53.354 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 12:59:53.355 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 12:59:53.356 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-11-25 12:59:53.363 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-11-25 12:59:53.364 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2021-11-25 12:59:53.364 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2021-11-25 12:59:53.365 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-11-25 12:59:53.527 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-003.kb.dk
2021-11-25 12:59:55.286 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2021-11-25 12:59:55.286 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@76f7d241 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3
2021-11-25 12:59:55.295 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3']'
2021-11-25 12:59:55.296 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2021-11-25 12:59:55.296 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2021-11-25 12:59:55.300 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2021-11-25 12:59:55.310 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2021-11-25 12:59:55.381 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2021-11-25 12:59:55.419 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2021-11-25 12:59:55.420 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2021-11-25 12:59:55.420 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_low'
2021-11-25 12:59:55.421 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@25ddbbbb as listener to Test6_COMMON_HCHAN_VAL_RESP
2021-11-25 12:59:55.441 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'LOWPRIORITY'
2021-11-25 12:59:55.479 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'LOWPRIORITY' is valid.
2021-11-25 12:59:55.481 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY']'
2021-11-25 12:59:55.481 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@25ddbbbb as listener to Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-005.kb.dk
Starting all applications on: kb-test-har-005.kb.dk
Starting linux application: HarvestControllerApplication_browser_1
Starting linux application: HarvestControllerApplication_browser_2
12:59:57,666 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml]
12:59:58,170 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:59:58,173 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:59:58,181 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:59:58,203 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:59:58,304 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:59:58,321 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:59:58,371 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1107024580 - No compression will be used
12:59:58,374 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1107024580 - Will use the pattern ./log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log for the active file
12:59:58,381 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log'.
12:59:58,381 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - Roll-over at midnight.
12:59:58,393 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - Setting initial period to Thu Nov 25 12:59:58 CET 2021
12:59:58,394 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:59:58,394 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:59:58,399 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:59:58,404 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_1.log
12:59:58,404 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_1.log]
12:59:58,405 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:59:59,381 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:59:59,383 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:59:59,383 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:59:59,384 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:59:59,384 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:59:59,384 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:59:59,384 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:59:59,385 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@35ef1869 - Registering current configuration as safe fallback point
2021-11-25 12:59:59.390 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2021-11-25 12:59:59.396 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_312
2021-11-25 12:59:59.396 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2021-11-25 12:59:59.397 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2021-11-25 12:59:59.397 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2021-11-25 12:59:59.397 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_1.xml'
2021-11-25 12:59:59.691 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8170/8270
2021-11-25 12:59:59.692 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8270/jndi/rmi://kb-test-har-005.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-11-25 12:59:59.711 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 12:59:59.713 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-11-25 12:59:59.722 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 12:59:59.723 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-11-25 12:59:59.744 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-11-25 12:59:59.745 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'BROWSER'
2021-11-25 12:59:59.745 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_browser_1'
2021-11-25 12:59:59.746 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-11-25 12:59:59.904 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk
12:59:57,665 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml]
12:59:58,173 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:59:58,176 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:59:58,183 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:59:58,203 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:59:58,305 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:59:58,321 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:59:58,375 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1107024580 - No compression will be used
12:59:58,378 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1107024580 - Will use the pattern ./log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log for the active file
12:59:58,383 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log'.
12:59:58,383 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - Roll-over at midnight.
12:59:58,394 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - Setting initial period to Thu Nov 25 12:59:58 CET 2021
12:59:58,394 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:59:58,394 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:59:58,397 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:59:58,411 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_2.log
12:59:58,411 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_2.log]
12:59:58,413 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:59:59,333 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:59:59,342 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:59:59,342 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:59:59,343 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:59:59,343 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:59:59,343 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:59:59,343 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:59:59,344 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@35ef1869 - Registering current configuration as safe fallback point
2021-11-25 12:59:59.357 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2021-11-25 12:59:59.398 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_312
2021-11-25 12:59:59.399 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2021-11-25 12:59:59.399 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2021-11-25 12:59:59.399 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2021-11-25 12:59:59.403 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_2.xml'
2021-11-25 12:59:59.634 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8175/8275
2021-11-25 12:59:59.634 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8175 communicating on port 8275 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8275/jndi/rmi://kb-test-har-005.kb.dk:8175/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-11-25 12:59:59.640 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-11-25 12:59:59.658 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-11-25 12:59:59.659 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'BROWSER'
2021-11-25 12:59:59.659 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_browser_2'
2021-11-25 12:59:59.660 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-11-25 12:59:59.669 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 12:59:59.670 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 12:59:59.671 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-11-25 12:59:59.886 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-004.kb.dk
Starting all applications on: kb-test-har-004.kb.dk
Starting linux application: HarvestControllerApplication_kblow002_h3
Starting linux application: HarvestControllerApplication_kbhigh_h3
13:00:02,938 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml]
13:00:03,341 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:00:03,357 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:00:03,377 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:00:03,405 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:00:03,485 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:00:03,489 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:00:03,535 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1259652483 - No compression will be used
13:00:03,536 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1259652483 - Will use the pattern ./log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
13:00:03,539 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
13:00:03,539 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - Roll-over at midnight.
13:00:03,545 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - Setting initial period to Thu Nov 25 13:00:03 CET 2021
13:00:03,546 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:00:03,546 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:00:03,548 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:00:03,554 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbhigh_h3.log
13:00:03,554 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbhigh_h3.log]
13:00:03,555 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:00:04,111 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:00:04,116 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:00:04,116 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:00:04,117 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:00:04,117 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:00:04,125 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:00:04,125 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:00:04,126 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4ddced80 - Registering current configuration as safe fallback point
2021-11-25 13:00:04.130 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2021-11-25 13:00:04.145 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_25
2021-11-25 13:00:04.146 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2021-11-25 13:00:04.146 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2021-11-25 13:00:04.147 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2021-11-25 13:00:04.147 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kbhigh_h3.xml'
2021-11-25 13:00:04.369 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8172/8272
2021-11-25 13:00:04.370 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8172 communicating on port 8272 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8272/jndi/rmi://kb-test-har-004.kb.dk:8172/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-11-25 13:00:04.393 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-11-25 13:00:04.423 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 13:00:04.447 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 13:00:04.448 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-11-25 13:00:04.471 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-11-25 13:00:04.472 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2021-11-25 13:00:04.473 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2021-11-25 13:00:04.485 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-11-25 13:00:04.715 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
13:00:02,937 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml]
13:00:03,342 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:00:03,357 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:00:03,372 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:00:03,397 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:00:03,481 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:00:03,485 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:00:03,524 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1259652483 - No compression will be used
13:00:03,526 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1259652483 - Will use the pattern ./log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log for the active file
13:00:03,528 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log'.
13:00:03,528 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - Roll-over at midnight.
13:00:03,534 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - Setting initial period to Thu Nov 25 13:00:03 CET 2021
13:00:03,534 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:00:03,534 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:00:03,536 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:00:03,541 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow002_h3.log
13:00:03,541 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow002_h3.log]
13:00:03,541 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:00:04,120 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:00:04,130 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:00:04,130 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:00:04,130 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:00:04,130 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:00:04,131 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:00:04,131 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:00:04,132 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4ddced80 - Registering current configuration as safe fallback point
2021-11-25 13:00:04.142 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2021-11-25 13:00:04.156 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_25
2021-11-25 13:00:04.157 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2021-11-25 13:00:04.157 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2021-11-25 13:00:04.158 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2021-11-25 13:00:04.158 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow002_h3.xml'
2021-11-25 13:00:04.389 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8170/8270
2021-11-25 13:00:04.390 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8270/jndi/rmi://kb-test-har-004.kb.dk:8170/jmxrmi
2021-11-25 13:00:04.403 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 13:00:04.403 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-11-25 13:00:04.408 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-11-25 13:00:04.412 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-11-25 13:00:04.433 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-11-25 13:00:04.434 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2021-11-25 13:00:04.434 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2021-11-25 13:00:04.435 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-11-25 13:00:04.693 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
--------------------------------------------
STARTING MACHINE: devel@kb-test-acs-001.kb.dk
Starting all applications on: kb-test-acs-001.kb.dk
Starting linux application: IndexServerApplication
Starting linux application: ViewerProxyApplication
13:00:09,486 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_IndexServerApplication.xml] at [file:/home/devel/Test6/conf/logback_IndexServerApplication.xml]
13:00:09,880 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:00:09,882 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:00:09,895 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:00:09,924 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:00:10,033 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:00:10,056 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:00:10,141 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1052245076 - No compression will be used
13:00:10,144 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1052245076 - Will use the pattern ./log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log for the active file
13:00:10,150 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log'.
13:00:10,150 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - Roll-over at midnight.
13:00:10,163 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - Setting initial period to Thu Nov 25 13:00:10 CET 2021
13:00:10,163 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:00:10,163 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:00:10,170 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:00:10,176 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/IndexServerApplication.log
13:00:10,176 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/IndexServerApplication.log]
13:00:10,178 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:00:11,018 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:00:11,020 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:00:11,020 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:00:11,020 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:00:11,020 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:00:11,021 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:00:11,021 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:00:11,022 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3c22fc4c - Registering current configuration as safe fallback point
2021-11-25 13:00:11.060 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2021-11-25 13:00:11.074 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_312
2021-11-25 13:00:11.074 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2021-11-25 13:00:11.075 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2021-11-25 13:00:11.075 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2021-11-25 13:00:11.075 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_IndexServerApplication.xml'
2021-11-25 13:00:11.329 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8371/8471
2021-11-25 13:00:11.330 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8371 communicating on port 8471 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8471/jndi/rmi://kb-test-acs-001.kb.dk:8371/jmxrmi
2021-11-25 13:00:11.341 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 13:00:11.342 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 13:00:11.343 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
dk.netarkivet.harvester.indexserver.IndexServer Running
2021-11-25 13:00:11.345 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.indexserver.IndexServer Running
2021-11-25 13:00:11.362 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata'
2021-11-25 13:00:11.424 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
13:00:09,486 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_ViewerProxyApplication.xml] at [file:/home/devel/Test6/conf/logback_ViewerProxyApplication.xml]
13:00:09,871 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:00:09,872 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:00:09,880 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:00:09,909 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:00:10,034 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:00:10,063 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:00:10,142 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1052245076 - No compression will be used
13:00:10,145 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1052245076 - Will use the pattern ./log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log for the active file
13:00:10,151 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log'.
13:00:10,151 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - Roll-over at midnight.
13:00:10,163 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - Setting initial period to Thu Nov 25 13:00:10 CET 2021
13:00:10,163 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:00:10,163 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:00:10,167 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:00:10,175 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ViewerProxyApplication.log
13:00:10,175 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ViewerProxyApplication.log]
13:00:10,177 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:00:11,097 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:00:11,101 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:00:11,101 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:00:11,102 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:00:11,102 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:00:11,103 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:00:11,103 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:00:11,105 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3c22fc4c - Registering current configuration as safe fallback point
2021-11-25 13:00:11.115 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2021-11-25 13:00:11.121 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_312
2021-11-25 13:00:11.122 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2021-11-25 13:00:11.122 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2021-11-25 13:00:11.122 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2021-11-25 13:00:11.122 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_ViewerProxyApplication.xml'
2021-11-25 13:00:11.328 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8370/8470
2021-11-25 13:00:11.329 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8370 communicating on port 8470 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8470/jndi/rmi://kb-test-acs-001.kb.dk:8370/jmxrmi
dk.netarkivet.viewerproxy.ViewerProxy Running
2021-11-25 13:00:11.337 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.viewerproxy.ViewerProxy Running
2021-11-25 13:00:11.352 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 13:00:11.353 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 13:00:11.353 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-11-25 13:00:11.394 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
--------------------------------------------
STARTING MACHINE: devel@kb-test-way-001.kb.dk
Starting all applications on: kb-test-way-001.kb.dk
Starting linux application: WaybackIndexerApplication
Starting linux application: AggregatorApplication
--------------------------------------------
--------------------------------------------
STARTING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
Starting all applications on: sb-test-har-001.statsbiblioteket.dk
Starting linux application: HarvestControllerApplication_sbhigh_h3
13:00:19,419 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] at [file:/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml]
13:00:19,577 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:00:19,580 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:00:19,586 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:00:19,598 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:00:19,631 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:00:19,636 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:00:19,651 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@517052730 - No compression will be used
13:00:19,652 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@517052730 - Will use the pattern ./log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
13:00:19,654 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f3f4916 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
13:00:19,654 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f3f4916 - Roll-over at midnight.
13:00:19,659 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f3f4916 - Setting initial period to Thu Nov 25 13:00:19 CET 2021
13:00:19,659 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f3f4916 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:00:19,659 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f3f4916 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:00:19,662 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:00:19,664 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_sbhigh_h3.log
13:00:19,664 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_sbhigh_h3.log]
13:00:19,744 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:00:20,075 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:00:20,077 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:00:20,077 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:00:20,078 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:00:20,078 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:00:20,078 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:00:20,078 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:00:20,079 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@794cb805 - Registering current configuration as safe fallback point
2021-11-25 13:00:20.085 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2021-11-25 13:00:20.094 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_232
2021-11-25 13:00:20.095 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_232
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
2021-11-25 13:00:20.096 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
Working dir: /home/netarkdv/Test6
2021-11-25 13:00:20.096 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/netarkdv/Test6
2021-11-25 13:00:20.101 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/netarkdv/Test6/conf/settings_HarvestControllerApplication_sbhigh_h3.xml'
2021-11-25 13:00:20.310 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'sb-test-har-001.statsbiblioteket.dk' and JMX/RMI ports 8170/8270
2021-11-25 13:00:20.311 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://sb-test-har-001.statsbiblioteket.dk:8270/jndi/rmi://sb-test-har-001.statsbiblioteket.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-11-25 13:00:20.316 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-11-25 13:00:20.324 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-11-25 13:00:20.324 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2021-11-25 13:00:20.334 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 13:00:20.334 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-11-25 13:00:20.334 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-11-25 13:00:20.338 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2021-11-25 13:00:20.339 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-11-25 13:00:20.585 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): sb-test-har-001.statsbiblioteket.dk
2021-11-25 13:00:21.968 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2021-11-25 13:00:21.970 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@37b70343 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3
2021-11-25 13:00:22.046 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3']'
2021-11-25 13:00:22.052 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/netarkdv/extra_configs/bitmag_config
2021-11-25 13:00:22.052 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2021-11-25 13:00:22.061 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2021-11-25 13:00:22.068 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2021-11-25 13:00:22.139 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2021-11-25 13:00:22.161 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2021-11-25 13:00:22.163 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2021-11-25 13:00:22.164 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_high'
2021-11-25 13:00:22.166 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@2cac4385 as listener to Test6_COMMON_HCHAN_VAL_RESP
2021-11-25 13:00:22.256 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'HIGHPRIORITY'
2021-11-25 13:00:22.286 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'HIGHPRIORITY' is valid.
2021-11-25 13:00:22.290 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY']'
2021-11-25 13:00:22.291 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@2cac4385 as listener to Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY
--------------------------------------------
Completed the script all_test.sh
Finished: SUCCESS
Console Output
Help us localize this page