YGBgqihikoFqS8/OK83NS9ZwhNEghAwQwghQWAACwxA+XYgAAAA==[0m[WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/CombiningMultiFileBasedCacheTester.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/CombiningMultiFileBasedCacheTester.java uses unchecked or unsafe operations.
[WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/CombiningMultiFileBasedCacheTester.java: Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvester-test ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvester-test ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvester-test ---
[WARNING] JAR will be empty - no content was marked for inclusion!
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/target/harvester-test-7.4-SNAPSHOT.jar
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvester-test ---
[INFO] No sources in project. Archive not created.
[JENKINS] Archiving disabled
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building NetarchiveSuite - monitor - test 7.4-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ monitor-test ---
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ monitor-test ---
[INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/../target/jacoco.exec,append=true
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ monitor-test ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ monitor-test ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ monitor-test ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 8 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ monitor-test ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 4 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/target/test-classes
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ monitor-test ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ monitor-test ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ monitor-test ---
[WARNING] JAR will be empty - no content was marked for inclusion!
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/target/monitor-test-7.4-SNAPSHOT.jar
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ monitor-test ---
[INFO] No sources in project. Archive not created.
[JENKINS] Archiving disabled
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building NetarchiveSuite - wayback resourceStore 7.4-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback-resourcestore ---
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ wayback-resourcestore ---
[INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/../target/jacoco.exec,append=true
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-resourcestore ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-resourcestore ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 7 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/classes
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-resourcestore ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/src/test/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-resourcestore ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 4 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/test-classes
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-resourcestore ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-resourcestore ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-resourcestore ---
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/wayback-resourcestore-7.4-SNAPSHOT.jar
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-resourcestore ---
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/wayback-resourcestore-7.4-SNAPSHOT-sources.jar
[JENKINS] Archiving disabled
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building NetarchiveSuite - wayback - test 7.4-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback-test ---
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ wayback-test ---
[INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/../target/jacoco.exec,append=true
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-test ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-test ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-test ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 28 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-test ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 17 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/target/test-classes
[WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/test/java/dk/netarkivet/wayback/hadoop/CDXMapperTester.java: Some input files use or override a deprecated API.
[WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/test/java/dk/netarkivet/wayback/hadoop/CDXMapperTester.java: Recompile with -Xlint:deprecation for details.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-test ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-test ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-test ---
[WARNING] JAR will be empty - no content was marked for inclusion!
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/target/wayback-test-7.4-SNAPSHOT.jar
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-test ---
[INFO] No sources in project. Archive not created.
[JENKINS] Archiving disabled
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building NetarchiveSuite - integration tests 7.4-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ integration-test ---
[INFO]
[INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ integration-test ---
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ integration-test ---
[JENKINS] Archiving disabled
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building NetarchiveSuite System test 7.4-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ system-test ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ system-test ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ system-test ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ system-test ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 22 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ system-test ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 34 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/target/test-classes
[WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java uses unchecked or unsafe operations.
[WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java: Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ system-test ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ system-test ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ system-test ---
[WARNING] JAR will be empty - no content was marked for inclusion!
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/target/system-test-7.4-SNAPSHOT.jar
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ system-test ---
[INFO] No sources in project. Archive not created.
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] NetarchiveSuite .................................... SUCCESS [ 1.480 s]
[INFO] NetarchiveSuite - build-tools ...................... SUCCESS [ 1.402 s]
[INFO] NetarchiveSuite - common ........................... SUCCESS [ 0.146 s]
[INFO] NetarchiveSuite - test utils ....................... SUCCESS [ 1.943 s]
[INFO] NetarchiveSuite - common - core .................... SUCCESS [ 7.602 s]
[INFO] NetarchiveSuite - common - test .................... SUCCESS [ 3.892 s]
[INFO] NetarchiveSuite - archive .......................... SUCCESS [ 0.130 s]
[INFO] NetarchiveSuite - archive - core ................... SUCCESS [ 3.536 s]
[INFO] NetarchiveSuite - harvester ........................ SUCCESS [ 0.120 s]
[INFO] NetarchiveSuite - harvester - core ................. SUCCESS [ 4.971 s]
[INFO] NetarchiveSuite - archive - test ................... SUCCESS [ 2.855 s]
[INFO] NetarchiveSuite - bitpreservation - webapp ......... SUCCESS [ 0.844 s]
[INFO] NetarchiveSuite - Harvest Scheduler ................ SUCCESS [ 2.377 s]
[INFO] NetarchiveSuite - monitor .......................... SUCCESS [ 0.134 s]
[INFO] NetarchiveSuite - monitor - core ................... SUCCESS [ 2.142 s]
[INFO] NetarchiveSuite - wayback .......................... SUCCESS [ 0.110 s]
[INFO] NetarchiveSuite - wayback - indexer ................ SUCCESS [ 2.220 s]
[INFO] NetarchiveSuite - deploy ........................... SUCCESS [ 0.137 s]
[INFO] NetarchiveSuite - deploy - core .................... SUCCESS [ 3.078 s]
[INFO] NetarchiveSuite - harvester - heritrix3 ............ SUCCESS [ 0.122 s]
[INFO] NetarchiveSuite - Heritrix3 Extensions ............. SUCCESS [ 3.554 s]
[INFO] NetarchiveSuite - heritrix3 controller ............. SUCCESS [ 2.638 s]
[INFO] hadoop-uber-jar .................................... SUCCESS [ 8.656 s]
[INFO] hadoop-uber-jar-invoker ............................ SUCCESS [ 8.368 s]
[INFO] NetarchiveSuite - Status - Webapp .................. SUCCESS [ 1.017 s]
[INFO] NetarchiveSuite - qa - webapp ...................... SUCCESS [ 0.502 s]
[INFO] NetarchiveSuite - history - webapp ................. SUCCESS [ 1.535 s]
[INFO] NetarchiveSuite - harvestDefinition - webapp ....... SUCCESS [ 1.135 s]
[INFO] NetarchiveSuite - harvestChannel - webapp .......... SUCCESS [ 0.474 s]
[INFO] NetarchiveSuite - heritrix3 monitor ................ SUCCESS [ 19.732 s]
[INFO] NetarchiveSuite - deploy - distribution ............ SUCCESS [ 18.343 s]
[INFO] NetarchiveSuite - deploy - test .................... SUCCESS [ 2.398 s]
[INFO] NetarchiveSuite - Heritrix3 Bundler ................ SUCCESS [ 19.567 s]
[INFO] NetarchiveSuite - harvester - test ................. SUCCESS [ 4.248 s]
[INFO] NetarchiveSuite - monitor - test ................... SUCCESS [ 1.411 s]
[INFO] NetarchiveSuite - wayback resourceStore ............ SUCCESS [ 1.661 s]
[INFO] NetarchiveSuite - wayback - test ................... SUCCESS [ 1.866 s]
[INFO] NetarchiveSuite - integration tests ................ SUCCESS [ 0.153 s]
[INFO] NetarchiveSuite System test ........................ SUCCESS [ 1.892 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:32 min
[INFO] Finished at: 2022-05-03T13:14:09+02:00
[INFO] Final Memory: 137M/329M
[INFO] ------------------------------------------------------------------------
channel stopped
[NetarchiveSuite-Colin-1-Click] $ /bin/bash /tmp/hudson4396511107520375883.sh
Do a total cleanup of system Test6
start tunning cleanup script
end part of script
--------------------------------------------
KILLING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
Killing all applications on: sb-test-har-001.statsbiblioteket.dk
Killing linux application: HarvestControllerApplication_sbhigh_h3
--------------------------------------------
--------------------------------------------
KILLING MACHINE: devel@kb-test-adm-001.kb.dk
Killing all applications on: kb-test-adm-001.kb.dk
Killing linux application: GUIApplication
Killing linux application: ArcRepositoryApplication
Killing linux application: HarvestJobManagerApplication
--------------------------------------------
KILLING MACHINE: devel@kb-test-har-003.kb.dk
Killing all applications on: kb-test-har-003.kb.dk
Killing linux application: HarvestControllerApplication_kblow001_h3
--------------------------------------------
KILLING MACHINE: devel@kb-test-har-005.kb.dk
Killing all applications on: kb-test-har-005.kb.dk
Killing linux application: HarvestControllerApplication_browser_1
Killing linux application: HarvestControllerApplication_browser_2
--------------------------------------------
KILLING MACHINE: devel@kb-test-har-004.kb.dk
Killing all applications on: kb-test-har-004.kb.dk
Killing linux application: HarvestControllerApplication_kblow002_h3
Killing linux application: HarvestControllerApplication_kbhigh_h3
--------------------------------------------
KILLING MACHINE: devel@kb-test-acs-001.kb.dk
Killing all applications on: kb-test-acs-001.kb.dk
Killing linux application: IndexServerApplication
Killing linux application: ViewerProxyApplication
--------------------------------------------
KILLING MACHINE: devel@kb-test-way-001.kb.dk
Killing all applications on: kb-test-way-001.kb.dk
Killing linux application: WaybackIndexerApplication
Killing linux application: AggregatorApplication
--------------------------------------------
running cleanup_bitmag
Resetting Collection Test6
Delete content in collection=Test6
13:15:32.809 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
13:15:33.155 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
13:15:33.194 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
13:15:34.001 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
13:15:34.020 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
13:15:34.021 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
13:15:34.196 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
13:15:34.198 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
13:15:35.087 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
13:15:35.229 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
13:15:35.232 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-26398]
13:15:35.236 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
13:15:35.236 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26398' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
13:15:35.237 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26398' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26398#282265585'.
13:15:35.237 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26398#282265585'.
Checksum: Count: FileID:
13:15:35.284 INFO o.b.a.g.ConversationBasedGetChecksumsClient - Requesting the checksums for file '' with the specifications 'org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@4d0f2471[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)]null' with query [ContributorQuery{componentID='netarkiv-tape-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-disk-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-disk-devel-02, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-checksum-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-kbh-disk-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}].
13:15:35.306 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
13:15:35.928 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent IdentifyPillarsForGetChecksumsRequest(c7342867) collectionID Test6, destination topic://netarkiv-devel: FileIDs=AllFiles
13:15:35.929 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: IDENTIFY_REQUEST_SENT: , Identifying pillars for GetChecksums
13:15:36.302 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(c7342867) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(Checksum operation available.)
13:15:36.305 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01
13:15:36.306 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
13:15:36.306 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01]
13:15:36.585 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(c7342867) collectionID Test6, from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.)
13:15:36.592 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01
13:15:36.592 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
13:15:36.592 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-tape-devel-01, netarkiv-disk-devel-01]
13:15:36.828 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(c7342867) collectionID Test6, from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
13:15:36.836 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01
13:15:36.836 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01
13:15:36.836 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-disk-devel-01]
13:15:37.138 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(c7342867) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
13:15:37.139 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01
13:15:37.140 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01
13:15:37.140 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02]
13:15:45.304 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: IDENTIFY_TIMEOUT: , Time has run out for looking up contributors
The following contributors didn't respond: [netarkiv-disk-devel-02]
13:15:45.305 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: COMPONENT_FAILED: ContributorID netarkiv-disk-devel-02 ResponseCode: null, Timeout for identifying contributor
13:15:45.306 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01]
13:15:45.308 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], Sending GetFileIDsRequest's
13:15:45.730 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(c7342867) collectionID Test6, destination queue://netarkiv-tape-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@4d0f2471[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
13:15:46.127 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(c7342867) collectionID Test6, destination queue://netarkiv-disk-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@4d0f2471[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
13:15:46.604 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(c7342867) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS)
13:15:46.607 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS
13:15:46.654 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(c7342867) collectionID Test6, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@4d0f2471[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
13:15:47.124 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(c7342867) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@689a7f6f[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
13:15:47.131 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01
13:15:47.132 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01]
13:15:47.238 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(c7342867) collectionID Test6, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@4d0f2471[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00
13:15:47.458 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(c7342867) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS)
13:15:47.465 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS
13:15:47.723 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(c7342867) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@39aa9c4b[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
13:15:47.730 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01
13:15:47.731 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-kbh-disk-devel-01]
13:15:47.939 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(c7342867) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS(Starting to calculate checksums.)
13:15:47.946 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-checksum-devel-01, Starting to calculate checksums.
13:15:48.191 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(c7342867) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_COMPLETED, NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@6f59bf3b[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
13:15:48.203 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
13:15:48.203 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-kbh-disk-devel-01]
13:15:48.441 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(c7342867) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(Completed checksum retrieval.), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@6575e598[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
13:15:48.442 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
13:15:48.442 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: []
Deleting file FileID: with checksum Checksum: in collection Test6 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01
13:15:49.775 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
13:15:49.917 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
13:15:50.227 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
13:15:50.254 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
13:15:51.006 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
13:15:51.025 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
13:15:51.025 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
13:15:51.264 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
13:15:51.265 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
13:15:52.246 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
13:15:52.384 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
13:15:52.387 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-26430]
13:15:52.391 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
13:15:52.391 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26430' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
13:15:52.392 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26430' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26430#1297836716'.
13:15:52.392 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26430#1297836716'.
13:15:52.412 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
java.lang.IllegalArgumentException: String hexString, 'Checksum:', must be an even number of characters.
at org.bitrepository.common.ArgumentValidator.checkTrue(ArgumentValidator.java:160)
at org.bitrepository.common.utils.Base16Utils.encodeBase16(Base16Utils.java:64)
at org.bitrepository.commandline.CommandLineClient.getChecksumDataForDeleteValidation(CommandLineClient.java:302)
at org.bitrepository.commandline.DeleteFileCmd.deleteTheFile(DeleteFileCmd.java:125)
at org.bitrepository.commandline.DeleteFileCmd.performOperation(DeleteFileCmd.java:107)
at org.bitrepository.commandline.CommandLineClient.runCommand(CommandLineClient.java:68)
at org.bitrepository.commandline.DeleteFileCmd.main(DeleteFileCmd.java:47)
xargs: ssh: exited with status 255; aborting
calling cleanup_hosts
running cleanup_hosts
Removing installation on sb-test-har-001.statsbiblioteket.dk
Removing installation on kb-test-har-003.kb.dk
Removing installation on kb-test-har-004.kb.dk
Removing installation on kb-test-har-005.kb.dk
Removing installation on kb-test-adm-001.kb.dk
Removing installation on kb-test-acs-001.kb.dk
Removing installation on kb-test-way-001.kb.dk
calling cleanup_linuxbarhosts
running cleanup_linuxbarhosts
Removing installation on sb-test-bar-001.statsbiblioteket.dk
Removing bitarchive on sb-test-bar-001.statsbiblioteket.dk
Calling cleanup_windowsbarhosts
running cleanup_windowsbarhosts
Removing C:\bitarkiv\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing E:\bitarchive_1\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing F:\bitarchive_2\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing g:\bitarchive_3\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing C:\Users\ba-devel\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
TESTX=Test6
PORT=8078
MAILRECEIVERS=csr@kb.dk
VERSION=CSR
DEPLOYCONF=deploy_config_bitmag.xml
H3ZIP=CSR
BITMAGCONF=/home/devel/bitmag_test_config/client_config
Using bundler file /home/devel/nas_versions/bundler/NetarchiveSuite-heritrix3-bundler-CSR.zip
Creating distribution files in /home/devel/prepared_software/Test6.
Will read source files using encoding 'UTF-8' (defaulted)
Branch in settings not found: common.warcRecordService
Branch in settings not found: common.arcrepositoryClient.bitrepository.getFileIDsMaxResults
Branch in settings not found: common.hadoop.kerberos
Branch in settings not found: common.hadoop.username
Branch in settings not found: common.hadoop.mapred.hadoopUberJar
Branch in settings not found: common.hadoop.mapred.inputFilesParentDir
Branch in settings not found: common.hadoop.mapred.cdxJob
Branch in settings not found: common.hadoop.mapred.metadataExtractionJob
Branch in settings not found: common.hadoop.mapred.metadataCDXExtractionJob
Branch in settings not found: common.hadoop.mapred.crawlLogExtractionJob
Branch in settings not found: common.fileResolver.class
Branch in settings not found: common.fileResolver.baseUrl
Branch in settings not found: common.fileResolver.keyfile
Branch in settings not found: common.webinterface.metadata_cache_dir
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Machine 'kb-test-adm-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-har-003.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks
Machine 'kb-test-har-005.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks
Machine 'kb-test-har-004.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
Machine 'kb-test-acs-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-way-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'sb-test-har-001.statsbiblioteket.dk' configured with encoding 'UTF-8' (defaulted)
/home/devel/prepared_software/Test6/NetarchiveSuite-heritrix3-bundler.zip -> /home/netarkdv/Test6/NetarchiveSuite-heritrix3-bundler.zip
13:21:25.954 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
13:21:25.959 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
13:21:25.960 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
13:21:25.960 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
13:21:25.960 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
13:21:25.960 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
13:21:25.961 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
13:21:25.961 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
13:21:25.961 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
13:21:25.961 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
13:21:25.962 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
13:21:25.962 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
13:21:26.025 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
13:21:26.026 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-adm-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-adm-001.kb.dk
deleting devel@kb-test-adm-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-adm-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-003.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-003.kb.dk
deleting devel@kb-test-har-003.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-003.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-005.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-005.kb.dk
deleting devel@kb-test-har-005.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-005.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-004.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-004.kb.dk
deleting devel@kb-test-har-004.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-004.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-acs-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-acs-001.kb.dk
deleting devel@kb-test-acs-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-acs-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-way-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-way-001.kb.dk
deleting devel@kb-test-way-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-way-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
--------------------------------------------
INSTALLING TO MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
copying NetarchiveSuite-CSR.zip to:sb-test-har-001.statsbiblioteket.dk
deleting netarkdv@sb-test-har-001.statsbiblioteket.dk:/home/netarkdv/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:sb-test-har-001.statsbiblioteket.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
Initializing database for system Test6
+ host=devel@kb-test-adm-001
+ scp -p /home/devel/devel-config/scripts/db/setup_admindb.sh /home/devel/devel-config/scripts/db/setup_harvestdb.sh /home/devel/devel-config/scripts/db/teardown_admindb.sh /home/devel/devel-config/scripts/db/teardown_harvestdb.sh /home/devel/devel-config/scripts/../resources/harvestdb.testdata.sql /home/devel/devel-config/scripts/../resources/default_orderxml.cxml devel@kb-test-adm-001:bin/
+ ssh devel@kb-test-adm-001
Pseudo-terminal will not be allocated because stdin is not a terminal.
Dette system må kun tilgås af brugere autoriserede af Det Kgl. Bibliotek.
This system is only to be used by users authorized by
the Royal Danish Library.
Destroying test6_admindb
DROP DATABASE
Creating empty test6_admindb
CREATE DATABASE
Initialising test6_admindb
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
Destroying test6_harvestdb
DROP DATABASE
CREATE DATABASE
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
GRANT
CREATE TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE INDEX
GRANT
CREATE TABLE
GRANT
CREATE TABLE
CREATE INDEX
GRANT
CREATE TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
CREATE TABLE
CREATE INDEX
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
CREATE TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
INSERT 0 1
INSERT 0 1
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE INDEX
CREATE SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
GRANT
INSERT 0 1
INSERT 0 1
INSERT 0 1
SET
SET
SET
SET
SET
SET
SET
SET
SET
COPY 16
COPY 16
setval
--------
17
(1 row)
COPY 16
setval
--------
17
(1 row)
COPY 3
setval
--------
17
(1 row)
COPY 2
setval
--------
5
(1 row)
COPY 4
setval
--------
4
(1 row)
COPY 25
COPY 16
setval
--------
17
(1 row)
13:23:50.614 [MLog-Init-Reporter] INFO com.mchange.v2.log.MLog - MLog clients using slf4j logging.
13:23:50.652 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - Reading VM config for path list /com/mchange/v2/log/default-mchange-log.properties, /mchange-commons.properties, /c3p0.properties, hocon:/reference,/application,/c3p0,/, /mchange-log.properties, /
13:23:50.652 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
13:23:50.652 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
13:23:50.652 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
13:23:50.653 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
13:23:50.667 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
13:23:50.667 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
13:23:50.667 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
13:23:50.668 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
13:23:51.217 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.5.4 [built 23-March-2019 23:00:48 -0700; debug? true; trace: 10]
13:23:51.418 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ao1272id61iltg8p|f4168b8,name=10bdx52ao1272id61iltg8p|f4168b8 registered.
13:23:51.554 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ao1272id61iltg8p|f4168b8,name=10bdx52ao1272id61iltg8p|f4168b8 unregistered, in order to be reregistered after update.
13:23:51.554 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ao1272id61iltg8p|f4168b8,name=10bdx52ao1272id61iltg8p|f4168b8 registered.
13:23:51.618 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
13:23:51.719 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, dataSourceName -> 10bdx52ao1272id61iltg8p|f4168b8, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, extensions -> {}, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, forceUseNamedDriverClass -> false, identityToken -> 10bdx52ao1272id61iltg8p|f4168b8, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost:5432/test6_harvestdb, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 3600, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, preferredTestQuery -> null, privilegeSpawnedThreads -> false, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ]
13:23:51.763 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
13:23:51.764 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
13:23:51.764 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
13:23:51.764 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
13:23:51.765 [main] WARN com.mchange.v2.resourcepool.BasicResourcePool - Bad pool size config, start 3 < min 5. Using 5 as start.
13:23:51.769 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@5be6e01c config: [start -> 5; min -> 5; max -> 20; inc -> 5; num_acq_attempts -> 30; acq_attempt_delay -> 1000; check_idle_resources_delay -> 0; max_resource_age -> 3600000; max_idle_time -> 0; excess_max_idle_time -> 0; destroy_unreturned_resc_time -> 0; expiration_enforcement_delay -> 900000; break_on_acquisition_failure -> false; debug_store_checkout_exceptions -> false; force_synchronous_checkins -> false]
13:23:51.769 [main] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPoolManager - Created new pool for auth, username (masked): 'de******'.
13:23:51.770 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - acquire test -- pool size: 0; target_pool_size: 5; desired target? 1
13:23:51.770 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - awaitAvailable(): [unknown]
13:23:52.173 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@3911c2a7 [wrapping: SELECT version FROM schemaversions WHERE tablename = 'ordertemplates'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@1725dc0f [wrapping: null]
13:23:52.199 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@2145b572 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@15eb5ee5 [wrapping: null]
13:23:52.240 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@35ef1869 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@3c407114 [wrapping: null]
The template 'default_orderxml' has now been updated.
+ set +x
--------------------------------------------
STARTING MACHINE: devel@kb-test-adm-001.kb.dk
Starting all applications on: kb-test-adm-001.kb.dk
Starting linux application: GUIApplication
Starting linux application: ArcRepositoryApplication
Starting linux application: HarvestJobManagerApplication
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-003.kb.dk
Starting all applications on: kb-test-har-003.kb.dk
Starting linux application: HarvestControllerApplication_kblow001_h3
13:24:00,372 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml]
13:24:00,679 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:24:00,683 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:24:00,692 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:24:00,705 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:00,768 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:24:00,775 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:24:00,804 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - No compression will be used
13:24:00,806 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - Will use the pattern ./log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log for the active file
13:24:00,810 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log'.
13:24:00,810 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Roll-over at midnight.
13:24:00,815 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Setting initial period to Tue May 03 13:24:00 CEST 2022
13:24:00,815 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:24:00,815 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:24:00,818 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:00,821 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow001_h3.log
13:24:00,821 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow001_h3.log]
13:24:00,822 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:24:01,395 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:24:01,397 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:24:01,398 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:24:01,398 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:24:01,398 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:24:01,399 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:24:01,399 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:24:01,400 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@40ef3420 - Registering current configuration as safe fallback point
2022-05-03 13:24:01.410 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
2022-05-03 13:24:01.419 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
Java VM: 1.8.0_332
2022-05-03 13:24:01.420 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
2022-05-03 13:24:01.420 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-05-03 13:24:01.420 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-05-03 13:24:01.425 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow001_h3.xml'
2022-05-03 13:24:01.573 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-003.kb.dk' and JMX/RMI ports 8170/8270
2022-05-03 13:24:01.574 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-003.kb.dk:8270/jndi/rmi://kb-test-har-003.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-05-03 13:24:01.580 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-05-03 13:24:01.592 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:01.592 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:01.593 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-05-03 13:24:01.597 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-05-03 13:24:01.598 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2022-05-03 13:24:01.598 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2022-05-03 13:24:01.598 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-05-03 13:24:01.752 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:01.752 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:01.763 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-003.kb.dk
2022-05-03 13:24:03.475 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-05-03 13:24:03.476 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@5c3b6c6e as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3
2022-05-03 13:24:03.491 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3']'
2022-05-03 13:24:03.492 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-05-03 13:24:03.493 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-05-03 13:24:03.503 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-05-03 13:24:03.522 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-05-03 13:24:03.629 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-05-03 13:24:03.655 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-05-03 13:24:03.657 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-05-03 13:24:03.657 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_low'
2022-05-03 13:24:03.658 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7c56e013 as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-05-03 13:24:03.674 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'LOWPRIORITY'
2022-05-03 13:24:03.686 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'LOWPRIORITY' is valid.
2022-05-03 13:24:03.687 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY']'
2022-05-03 13:24:03.688 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7c56e013 as listener to Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-005.kb.dk
Starting all applications on: kb-test-har-005.kb.dk
Starting linux application: HarvestControllerApplication_browser_1
Starting linux application: HarvestControllerApplication_browser_2
13:24:05,859 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml]
13:24:06,333 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:24:06,336 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:24:06,342 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:24:06,368 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:06,462 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:24:06,471 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:24:06,504 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - No compression will be used
13:24:06,505 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - Will use the pattern ./log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log for the active file
13:24:06,507 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log'.
13:24:06,507 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Roll-over at midnight.
13:24:06,511 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Setting initial period to Tue May 03 13:24:06 CEST 2022
13:24:06,511 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:24:06,511 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:24:06,517 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:06,519 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_1.log
13:24:06,519 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_1.log]
13:24:06,520 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:24:07,154 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:24:07,155 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:24:07,155 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:24:07,156 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:24:07,156 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:24:07,156 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:24:07,156 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:24:07,157 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@333291e3 - Registering current configuration as safe fallback point
2022-05-03 13:24:07.191 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
2022-05-03 13:24:07.207 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
Java VM: 1.8.0_312
2022-05-03 13:24:07.208 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2022-05-03 13:24:07.208 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-05-03 13:24:07.208 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-05-03 13:24:07.212 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_1.xml'
2022-05-03 13:24:07.423 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8170/8270
2022-05-03 13:24:07.424 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8270/jndi/rmi://kb-test-har-005.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-05-03 13:24:07.429 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-05-03 13:24:07.437 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-05-03 13:24:07.437 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'BROWSER'
2022-05-03 13:24:07.437 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_browser_1'
2022-05-03 13:24:07.438 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-05-03 13:24:07.465 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:07.465 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:07.466 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-05-03 13:24:07.696 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:07.696 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:07.720 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk
2022-05-03 13:24:10.070 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-05-03 13:24:10.071 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@1ce61929 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1
2022-05-03 13:24:10.096 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1']'
2022-05-03 13:24:10.096 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-05-03 13:24:10.097 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-05-03 13:24:10.101 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-05-03 13:24:10.111 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-05-03 13:24:10.166 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-05-03 13:24:10.207 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-05-03 13:24:10.208 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-05-03 13:24:10.208 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_1'
2022-05-03 13:24:10.208 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@674c583e as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-05-03 13:24:10.235 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'BROWSER'
2022-05-03 13:24:10.241 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'BROWSER' is valid.
2022-05-03 13:24:10.242 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_BROWSER']'
2022-05-03 13:24:10.242 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@674c583e as listener to Test6_COMMON_JOB_PARTIAL_BROWSER
13:24:05,815 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml]
13:24:06,273 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:24:06,276 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:24:06,282 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:24:06,306 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:06,380 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:24:06,384 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:24:06,414 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - No compression will be used
13:24:06,415 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - Will use the pattern ./log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log for the active file
13:24:06,418 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log'.
13:24:06,418 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Roll-over at midnight.
13:24:06,421 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Setting initial period to Tue May 03 13:24:06 CEST 2022
13:24:06,421 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:24:06,421 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:24:06,425 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:06,427 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_2.log
13:24:06,427 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_2.log]
13:24:06,428 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:24:07,280 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:24:07,281 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:24:07,284 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:24:07,284 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:24:07,284 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:24:07,285 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:24:07,285 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:24:07,286 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@333291e3 - Registering current configuration as safe fallback point
2022-05-03 13:24:07.296 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
2022-05-03 13:24:07.302 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
Java VM: 1.8.0_312
2022-05-03 13:24:07.303 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2022-05-03 13:24:07.303 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-05-03 13:24:07.303 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-05-03 13:24:07.303 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_2.xml'
2022-05-03 13:24:07.543 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8175/8275
2022-05-03 13:24:07.543 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8175 communicating on port 8275 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8275/jndi/rmi://kb-test-har-005.kb.dk:8175/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-05-03 13:24:07.548 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-05-03 13:24:07.558 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:07.558 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:07.558 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-05-03 13:24:07.570 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-05-03 13:24:07.570 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'BROWSER'
2022-05-03 13:24:07.571 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_browser_2'
2022-05-03 13:24:07.571 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-05-03 13:24:07.702 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:07.702 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:07.711 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk
2022-05-03 13:24:09.191 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-05-03 13:24:09.192 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@26425897 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2
2022-05-03 13:24:09.236 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2']'
2022-05-03 13:24:09.237 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-05-03 13:24:09.237 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-05-03 13:24:09.241 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-05-03 13:24:09.254 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-05-03 13:24:09.369 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-05-03 13:24:09.434 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-05-03 13:24:09.435 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-05-03 13:24:09.435 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_2'
2022-05-03 13:24:09.436 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-05-03 13:24:09.463 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'BROWSER' is valid.
2022-05-03 13:24:09.465 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_BROWSER']'
2022-05-03 13:24:09.465 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_JOB_PARTIAL_BROWSER
2022-05-03 13:24:09.466 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'BROWSER'
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-004.kb.dk
Starting all applications on: kb-test-har-004.kb.dk
Starting linux application: HarvestControllerApplication_kblow002_h3
Starting linux application: HarvestControllerApplication_kbhigh_h3
13:24:11,682 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml]
13:24:12,159 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:24:12,171 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:24:12,183 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:24:12,205 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:12,259 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:24:12,263 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:24:12,296 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - No compression will be used
13:24:12,298 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - Will use the pattern ./log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
13:24:12,300 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
13:24:12,300 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Roll-over at midnight.
13:24:12,306 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Setting initial period to Tue May 03 13:24:12 CEST 2022
13:24:12,307 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:24:12,307 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:24:12,308 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:12,313 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbhigh_h3.log
13:24:12,313 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbhigh_h3.log]
13:24:12,314 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:24:12,859 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:24:12,863 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:24:12,863 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:24:12,864 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:24:12,864 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:24:12,864 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:24:12,864 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:24:12,866 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2473d930 - Registering current configuration as safe fallback point
2022-05-03 13:24:12.877 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
2022-05-03 13:24:12.895 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
Java VM: 1.8.0_25
2022-05-03 13:24:12.896 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2022-05-03 13:24:12.896 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-05-03 13:24:12.896 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-05-03 13:24:12.897 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kbhigh_h3.xml'
2022-05-03 13:24:13.102 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8172/8272
2022-05-03 13:24:13.102 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8172 communicating on port 8272 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8272/jndi/rmi://kb-test-har-004.kb.dk:8172/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-05-03 13:24:13.122 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-05-03 13:24:13.145 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:13.149 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:13.153 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-05-03 13:24:13.157 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-05-03 13:24:13.157 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2022-05-03 13:24:13.157 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2022-05-03 13:24:13.158 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-05-03 13:24:13.365 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:13.390 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:13.395 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
13:24:11,807 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml]
13:24:12,515 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:24:12,526 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:24:12,556 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:24:12,599 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:12,713 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:24:12,726 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:24:12,808 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - No compression will be used
13:24:12,813 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - Will use the pattern ./log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log for the active file
13:24:12,817 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log'.
13:24:12,817 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Roll-over at midnight.
13:24:12,833 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Setting initial period to Tue May 03 13:24:12 CEST 2022
13:24:12,834 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:24:12,834 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:24:12,839 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:12,854 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow002_h3.log
13:24:12,854 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow002_h3.log]
13:24:12,856 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:24:13,788 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:24:13,795 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:24:13,797 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:24:13,799 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:24:13,799 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:24:13,801 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:24:13,801 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:24:13,806 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2473d930 - Registering current configuration as safe fallback point
2022-05-03 13:24:13.823 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
2022-05-03 13:24:13.848 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
Java VM: 1.8.0_25
2022-05-03 13:24:13.860 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2022-05-03 13:24:13.863 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-05-03 13:24:13.865 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-05-03 13:24:13.867 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow002_h3.xml'
2022-05-03 13:24:14.167 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8170/8270
2022-05-03 13:24:14.168 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8270/jndi/rmi://kb-test-har-004.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-05-03 13:24:14.191 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-05-03 13:24:14.227 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:14.227 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:14.228 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-05-03 13:24:14.259 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-05-03 13:24:14.263 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2022-05-03 13:24:14.265 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2022-05-03 13:24:14.269 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-05-03 13:24:14.600 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:14.623 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:14.645 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
--------------------------------------------
STARTING MACHINE: devel@kb-test-acs-001.kb.dk
Starting all applications on: kb-test-acs-001.kb.dk
Starting linux application: IndexServerApplication
Starting linux application: ViewerProxyApplication
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
13:24:18,337 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_IndexServerApplication.xml] at [file:/home/devel/Test6/conf/logback_IndexServerApplication.xml]
13:24:18,665 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:24:18,671 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:24:18,685 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:24:18,711 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:18,789 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:24:18,794 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:24:18,833 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@29183965 - No compression will be used
13:24:18,835 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@29183965 - Will use the pattern ./log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log for the active file
13:24:18,838 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log'.
13:24:18,838 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - Roll-over at midnight.
13:24:18,842 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - Setting initial period to Tue May 03 13:24:18 CEST 2022
13:24:18,842 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:24:18,842 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:24:18,845 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:18,848 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/IndexServerApplication.log
13:24:18,848 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/IndexServerApplication.log]
13:24:18,849 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:24:19,514 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:24:19,517 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:24:19,517 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:24:19,518 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:24:19,518 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:24:19,518 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:24:19,518 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:24:19,519 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4f83df68 - Registering current configuration as safe fallback point
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2022-05-03 13:24:19.526 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
2022-05-03 13:24:19.533 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
Java VM: 1.8.0_332
2022-05-03 13:24:19.544 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
2022-05-03 13:24:19.545 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-05-03 13:24:19.545 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-05-03 13:24:19.545 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_IndexServerApplication.xml'
2022-05-03 13:24:19.748 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8371/8471
2022-05-03 13:24:19.748 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8371 communicating on port 8471 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8471/jndi/rmi://kb-test-acs-001.kb.dk:8371/jmxrmi
dk.netarkivet.harvester.indexserver.IndexServer Running
2022-05-03 13:24:19.753 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.indexserver.IndexServer Running
2022-05-03 13:24:19.770 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata'
2022-05-03 13:24:19.789 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:19.790 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:19.791 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:19.791 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-05-03 13:24:19.791 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:19.806 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
2022-05-03 13:24:21.536 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-05-03 13:24:21.537 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@4fc5e095 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS
2022-05-03 13:24:21.558 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS']'
2022-05-03 13:24:21.559 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-05-03 13:24:21.560 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-05-03 13:24:21.566 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-05-03 13:24:21.574 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-05-03 13:24:21.623 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found
2022-05-03 13:24:21.625 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found
2022-05-03 13:24:21.661 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2022-05-03 13:24:21.661 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxindex' uses directory '/home/devel/Test6/cache/cdxindex'
2022-05-03 13:24:21.664 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'crawllog' uses directory '/home/devel/Test6/cache/crawllog'
2022-05-03 13:24:21.664 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled
2022-05-03 13:24:21.665 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'dedupcrawllogindex' uses directory '/home/devel/Test6/cache/dedupcrawllogindex'
2022-05-03 13:24:21.665 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata'
2022-05-03 13:24:21.666 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2022-05-03 13:24:21.667 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'crawllog' uses directory '/home/devel/Test6/cache/crawllog'
2022-05-03 13:24:21.667 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled
2022-05-03 13:24:21.668 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'fullcrawllogindex' uses directory '/home/devel/Test6/cache/fullcrawllogindex'
2022-05-03 13:24:21.668 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata'
2022-05-03 13:24:21.669 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2022-05-03 13:24:21.669 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/cdxindex/empty-cache.working
2022-05-03 13:24:21.669 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/cdxindex/empty-cache.working' (thread = main)
2022-05-03 13:24:21.672 DEBUG d.n.common.utils.ProcessUtils.runProcess - Running external program: sort /home/devel/Test6/cache/cdxindex/empty-cache -o /home/devel/Test6/cache/cdxindex/empty-cache.unsorted with environment LANG=C
2022-05-03 13:24:21.684 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@18f20260
2022-05-03 13:24:21.684 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/cdxindex/empty-cache' of id '[]', request was for '[]'
2022-05-03 13:24:21.685 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/dedupcrawllogindex/empty-cache.working
2022-05-03 13:24:21.685 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/dedupcrawllogindex/empty-cache.working' (thread = main)
2022-05-03 13:24:21.685 INFO d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate dedupcrawllogindex for the 0 jobs: []
2022-05-03 13:24:21.685 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main)
2022-05-03 13:24:21.794 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1)
2022-05-03 13:24:21.801 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)!
2022-05-03 13:24:21.802 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1
2022-05-03 13:24:21.803 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1
2022-05-03 13:24:21.808 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes
2022-05-03 13:24:21.809 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@55e7a35c
2022-05-03 13:24:21.809 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/dedupcrawllogindex/empty-cache' of id '[]', request was for '[]'
2022-05-03 13:24:21.809 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/fullcrawllogindex/empty-cache.working
2022-05-03 13:24:21.810 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/fullcrawllogindex/empty-cache.working' (thread = main)
2022-05-03 13:24:21.810 INFO d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate fullcrawllogindex for the 0 jobs: []
2022-05-03 13:24:21.810 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main)
2022-05-03 13:24:21.812 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1)
2022-05-03 13:24:21.814 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)!
2022-05-03 13:24:21.815 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1
2022-05-03 13:24:21.815 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1
2022-05-03 13:24:21.816 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes
2022-05-03 13:24:21.816 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@5922ae77
2022-05-03 13:24:21.817 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/fullcrawllogindex/empty-cache' of id '[]', request was for '[]'
2022-05-03 13:24:21.846 INFO d.n.c.utils.hadoop.HadoopJobUtils.doKerberosLogin - Kerberos: /home/devel/extra_configs/kerberos_config/krb5.conf, /home/devel/extra_configs/kerberos_config/nat-nas-devel.keytab, nat-nas-devel@KBHPC.KB.DK
2022-05-03 13:24:22.057 WARN o.a.hadoop.util.NativeCodeLoader.<clinit> - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2022-05-03 13:24:22.275 INFO d.n.h.i.d.IndexRequestServer.setHandler - Setting handler for RequestType: CDX
2022-05-03 13:24:22.276 INFO d.n.h.i.d.IndexRequestServer.setHandler - Setting handler for RequestType: DEDUP_CRAWL_LOG
2022-05-03 13:24:22.277 INFO d.n.h.i.d.IndexRequestServer.setHandler - Setting handler for RequestType: FULL_CRAWL_LOG
2022-05-03 13:24:22.277 INFO d.n.h.i.d.IndexRequestServer.restoreRequestsfromRequestDir - requestdir not found: creating request dir
2022-05-03 13:24:22.278 INFO d.n.h.i.d.IndexRequestServer.start - 0 indexing jobs in progress that was stored in requestdir: /home/devel/Test6/requests
2022-05-03 13:24:22.279 INFO d.n.h.i.d.IndexRequestServer.run - Enabling listening to the indexserver channel '[Queue 'Test6_COMMON_INDEX_SERVER']'
2022-05-03 13:24:22.280 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer@e5554fc as listener to Test6_COMMON_INDEX_SERVER
13:24:18,178 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_ViewerProxyApplication.xml] at [file:/home/devel/Test6/conf/logback_ViewerProxyApplication.xml]
13:24:18,549 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:24:18,550 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:24:18,574 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:24:18,600 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:18,684 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:24:18,693 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:24:18,726 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@117009527 - No compression will be used
13:24:18,728 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@117009527 - Will use the pattern ./log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log for the active file
13:24:18,734 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log'.
13:24:18,734 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - Roll-over at midnight.
13:24:18,739 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - Setting initial period to Tue May 03 13:24:18 CEST 2022
13:24:18,740 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:24:18,740 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:24:18,743 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:18,746 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ViewerProxyApplication.log
13:24:18,746 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ViewerProxyApplication.log]
13:24:18,747 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:24:19,443 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:24:19,454 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:24:19,454 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:24:19,455 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:24:19,455 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:24:19,456 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:24:19,456 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:24:19,457 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3ba9ad43 - Registering current configuration as safe fallback point
2022-05-03 13:24:19.468 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
2022-05-03 13:24:19.482 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
Java VM: 1.8.0_332
2022-05-03 13:24:19.483 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
2022-05-03 13:24:19.483 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-05-03 13:24:19.484 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-05-03 13:24:19.484 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_ViewerProxyApplication.xml'
2022-05-03 13:24:19.656 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8370/8470
2022-05-03 13:24:19.657 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8370 communicating on port 8470 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8470/jndi/rmi://kb-test-acs-001.kb.dk:8370/jmxrmi
dk.netarkivet.viewerproxy.ViewerProxy Running
2022-05-03 13:24:19.659 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.viewerproxy.ViewerProxy Running
2022-05-03 13:24:19.669 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:19.670 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-05-03 13:24:19.675 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:19.676 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:19.677 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-05-03 13:24:19.677 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
2022-05-03 13:24:21.378 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-05-03 13:24:21.379 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@b6b1987 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP
2022-05-03 13:24:21.398 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP']'
2022-05-03 13:24:21.398 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-05-03 13:24:21.399 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-05-03 13:24:21.403 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-05-03 13:24:21.419 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-05-03 13:24:21.497 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found
2022-05-03 13:24:21.498 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found
2022-05-03 13:24:21.542 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'FULL_CRAWL_LOG' uses directory '/home/devel/Test6/cache/FULL_CRAWL_LOG'
2022-05-03 13:24:21.557 INFO d.n.viewerproxy.ARCArchiveAccess.<init> - Constructed instance of ARCArchiveAccess with TryToLookupUriAsFtp: false
2022-05-03 13:24:21.587 INFO dk.netarkivet.viewerproxy.WebProxy.<init> - Starting viewerproxy jetty on port 8078
--------------------------------------------
STARTING MACHINE: devel@kb-test-way-001.kb.dk
Starting all applications on: kb-test-way-001.kb.dk
Starting linux application: WaybackIndexerApplication
Starting linux application: AggregatorApplication
13:24:25,828 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_AggregatorApplication.xml] at [file:/home/devel/Test6/conf/logback_AggregatorApplication.xml]
13:24:26,137 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:24:26,141 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:24:26,151 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:24:26,184 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:26,353 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:24:26,405 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:24:26,557 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@477289012 - No compression will be used
13:24:26,568 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@477289012 - Will use the pattern ./log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log for the active file
13:24:26,588 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log'.
13:24:26,588 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - Roll-over at midnight.
13:24:26,632 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - Setting initial period to Tue May 03 13:24:26 CEST 2022
13:24:26,636 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:24:26,636 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:24:26,639 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:26,669 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/AggregatorApplication.log
13:24:26,669 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/AggregatorApplication.log]
13:24:26,677 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:24:28,049 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:24:28,053 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:24:28,053 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:24:28,064 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:24:28,064 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:24:28,064 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:24:28,064 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:24:28,065 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3d3fcdb0 - Registering current configuration as safe fallback point
2022-05-03 13:24:28.098 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.wayback.aggregator.AggregationWorker
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
2022-05-03 13:24:28.136 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.wayback.aggregator.AggregationWorker
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
Java VM: 1.8.0_25
2022-05-03 13:24:28.137 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
2022-05-03 13:24:28.138 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-05-03 13:24:28.139 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-05-03 13:24:28.141 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_AggregatorApplication.xml'
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
--------------------------------------------
--------------------------------------------
STARTING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
Starting all applications on: sb-test-har-001.statsbiblioteket.dk
Starting linux application: HarvestControllerApplication_sbhigh_h3
13:24:29,324 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] at [file:/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml]
13:24:29,484 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
13:24:29,487 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
13:24:29,493 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
13:24:29,504 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:29,547 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
13:24:29,549 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
13:24:29,569 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@251210093 - No compression will be used
13:24:29,571 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@251210093 - Will use the pattern ./log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
13:24:29,573 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@36c88a32 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
13:24:29,573 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@36c88a32 - Roll-over at midnight.
13:24:29,578 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@36c88a32 - Setting initial period to Tue May 03 13:24:29 CEST 2022
13:24:29,578 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@36c88a32 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
13:24:29,578 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@36c88a32 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
13:24:29,582 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
13:24:29,584 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_sbhigh_h3.log
13:24:29,584 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_sbhigh_h3.log]
13:24:29,588 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
13:24:29,868 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
13:24:29,870 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
13:24:29,870 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
13:24:29,875 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
13:24:29,875 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
13:24:29,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
13:24:29,875 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
13:24:29,876 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@7880cdf3 - Registering current configuration as safe fallback point
2022-05-03 13:24:29.879 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
2022-05-03 13:24:29.886 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce)
Java VM: 1.8.0_232
2022-05-03 13:24:29.887 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_232
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
2022-05-03 13:24:29.887 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
Working dir: /home/netarkdv/Test6
2022-05-03 13:24:29.887 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/netarkdv/Test6
2022-05-03 13:24:29.887 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/netarkdv/Test6/conf/settings_HarvestControllerApplication_sbhigh_h3.xml'
2022-05-03 13:24:30.063 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'sb-test-har-001.statsbiblioteket.dk' and JMX/RMI ports 8170/8270
2022-05-03 13:24:30.064 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://sb-test-har-001.statsbiblioteket.dk:8270/jndi/rmi://sb-test-har-001.statsbiblioteket.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-05-03 13:24:30.072 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-05-03 13:24:30.079 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:30.080 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-05-03 13:24:30.086 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-05-03 13:24:30.093 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-05-03 13:24:30.099 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2022-05-03 13:24:30.105 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2022-05-03 13:24:30.105 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-05-03 13:24:30.274 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/netarkdv/extra_configs/bitmag_config.
2022-05-03 13:24:30.275 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/netarkdv/extra_configs/bitmag_config.
2022-05-03 13:24:30.279 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): sb-test-har-001.statsbiblioteket.dk
2022-05-03 13:24:31.420 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-05-03 13:24:31.422 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@4504d271 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3
2022-05-03 13:24:31.462 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3']'
2022-05-03 13:24:31.462 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/netarkdv/extra_configs/bitmag_config
2022-05-03 13:24:31.463 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-05-03 13:24:31.493 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-05-03 13:24:31.503 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-05-03 13:24:31.533 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-05-03 13:24:31.552 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-05-03 13:24:31.553 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-05-03 13:24:31.553 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_high'
2022-05-03 13:24:31.554 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@31e75d13 as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-05-03 13:24:31.647 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'HIGHPRIORITY'
2022-05-03 13:24:31.834 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'HIGHPRIORITY' is valid.
2022-05-03 13:24:31.838 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY']'
2022-05-03 13:24:31.838 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@31e75d13 as listener to Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY
--------------------------------------------
Completed the script all_test.sh
Finished: SUCCESS
Console Output
Help us localize this page