SuccessConsole Output

Skipping 282 KB.. Full Log
s-xsd-12.jar!/xsd/RepositorySettings.xsd
12:19:23.356 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
12:19:23.750 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
12:19:23.788 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
12:19:24.767 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
12:19:24.817 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
12:19:24.818 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
12:19:25.073 INFO  o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:19:25.073 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
12:19:26.060 INFO  o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
12:19:26.135 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:19:26.137 INFO  o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-7800]
12:19:26.139 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
12:19:26.140 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7800' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
12:19:26.140 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7800' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7800#1297836716'.
12:19:26.140 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7800#1297836716'.
12:19:26.155 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
12:19:26.163 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
12:19:26.165 INFO  o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-checksum-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-101,40,-25,76,81,-27,-103,-63,-76,10,-76,-22,89,5,-20,-24}, calculationTimestamp=2022-07-11T12:19:26.157+02:00]', while requested checksum 'null'. And the audit trail information 'null'.
12:19:26.178 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
12:19:26.683 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(4e36ca2b) collectionID Test6,  to netarkiv-checksum-devel-01,  destination topic://netarkiv-devel:  FileID=1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz
12:19:26.684 DEBUG o.b.commandline.DeleteFileCmd - Received event: 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
12:19:27.133 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(4e36ca2b) collectionID Test6,  from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.)
12:19:27.153 DEBUG o.b.c.c.ConversationEventMonitor - 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01
12:19:27.421 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(4e36ca2b) collectionID Test6,  from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.)
12:19:27.434 DEBUG o.b.commandline.DeleteFileCmd - Received event: 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01
12:19:27.435 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
12:19:27.435 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: []
12:19:27.435 DEBUG o.b.commandline.DeleteFileCmd - Received event: 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-checksum-devel-01]
12:19:27.436 DEBUG o.b.commandline.DeleteFileCmd - Received event: 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01], Sending request for deleting file
12:19:27.959 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(4e36ca2b) collectionID Test6,  to netarkiv-checksum-devel-01,  destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor:  FileID=1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-101,40,-25,76,81,-27,-103,-63,-76,10,-76,-22,89,5,-20,-24}, calculationTimestamp=2022-07-11T12:19:26.157+02:00]
12:19:28.045 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(4e36ca2b) collectionID Test6,  from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
12:19:28.049 DEBUG o.b.c.c.ConversationEventMonitor - 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
12:19:28.426 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(4e36ca2b) collectionID Test6,  from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
12:19:28.435 DEBUG o.b.c.c.ConversationEventMonitor - 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
12:19:28.815 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(4e36ca2b) collectionID Test6,  from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS
12:19:28.822 DEBUG o.b.commandline.DeleteFileCmd - Received event: 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-checksum-devel-01
12:19:29.185 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(4e36ca2b) collectionID Test6,  from netarkiv-checksum-devel-01: OPERATION_COMPLETED
12:19:29.186 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
12:19:29.187 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: []
12:19:29.187 DEBUG o.b.commandline.DeleteFileCmd - Complete: 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 
12:19:29.187 INFO  o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 
12:19:29.187 DEBUG o.b.commandline.DeleteFileCmd - 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 
12:19:30.449 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
12:19:30.550 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
12:19:30.937 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
12:19:30.992 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
12:19:31.937 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
12:19:31.959 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
12:19:31.959 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
12:19:32.216 INFO  o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:19:32.217 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
12:19:33.129 INFO  o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
12:19:33.191 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:19:33.192 INFO  o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-7878]
12:19:33.194 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
12:19:33.194 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7878' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
12:19:33.194 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7878' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7878#282265585'.
12:19:33.194 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7878#282265585'.
12:19:33.206 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
12:19:33.211 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
12:19:33.212 INFO  o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-kbh-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@25084a1e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@156b88f5[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-101,40,-25,76,81,-27,-103,-63,-76,10,-76,-22,89,5,-20,-24}, calculationTimestamp=2022-07-11T12:19:33.207+02:00]', while requested checksum 'null'. And the audit trail information 'null'.
12:19:33.222 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
12:19:33.859 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(2c0975e6) collectionID Test6,  to netarkiv-kbh-disk-devel-01,  destination topic://netarkiv-devel:  FileID=1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz
12:19:33.859 DEBUG o.b.commandline.DeleteFileCmd - Received event: 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
12:19:34.293 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(2c0975e6) collectionID Test6,  from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.)
12:19:34.315 DEBUG o.b.commandline.DeleteFileCmd - Received event: 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01
12:19:34.316 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
12:19:34.316 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: []
12:19:34.317 DEBUG o.b.commandline.DeleteFileCmd - Received event: 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01]
12:19:34.318 DEBUG o.b.commandline.DeleteFileCmd - Received event: 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-kbh-disk-devel-01], Sending request for deleting file
12:19:34.961 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(2c0975e6) collectionID Test6,  from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
12:19:35.188 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(2c0975e6) collectionID Test6,  to netarkiv-kbh-disk-devel-01,  destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01:  FileID=1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@25084a1e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@156b88f5[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-101,40,-25,76,81,-27,-103,-63,-76,10,-76,-22,89,5,-20,-24}, calculationTimestamp=2022-07-11T12:19:33.207+02:00]
12:19:35.189 DEBUG o.b.c.c.ConversationEventMonitor - 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
12:19:35.468 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(2c0975e6) collectionID Test6,  from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
12:19:35.477 DEBUG o.b.c.c.ConversationEventMonitor - 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
12:19:35.754 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(2c0975e6) collectionID Test6,  from netarkiv-kbh-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(Deleting..)
12:19:35.759 DEBUG o.b.commandline.DeleteFileCmd - Received event: 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-kbh-disk-devel-01, Deleting..
12:19:36.269 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(2c0975e6) collectionID Test6,  from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz deleted.)
12:19:36.270 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
12:19:36.270 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: []
12:19:36.270 DEBUG o.b.commandline.DeleteFileCmd - Complete: 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 
12:19:36.270 INFO  o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 
12:19:36.270 DEBUG o.b.commandline.DeleteFileCmd - 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 
calling cleanup_hosts
running cleanup_hosts
Removing installation on sb-test-har-001.statsbiblioteket.dk
Removing installation on kb-test-har-003.kb.dk
Removing installation on kb-test-har-004.kb.dk
Removing installation on kb-test-har-005.kb.dk
Removing installation on kb-test-adm-001.kb.dk
Removing installation on kb-test-acs-001.kb.dk
Removing installation on kb-test-way-001.kb.dk
calling cleanup_linuxbarhosts
running cleanup_linuxbarhosts
Removing installation on sb-test-bar-001.statsbiblioteket.dk
Removing bitarchive on sb-test-bar-001.statsbiblioteket.dk
Calling cleanup_windowsbarhosts
running cleanup_windowsbarhosts
Removing C:\bitarkiv\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing E:\bitarchive_1\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing F:\bitarchive_2\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing g:\bitarchive_3\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing C:\Users\ba-devel\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
TESTX=Test6
PORT=8078
MAILRECEIVERS=csr@kb.dk
VERSION=CSR
DEPLOYCONF=deploy_config_bitmag.xml
H3ZIP=CSR
BITMAGCONF=/home/devel/bitmag_test_config/client_config
Using bundler file /home/devel/nas_versions/bundler/NetarchiveSuite-heritrix3-bundler-CSR.zip
Creating distribution files in /home/devel/prepared_software/Test6.
Will read source files using encoding 'UTF-8' (defaulted)
Branch in settings not found: common.warcRecordService
Branch in settings not found: common.arcrepositoryClient.bitrepository.getFileIDsMaxResults
Branch in settings not found: common.hadoop.kerberos
Branch in settings not found: common.hadoop.username
Branch in settings not found: common.hadoop.mapred.hadoopUberJar
Branch in settings not found: common.hadoop.mapred.inputFilesParentDir
Branch in settings not found: common.hadoop.mapred.cdxJob
Branch in settings not found: common.hadoop.mapred.metadataExtractionJob
Branch in settings not found: common.hadoop.mapred.metadataCDXExtractionJob
Branch in settings not found: common.hadoop.mapred.crawlLogExtractionJob
Branch in settings not found: common.fileResolver.class
Branch in settings not found: common.fileResolver.baseUrl
Branch in settings not found: common.fileResolver.keyfile
Branch in settings not found: common.webinterface.metadata_cache_dir
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Machine 'kb-test-adm-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-har-003.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks
Machine 'kb-test-har-005.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks
Machine 'kb-test-har-004.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
Machine 'kb-test-acs-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-way-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'sb-test-har-001.statsbiblioteket.dk' configured with encoding 'UTF-8' (defaulted)
/home/devel/prepared_software/Test6/NetarchiveSuite-heritrix3-bundler.zip -> /home/netarkdv/Test6/NetarchiveSuite-heritrix3-bundler.zip
12:25:05.439 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:25:05.444 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:25:05.445 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:25:05.445 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:25:05.445 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:25:05.445 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:25:05.447 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:25:05.447 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:25:05.447 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:25:05.447 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:25:05.448 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:25:05.448 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:25:05.536 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:25:05.542 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-adm-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-adm-001.kb.dk
deleting devel@kb-test-adm-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-adm-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-003.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-003.kb.dk
deleting devel@kb-test-har-003.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-003.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-005.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-005.kb.dk
deleting devel@kb-test-har-005.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-005.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-004.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-004.kb.dk
deleting devel@kb-test-har-004.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-004.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-acs-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-acs-001.kb.dk
deleting devel@kb-test-acs-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-acs-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-way-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-way-001.kb.dk
deleting devel@kb-test-way-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-way-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
--------------------------------------------
INSTALLING TO MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
copying NetarchiveSuite-CSR.zip to:sb-test-har-001.statsbiblioteket.dk
deleting netarkdv@sb-test-har-001.statsbiblioteket.dk:/home/netarkdv/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:sb-test-har-001.statsbiblioteket.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
Initializing database for system Test6
+ host=devel@kb-test-adm-001
+ scp -p /home/devel/devel-config/scripts/db/setup_admindb.sh /home/devel/devel-config/scripts/db/setup_harvestdb.sh /home/devel/devel-config/scripts/db/teardown_admindb.sh /home/devel/devel-config/scripts/db/teardown_harvestdb.sh /home/devel/devel-config/scripts/../resources/harvestdb.testdata.sql /home/devel/devel-config/scripts/../resources/default_orderxml.cxml devel@kb-test-adm-001:bin/
+ ssh devel@kb-test-adm-001
Pseudo-terminal will not be allocated because stdin is not a terminal.
Dette system må kun tilgås af brugere autoriserede af Det Kgl. Bibliotek.

This system is only to be used by users authorized by
the Royal Danish Library.
Destroying test6_admindb
DROP DATABASE
Creating empty test6_admindb
CREATE DATABASE
Initialising test6_admindb
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
Destroying test6_harvestdb
DROP DATABASE
CREATE DATABASE
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
GRANT
CREATE TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE INDEX
GRANT
CREATE TABLE
GRANT
CREATE TABLE
CREATE INDEX
GRANT
CREATE TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
CREATE TABLE
CREATE INDEX
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
CREATE TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
INSERT 0 1
INSERT 0 1
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE INDEX
CREATE SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
GRANT
INSERT 0 1
INSERT 0 1
INSERT 0 1
SET
SET
SET
SET
SET
SET
SET
SET
SET
COPY 16
COPY 16
 setval 
--------
     17
(1 row)

COPY 16
 setval 
--------
     17
(1 row)

COPY 3
 setval 
--------
     17
(1 row)

COPY 2
 setval 
--------
      5
(1 row)

COPY 4
 setval 
--------
      4
(1 row)

COPY 25
COPY 16
 setval 
--------
     17
(1 row)

12:27:11.306 [MLog-Init-Reporter] INFO com.mchange.v2.log.MLog - MLog clients using slf4j logging.
12:27:11.321 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - Reading VM config for path list /com/mchange/v2/log/default-mchange-log.properties, /mchange-commons.properties, /c3p0.properties, hocon:/reference,/application,/c3p0,/, /mchange-log.properties, /
12:27:11.322 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
12:27:11.322 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
12:27:11.322 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
12:27:11.322 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
12:27:11.328 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
12:27:11.328 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
12:27:11.329 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
12:27:11.329 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
12:27:11.674 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.5.4 [built 23-March-2019 23:00:48 -0700; debug? true; trace: 10]
12:27:11.747 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ap1tpbdee1mefscm|f4168b8,name=10bdx52ap1tpbdee1mefscm|f4168b8 registered.
12:27:11.811 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ap1tpbdee1mefscm|f4168b8,name=10bdx52ap1tpbdee1mefscm|f4168b8 unregistered, in order to be reregistered after update.
12:27:11.811 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ap1tpbdee1mefscm|f4168b8,name=10bdx52ap1tpbdee1mefscm|f4168b8 registered.
12:27:11.833 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
12:27:11.894 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, dataSourceName -> 10bdx52ap1tpbdee1mefscm|f4168b8, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, extensions -> {}, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, forceUseNamedDriverClass -> false, identityToken -> 10bdx52ap1tpbdee1mefscm|f4168b8, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost:5432/test6_harvestdb, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 3600, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, preferredTestQuery -> null, privilegeSpawnedThreads -> false, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ]
12:27:11.919 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
12:27:11.919 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
12:27:11.919 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
12:27:11.919 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
12:27:11.919 [main] WARN com.mchange.v2.resourcepool.BasicResourcePool - Bad pool size config, start 3 < min 5. Using 5 as start.
12:27:11.922 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@5be6e01c config: [start -> 5; min -> 5; max -> 20; inc -> 5; num_acq_attempts -> 30; acq_attempt_delay -> 1000; check_idle_resources_delay -> 0; max_resource_age -> 3600000; max_idle_time -> 0; excess_max_idle_time -> 0; destroy_unreturned_resc_time -> 0; expiration_enforcement_delay -> 900000; break_on_acquisition_failure -> false; debug_store_checkout_exceptions -> false; force_synchronous_checkins -> false]
12:27:11.923 [main] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPoolManager - Created new pool for auth, username (masked): 'de******'.
12:27:11.923 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - acquire test -- pool size: 0; target_pool_size: 5; desired target? 1
12:27:11.923 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - awaitAvailable(): [unknown]
12:27:12.100 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@3911c2a7 [wrapping: SELECT version FROM schemaversions WHERE tablename = 'ordertemplates'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@1725dc0f [wrapping: null]
12:27:12.116 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@2145b572 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@15eb5ee5 [wrapping: null]
12:27:12.137 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@35ef1869 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@3c407114 [wrapping: null]
The template 'default_orderxml' has now been updated.
+ set +x
--------------------------------------------
STARTING MACHINE: devel@kb-test-adm-001.kb.dk
Starting all applications on: kb-test-adm-001.kb.dk
Starting linux application: GUIApplication
Starting linux application: ArcRepositoryApplication
Starting linux application: HarvestJobManagerApplication
12:27:13,915 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_ArcRepositoryApplication.xml] at [file:/home/devel/Test6/conf/logback_ArcRepositoryApplication.xml]
12:27:14,493 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:14,495 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:14,523 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:14,561 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:14,740 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:14,762 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:14,856 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1254344205 - No compression will be used
12:27:14,863 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1254344205 - Will use the pattern ./log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:27:14,885 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4facf68f - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log'.
12:27:14,885 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4facf68f - Roll-over at midnight.
12:27:14,895 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4facf68f - Setting initial period to Mon Jul 11 12:27:14 CEST 2022
12:27:14,896 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4facf68f - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:14,896 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4facf68f - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:14,900 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:14,906 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ArcRepositoryApplication.log
12:27:14,907 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ArcRepositoryApplication.log]
12:27:14,911 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:16,471 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:16,481 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:16,481 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:16,484 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:16,484 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:16,486 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:16,486 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:16,490 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@76508ed1 - Registering current configuration as safe fallback point

2022-07-11 12:27:16.512 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 12:27:16.542 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_322
2022-07-11 12:27:16.545 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_322
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.322.b06-2.el8_5.x86_64/jre
2022-07-11 12:27:16.546 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.322.b06-2.el8_5.x86_64/jre
Working dir: /home/devel/Test6
2022-07-11 12:27:16.547 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 12:27:16.549 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_ArcRepositoryApplication.xml'
2022-07-11 12:27:16.970 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8171/8271
2022-07-11 12:27:16.970 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8171 communicating on port 8271 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8271/jndi/rmi://kb-test-adm-001.kb.dk:8171/jmxrmi
dk.netarkivet.archive.arcrepository.ArcRepository Running
2022-07-11 12:27:16.980 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.archive.arcrepository.ArcRepository Running
2022-07-11 12:27:17.025 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:17.029 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:17.031 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 12:27:17.740 INFO  d.n.a.a.ArchiveDBConnection.initDataSource - Using jdbc url: jdbc:postgresql://localhost:5432/test6_admindb
2022-07-11 12:27:17.758 INFO  d.n.a.a.ArchiveDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=10
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=30
- idleConnTestQuery='SELECT COUNT(*) FROM replica'
- idleConnTestOnCheckin=false
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
12:27:14,140 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_GUIApplication.xml] at [file:/home/devel/Test6/conf/logback_GUIApplication.xml]
12:27:14,752 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:14,760 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:14,793 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:14,835 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:15,018 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:15,073 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:15,138 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@798981583 - No compression will be used
12:27:15,141 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@798981583 - Will use the pattern ./log/GUIApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:27:15,150 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@747ddf94 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/GUIApplication.%d{yyyy-MM-dd}.%i.log'.
12:27:15,150 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@747ddf94 - Roll-over at midnight.
12:27:15,160 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@747ddf94 - Setting initial period to Mon Jul 11 12:27:15 CEST 2022
12:27:15,161 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@747ddf94 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:15,161 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@747ddf94 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:15,166 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:15,178 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/GUIApplication.log
12:27:15,178 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/GUIApplication.log]
12:27:15,182 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:16,562 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:16,572 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:16,572 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:16,573 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:16,573 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:16,573 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:16,573 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:16,581 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@35e2d654 - Registering current configuration as safe fallback point

SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2022-07-11 12:27:16.600 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 12:27:16.627 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_322
2022-07-11 12:27:16.633 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_322
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.322.b06-2.el8_5.x86_64/jre
2022-07-11 12:27:16.636 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.322.b06-2.el8_5.x86_64/jre
Working dir: /home/devel/Test6
2022-07-11 12:27:16.636 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 12:27:16.638 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_GUIApplication.xml'
2022-07-11 12:27:16.971 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8170/8270
2022-07-11 12:27:16.971 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8270/jndi/rmi://kb-test-adm-001.kb.dk:8170/jmxrmi
dk.netarkivet.common.webinterface.GUIWebServer Running
2022-07-11 12:27:16.972 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.common.webinterface.GUIWebServer Running
2022-07-11 12:27:16.972 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war
2022-07-11 12:27:16.973 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection
2022-07-11 12:27:16.973 INFO  d.n.common.webinterface.GUIWebServer.<init> - Starting webserver. Port: 8078 deployment directories: 'webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war' classes: 'dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection'
2022-07-11 12:27:16.998 DEBUG d.n.common.webinterface.GUIWebServer.<init> - GUI using tempdir /home/devel/Test6/tmpdircommon
2022-07-11 12:27:16.998 DEBUG d.n.common.webinterface.GUIWebServer.<init> - GUI using basedir /home/devel/Test6
2022-07-11 12:27:16.998 INFO  d.n.common.webinterface.GUIWebServer.<init> - Deleted existing tempdir '/home/devel/Test6/tmpdircommon'
2022-07-11 12:27:17.003 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:17.003 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:17.004 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 12:27:17.143 INFO  d.n.common.webinterface.GUIWebServer.<init> - Scanning for taglibs is disabled as tomcat.util.scan.StandardJarScanFilter.jarsToSkip is unset.
12:27:13,923 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestJobManagerApplication.xml] at [file:/home/devel/Test6/conf/logback_HarvestJobManagerApplication.xml]
12:27:14,193 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:14,197 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:14,234 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:14,290 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:14,488 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:14,507 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:14,597 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1742920067 - No compression will be used
12:27:14,601 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1742920067 - Will use the pattern ./log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:27:14,608 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5d47c63f - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log'.
12:27:14,608 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5d47c63f - Roll-over at midnight.
12:27:14,630 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5d47c63f - Setting initial period to Mon Jul 11 12:27:14 CEST 2022
12:27:14,631 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5d47c63f - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:14,631 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5d47c63f - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:14,636 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:14,643 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestJobManagerApplication.log
12:27:14,643 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestJobManagerApplication.log]
12:27:14,646 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:16,135 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:16,156 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:16,158 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:16,163 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:16,163 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:16,167 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:16,167 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:16,169 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@5ea434c8 - Registering current configuration as safe fallback point

2022-07-11 12:27:16.187 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
2022-07-11 12:27:16.254 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:16.261 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:16.263 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 12:27:17.407 INFO  d.n.h.datamodel.HarvestDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
2022-07-11 12:27:17.580 WARN  c.m.v.resourcepool.BasicResourcePool.log - Bad pool size config, start 3 < min 5. Using 5 as start.
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-003.kb.dk
Starting all applications on: kb-test-har-003.kb.dk
Starting linux application: HarvestControllerApplication_kblow001_h3
12:27:18,862 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml]
12:27:19,057 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:19,060 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:19,067 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:19,082 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:19,139 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:19,144 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:19,166 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - No compression will be used
12:27:19,167 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - Will use the pattern ./log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log for the active file
12:27:19,170 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log'.
12:27:19,170 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Roll-over at midnight.
12:27:19,174 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Setting initial period to Mon Jul 11 12:27:19 CEST 2022
12:27:19,174 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:19,174 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:19,176 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:19,178 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow001_h3.log
12:27:19,178 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow001_h3.log]
12:27:19,179 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:19,673 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:19,679 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:19,679 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:19,679 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:19,680 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:19,680 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:19,680 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:19,681 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@40ef3420 - Registering current configuration as safe fallback point

2022-07-11 12:27:19.687 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 12:27:19.695 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_332
2022-07-11 12:27:19.696 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
2022-07-11 12:27:19.696 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-07-11 12:27:19.696 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 12:27:19.701 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow001_h3.xml'
2022-07-11 12:27:19.844 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-003.kb.dk' and JMX/RMI ports 8170/8270
2022-07-11 12:27:19.844 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-003.kb.dk:8270/jndi/rmi://kb-test-har-003.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 12:27:19.852 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 12:27:19.859 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:19.860 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:19.862 INFO  d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-07-11 12:27:19.862 INFO  d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2022-07-11 12:27:19.862 INFO  d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2022-07-11 12:27:19.863 INFO  d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-07-11 12:27:19.864 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 12:27:20.009 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:20.010 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:20.015 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-har-003.kb.dk
2022-07-11 12:27:21.447 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-07-11 12:27:21.448 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@56a4479a as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3
2022-07-11 12:27:21.456 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3']'
2022-07-11 12:27:21.457 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-07-11 12:27:21.457 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-07-11 12:27:21.462 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-07-11 12:27:21.483 INFO  d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-07-11 12:27:21.534 INFO  d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-07-11 12:27:21.557 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-07-11 12:27:21.558 INFO  d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-07-11 12:27:21.558 INFO  d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_low'
2022-07-11 12:27:21.558 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@557a1e2d as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-07-11 12:27:21.567 INFO  d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'LOWPRIORITY'
2022-07-11 12:27:21.581 INFO  d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'LOWPRIORITY' is valid.
2022-07-11 12:27:21.582 INFO  d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY']'
2022-07-11 12:27:21.583 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@557a1e2d as listener to Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-005.kb.dk
Starting all applications on: kb-test-har-005.kb.dk
Starting linux application: HarvestControllerApplication_browser_1
Starting linux application: HarvestControllerApplication_browser_2
12:27:24,451 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml]
12:27:24,819 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:24,822 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:24,847 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:24,872 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:24,955 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:24,960 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:24,996 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - No compression will be used
12:27:24,997 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - Will use the pattern ./log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log for the active file
12:27:25,000 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log'.
12:27:25,000 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Roll-over at midnight.
12:27:25,003 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Setting initial period to Mon Jul 11 12:27:25 CEST 2022
12:27:25,003 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:25,003 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:25,008 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:25,010 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_1.log
12:27:25,010 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_1.log]
12:27:25,011 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:25,756 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:25,757 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:25,757 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:25,770 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:25,770 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:25,771 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:25,771 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:25,772 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@333291e3 - Registering current configuration as safe fallback point

2022-07-11 12:27:25.776 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 12:27:25.793 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_312
2022-07-11 12:27:25.794 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2022-07-11 12:27:25.794 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-07-11 12:27:25.794 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 12:27:25.798 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_1.xml'
2022-07-11 12:27:26.057 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8170/8270
2022-07-11 12:27:26.058 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8270/jndi/rmi://kb-test-har-005.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 12:27:26.063 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 12:27:26.087 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:26.087 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:26.088 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 12:27:26.129 INFO  d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-07-11 12:27:26.129 INFO  d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'BROWSER'
2022-07-11 12:27:26.129 INFO  d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_browser_1'
2022-07-11 12:27:26.130 INFO  d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-07-11 12:27:26.315 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:26.316 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:26.324 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-har-005.kb.dk
2022-07-11 12:27:28.138 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-07-11 12:27:28.138 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@26425897 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1
2022-07-11 12:27:28.177 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1']'
2022-07-11 12:27:28.178 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-07-11 12:27:28.178 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-07-11 12:27:28.182 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-07-11 12:27:28.200 INFO  d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-07-11 12:27:28.283 INFO  d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-07-11 12:27:28.330 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-07-11 12:27:28.331 INFO  d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-07-11 12:27:28.331 INFO  d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_1'
2022-07-11 12:27:28.332 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-07-11 12:27:28.374 INFO  d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'BROWSER'
2022-07-11 12:27:28.420 INFO  d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'BROWSER' is valid.
2022-07-11 12:27:28.428 INFO  d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_BROWSER']'
2022-07-11 12:27:28.428 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_JOB_PARTIAL_BROWSER
12:27:24,398 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml]
12:27:24,745 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:24,761 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:24,767 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:24,792 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:24,894 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:24,906 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:24,935 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - No compression will be used
12:27:24,936 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - Will use the pattern ./log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log for the active file
12:27:24,941 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log'.
12:27:24,941 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Roll-over at midnight.
12:27:24,946 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Setting initial period to Mon Jul 11 12:27:24 CEST 2022
12:27:24,946 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:24,946 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:24,958 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:24,961 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_2.log
12:27:24,961 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_2.log]
12:27:24,961 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:25,644 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:25,656 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:25,656 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:25,657 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:25,657 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:25,657 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:25,658 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:25,658 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@333291e3 - Registering current configuration as safe fallback point

2022-07-11 12:27:25.662 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 12:27:25.683 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_312
2022-07-11 12:27:25.684 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2022-07-11 12:27:25.684 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-07-11 12:27:25.684 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 12:27:25.684 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_2.xml'
2022-07-11 12:27:25.919 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8175/8275
2022-07-11 12:27:25.919 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8175 communicating on port 8275 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8275/jndi/rmi://kb-test-har-005.kb.dk:8175/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 12:27:25.924 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 12:27:25.930 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:25.931 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:25.931 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 12:27:25.955 INFO  d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-07-11 12:27:25.956 INFO  d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'BROWSER'
2022-07-11 12:27:25.956 INFO  d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_browser_2'
2022-07-11 12:27:25.956 INFO  d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-07-11 12:27:26.070 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:26.071 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:26.075 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-har-005.kb.dk
2022-07-11 12:27:27.956 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-07-11 12:27:27.956 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@6f8f9349 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2
2022-07-11 12:27:27.979 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2']'
2022-07-11 12:27:27.980 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-07-11 12:27:27.980 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-07-11 12:27:27.984 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-07-11 12:27:27.999 INFO  d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-07-11 12:27:28.115 INFO  d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-07-11 12:27:28.167 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-07-11 12:27:28.168 INFO  d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-07-11 12:27:28.168 INFO  d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_2'
2022-07-11 12:27:28.184 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@2c3dec30 as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-07-11 12:27:28.241 INFO  d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'BROWSER' is valid.
2022-07-11 12:27:28.243 INFO  d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_BROWSER']'
2022-07-11 12:27:28.243 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@2c3dec30 as listener to Test6_COMMON_JOB_PARTIAL_BROWSER
2022-07-11 12:27:28.294 INFO  d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'BROWSER'
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-004.kb.dk
Starting all applications on: kb-test-har-004.kb.dk
Starting linux application: HarvestControllerApplication_kblow002_h3
Starting linux application: HarvestControllerApplication_kbhigh_h3
12:27:30,393 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml]
12:27:31,009 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:31,021 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:31,048 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:31,095 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:31,200 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:31,218 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:31,279 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - No compression will be used
12:27:31,282 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - Will use the pattern ./log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
12:27:31,287 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
12:27:31,287 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Roll-over at midnight.
12:27:31,297 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Setting initial period to Mon Jul 11 12:27:31 CEST 2022
12:27:31,298 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:31,298 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:31,301 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:31,313 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbhigh_h3.log
12:27:31,313 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbhigh_h3.log]
12:27:31,315 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:32,073 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:32,081 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:32,081 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:32,082 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:32,082 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:32,082 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:32,082 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:32,083 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2473d930 - Registering current configuration as safe fallback point

2022-07-11 12:27:32.092 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 12:27:32.109 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_25
2022-07-11 12:27:32.110 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2022-07-11 12:27:32.112 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-07-11 12:27:32.113 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 12:27:32.113 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kbhigh_h3.xml'
2022-07-11 12:27:32.327 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8172/8272
2022-07-11 12:27:32.328 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8172 communicating on port 8272 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8272/jndi/rmi://kb-test-har-004.kb.dk:8172/jmxrmi
2022-07-11 12:27:32.346 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:32.347 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:32.348 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 12:27:32.355 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 12:27:32.382 INFO  d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-07-11 12:27:32.382 INFO  d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2022-07-11 12:27:32.382 INFO  d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2022-07-11 12:27:32.392 INFO  d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-07-11 12:27:32.594 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:32.622 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:32.638 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-har-004.kb.dk
12:27:30,520 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml]
12:27:31,071 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:31,082 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:31,099 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:31,131 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:31,200 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:31,204 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:31,246 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - No compression will be used
12:27:31,247 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - Will use the pattern ./log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log for the active file
12:27:31,250 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log'.
12:27:31,250 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Roll-over at midnight.
12:27:31,257 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Setting initial period to Mon Jul 11 12:27:31 CEST 2022
12:27:31,258 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:31,258 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:31,259 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:31,265 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow002_h3.log
12:27:31,265 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow002_h3.log]
12:27:31,266 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:31,959 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:31,970 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:31,970 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:31,972 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:31,972 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:31,974 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:31,975 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:31,977 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2473d930 - Registering current configuration as safe fallback point

2022-07-11 12:27:31.993 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 12:27:32.022 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_25
2022-07-11 12:27:32.024 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2022-07-11 12:27:32.026 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-07-11 12:27:32.027 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 12:27:32.029 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow002_h3.xml'
2022-07-11 12:27:32.242 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8170/8270
2022-07-11 12:27:32.243 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8270/jndi/rmi://kb-test-har-004.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 12:27:32.270 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 12:27:32.284 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:32.284 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:32.289 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 12:27:32.294 INFO  d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-07-11 12:27:32.303 INFO  d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2022-07-11 12:27:32.303 INFO  d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2022-07-11 12:27:32.304 INFO  d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-07-11 12:27:32.528 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:32.539 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:32.555 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-har-004.kb.dk
--------------------------------------------
STARTING MACHINE: devel@kb-test-acs-001.kb.dk
Starting all applications on: kb-test-acs-001.kb.dk
Starting linux application: IndexServerApplication
Starting linux application: ViewerProxyApplication
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
12:27:35,892 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_IndexServerApplication.xml] at [file:/home/devel/Test6/conf/logback_IndexServerApplication.xml]
12:27:36,196 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:36,199 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:36,206 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:36,218 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:36,279 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:36,286 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:36,314 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@29183965 - No compression will be used
12:27:36,315 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@29183965 - Will use the pattern ./log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:27:36,318 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log'.
12:27:36,318 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - Roll-over at midnight.
12:27:36,323 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - Setting initial period to Mon Jul 11 12:27:36 CEST 2022
12:27:36,323 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:36,323 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:36,325 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:36,327 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/IndexServerApplication.log
12:27:36,327 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/IndexServerApplication.log]
12:27:36,328 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:36,914 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:36,916 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:36,916 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:36,927 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:36,927 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:36,927 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:36,928 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:36,928 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4f83df68 - Registering current configuration as safe fallback point

SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2022-07-11 12:27:36.936 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 12:27:36.945 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_332
2022-07-11 12:27:36.946 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
2022-07-11 12:27:36.946 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-07-11 12:27:36.947 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 12:27:36.947 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_IndexServerApplication.xml'
2022-07-11 12:27:37.239 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8371/8471
2022-07-11 12:27:37.240 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8371 communicating on port 8471 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8471/jndi/rmi://kb-test-acs-001.kb.dk:8371/jmxrmi
dk.netarkivet.harvester.indexserver.IndexServer Running
2022-07-11 12:27:37.247 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.indexserver.IndexServer Running
2022-07-11 12:27:37.254 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata'
2022-07-11 12:27:37.257 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:37.258 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:37.267 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:37.268 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:37.275 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-acs-001.kb.dk
2022-07-11 12:27:37.259 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 12:27:39.061 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-07-11 12:27:39.061 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@7a527389 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS
2022-07-11 12:27:39.069 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS']'
2022-07-11 12:27:39.070 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-07-11 12:27:39.070 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-07-11 12:27:39.074 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-07-11 12:27:39.081 INFO  d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-07-11 12:27:39.150 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found
2022-07-11 12:27:39.151 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found
2022-07-11 12:27:39.211 INFO  d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2022-07-11 12:27:39.212 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxindex' uses directory '/home/devel/Test6/cache/cdxindex'
2022-07-11 12:27:39.214 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'crawllog' uses directory '/home/devel/Test6/cache/crawllog'
2022-07-11 12:27:39.215 INFO  d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled
2022-07-11 12:27:39.215 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'dedupcrawllogindex' uses directory '/home/devel/Test6/cache/dedupcrawllogindex'
2022-07-11 12:27:39.216 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata'
2022-07-11 12:27:39.216 INFO  d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2022-07-11 12:27:39.217 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'crawllog' uses directory '/home/devel/Test6/cache/crawllog'
2022-07-11 12:27:39.217 INFO  d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled
2022-07-11 12:27:39.217 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'fullcrawllogindex' uses directory '/home/devel/Test6/cache/fullcrawllogindex'
2022-07-11 12:27:39.218 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata'
2022-07-11 12:27:39.218 INFO  d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2022-07-11 12:27:39.219 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/cdxindex/empty-cache.working
2022-07-11 12:27:39.219 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/cdxindex/empty-cache.working' (thread = main)
2022-07-11 12:27:39.233 DEBUG d.n.common.utils.ProcessUtils.runProcess - Running external program: sort /home/devel/Test6/cache/cdxindex/empty-cache -o /home/devel/Test6/cache/cdxindex/empty-cache.unsorted with environment LANG=C
2022-07-11 12:27:39.246 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@5cc126dc
2022-07-11 12:27:39.246 INFO  d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/cdxindex/empty-cache' of id '[]', request was for '[]'
2022-07-11 12:27:39.247 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/dedupcrawllogindex/empty-cache.working
2022-07-11 12:27:39.247 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/dedupcrawllogindex/empty-cache.working' (thread = main)
2022-07-11 12:27:39.247 INFO  d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate dedupcrawllogindex for the 0 jobs: []
2022-07-11 12:27:39.248 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main)
2022-07-11 12:27:39.352 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1)
2022-07-11 12:27:39.358 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)!
2022-07-11 12:27:39.358 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1
2022-07-11 12:27:39.358 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1
2022-07-11 12:27:39.361 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes
2022-07-11 12:27:39.362 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@d1f74b8
2022-07-11 12:27:39.362 INFO  d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/dedupcrawllogindex/empty-cache' of id '[]', request was for '[]'
2022-07-11 12:27:39.362 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/fullcrawllogindex/empty-cache.working
2022-07-11 12:27:39.362 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/fullcrawllogindex/empty-cache.working' (thread = main)
2022-07-11 12:27:39.363 INFO  d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate fullcrawllogindex for the 0 jobs: []
2022-07-11 12:27:39.363 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main)
2022-07-11 12:27:39.364 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1)
2022-07-11 12:27:39.367 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)!
2022-07-11 12:27:39.368 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1
2022-07-11 12:27:39.368 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1
2022-07-11 12:27:39.369 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes
2022-07-11 12:27:39.369 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@3a0807b7
2022-07-11 12:27:39.369 INFO  d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/fullcrawllogindex/empty-cache' of id '[]', request was for '[]'
2022-07-11 12:27:39.396 INFO  d.n.c.utils.hadoop.HadoopJobUtils.doKerberosLogin - Kerberos: /home/devel/extra_configs/kerberos_config/krb5.conf, /home/devel/extra_configs/kerberos_config/nat-nas-devel.keytab, nat-nas-devel@KBHPC.KB.DK
2022-07-11 12:27:39.683 WARN  o.a.hadoop.util.NativeCodeLoader.<clinit> - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2022-07-11 12:27:39.864 INFO  d.n.h.i.d.IndexRequestServer.setHandler - Setting handler for RequestType: CDX
2022-07-11 12:27:39.865 INFO  d.n.h.i.d.IndexRequestServer.setHandler - Setting handler for RequestType: DEDUP_CRAWL_LOG
2022-07-11 12:27:39.865 INFO  d.n.h.i.d.IndexRequestServer.setHandler - Setting handler for RequestType: FULL_CRAWL_LOG
2022-07-11 12:27:39.865 INFO  d.n.h.i.d.IndexRequestServer.restoreRequestsfromRequestDir - requestdir not found: creating request dir
2022-07-11 12:27:39.866 INFO  d.n.h.i.d.IndexRequestServer.start - 0 indexing jobs in progress that was stored in requestdir: /home/devel/Test6/requests
2022-07-11 12:27:39.867 INFO  d.n.h.i.d.IndexRequestServer.run - Enabling listening to the indexserver channel '[Queue 'Test6_COMMON_INDEX_SERVER']'
2022-07-11 12:27:39.868 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer@5511437b as listener to Test6_COMMON_INDEX_SERVER
12:27:35,892 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_ViewerProxyApplication.xml] at [file:/home/devel/Test6/conf/logback_ViewerProxyApplication.xml]
12:27:36,183 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:36,185 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:36,192 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:36,205 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:36,286 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:36,296 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:36,338 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@117009527 - No compression will be used
12:27:36,341 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@117009527 - Will use the pattern ./log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:27:36,351 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log'.
12:27:36,351 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - Roll-over at midnight.
12:27:36,358 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - Setting initial period to Mon Jul 11 12:27:36 CEST 2022
12:27:36,359 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:36,359 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:36,363 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:36,368 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ViewerProxyApplication.log
12:27:36,368 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ViewerProxyApplication.log]
12:27:36,370 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:37,016 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:37,026 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:37,027 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:37,027 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:37,027 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:37,028 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:37,028 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:37,029 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3ba9ad43 - Registering current configuration as safe fallback point

2022-07-11 12:27:37.034 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 12:27:37.040 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_332
2022-07-11 12:27:37.040 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
2022-07-11 12:27:37.041 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-07-11 12:27:37.041 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 12:27:37.041 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_ViewerProxyApplication.xml'
2022-07-11 12:27:37.239 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8370/8470
2022-07-11 12:27:37.240 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8370 communicating on port 8470 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8470/jndi/rmi://kb-test-acs-001.kb.dk:8370/jmxrmi
dk.netarkivet.viewerproxy.ViewerProxy Running
2022-07-11 12:27:37.243 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.viewerproxy.ViewerProxy Running
2022-07-11 12:27:37.261 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:37.262 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:37.255 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:37.263 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:37.269 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-acs-001.kb.dk
2022-07-11 12:27:37.263 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 12:27:39.037 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-07-11 12:27:39.043 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@5c18016b as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP
2022-07-11 12:27:39.060 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP']'
2022-07-11 12:27:39.061 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-07-11 12:27:39.061 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-07-11 12:27:39.075 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-07-11 12:27:39.088 INFO  d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-07-11 12:27:39.148 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found
2022-07-11 12:27:39.150 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found
2022-07-11 12:27:39.185 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'FULL_CRAWL_LOG' uses directory '/home/devel/Test6/cache/FULL_CRAWL_LOG'
2022-07-11 12:27:39.194 INFO  d.n.viewerproxy.ARCArchiveAccess.<init> - Constructed instance of ARCArchiveAccess with TryToLookupUriAsFtp: false
2022-07-11 12:27:39.225 INFO  dk.netarkivet.viewerproxy.WebProxy.<init> - Starting viewerproxy jetty on port 8078
--------------------------------------------
STARTING MACHINE: devel@kb-test-way-001.kb.dk
Starting all applications on: kb-test-way-001.kb.dk
Starting linux application: WaybackIndexerApplication
Starting linux application: AggregatorApplication
12:27:42,498 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_AggregatorApplication.xml] at [file:/home/devel/Test6/conf/logback_AggregatorApplication.xml]
12:27:42,913 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:42,914 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:42,952 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:43,004 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:43,198 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:43,240 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:43,382 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@477289012 - No compression will be used
12:27:43,383 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@477289012 - Will use the pattern ./log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:27:43,392 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log'.
12:27:43,392 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - Roll-over at midnight.
12:27:43,424 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - Setting initial period to Mon Jul 11 12:27:43 CEST 2022
12:27:43,425 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:43,425 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:43,429 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:43,435 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/AggregatorApplication.log
12:27:43,435 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/AggregatorApplication.log]
12:27:43,443 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:44,764 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:44,777 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:44,777 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:44,778 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:44,778 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:44,778 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:44,778 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:44,785 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3d3fcdb0 - Registering current configuration as safe fallback point

2022-07-11 12:27:44.805 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.wayback.aggregator.AggregationWorker
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 12:27:44.828 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.wayback.aggregator.AggregationWorker
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_25
2022-07-11 12:27:44.829 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
2022-07-11 12:27:44.831 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-07-11 12:27:44.831 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 12:27:44.838 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_AggregatorApplication.xml'
2022-07-11 12:27:45.164 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-way-001.kb.dk' and JMX/RMI ports 9170/9270
2022-07-11 12:27:45.167 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 9170 communicating on port 9270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-way-001.kb.dk:9270/jndi/rmi://kb-test-way-001.kb.dk:9170/jmxrmi
dk.netarkivet.wayback.aggregator.AggregationWorker Running
2022-07-11 12:27:45.168 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.wayback.aggregator.AggregationWorker Running
2022-07-11 12:27:45.196 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:45.225 DEBUG d.n.w.aggregator.AggregationWorker.runAggregation - No new raw index files found in '/home/devel/Test6/batchOutputDir' skipping aggregation
2022-07-11 12:27:45.196 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:45.225 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
12:27:42,738 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_WaybackIndexerApplication.xml] at [file:/home/devel/Test6/conf/logback_WaybackIndexerApplication.xml]
12:27:43,309 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:43,315 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:43,329 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:43,367 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:43,502 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:43,509 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:43,580 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1201484275 - No compression will be used
12:27:43,581 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1201484275 - Will use the pattern ./log/WaybackIndexerApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:27:43,591 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@40ef3420 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/WaybackIndexerApplication.%d{yyyy-MM-dd}.%i.log'.
12:27:43,591 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@40ef3420 - Roll-over at midnight.
12:27:43,612 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@40ef3420 - Setting initial period to Mon Jul 11 12:27:43 CEST 2022
12:27:43,613 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@40ef3420 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:43,613 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@40ef3420 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:43,620 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:43,633 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/WaybackIndexerApplication.log
12:27:43,633 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/WaybackIndexerApplication.log]
12:27:43,634 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:44,755 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:44,759 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:44,759 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:44,771 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:44,771 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:44,771 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:44,771 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:44,772 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@498d318c - Registering current configuration as safe fallback point

SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2022-07-11 12:27:44.791 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.wayback.indexer.WaybackIndexer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 12:27:44.820 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.wayback.indexer.WaybackIndexer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_25
2022-07-11 12:27:44.821 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
2022-07-11 12:27:44.821 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-07-11 12:27:44.822 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 12:27:44.822 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_WaybackIndexerApplication.xml'
2022-07-11 12:27:45.166 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-way-001.kb.dk' and JMX/RMI ports 8171/8271
2022-07-11 12:27:45.170 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8171 communicating on port 8271 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-way-001.kb.dk:8271/jndi/rmi://kb-test-way-001.kb.dk:8171/jmxrmi
dk.netarkivet.wayback.indexer.WaybackIndexer Running
2022-07-11 12:27:45.193 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.wayback.indexer.WaybackIndexer Running
2022-07-11 12:27:45.211 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:45.227 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:45.227 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 12:27:45.245 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:45.300 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 12:27:45.316 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-way-001.kb.dk
--------------------------------------------
--------------------------------------------
STARTING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
Starting all applications on: sb-test-har-001.statsbiblioteket.dk
Starting linux application: HarvestControllerApplication_sbhigh_h3
12:27:46,083 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] at [file:/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml]
12:27:46,222 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:27:46,224 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:27:46,230 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:27:46,240 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:46,278 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:27:46,280 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:27:46,293 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - No compression will be used
12:27:46,294 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - Will use the pattern ./log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
12:27:46,295 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
12:27:46,295 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Roll-over at midnight.
12:27:46,298 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Setting initial period to Mon Jul 11 12:27:46 CEST 2022
12:27:46,298 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:27:46,298 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:27:46,299 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:27:46,300 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_sbhigh_h3.log
12:27:46,300 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_sbhigh_h3.log]
12:27:46,301 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:27:46,551 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:27:46,552 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:27:46,552 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:27:46,553 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:27:46,553 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:27:46,553 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:27:46,553 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:27:46,553 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@40ef3420 - Registering current configuration as safe fallback point

2022-07-11 12:27:46.556 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 12:27:46.559 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_332
2022-07-11 12:27:46.560 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-2.el8_6.x86_64/jre
2022-07-11 12:27:46.560 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-2.el8_6.x86_64/jre
Working dir: /home/netarkdv/Test6
2022-07-11 12:27:46.560 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/netarkdv/Test6
2022-07-11 12:27:46.560 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/netarkdv/Test6/conf/settings_HarvestControllerApplication_sbhigh_h3.xml'
2022-07-11 12:27:46.648 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'sb-test-har-001.statsbiblioteket.dk' and JMX/RMI ports 8170/8270
2022-07-11 12:27:46.649 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://sb-test-har-001.statsbiblioteket.dk:8270/jndi/rmi://sb-test-har-001.statsbiblioteket.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 12:27:46.653 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 12:27:46.660 INFO  d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-07-11 12:27:46.660 INFO  d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2022-07-11 12:27:46.660 INFO  d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2022-07-11 12:27:46.660 INFO  d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-07-11 12:27:46.665 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:46.665 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 12:27:46.665 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 12:27:47.037 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/netarkdv/extra_configs/bitmag_config.
2022-07-11 12:27:47.037 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/netarkdv/extra_configs/bitmag_config.
2022-07-11 12:27:47.040 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): sb-test-har-001.statsbiblioteket.dk
2022-07-11 12:27:47.881 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-07-11 12:27:47.882 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@fd8294b as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3
2022-07-11 12:27:48.114 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3']'
2022-07-11 12:27:48.115 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/netarkdv/extra_configs/bitmag_config
2022-07-11 12:27:48.115 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-07-11 12:27:48.120 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-07-11 12:27:48.127 INFO  d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-07-11 12:27:48.192 INFO  d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-07-11 12:27:48.219 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-07-11 12:27:48.225 INFO  d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-07-11 12:27:48.225 INFO  d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_high'
2022-07-11 12:27:48.226 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@51850751 as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-07-11 12:27:48.375 INFO  d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'HIGHPRIORITY'
2022-07-11 12:27:48.495 INFO  d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'HIGHPRIORITY' is valid.
2022-07-11 12:27:48.496 INFO  d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY']'
2022-07-11 12:27:48.497 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@51850751 as listener to Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY
--------------------------------------------
Completed the script all_test.sh
Finished: SUCCESS