SuccessConsole Output

Skipping 249 KB.. Full Log
ster-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:48:57.426 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
10:48:58.231 INFO  o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
10:48:58.341 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:48:58.344 INFO  o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-5973]
10:48:58.348 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
10:48:58.348 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5973' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
10:48:58.349 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5973' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5973#282265585'.
10:48:58.349 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5973#282265585'.
10:48:58.374 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
10:48:58.388 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
10:48:58.391 INFO  o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-checksum-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@25084a1e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@156b88f5[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={10,95,28,-66,-13,68,11,-37,126,-52,-19,-26,61,2,-86,-19}, calculationTimestamp=2022-07-11T10:48:58.377+02:00]', while requested checksum 'null'. And the audit trail information 'null'.
10:48:58.414 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
10:48:59.064 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(683cde5f) collectionID Test6,  to netarkiv-checksum-devel-01,  destination topic://netarkiv-devel:  FileID=1-metadata-1.warc.gz
10:48:59.066 DEBUG o.b.commandline.DeleteFileCmd - Received event: 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
10:48:59.462 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(683cde5f) collectionID Test6,  from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.)
10:48:59.475 DEBUG o.b.c.c.ConversationEventMonitor - 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01
10:48:59.743 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(683cde5f) collectionID Test6,  from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.)
10:48:59.752 DEBUG o.b.commandline.DeleteFileCmd - Received event: 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01
10:48:59.754 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
10:48:59.754 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: []
10:48:59.755 DEBUG o.b.commandline.DeleteFileCmd - Received event: 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-checksum-devel-01]
10:48:59.756 DEBUG o.b.commandline.DeleteFileCmd - Received event: 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01], Sending request for deleting file
10:49:00.371 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(683cde5f) collectionID Test6,  from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:49:00.525 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(683cde5f) collectionID Test6,  to netarkiv-checksum-devel-01,  destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor:  FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@25084a1e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@156b88f5[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={10,95,28,-66,-13,68,11,-37,126,-52,-19,-26,61,2,-86,-19}, calculationTimestamp=2022-07-11T10:48:58.377+02:00]
10:49:00.533 DEBUG o.b.c.c.ConversationEventMonitor - 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
10:49:00.721 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(683cde5f) collectionID Test6,  from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:49:00.723 DEBUG o.b.c.c.ConversationEventMonitor - 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
10:49:00.980 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(683cde5f) collectionID Test6,  from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS
10:49:00.987 DEBUG o.b.commandline.DeleteFileCmd - Received event: 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-checksum-devel-01
10:49:01.257 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(683cde5f) collectionID Test6,  from netarkiv-checksum-devel-01: OPERATION_COMPLETED
10:49:01.258 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
10:49:01.258 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: []
10:49:01.259 DEBUG o.b.commandline.DeleteFileCmd - Complete: 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 
10:49:01.259 INFO  o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz': 
10:49:01.259 DEBUG o.b.commandline.DeleteFileCmd - 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 
10:49:02.576 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
10:49:02.654 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
10:49:02.943 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
10:49:02.995 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
10:49:03.733 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
10:49:03.753 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
10:49:03.753 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
10:49:03.984 INFO  o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:49:03.985 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
10:49:04.953 INFO  o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
10:49:05.042 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:49:05.044 INFO  o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-6014]
10:49:05.047 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
10:49:05.047 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6014' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
10:49:05.048 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6014' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6014#1249875355'.
10:49:05.048 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6014#1249875355'.
10:49:05.062 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
10:49:05.072 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
10:49:05.074 INFO  o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-kbh-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={10,95,28,-66,-13,68,11,-37,126,-52,-19,-26,61,2,-86,-19}, calculationTimestamp=2022-07-11T10:49:05.064+02:00]', while requested checksum 'null'. And the audit trail information 'null'.
10:49:05.094 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
10:49:05.725 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(e5df53d4) collectionID Test6,  to netarkiv-kbh-disk-devel-01,  destination topic://netarkiv-devel:  FileID=1-metadata-1.warc.gz
10:49:05.726 DEBUG o.b.commandline.DeleteFileCmd - Received event: e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
10:49:06.104 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(e5df53d4) collectionID Test6,  from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.)
10:49:06.129 DEBUG o.b.commandline.DeleteFileCmd - Received event: e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01
10:49:06.130 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
10:49:06.130 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: []
10:49:06.130 DEBUG o.b.commandline.DeleteFileCmd - Received event: e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01]
10:49:06.131 DEBUG o.b.commandline.DeleteFileCmd - Received event: e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-kbh-disk-devel-01], Sending request for deleting file
10:49:06.742 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(e5df53d4) collectionID Test6,  from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:49:06.750 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(e5df53d4) collectionID Test6,  to netarkiv-kbh-disk-devel-01,  destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01:  FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={10,95,28,-66,-13,68,11,-37,126,-52,-19,-26,61,2,-86,-19}, calculationTimestamp=2022-07-11T10:49:05.064+02:00]
10:49:06.768 DEBUG o.b.c.c.ConversationEventMonitor - e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
10:49:07.027 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(e5df53d4) collectionID Test6,  from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:49:07.028 DEBUG o.b.c.c.ConversationEventMonitor - e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
10:49:07.291 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(e5df53d4) collectionID Test6,  from netarkiv-kbh-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(Deleting..)
10:49:07.306 DEBUG o.b.commandline.DeleteFileCmd - Received event: e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-kbh-disk-devel-01, Deleting..
10:49:07.565 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(e5df53d4) collectionID Test6,  from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(1-metadata-1.warc.gz deleted.)
10:49:07.566 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
10:49:07.566 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: []
10:49:07.566 DEBUG o.b.commandline.DeleteFileCmd - Complete: e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 
10:49:07.567 INFO  o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz': 
10:49:07.567 DEBUG o.b.commandline.DeleteFileCmd - e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 
Deleting file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz with checksum e7062a763a61fb537d4ffcb471cc8ceb in collection Test6 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01
10:49:08.920 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
10:49:09.048 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
10:49:09.398 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
10:49:09.443 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
10:49:10.172 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
10:49:10.191 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
10:49:10.191 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
10:49:10.368 INFO  o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:49:10.369 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
10:49:11.224 INFO  o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
10:49:11.358 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:49:11.361 INFO  o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-6054]
10:49:11.365 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
10:49:11.366 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6054' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
10:49:11.366 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6054' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6054#1297836716'.
10:49:11.366 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6054#1297836716'.
10:49:11.394 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
10:49:11.408 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
10:49:11.410 INFO  o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-tape-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:11.397+02:00]', while requested checksum 'null'. And the audit trail information 'null'.
10:49:11.430 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
10:49:12.189 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(d0085a97) collectionID Test6,  to netarkiv-tape-devel-01,  destination topic://netarkiv-devel:  FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz
10:49:12.191 DEBUG o.b.commandline.DeleteFileCmd - Received event: d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
10:49:12.560 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(d0085a97) collectionID Test6,  from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.)
10:49:12.570 DEBUG o.b.c.c.ConversationEventMonitor - d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01
10:49:12.822 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(d0085a97) collectionID Test6,  from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
10:49:12.831 DEBUG o.b.c.c.ConversationEventMonitor - d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
10:49:13.074 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(d0085a97) collectionID Test6,  from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
10:49:13.075 DEBUG o.b.commandline.DeleteFileCmd - Received event: d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01
10:49:13.076 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01
10:49:13.076 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: []
10:49:13.076 DEBUG o.b.commandline.DeleteFileCmd - Received event: d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-tape-devel-01]
10:49:13.077 DEBUG o.b.commandline.DeleteFileCmd - Received event: d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-tape-devel-01], Sending request for deleting file
10:49:13.323 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(d0085a97) collectionID Test6,  to netarkiv-tape-devel-01,  destination queue://netarkiv-tape-devel-01:  FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:11.397+02:00]
10:49:13.874 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(d0085a97) collectionID Test6,  from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS)
10:49:13.875 DEBUG o.b.commandline.DeleteFileCmd - Received event: d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS
10:49:14.134 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(d0085a97) collectionID Test6,  from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED)
10:49:14.135 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01
10:49:14.135 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: []
10:49:14.136 DEBUG o.b.commandline.DeleteFileCmd - Complete: d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 
10:49:14.136 INFO  o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 
10:49:14.136 DEBUG o.b.commandline.DeleteFileCmd - d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 
10:49:15.401 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
10:49:15.501 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
10:49:15.786 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
10:49:15.815 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
10:49:16.463 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
10:49:16.480 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
10:49:16.481 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
10:49:16.659 INFO  o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:49:16.660 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
10:49:17.550 INFO  o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
10:49:17.628 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:49:17.630 INFO  o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-6093]
10:49:17.632 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
10:49:17.633 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6093' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
10:49:17.633 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6093' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6093#1297836716'.
10:49:17.633 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6093#1297836716'.
10:49:17.649 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
10:49:17.658 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
10:49:17.660 INFO  o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:17.651+02:00]', while requested checksum 'null'. And the audit trail information 'null'.
10:49:17.674 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
10:49:18.191 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(03ccb09c) collectionID Test6,  to netarkiv-disk-devel-01,  destination topic://netarkiv-devel:  FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz
10:49:18.192 DEBUG o.b.commandline.DeleteFileCmd - Received event: 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
10:49:18.558 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(03ccb09c) collectionID Test6,  from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.)
10:49:18.579 DEBUG o.b.c.c.ConversationEventMonitor - 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01
10:49:18.833 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(03ccb09c) collectionID Test6,  from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
10:49:18.834 DEBUG o.b.commandline.DeleteFileCmd - Received event: 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01
10:49:18.835 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01
10:49:18.835 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: []
10:49:18.839 DEBUG o.b.commandline.DeleteFileCmd - Received event: 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-disk-devel-01]
10:49:18.840 DEBUG o.b.commandline.DeleteFileCmd - Received event: 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-disk-devel-01], Sending request for deleting file
10:49:19.345 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(03ccb09c) collectionID Test6,  from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:49:19.418 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(03ccb09c) collectionID Test6,  to netarkiv-disk-devel-01,  destination queue://netarkiv-disk-devel-01:  FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:17.651+02:00]
10:49:19.419 DEBUG o.b.c.c.ConversationEventMonitor - 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
10:49:19.973 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(03ccb09c) collectionID Test6,  from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS)
10:49:19.976 DEBUG o.b.commandline.DeleteFileCmd - Received event: 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS
10:49:20.223 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(03ccb09c) collectionID Test6,  from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED)
10:49:20.224 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01
10:49:20.224 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: []
10:49:20.224 DEBUG o.b.commandline.DeleteFileCmd - Complete: 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 
10:49:20.225 INFO  o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 
10:49:20.225 DEBUG o.b.commandline.DeleteFileCmd - 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 
10:49:21.500 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
10:49:21.610 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
10:49:21.985 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
10:49:22.035 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
10:49:22.842 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
10:49:22.859 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
10:49:22.860 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
10:49:23.022 INFO  o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:49:23.022 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
10:49:23.868 INFO  o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
10:49:23.959 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:49:23.962 INFO  o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-6133]
10:49:23.965 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
10:49:23.966 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6133' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
10:49:23.966 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6133' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6133#1297836716'.
10:49:23.966 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6133#1297836716'.
10:49:23.987 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
10:49:23.999 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
10:49:24.001 INFO  o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-checksum-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:23.990+02:00]', while requested checksum 'null'. And the audit trail information 'null'.
10:49:24.021 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
10:49:24.748 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(a3aa95c4) collectionID Test6,  to netarkiv-checksum-devel-01,  destination topic://netarkiv-devel:  FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz
10:49:24.748 DEBUG o.b.commandline.DeleteFileCmd - Received event: a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
10:49:25.092 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(a3aa95c4) collectionID Test6,  from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.)
10:49:25.108 DEBUG o.b.c.c.ConversationEventMonitor - a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01
10:49:25.454 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(a3aa95c4) collectionID Test6,  from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.)
10:49:25.459 DEBUG o.b.commandline.DeleteFileCmd - Received event: a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01
10:49:25.460 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
10:49:25.460 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: []
10:49:25.461 DEBUG o.b.commandline.DeleteFileCmd - Received event: a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-checksum-devel-01]
10:49:25.461 DEBUG o.b.commandline.DeleteFileCmd - Received event: a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01], Sending request for deleting file
10:49:25.986 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(a3aa95c4) collectionID Test6,  from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:49:26.136 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(a3aa95c4) collectionID Test6,  to netarkiv-checksum-devel-01,  destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor:  FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:23.990+02:00]
10:49:26.136 DEBUG o.b.c.c.ConversationEventMonitor - a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
10:49:26.359 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(a3aa95c4) collectionID Test6,  from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:49:26.370 DEBUG o.b.c.c.ConversationEventMonitor - a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
10:49:26.621 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(a3aa95c4) collectionID Test6,  from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS
10:49:26.628 DEBUG o.b.commandline.DeleteFileCmd - Received event: a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-checksum-devel-01
10:49:26.906 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(a3aa95c4) collectionID Test6,  from netarkiv-checksum-devel-01: OPERATION_COMPLETED
10:49:26.907 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
10:49:26.907 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: []
10:49:26.908 DEBUG o.b.commandline.DeleteFileCmd - Complete: a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 
10:49:26.908 INFO  o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 
10:49:26.908 DEBUG o.b.commandline.DeleteFileCmd - a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 
10:49:28.227 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
10:49:28.307 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
10:49:28.621 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
10:49:28.649 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
10:49:29.406 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
10:49:29.421 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
10:49:29.421 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
10:49:29.607 INFO  o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:49:29.608 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
10:49:30.533 INFO  o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
10:49:30.626 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:49:30.629 INFO  o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-6173]
10:49:30.631 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
10:49:30.632 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@73700b80' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6173' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
10:49:30.632 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6173' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@73700b80'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6173#1936722816'.
10:49:30.632 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6173#1936722816'.
10:49:30.648 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
10:49:30.657 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
10:49:30.660 INFO  o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-kbh-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@4efc180e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@bd4dc25[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:30.650+02:00]', while requested checksum 'null'. And the audit trail information 'null'.
10:49:30.674 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
10:49:31.239 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(fde55508) collectionID Test6,  to netarkiv-kbh-disk-devel-01,  destination topic://netarkiv-devel:  FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz
10:49:31.240 DEBUG o.b.commandline.DeleteFileCmd - Received event: fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
10:49:31.650 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fde55508) collectionID Test6,  from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.)
10:49:31.657 DEBUG o.b.commandline.DeleteFileCmd - Received event: fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01
10:49:31.658 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
10:49:31.658 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: []
10:49:31.658 DEBUG o.b.commandline.DeleteFileCmd - Received event: fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01]
10:49:31.659 DEBUG o.b.commandline.DeleteFileCmd - Received event: fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-kbh-disk-devel-01], Sending request for deleting file
10:49:32.120 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fde55508) collectionID Test6,  from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:49:32.534 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(fde55508) collectionID Test6,  to netarkiv-kbh-disk-devel-01,  destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01:  FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@4efc180e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@bd4dc25[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:30.650+02:00]
10:49:32.535 DEBUG o.b.c.c.ConversationEventMonitor - fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
10:49:32.680 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fde55508) collectionID Test6,  from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:49:32.683 DEBUG o.b.c.c.ConversationEventMonitor - fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
10:49:32.935 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(fde55508) collectionID Test6,  from netarkiv-kbh-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(Deleting..)
10:49:32.937 DEBUG o.b.commandline.DeleteFileCmd - Received event: fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-kbh-disk-devel-01, Deleting..
10:49:33.280 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(fde55508) collectionID Test6,  from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz deleted.)
10:49:33.281 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
10:49:33.281 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: []
10:49:33.282 DEBUG o.b.commandline.DeleteFileCmd - Complete: fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 
10:49:33.282 INFO  o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 
10:49:33.282 DEBUG o.b.commandline.DeleteFileCmd - fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 
calling cleanup_hosts
running cleanup_hosts
Removing installation on sb-test-har-001.statsbiblioteket.dk
Removing installation on kb-test-har-003.kb.dk
Removing installation on kb-test-har-004.kb.dk
Removing installation on kb-test-har-005.kb.dk
Removing installation on kb-test-adm-001.kb.dk
Removing installation on kb-test-acs-001.kb.dk
Removing installation on kb-test-way-001.kb.dk
calling cleanup_linuxbarhosts
running cleanup_linuxbarhosts
Removing installation on sb-test-bar-001.statsbiblioteket.dk
Removing bitarchive on sb-test-bar-001.statsbiblioteket.dk
Calling cleanup_windowsbarhosts
running cleanup_windowsbarhosts
Removing C:\bitarkiv\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing E:\bitarchive_1\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing F:\bitarchive_2\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing g:\bitarchive_3\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
Removing C:\Users\ba-devel\Test6 on kb-test-bar-01.bitarkiv.kb.dk
ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out
TESTX=Test6
PORT=8078
MAILRECEIVERS=csr@kb.dk
VERSION=CSR
DEPLOYCONF=deploy_config_bitmag.xml
H3ZIP=CSR
BITMAGCONF=/home/devel/bitmag_test_config/client_config
Using bundler file /home/devel/nas_versions/bundler/NetarchiveSuite-heritrix3-bundler-CSR.zip
Creating distribution files in /home/devel/prepared_software/Test6.
Will read source files using encoding 'UTF-8' (defaulted)
Branch in settings not found: common.warcRecordService
Branch in settings not found: common.arcrepositoryClient.bitrepository.getFileIDsMaxResults
Branch in settings not found: common.hadoop.kerberos
Branch in settings not found: common.hadoop.username
Branch in settings not found: common.hadoop.mapred.hadoopUberJar
Branch in settings not found: common.hadoop.mapred.inputFilesParentDir
Branch in settings not found: common.hadoop.mapred.cdxJob
Branch in settings not found: common.hadoop.mapred.metadataExtractionJob
Branch in settings not found: common.hadoop.mapred.metadataCDXExtractionJob
Branch in settings not found: common.hadoop.mapred.crawlLogExtractionJob
Branch in settings not found: common.fileResolver.class
Branch in settings not found: common.fileResolver.baseUrl
Branch in settings not found: common.fileResolver.keyfile
Branch in settings not found: common.webinterface.metadata_cache_dir
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Machine 'kb-test-adm-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-har-003.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks
Machine 'kb-test-har-005.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks
Machine 'kb-test-har-004.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
Machine 'kb-test-acs-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-way-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'sb-test-har-001.statsbiblioteket.dk' configured with encoding 'UTF-8' (defaulted)
/home/devel/prepared_software/Test6/NetarchiveSuite-heritrix3-bundler.zip -> /home/netarkdv/Test6/NetarchiveSuite-heritrix3-bundler.zip
10:55:01.239 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:55:01.244 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
10:55:01.245 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:55:01.245 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
10:55:01.245 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:55:01.246 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
10:55:01.246 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:55:01.246 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
10:55:01.247 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:55:01.247 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
10:55:01.247 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:55:01.247 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
10:55:01.315 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:55:01.315 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-adm-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-adm-001.kb.dk
deleting devel@kb-test-adm-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-adm-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-003.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-003.kb.dk
deleting devel@kb-test-har-003.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-003.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-005.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-005.kb.dk
deleting devel@kb-test-har-005.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-005.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-004.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-004.kb.dk
deleting devel@kb-test-har-004.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-004.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-acs-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-acs-001.kb.dk
deleting devel@kb-test-acs-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-acs-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-way-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-way-001.kb.dk
deleting devel@kb-test-way-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-way-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
--------------------------------------------
INSTALLING TO MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
copying NetarchiveSuite-CSR.zip to:sb-test-har-001.statsbiblioteket.dk
deleting netarkdv@sb-test-har-001.statsbiblioteket.dk:/home/netarkdv/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:sb-test-har-001.statsbiblioteket.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
Initializing database for system Test6
+ host=devel@kb-test-adm-001
+ scp -p /home/devel/devel-config/scripts/db/setup_admindb.sh /home/devel/devel-config/scripts/db/setup_harvestdb.sh /home/devel/devel-config/scripts/db/teardown_admindb.sh /home/devel/devel-config/scripts/db/teardown_harvestdb.sh /home/devel/devel-config/scripts/../resources/harvestdb.testdata.sql /home/devel/devel-config/scripts/../resources/default_orderxml.cxml devel@kb-test-adm-001:bin/
+ ssh devel@kb-test-adm-001
Pseudo-terminal will not be allocated because stdin is not a terminal.
Dette system må kun tilgås af brugere autoriserede af Det Kgl. Bibliotek.

This system is only to be used by users authorized by
the Royal Danish Library.
Destroying test6_admindb
DROP DATABASE
Creating empty test6_admindb
CREATE DATABASE
Initialising test6_admindb
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
Destroying test6_harvestdb
DROP DATABASE
CREATE DATABASE
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
GRANT
CREATE TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE INDEX
GRANT
CREATE TABLE
GRANT
CREATE TABLE
CREATE INDEX
GRANT
CREATE TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
CREATE TABLE
CREATE INDEX
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
CREATE TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
CREATE TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
INSERT 0 1
INSERT 0 1
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE INDEX
CREATE SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
GRANT
INSERT 0 1
INSERT 0 1
INSERT 0 1
SET
SET
SET
SET
SET
SET
SET
SET
SET
COPY 16
COPY 16
 setval 
--------
     17
(1 row)

COPY 16
 setval 
--------
     17
(1 row)

COPY 3
 setval 
--------
     17
(1 row)

COPY 2
 setval 
--------
      5
(1 row)

COPY 4
 setval 
--------
      4
(1 row)

COPY 25
COPY 16
 setval 
--------
     17
(1 row)

10:56:59.699 [MLog-Init-Reporter] INFO com.mchange.v2.log.MLog - MLog clients using slf4j logging.
10:56:59.729 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - Reading VM config for path list /com/mchange/v2/log/default-mchange-log.properties, /mchange-commons.properties, /c3p0.properties, hocon:/reference,/application,/c3p0,/, /mchange-log.properties, /
10:56:59.730 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
10:56:59.730 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
10:56:59.730 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
10:56:59.730 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
10:56:59.742 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
10:56:59.742 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
10:56:59.743 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
10:56:59.743 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
10:57:00.195 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.5.4 [built 23-March-2019 23:00:48 -0700; debug? true; trace: 10]
10:57:00.285 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ap1tm3dtr1lc8ghk|f4168b8,name=10bdx52ap1tm3dtr1lc8ghk|f4168b8 registered.
10:57:00.357 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ap1tm3dtr1lc8ghk|f4168b8,name=10bdx52ap1tm3dtr1lc8ghk|f4168b8 unregistered, in order to be reregistered after update.
10:57:00.358 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ap1tm3dtr1lc8ghk|f4168b8,name=10bdx52ap1tm3dtr1lc8ghk|f4168b8 registered.
10:57:00.377 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
10:57:00.460 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, dataSourceName -> 10bdx52ap1tm3dtr1lc8ghk|f4168b8, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, extensions -> {}, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, forceUseNamedDriverClass -> false, identityToken -> 10bdx52ap1tm3dtr1lc8ghk|f4168b8, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost:5432/test6_harvestdb, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 3600, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, preferredTestQuery -> null, privilegeSpawnedThreads -> false, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ]
10:57:00.510 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
10:57:00.511 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
10:57:00.511 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
10:57:00.511 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
10:57:00.511 [main] WARN com.mchange.v2.resourcepool.BasicResourcePool - Bad pool size config, start 3 < min 5. Using 5 as start.
10:57:00.536 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@5be6e01c config: [start -> 5; min -> 5; max -> 20; inc -> 5; num_acq_attempts -> 30; acq_attempt_delay -> 1000; check_idle_resources_delay -> 0; max_resource_age -> 3600000; max_idle_time -> 0; excess_max_idle_time -> 0; destroy_unreturned_resc_time -> 0; expiration_enforcement_delay -> 900000; break_on_acquisition_failure -> false; debug_store_checkout_exceptions -> false; force_synchronous_checkins -> false]
10:57:00.536 [main] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPoolManager - Created new pool for auth, username (masked): 'de******'.
10:57:00.536 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - acquire test -- pool size: 0; target_pool_size: 5; desired target? 1
10:57:00.536 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - awaitAvailable(): [unknown]
10:57:00.836 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@3911c2a7 [wrapping: SELECT version FROM schemaversions WHERE tablename = 'ordertemplates'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@1725dc0f [wrapping: null]
10:57:00.844 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@2145b572 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@15eb5ee5 [wrapping: null]
10:57:00.876 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@35ef1869 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@3c407114 [wrapping: null]
The template 'default_orderxml' has now been updated.
+ set +x
--------------------------------------------
STARTING MACHINE: devel@kb-test-adm-001.kb.dk
Starting all applications on: kb-test-adm-001.kb.dk
Starting linux application: GUIApplication
Starting linux application: ArcRepositoryApplication
Starting linux application: HarvestJobManagerApplication
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-003.kb.dk
Starting all applications on: kb-test-har-003.kb.dk
Starting linux application: HarvestControllerApplication_kblow001_h3
10:57:08,560 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml]
10:57:08,810 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
10:57:08,813 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
10:57:08,820 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
10:57:08,833 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:08,892 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:57:08,899 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
10:57:08,928 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - No compression will be used
10:57:08,929 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - Will use the pattern ./log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log for the active file
10:57:08,932 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log'.
10:57:08,932 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Roll-over at midnight.
10:57:08,936 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Setting initial period to Mon Jul 11 10:57:08 CEST 2022
10:57:08,936 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
10:57:08,937 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
10:57:08,939 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:08,941 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow001_h3.log
10:57:08,941 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow001_h3.log]
10:57:08,942 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
10:57:09,444 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
10:57:09,446 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
10:57:09,447 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
10:57:09,447 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
10:57:09,447 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
10:57:09,448 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
10:57:09,448 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
10:57:09,450 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@40ef3420 - Registering current configuration as safe fallback point

2022-07-11 10:57:09.462 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 10:57:09.469 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_332
2022-07-11 10:57:09.470 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
2022-07-11 10:57:09.470 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-07-11 10:57:09.470 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 10:57:09.475 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow001_h3.xml'
2022-07-11 10:57:09.611 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-003.kb.dk' and JMX/RMI ports 8170/8270
2022-07-11 10:57:09.612 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-003.kb.dk:8270/jndi/rmi://kb-test-har-003.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 10:57:09.618 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 10:57:09.621 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:09.622 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:09.622 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 10:57:09.634 INFO  d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-07-11 10:57:09.635 INFO  d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2022-07-11 10:57:09.635 INFO  d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2022-07-11 10:57:09.636 INFO  d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-07-11 10:57:09.756 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:09.757 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:09.771 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-har-003.kb.dk
2022-07-11 10:57:11.193 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-07-11 10:57:11.194 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@5c3b6c6e as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3
2022-07-11 10:57:11.206 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3']'
2022-07-11 10:57:11.207 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-07-11 10:57:11.207 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-07-11 10:57:11.212 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-07-11 10:57:11.221 INFO  d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-07-11 10:57:11.272 INFO  d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-07-11 10:57:11.299 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-07-11 10:57:11.301 INFO  d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-07-11 10:57:11.301 INFO  d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_low'
2022-07-11 10:57:11.302 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7c56e013 as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-07-11 10:57:11.335 INFO  d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'LOWPRIORITY'
2022-07-11 10:57:11.348 INFO  d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'LOWPRIORITY' is valid.
2022-07-11 10:57:11.350 INFO  d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY']'
2022-07-11 10:57:11.350 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7c56e013 as listener to Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-005.kb.dk
Starting all applications on: kb-test-har-005.kb.dk
Starting linux application: HarvestControllerApplication_browser_1
Starting linux application: HarvestControllerApplication_browser_2
10:57:14,089 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml]
10:57:14,471 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
10:57:14,475 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
10:57:14,496 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
10:57:14,526 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:14,657 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:57:14,661 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
10:57:14,693 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - No compression will be used
10:57:14,694 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - Will use the pattern ./log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log for the active file
10:57:14,709 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log'.
10:57:14,709 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Roll-over at midnight.
10:57:14,715 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Setting initial period to Mon Jul 11 10:57:14 CEST 2022
10:57:14,715 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
10:57:14,715 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
10:57:14,717 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:14,731 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_1.log
10:57:14,731 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_1.log]
10:57:14,732 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
10:57:15,609 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
10:57:15,611 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
10:57:15,612 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
10:57:15,612 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
10:57:15,612 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
10:57:15,613 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
10:57:15,613 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
10:57:15,613 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@333291e3 - Registering current configuration as safe fallback point

2022-07-11 10:57:15.632 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 10:57:15.638 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_312
2022-07-11 10:57:15.639 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2022-07-11 10:57:15.639 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-07-11 10:57:15.639 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 10:57:15.640 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_1.xml'
2022-07-11 10:57:15.906 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8170/8270
2022-07-11 10:57:15.906 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8270/jndi/rmi://kb-test-har-005.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 10:57:15.911 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 10:57:15.922 INFO  d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-07-11 10:57:15.923 INFO  d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'BROWSER'
2022-07-11 10:57:15.923 INFO  d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_browser_1'
2022-07-11 10:57:15.923 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:15.923 INFO  d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-07-11 10:57:15.924 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:15.924 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 10:57:16.119 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:16.120 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:16.148 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-har-005.kb.dk
2022-07-11 10:57:18.318 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-07-11 10:57:18.319 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@26425897 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1
2022-07-11 10:57:18.346 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1']'
2022-07-11 10:57:18.346 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-07-11 10:57:18.347 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-07-11 10:57:18.361 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-07-11 10:57:18.372 INFO  d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-07-11 10:57:18.434 INFO  d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-07-11 10:57:18.461 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-07-11 10:57:18.463 INFO  d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-07-11 10:57:18.463 INFO  d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_1'
2022-07-11 10:57:18.463 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-07-11 10:57:18.492 INFO  d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'BROWSER'
2022-07-11 10:57:18.500 INFO  d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'BROWSER' is valid.
2022-07-11 10:57:18.501 INFO  d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_BROWSER']'
2022-07-11 10:57:18.501 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_JOB_PARTIAL_BROWSER
10:57:14,073 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml]
10:57:14,476 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
10:57:14,492 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
10:57:14,523 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
10:57:14,547 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:14,634 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:57:14,648 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
10:57:14,683 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - No compression will be used
10:57:14,684 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - Will use the pattern ./log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log for the active file
10:57:14,687 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log'.
10:57:14,687 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Roll-over at midnight.
10:57:14,693 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Setting initial period to Mon Jul 11 10:57:14 CEST 2022
10:57:14,693 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
10:57:14,693 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
10:57:14,695 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:14,697 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_2.log
10:57:14,697 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_2.log]
10:57:14,698 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
10:57:15,439 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
10:57:15,442 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
10:57:15,442 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
10:57:15,468 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
10:57:15,468 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
10:57:15,468 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
10:57:15,469 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
10:57:15,469 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@333291e3 - Registering current configuration as safe fallback point

2022-07-11 10:57:15.474 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 10:57:15.494 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_312
2022-07-11 10:57:15.495 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2022-07-11 10:57:15.495 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-07-11 10:57:15.495 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 10:57:15.500 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_2.xml'
2022-07-11 10:57:15.680 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8175/8275
2022-07-11 10:57:15.680 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8175 communicating on port 8275 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8275/jndi/rmi://kb-test-har-005.kb.dk:8175/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 10:57:15.685 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 10:57:15.694 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:15.695 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:15.695 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 10:57:15.704 INFO  d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-07-11 10:57:15.704 INFO  d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'BROWSER'
2022-07-11 10:57:15.704 INFO  d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_browser_2'
2022-07-11 10:57:15.705 INFO  d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-07-11 10:57:15.838 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:15.839 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:15.853 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-har-005.kb.dk
2022-07-11 10:57:18.041 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-07-11 10:57:18.042 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@26425897 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2
2022-07-11 10:57:18.061 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2']'
2022-07-11 10:57:18.062 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-07-11 10:57:18.062 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-07-11 10:57:18.066 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-07-11 10:57:18.088 INFO  d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-07-11 10:57:18.200 INFO  d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-07-11 10:57:18.226 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-07-11 10:57:18.228 INFO  d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-07-11 10:57:18.228 INFO  d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_2'
2022-07-11 10:57:18.228 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-07-11 10:57:18.246 INFO  d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'BROWSER' is valid.
2022-07-11 10:57:18.247 INFO  d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_BROWSER']'
2022-07-11 10:57:18.248 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_JOB_PARTIAL_BROWSER
2022-07-11 10:57:18.249 INFO  d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'BROWSER'
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-004.kb.dk
Starting all applications on: kb-test-har-004.kb.dk
Starting linux application: HarvestControllerApplication_kblow002_h3
Starting linux application: HarvestControllerApplication_kbhigh_h3
10:57:20,704 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml]
10:57:21,621 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
10:57:21,635 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
10:57:21,675 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
10:57:21,743 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:21,912 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:57:21,925 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
10:57:22,046 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - No compression will be used
10:57:22,056 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - Will use the pattern ./log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
10:57:22,069 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
10:57:22,069 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Roll-over at midnight.
10:57:22,088 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Setting initial period to Mon Jul 11 10:57:22 CEST 2022
10:57:22,089 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
10:57:22,089 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
10:57:22,096 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:22,111 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbhigh_h3.log
10:57:22,111 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbhigh_h3.log]
10:57:22,116 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
10:57:23,151 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
10:57:23,159 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
10:57:23,159 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
10:57:23,161 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
10:57:23,161 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
10:57:23,164 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
10:57:23,164 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
10:57:23,166 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2473d930 - Registering current configuration as safe fallback point

2022-07-11 10:57:23.186 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 10:57:23.229 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_25
2022-07-11 10:57:23.232 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2022-07-11 10:57:23.236 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-07-11 10:57:23.239 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 10:57:23.243 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kbhigh_h3.xml'
2022-07-11 10:57:23.640 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8172/8272
2022-07-11 10:57:23.640 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8172 communicating on port 8272 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8272/jndi/rmi://kb-test-har-004.kb.dk:8172/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 10:57:23.646 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 10:57:23.669 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:23.670 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:23.670 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 10:57:23.693 INFO  d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-07-11 10:57:23.694 INFO  d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2022-07-11 10:57:23.694 INFO  d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2022-07-11 10:57:23.695 INFO  d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-07-11 10:57:24.039 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:24.061 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:24.093 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-har-004.kb.dk
10:57:20,570 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml]
10:57:21,472 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
10:57:21,498 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
10:57:21,537 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
10:57:21,599 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:21,792 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:57:21,807 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
10:57:21,921 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - No compression will be used
10:57:21,924 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - Will use the pattern ./log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log for the active file
10:57:21,933 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log'.
10:57:21,933 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Roll-over at midnight.
10:57:21,954 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Setting initial period to Mon Jul 11 10:57:21 CEST 2022
10:57:21,955 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
10:57:21,955 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
10:57:21,966 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:21,978 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow002_h3.log
10:57:21,978 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow002_h3.log]
10:57:21,980 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
10:57:23,078 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
10:57:23,097 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
10:57:23,097 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
10:57:23,098 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
10:57:23,098 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
10:57:23,099 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
10:57:23,099 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
10:57:23,100 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2473d930 - Registering current configuration as safe fallback point

2022-07-11 10:57:23.120 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 10:57:23.144 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_25
2022-07-11 10:57:23.145 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2022-07-11 10:57:23.152 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-07-11 10:57:23.154 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 10:57:23.155 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow002_h3.xml'
2022-07-11 10:57:23.525 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8170/8270
2022-07-11 10:57:23.526 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8270/jndi/rmi://kb-test-har-004.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 10:57:23.549 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 10:57:23.570 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:23.570 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:23.571 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 10:57:23.591 INFO  d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-07-11 10:57:23.593 INFO  d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2022-07-11 10:57:23.593 INFO  d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2022-07-11 10:57:23.603 INFO  d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-07-11 10:57:23.973 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:24.008 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:24.051 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-har-004.kb.dk
--------------------------------------------
STARTING MACHINE: devel@kb-test-acs-001.kb.dk
Starting all applications on: kb-test-acs-001.kb.dk
Starting linux application: IndexServerApplication
Starting linux application: ViewerProxyApplication
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
10:57:25,602 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_IndexServerApplication.xml] at [file:/home/devel/Test6/conf/logback_IndexServerApplication.xml]
10:57:25,864 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
10:57:25,867 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
10:57:25,874 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
10:57:25,886 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:25,987 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:57:25,997 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
10:57:26,055 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@29183965 - No compression will be used
10:57:26,057 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@29183965 - Will use the pattern ./log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log for the active file
10:57:26,063 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log'.
10:57:26,063 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - Roll-over at midnight.
10:57:26,071 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - Setting initial period to Mon Jul 11 10:57:26 CEST 2022
10:57:26,072 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
10:57:26,072 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
10:57:26,075 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:26,083 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/IndexServerApplication.log
10:57:26,083 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/IndexServerApplication.log]
10:57:26,085 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
10:57:27,044 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
10:57:27,047 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
10:57:27,047 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
10:57:27,048 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
10:57:27,048 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
10:57:27,048 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
10:57:27,048 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
10:57:27,049 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4f83df68 - Registering current configuration as safe fallback point

SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2022-07-11 10:57:27.055 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 10:57:27.062 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_332
2022-07-11 10:57:27.063 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
2022-07-11 10:57:27.074 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-07-11 10:57:27.074 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 10:57:27.074 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_IndexServerApplication.xml'
2022-07-11 10:57:27.249 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8371/8471
2022-07-11 10:57:27.250 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8371 communicating on port 8471 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8471/jndi/rmi://kb-test-acs-001.kb.dk:8371/jmxrmi
dk.netarkivet.harvester.indexserver.IndexServer Running
2022-07-11 10:57:27.259 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.indexserver.IndexServer Running
2022-07-11 10:57:27.265 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata'
2022-07-11 10:57:27.269 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:27.270 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:27.270 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 10:57:27.293 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:27.293 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:27.298 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-acs-001.kb.dk
2022-07-11 10:57:29.305 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-07-11 10:57:29.306 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@4fc5e095 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS
2022-07-11 10:57:29.320 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS']'
2022-07-11 10:57:29.321 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-07-11 10:57:29.321 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-07-11 10:57:29.326 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-07-11 10:57:29.338 INFO  d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-07-11 10:57:29.390 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found
2022-07-11 10:57:29.392 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found
2022-07-11 10:57:29.428 INFO  d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2022-07-11 10:57:29.428 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxindex' uses directory '/home/devel/Test6/cache/cdxindex'
2022-07-11 10:57:29.431 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'crawllog' uses directory '/home/devel/Test6/cache/crawllog'
2022-07-11 10:57:29.431 INFO  d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled
2022-07-11 10:57:29.432 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'dedupcrawllogindex' uses directory '/home/devel/Test6/cache/dedupcrawllogindex'
2022-07-11 10:57:29.432 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata'
2022-07-11 10:57:29.433 INFO  d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2022-07-11 10:57:29.434 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'crawllog' uses directory '/home/devel/Test6/cache/crawllog'
2022-07-11 10:57:29.434 INFO  d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled
2022-07-11 10:57:29.434 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'fullcrawllogindex' uses directory '/home/devel/Test6/cache/fullcrawllogindex'
2022-07-11 10:57:29.435 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata'
2022-07-11 10:57:29.435 INFO  d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2022-07-11 10:57:29.436 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/cdxindex/empty-cache.working
2022-07-11 10:57:29.436 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/cdxindex/empty-cache.working' (thread = main)
2022-07-11 10:57:29.440 DEBUG d.n.common.utils.ProcessUtils.runProcess - Running external program: sort /home/devel/Test6/cache/cdxindex/empty-cache -o /home/devel/Test6/cache/cdxindex/empty-cache.unsorted with environment LANG=C
2022-07-11 10:57:29.469 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@18f20260
2022-07-11 10:57:29.470 INFO  d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/cdxindex/empty-cache' of id '[]', request was for '[]'
2022-07-11 10:57:29.470 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/dedupcrawllogindex/empty-cache.working
2022-07-11 10:57:29.471 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/dedupcrawllogindex/empty-cache.working' (thread = main)
2022-07-11 10:57:29.471 INFO  d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate dedupcrawllogindex for the 0 jobs: []
2022-07-11 10:57:29.471 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main)
2022-07-11 10:57:29.643 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1)
2022-07-11 10:57:29.653 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)!
2022-07-11 10:57:29.654 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1
2022-07-11 10:57:29.655 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1
2022-07-11 10:57:29.661 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes
2022-07-11 10:57:29.662 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@55e7a35c
2022-07-11 10:57:29.663 INFO  d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/dedupcrawllogindex/empty-cache' of id '[]', request was for '[]'
2022-07-11 10:57:29.663 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/fullcrawllogindex/empty-cache.working
2022-07-11 10:57:29.663 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/fullcrawllogindex/empty-cache.working' (thread = main)
2022-07-11 10:57:29.664 INFO  d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate fullcrawllogindex for the 0 jobs: []
2022-07-11 10:57:29.664 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main)
2022-07-11 10:57:29.667 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1)
2022-07-11 10:57:29.669 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)!
2022-07-11 10:57:29.670 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1
2022-07-11 10:57:29.671 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1
2022-07-11 10:57:29.672 INFO  d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes
2022-07-11 10:57:29.673 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@5922ae77
2022-07-11 10:57:29.674 INFO  d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/fullcrawllogindex/empty-cache' of id '[]', request was for '[]'
2022-07-11 10:57:29.722 INFO  d.n.c.utils.hadoop.HadoopJobUtils.doKerberosLogin - Kerberos: /home/devel/extra_configs/kerberos_config/krb5.conf, /home/devel/extra_configs/kerberos_config/nat-nas-devel.keytab, nat-nas-devel@KBHPC.KB.DK
10:57:25,425 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_ViewerProxyApplication.xml] at [file:/home/devel/Test6/conf/logback_ViewerProxyApplication.xml]
10:57:25,797 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
10:57:25,798 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
10:57:25,805 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
10:57:25,843 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:25,984 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:57:25,995 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
10:57:26,047 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@117009527 - No compression will be used
10:57:26,048 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@117009527 - Will use the pattern ./log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log for the active file
10:57:26,053 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log'.
10:57:26,053 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - Roll-over at midnight.
10:57:26,064 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - Setting initial period to Mon Jul 11 10:57:26 CEST 2022
10:57:26,064 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
10:57:26,064 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
10:57:26,067 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:26,073 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ViewerProxyApplication.log
10:57:26,073 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ViewerProxyApplication.log]
10:57:26,075 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
10:57:27,017 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
10:57:27,030 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
10:57:27,030 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
10:57:27,031 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
10:57:27,031 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
10:57:27,031 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
10:57:27,031 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
10:57:27,032 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3ba9ad43 - Registering current configuration as safe fallback point

2022-07-11 10:57:27.039 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 10:57:27.048 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_332
2022-07-11 10:57:27.049 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
2022-07-11 10:57:27.049 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-07-11 10:57:27.049 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-07-11 10:57:27.050 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_ViewerProxyApplication.xml'
2022-07-11 10:57:27.257 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8370/8470
2022-07-11 10:57:27.259 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8370 communicating on port 8470 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8470/jndi/rmi://kb-test-acs-001.kb.dk:8370/jmxrmi
dk.netarkivet.viewerproxy.ViewerProxy Running
2022-07-11 10:57:27.270 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.viewerproxy.ViewerProxy Running
2022-07-11 10:57:27.286 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:27.293 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:27.294 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 10:57:27.292 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:27.300 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config.
2022-07-11 10:57:27.310 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): kb-test-acs-001.kb.dk
2022-07-11 10:57:29.139 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-07-11 10:57:29.140 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@3543df7d as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP
2022-07-11 10:57:29.148 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP']'
2022-07-11 10:57:29.148 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-07-11 10:57:29.148 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-07-11 10:57:29.153 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-07-11 10:57:29.162 INFO  d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-07-11 10:57:29.222 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found
2022-07-11 10:57:29.224 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found
2022-07-11 10:57:29.270 INFO  d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'FULL_CRAWL_LOG' uses directory '/home/devel/Test6/cache/FULL_CRAWL_LOG'
2022-07-11 10:57:29.285 INFO  d.n.viewerproxy.ARCArchiveAccess.<init> - Constructed instance of ARCArchiveAccess with TryToLookupUriAsFtp: false
2022-07-11 10:57:29.336 INFO  dk.netarkivet.viewerproxy.WebProxy.<init> - Starting viewerproxy jetty on port 8078
--------------------------------------------
STARTING MACHINE: devel@kb-test-way-001.kb.dk
Starting all applications on: kb-test-way-001.kb.dk
Starting linux application: WaybackIndexerApplication
Starting linux application: AggregatorApplication
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
--------------------------------------------
--------------------------------------------
STARTING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
Starting all applications on: sb-test-har-001.statsbiblioteket.dk
Starting linux application: HarvestControllerApplication_sbhigh_h3
10:57:35,831 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] at [file:/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml]
10:57:35,968 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
10:57:35,970 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
10:57:35,975 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
10:57:35,985 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:36,021 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:57:36,024 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
10:57:36,037 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - No compression will be used
10:57:36,038 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - Will use the pattern ./log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
10:57:36,039 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
10:57:36,039 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Roll-over at midnight.
10:57:36,042 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Setting initial period to Mon Jul 11 10:57:36 CEST 2022
10:57:36,042 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
10:57:36,042 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
10:57:36,043 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:57:36,045 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_sbhigh_h3.log
10:57:36,045 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_sbhigh_h3.log]
10:57:36,045 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
10:57:36,290 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
10:57:36,292 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
10:57:36,292 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
10:57:36,292 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
10:57:36,292 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
10:57:36,293 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
10:57:36,293 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
10:57:36,293 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@40ef3420 - Registering current configuration as safe fallback point

2022-07-11 10:57:36.296 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
2022-07-11 10:57:36.299 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555)
Java VM: 1.8.0_332
2022-07-11 10:57:36.300 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-2.el8_6.x86_64/jre
2022-07-11 10:57:36.300 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-2.el8_6.x86_64/jre
Working dir: /home/netarkdv/Test6
2022-07-11 10:57:36.300 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/netarkdv/Test6
2022-07-11 10:57:36.300 INFO  d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/netarkdv/Test6/conf/settings_HarvestControllerApplication_sbhigh_h3.xml'
2022-07-11 10:57:36.385 INFO  d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'sb-test-har-001.statsbiblioteket.dk' and JMX/RMI ports 8170/8270
2022-07-11 10:57:36.386 INFO  d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://sb-test-har-001.statsbiblioteket.dk:8270/jndi/rmi://sb-test-har-001.statsbiblioteket.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 10:57:36.389 INFO  d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-07-11 10:57:36.399 INFO  d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:36.400 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-07-11 10:57:36.400 INFO  d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-07-11 10:57:36.402 INFO  d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-07-11 10:57:36.402 INFO  d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2022-07-11 10:57:36.402 INFO  d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2022-07-11 10:57:36.402 INFO  d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-07-11 10:57:36.552 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/netarkdv/extra_configs/bitmag_config.
2022-07-11 10:57:36.554 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/netarkdv/extra_configs/bitmag_config.
2022-07-11 10:57:36.557 INFO  d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided  by getCanonicalHostName): sb-test-har-001.statsbiblioteket.dk
2022-07-11 10:57:37.299 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-07-11 10:57:37.300 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@1c7fd41f as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3
2022-07-11 10:57:37.316 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3']'
2022-07-11 10:57:37.316 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/netarkdv/extra_configs/bitmag_config
2022-07-11 10:57:37.317 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-07-11 10:57:37.319 INFO  d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-07-11 10:57:37.325 INFO  d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-07-11 10:57:37.352 INFO  d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-07-11 10:57:37.369 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-07-11 10:57:37.370 INFO  d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-07-11 10:57:37.370 INFO  d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_high'
2022-07-11 10:57:37.371 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@1de5f0ef as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-07-11 10:57:37.408 INFO  d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'HIGHPRIORITY'
2022-07-11 10:57:37.482 INFO  d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'HIGHPRIORITY' is valid.
2022-07-11 10:57:37.483 INFO  d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY']'
2022-07-11 10:57:37.483 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@1de5f0ef as listener to Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY
--------------------------------------------
Completed the script all_test.sh
Finished: SUCCESS