o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(7c9f152f) collectionID Test6, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileID=18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={102,-111,52,-108,-124,38,15,65,-83,82,-76,-55,41,-74,69,-16}, calculationTimestamp=2022-01-25T10:56:33.042+01:00]
10:56:35.130 DEBUG o.b.c.c.ConversationEventMonitor - 7c9f152f: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
10:56:35.133 DEBUG o.b.c.c.ConversationEventMonitor - 7c9f152f: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
10:56:35.576 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(7c9f152f) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS
10:56:35.590 DEBUG o.b.commandline.DeleteFileCmd - Received event: 7c9f152f: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz: PROGRESS: ContributorID netarkiv-checksum-devel-01
10:56:35.967 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(7c9f152f) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_COMPLETED
10:56:35.971 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
10:56:35.971 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: []
10:56:35.971 DEBUG o.b.commandline.DeleteFileCmd - Complete: 7c9f152f: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz: COMPLETE:
10:56:35.972 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz':
10:56:35.972 DEBUG o.b.commandline.DeleteFileCmd - 7c9f152f: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz: COMPLETE:
10:56:37.299 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
10:56:37.371 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
10:56:37.801 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
10:56:37.842 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
10:56:38.540 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
10:56:38.556 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
10:56:38.557 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
10:56:38.772 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@3754a4bf[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:56:38.773 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
10:56:39.724 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
10:56:39.824 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@3754a4bf[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:56:39.826 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-25778]
10:56:39.830 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
10:56:39.830 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3e84448c' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25778' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
10:56:39.830 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25778' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3e84448c'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25778#1048855692'.
10:56:39.831 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25778#1048855692'.
10:56:39.848 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
10:56:39.861 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
10:56:39.864 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz' from the pillar 'netarkiv-kbh-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@3bf9ce3e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@16610890[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={102,-111,52,-108,-124,38,15,65,-83,82,-76,-55,41,-74,69,-16}, calculationTimestamp=2022-01-25T10:56:39.851+01:00]', while requested checksum 'null'. And the audit trail information 'null'.
10:56:39.886 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
10:56:40.434 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(f09027a3) collectionID Test6, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel: FileID=18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz
10:56:40.435 DEBUG o.b.commandline.DeleteFileCmd - Received event: f09027a3: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
10:56:40.794 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(f09027a3) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz is in collection and can be deleted.)
10:56:40.824 DEBUG o.b.commandline.DeleteFileCmd - Received event: f09027a3: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01
10:56:40.824 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
10:56:40.824 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: []
10:56:40.825 DEBUG o.b.commandline.DeleteFileCmd - Received event: f09027a3: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01]
10:56:40.825 DEBUG o.b.commandline.DeleteFileCmd - Received event: f09027a3: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-kbh-disk-devel-01], Sending request for deleting file
10:56:41.561 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(f09027a3) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:56:41.592 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(f09027a3) collectionID Test6, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileID=18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@3bf9ce3e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@16610890[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={102,-111,52,-108,-124,38,15,65,-83,82,-76,-55,41,-74,69,-16}, calculationTimestamp=2022-01-25T10:56:39.851+01:00]
10:56:41.595 DEBUG o.b.c.c.ConversationEventMonitor - f09027a3: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
10:56:41.859 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(f09027a3) collectionID Test6, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:56:41.863 DEBUG o.b.c.c.ConversationEventMonitor - f09027a3: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
10:56:42.123 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(f09027a3) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(Deleting..)
10:56:42.133 DEBUG o.b.commandline.DeleteFileCmd - Received event: f09027a3: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz: PROGRESS: ContributorID netarkiv-kbh-disk-devel-01, Deleting..
10:56:42.382 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(f09027a3) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz deleted.)
10:56:42.384 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
10:56:42.384 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: []
10:56:42.384 DEBUG o.b.commandline.DeleteFileCmd - Complete: f09027a3: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz: COMPLETE:
10:56:42.384 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz':
10:56:42.385 DEBUG o.b.commandline.DeleteFileCmd - f09027a3: DELETE_FILE for file 18-1-20211125132044096-00000-kb-test-har-004.kb.dk.warc.gz: COMPLETE:
Deleting file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz with checksum b32e4047c88138d3b060deec69d9f5b3 in collection Test6 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01
10:56:43.822 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
10:56:43.973 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
10:56:44.338 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
10:56:44.367 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
10:56:45.083 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
10:56:45.100 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
10:56:45.101 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
10:56:45.258 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:56:45.259 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
10:56:46.159 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
10:56:46.246 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:56:46.248 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-25818]
10:56:46.250 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
10:56:46.251 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25818' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
10:56:46.251 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25818' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25818#1297836716'.
10:56:46.251 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25818#1297836716'.
10:56:46.266 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
10:56:46.274 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
10:56:46.276 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz' from the pillar 'netarkiv-tape-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-77,46,64,71,-56,-127,56,-45,-80,96,-34,-20,105,-39,-11,-77}, calculationTimestamp=2022-01-25T10:56:46.268+01:00]', while requested checksum 'null'. And the audit trail information 'null'.
10:56:46.290 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
10:56:47.066 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(9e1edf8d) collectionID Test6, to netarkiv-tape-devel-01, destination topic://netarkiv-devel: FileID=1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz
10:56:47.067 DEBUG o.b.commandline.DeleteFileCmd - Received event: 9e1edf8d: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
10:56:47.526 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(9e1edf8d) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz is in collection and can be deleted.)
10:56:47.541 DEBUG o.b.c.c.ConversationEventMonitor - 9e1edf8d: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01
10:56:47.810 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(9e1edf8d) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
10:56:47.811 DEBUG o.b.c.c.ConversationEventMonitor - 9e1edf8d: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
10:56:48.064 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(9e1edf8d) collectionID Test6, from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
10:56:48.066 DEBUG o.b.commandline.DeleteFileCmd - Received event: 9e1edf8d: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01
10:56:48.066 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01
10:56:48.067 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: []
10:56:48.067 DEBUG o.b.commandline.DeleteFileCmd - Received event: 9e1edf8d: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-tape-devel-01]
10:56:48.068 DEBUG o.b.commandline.DeleteFileCmd - Received event: 9e1edf8d: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-tape-devel-01], Sending request for deleting file
10:56:48.319 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(9e1edf8d) collectionID Test6, to netarkiv-tape-devel-01, destination queue://netarkiv-tape-devel-01: FileID=1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-77,46,64,71,-56,-127,56,-45,-80,96,-34,-20,105,-39,-11,-77}, calculationTimestamp=2022-01-25T10:56:46.268+01:00]
10:56:48.816 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(9e1edf8d) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS)
10:56:48.822 DEBUG o.b.commandline.DeleteFileCmd - Received event: 9e1edf8d: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS
10:56:49.276 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(9e1edf8d) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED)
10:56:49.276 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01
10:56:49.277 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: []
10:56:49.277 DEBUG o.b.commandline.DeleteFileCmd - Complete: 9e1edf8d: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: COMPLETE:
10:56:49.277 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz':
10:56:49.277 DEBUG o.b.commandline.DeleteFileCmd - 9e1edf8d: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: COMPLETE:
10:56:50.560 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
10:56:50.691 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
10:56:50.983 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
10:56:51.022 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
10:56:51.867 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
10:56:51.888 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
10:56:51.889 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
10:56:52.098 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@62379589[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:56:52.099 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
10:56:52.950 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
10:56:53.101 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@62379589[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:56:53.104 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-25857]
10:56:53.108 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
10:56:53.109 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25857' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
10:56:53.110 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25857' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25857#1249875355'.
10:56:53.110 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25857#1249875355'.
10:56:53.155 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
10:56:53.170 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
10:56:53.173 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz' from the pillar 'netarkiv-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-77,46,64,71,-56,-127,56,-45,-80,96,-34,-20,105,-39,-11,-77}, calculationTimestamp=2022-01-25T10:56:53.159+01:00]', while requested checksum 'null'. And the audit trail information 'null'.
10:56:53.196 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
10:56:53.944 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(30b919f9) collectionID Test6, to netarkiv-disk-devel-01, destination topic://netarkiv-devel: FileID=1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz
10:56:53.945 DEBUG o.b.commandline.DeleteFileCmd - Received event: 30b919f9: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
10:56:54.310 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(30b919f9) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz is in collection and can be deleted.)
10:56:54.318 DEBUG o.b.c.c.ConversationEventMonitor - 30b919f9: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01
10:56:54.567 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(30b919f9) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:56:54.569 DEBUG o.b.c.c.ConversationEventMonitor - 30b919f9: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
10:56:54.938 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(30b919f9) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
10:56:54.940 DEBUG o.b.commandline.DeleteFileCmd - Received event: 30b919f9: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01
10:56:54.940 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01
10:56:54.940 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: []
10:56:54.941 DEBUG o.b.commandline.DeleteFileCmd - Received event: 30b919f9: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-disk-devel-01]
10:56:54.941 DEBUG o.b.commandline.DeleteFileCmd - Received event: 30b919f9: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-disk-devel-01], Sending request for deleting file
10:56:55.200 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(30b919f9) collectionID Test6, to netarkiv-disk-devel-01, destination queue://netarkiv-disk-devel-01: FileID=1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-77,46,64,71,-56,-127,56,-45,-80,96,-34,-20,105,-39,-11,-77}, calculationTimestamp=2022-01-25T10:56:53.159+01:00]
10:56:55.728 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(30b919f9) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS)
10:56:55.728 DEBUG o.b.commandline.DeleteFileCmd - Received event: 30b919f9: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS
10:56:55.998 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(30b919f9) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED)
10:56:56.006 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01
10:56:56.006 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: []
10:56:56.006 DEBUG o.b.commandline.DeleteFileCmd - Complete: 30b919f9: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: COMPLETE:
10:56:56.007 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz':
10:56:56.007 DEBUG o.b.commandline.DeleteFileCmd - 30b919f9: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: COMPLETE:
10:57:02.453 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
10:57:02.563 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
10:57:02.871 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
10:57:02.904 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
10:57:03.622 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
10:57:03.643 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
10:57:03.644 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
10:57:03.850 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@3754a4bf[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:57:03.852 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
10:57:04.651 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
10:57:04.732 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@3754a4bf[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:57:04.734 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-25896]
10:57:04.736 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
10:57:04.736 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@429bffaa' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25896' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
10:57:04.736 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25896' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@429bffaa'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25896#1117519786'.
10:57:04.736 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25896#1117519786'.
10:57:04.749 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
10:57:04.757 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
10:57:04.759 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz' from the pillar 'netarkiv-checksum-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@71def8f8[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@383bfa16[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-77,46,64,71,-56,-127,56,-45,-80,96,-34,-20,105,-39,-11,-77}, calculationTimestamp=2022-01-25T10:57:04.751+01:00]', while requested checksum 'null'. And the audit trail information 'null'.
10:57:04.771 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
10:57:05.309 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(fb63f6de) collectionID Test6, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel: FileID=1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz
10:57:05.310 DEBUG o.b.commandline.DeleteFileCmd - Received event: fb63f6de: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
10:57:05.653 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fb63f6de) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz is in collection and can be deleted.)
10:57:05.667 DEBUG o.b.c.c.ConversationEventMonitor - fb63f6de: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01
10:57:05.895 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fb63f6de) collectionID Test6, from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.)
10:57:05.902 DEBUG o.b.commandline.DeleteFileCmd - Received event: fb63f6de: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01
10:57:05.902 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
10:57:05.902 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: []
10:57:05.903 DEBUG o.b.commandline.DeleteFileCmd - Received event: fb63f6de: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-checksum-devel-01]
10:57:05.903 DEBUG o.b.commandline.DeleteFileCmd - Received event: fb63f6de: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01], Sending request for deleting file
10:57:06.399 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fb63f6de) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:57:06.513 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(fb63f6de) collectionID Test6, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileID=1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@71def8f8[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@383bfa16[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-77,46,64,71,-56,-127,56,-45,-80,96,-34,-20,105,-39,-11,-77}, calculationTimestamp=2022-01-25T10:57:04.751+01:00]
10:57:06.515 DEBUG o.b.c.c.ConversationEventMonitor - fb63f6de: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
10:57:06.697 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fb63f6de) collectionID Test6, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:57:06.697 DEBUG o.b.c.c.ConversationEventMonitor - fb63f6de: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
10:57:06.920 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(fb63f6de) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS
10:57:06.920 DEBUG o.b.commandline.DeleteFileCmd - Received event: fb63f6de: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: PROGRESS: ContributorID netarkiv-checksum-devel-01
10:57:07.182 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(fb63f6de) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_COMPLETED
10:57:07.184 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
10:57:07.184 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: []
10:57:07.184 DEBUG o.b.commandline.DeleteFileCmd - Complete: fb63f6de: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: COMPLETE:
10:57:07.184 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz':
10:57:07.185 DEBUG o.b.commandline.DeleteFileCmd - fb63f6de: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: COMPLETE:
10:57:08.660 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
10:57:08.767 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
10:57:09.074 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
10:57:09.123 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
10:57:09.833 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
10:57:09.851 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
10:57:09.851 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
10:57:09.997 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@62379589[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:57:09.998 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
10:57:10.840 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
10:57:10.911 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@62379589[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
10:57:10.912 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-25936]
10:57:10.914 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
10:57:10.914 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25936' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
10:57:10.914 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25936' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25936#1249875355'.
10:57:10.915 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-25936#1249875355'.
10:57:10.927 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
10:57:10.939 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
10:57:10.942 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz' from the pillar 'netarkiv-kbh-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-77,46,64,71,-56,-127,56,-45,-80,96,-34,-20,105,-39,-11,-77}, calculationTimestamp=2022-01-25T10:57:10.930+01:00]', while requested checksum 'null'. And the audit trail information 'null'.
10:57:10.962 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
10:57:11.600 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(ac6afa2e) collectionID Test6, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel: FileID=1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz
10:57:11.601 DEBUG o.b.commandline.DeleteFileCmd - Received event: ac6afa2e: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
10:57:11.961 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(ac6afa2e) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz is in collection and can be deleted.)
10:57:11.976 DEBUG o.b.commandline.DeleteFileCmd - Received event: ac6afa2e: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01
10:57:11.977 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
10:57:11.977 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: []
10:57:11.977 DEBUG o.b.commandline.DeleteFileCmd - Received event: ac6afa2e: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01]
10:57:11.978 DEBUG o.b.commandline.DeleteFileCmd - Received event: ac6afa2e: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-kbh-disk-devel-01], Sending request for deleting file
10:57:12.625 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(ac6afa2e) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:57:12.823 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(ac6afa2e) collectionID Test6, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileID=1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-77,46,64,71,-56,-127,56,-45,-80,96,-34,-20,105,-39,-11,-77}, calculationTimestamp=2022-01-25T10:57:10.930+01:00]
10:57:12.824 DEBUG o.b.c.c.ConversationEventMonitor - ac6afa2e: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
10:57:12.967 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(ac6afa2e) collectionID Test6, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
10:57:12.967 DEBUG o.b.c.c.ConversationEventMonitor - ac6afa2e: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
10:57:13.218 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(ac6afa2e) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(Deleting..)
10:57:13.223 DEBUG o.b.commandline.DeleteFileCmd - Received event: ac6afa2e: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: PROGRESS: ContributorID netarkiv-kbh-disk-devel-01, Deleting..
10:57:13.473 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(ac6afa2e) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz deleted.)
10:57:13.475 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
10:57:13.475 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: []
10:57:13.475 DEBUG o.b.commandline.DeleteFileCmd - Complete: ac6afa2e: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: COMPLETE:
10:57:13.475 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz':
10:57:13.475 DEBUG o.b.commandline.DeleteFileCmd - ac6afa2e: DELETE_FILE for file 1-1-20211125120525579-00000-kb-test-har-004.kb.dk.warc.gz: COMPLETE:
calling cleanup_hosts
running cleanup_hosts
Removing installation on sb-test-har-001.statsbiblioteket.dk
Removing installation on kb-test-har-003.kb.dk
Removing installation on kb-test-har-004.kb.dk
Removing installation on kb-test-har-005.kb.dk
Removing installation on kb-test-adm-001.kb.dk
Removing installation on kb-test-acs-001.kb.dk
Removing installation on kb-test-way-001.kb.dk
calling cleanup_linuxbarhosts
running cleanup_linuxbarhosts
Removing installation on sb-test-bar-001.statsbiblioteket.dk
Removing bitarchive on sb-test-bar-001.statsbiblioteket.dk
Calling cleanup_windowsbarhosts
running cleanup_windowsbarhosts
Removing C:\bitarkiv\Test6 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing E:\bitarchive_1\Test6 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing F:\bitarchive_2\Test6 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing g:\bitarchive_3\Test6 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing C:\Users\ba-devel\Test6 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
TESTX=Test6
PORT=8078
MAILRECEIVERS=csr@kb.dk
VERSION=CSR
DEPLOYCONF=deploy_config_bitmag.xml
H3ZIP=CSR
BITMAGCONF=/home/devel/bitmag_test_config/client_config
Using bundler file /home/devel/nas_versions/bundler/NetarchiveSuite-heritrix3-bundler-CSR.zip
Creating distribution files in /home/devel/prepared_software/Test6.
Will read source files using encoding 'UTF-8' (defaulted)
Branch in settings not found: common.warcRecordService
Branch in settings not found: common.arcrepositoryClient.bitrepository.getFileIDsMaxResults
Branch in settings not found: common.hadoop.kerberos
Branch in settings not found: common.hadoop.username
Branch in settings not found: common.hadoop.mapred.hadoopUberJar
Branch in settings not found: common.hadoop.mapred.inputFilesParentDir
Branch in settings not found: common.hadoop.mapred.cdxJob
Branch in settings not found: common.hadoop.mapred.metadataExtractionJob
Branch in settings not found: common.hadoop.mapred.metadataCDXExtractionJob
Branch in settings not found: common.hadoop.mapred.crawlLogExtractionJob
Branch in settings not found: common.fileResolver.baseUrl
Branch in settings not found: common.fileResolver.keyfile
Branch in settings not found: common.webinterface.metadata_cache_dir
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Machine 'kb-test-adm-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-har-003.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks
Machine 'kb-test-har-005.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks
Machine 'kb-test-har-004.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip
Machine 'kb-test-acs-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-way-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'sb-test-har-001.statsbiblioteket.dk' configured with encoding 'UTF-8' (defaulted)
/home/devel/prepared_software/Test6/NetarchiveSuite-heritrix3-bundler.zip -> /home/netarkdv/Test6/NetarchiveSuite-heritrix3-bundler.zip
10:58:12.261 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:58:12.268 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
10:58:12.270 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:58:12.270 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
10:58:12.271 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:58:12.271 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
10:58:12.272 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:58:12.272 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
10:58:12.273 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:58:12.273 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
10:58:12.274 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:58:12.274 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
10:58:12.400 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
10:58:12.400 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-adm-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-adm-001.kb.dk
deleting devel@kb-test-adm-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-adm-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-003.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-003.kb.dk
deleting devel@kb-test-har-003.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-003.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-005.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-005.kb.dk
deleting devel@kb-test-har-005.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-005.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-004.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-har-004.kb.dk
deleting devel@kb-test-har-004.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-har-004.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-acs-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-acs-001.kb.dk
deleting devel@kb-test-acs-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-acs-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-way-001.kb.dk
copying NetarchiveSuite-CSR.zip to:kb-test-way-001.kb.dk
deleting devel@kb-test-way-001.kb.dk:/home/devel/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:kb-test-way-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
--------------------------------------------
INSTALLING TO MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
copying NetarchiveSuite-CSR.zip to:sb-test-har-001.statsbiblioteket.dk
deleting netarkdv@sb-test-har-001.statsbiblioteket.dk:/home/netarkdv/Test6/lib
unzipping NetarchiveSuite-CSR.zip at:sb-test-har-001.statsbiblioteket.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
Initializing database for system Test6
+ host=devel@kb-test-adm-001
+ scp -p /home/devel/devel-config/scripts/db/setup_admindb.sh /home/devel/devel-config/scripts/db/setup_harvestdb.sh /home/devel/devel-config/scripts/db/teardown_admindb.sh /home/devel/devel-config/scripts/db/teardown_harvestdb.sh /home/devel/devel-config/scripts/../resources/harvestdb.testdata.sql /home/devel/devel-config/scripts/../resources/default_orderxml.cxml devel@kb-test-adm-001:bin/
+ ssh devel@kb-test-adm-001
Pseudo-terminal will not be allocated because stdin is not a terminal.
Destroying test6_admindb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
DROP DATABASE
Creating empty test6_admindb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
CREATE DATABASE
Initialising test6_admindb
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "replica_pkey" for table "replica"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "replica_replica_id_key" for table "replica"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "replica_replica_name_key" for table "replica"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "replicafileinfo_pkey" for table "replicafileinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "file_pkey" for table "file"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "segment_pkey" for table "segment"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
Destroying test6_harvestdb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
DROP DATABASE
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
CREATE DATABASE
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "domains_pkey" for table "domains"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "domains_name_key" for table "domains"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "configurations_pkey" for table "configurations"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "config_passwords_pkey" for table "config_passwords"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "config_seedlists_pkey" for table "config_seedlists"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "seedlists_pkey" for table "seedlists"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "passwords_pkey" for table "passwords"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "ownerinfo_pkey" for table "ownerinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "historyinfo_pkey" for table "historyinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvestdefinitions_pkey" for table "harvestdefinitions"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "harvestdefinitions_name_key" for table "harvestdefinitions"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "fullharvests_pkey" for table "fullharvests"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "partialharvests_pkey" for table "partialharvests"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvest_configs_pkey" for table "harvest_configs"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "schedules_pkey" for table "schedules"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "schedules_name_key" for table "schedules"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "ordertemplates_pkey" for table "ordertemplates"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "ordertemplates_name_key" for table "ordertemplates"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "jobs_pkey" for table "jobs"
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "job_configs_pkey" for table "job_configs"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "global_crawler_trap_lists_pkey" for table "global_crawler_trap_lists"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "global_crawler_trap_lists_name_key" for table "global_crawler_trap_lists"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "global_crawler_trap_expressions_pkey" for table "global_crawler_trap_expressions"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "pkrunningjobshistory" for table "runningjobshistory"
CREATE TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "pkrunningjobsmonitor" for table "runningjobsmonitor"
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / UNIQUE will create implicit index "pkfrontierreportlines" for table "frontierreportmonitor"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfieldtype_pkey" for table "extendedfieldtype"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfield_pkey" for table "extendedfield"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfieldvalue_pkey" for table "extendedfieldvalue"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
INSERT 0 1
INSERT 0 1
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvestchannel_pkey" for table "harvestchannel"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "harvestchannel_name_key" for table "harvestchannel"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE TABLE
NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index "eav_type_attribute_pkey" for table "eav_type_attribute"
ALTER TABLE
CREATE INDEX
CREATE SEQUENCE
CREATE TABLE
NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index "eav_attribute_pkey" for table "eav_attribute"
ALTER TABLE
CREATE INDEX
GRANT
GRANT
GRANT
INSERT 0 1
INSERT 0 1
INSERT 0 1
SET
SET
SET
SET
SET
SET
SET
SET
SET
setval
--------
17
(1 row)
setval
--------
17
(1 row)
setval
--------
17
(1 row)
setval
--------
5
(1 row)
setval
--------
4
(1 row)
setval
--------
17
(1 row)
11:00:42.781 [MLog-Init-Reporter] INFO com.mchange.v2.log.MLog - MLog clients using slf4j logging.
11:00:42.841 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - Reading VM config for path list /com/mchange/v2/log/default-mchange-log.properties, /mchange-commons.properties, /c3p0.properties, hocon:/reference,/application,/c3p0,/, /mchange-log.properties, /
11:00:42.841 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
11:00:42.841 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
11:00:42.841 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
11:00:42.841 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
11:00:42.854 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
11:00:42.854 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
11:00:42.854 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
11:00:42.855 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
11:00:43.270 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.5.4 [built 23-March-2019 23:00:48 -0700; debug? true; trace: 10]
11:00:43.460 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52am14568da1tdme3l|1416310,name=10bdx52am14568da1tdme3l|1416310 registered.
11:00:43.640 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52am14568da1tdme3l|1416310,name=10bdx52am14568da1tdme3l|1416310 unregistered, in order to be reregistered after update.
11:00:43.640 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52am14568da1tdme3l|1416310,name=10bdx52am14568da1tdme3l|1416310 registered.
11:00:43.679 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
11:00:43.812 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, dataSourceName -> 10bdx52am14568da1tdme3l|1416310, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, extensions -> {}, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, forceUseNamedDriverClass -> false, identityToken -> 10bdx52am14568da1tdme3l|1416310, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost:5432/test6_harvestdb, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 3600, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, preferredTestQuery -> null, privilegeSpawnedThreads -> false, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ]
11:00:43.935 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping.
11:00:43.936 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping.
11:00:43.936 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping.
11:00:43.937 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping.
11:00:43.937 [main] WARN com.mchange.v2.resourcepool.BasicResourcePool - Bad pool size config, start 3 < min 5. Using 5 as start.
11:00:43.967 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@1f82230 config: [start -> 5; min -> 5; max -> 20; inc -> 5; num_acq_attempts -> 30; acq_attempt_delay -> 1000; check_idle_resources_delay -> 0; max_resource_age -> 3600000; max_idle_time -> 0; excess_max_idle_time -> 0; destroy_unreturned_resc_time -> 0; expiration_enforcement_delay -> 900000; break_on_acquisition_failure -> false; debug_store_checkout_exceptions -> false; force_synchronous_checkins -> false]
11:00:43.970 [main] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPoolManager - Created new pool for auth, username (masked): 'de******'.
11:00:43.970 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - acquire test -- pool size: 0; target_pool_size: 5; desired target? 1
11:00:43.973 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - awaitAvailable(): [unknown]
11:00:44.632 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@1301423 [wrapping: SELECT version FROM schemaversions WHERE tablename = 'ordertemplates'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@9d0b9d [wrapping: null]
11:00:44.653 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@b0404f [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@19c5f1a [wrapping: null]
11:00:44.683 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@fa0f47 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@1677d1 [wrapping: null]
The template 'default_orderxml' has now been updated.
+ set +x
--------------------------------------------
STARTING MACHINE: devel@kb-test-adm-001.kb.dk
Starting all applications on: kb-test-adm-001.kb.dk
Starting linux application: GUIApplication
Starting linux application: ArcRepositoryApplication
Starting linux application: HarvestJobManagerApplication
11:00:47,919 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_ArcRepositoryApplication.xml] at [file:/home/devel/Test6/conf/logback_ArcRepositoryApplication.xml]
11:00:48,813 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:00:48,820 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:00:48,856 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:00:48,907 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:00:49,133 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:00:49,166 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:00:49,285 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@10292125 - No compression will be used
11:00:49,289 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@10292125 - Will use the pattern ./log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log for the active file
11:00:49,301 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1301423 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log'.
11:00:49,301 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1301423 - Roll-over at midnight.
11:00:49,317 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1301423 - Setting initial period to Tue Jan 25 11:00:49 CET 2022
11:00:49,318 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1301423 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:00:49,318 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1301423 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:00:49,324 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:00:49,338 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ArcRepositoryApplication.log
11:00:49,338 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ArcRepositoryApplication.log]
11:00:49,347 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:00:50,862 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:00:50,877 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:00:50,877 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:00:50,881 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:00:50,881 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:00:50,884 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:00:50,884 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:00:50,888 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@1112965 - Registering current configuration as safe fallback point
2022-01-25 11:00:50.920 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2022-01-25 11:00:50.952 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_20
2022-01-25 11:00:50.955 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_20
java.home: /usr/java/jdk1.8.0_20/jre
2022-01-25 11:00:50.956 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/java/jdk1.8.0_20/jre
Working dir: /home/devel/Test6
2022-01-25 11:00:50.957 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-01-25 11:00:50.959 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_ArcRepositoryApplication.xml'
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-003.kb.dk
Starting all applications on: kb-test-har-003.kb.dk
Starting linux application: HarvestControllerApplication_kblow001_h3
11:00:52,605 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml]
11:00:52,845 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:00:52,849 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:00:52,856 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:00:52,869 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:00:52,920 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:00:52,926 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:00:52,949 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1107024580 - No compression will be used
11:00:52,951 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1107024580 - Will use the pattern ./log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log for the active file
11:00:52,954 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log'.
11:00:52,954 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - Roll-over at midnight.
11:00:52,958 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - Setting initial period to Tue Jan 25 11:00:52 CET 2022
11:00:52,958 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:00:52,958 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:00:52,960 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:00:52,977 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow001_h3.log
11:00:52,977 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow001_h3.log]
11:00:52,978 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:00:53,740 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:00:53,746 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:00:53,746 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:00:53,747 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:00:53,747 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:00:53,748 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:00:53,748 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:00:53,749 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@35ef1869 - Registering current configuration as safe fallback point
2022-01-25 11:00:53.754 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2022-01-25 11:00:53.761 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_312
2022-01-25 11:00:53.762 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2022-01-25 11:00:53.763 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-01-25 11:00:53.763 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-01-25 11:00:53.763 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow001_h3.xml'
2022-01-25 11:00:54.029 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-003.kb.dk' and JMX/RMI ports 8170/8270
2022-01-25 11:00:54.030 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-003.kb.dk:8270/jndi/rmi://kb-test-har-003.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-01-25 11:00:54.044 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-01-25 11:00:54.047 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:00:54.048 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:00:54.049 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-01-25 11:00:54.106 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-01-25 11:00:54.107 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2022-01-25 11:00:54.108 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2022-01-25 11:00:54.108 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-01-25 11:00:54.325 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-003.kb.dk
2022-01-25 11:00:56.046 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-01-25 11:00:56.047 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@76f7d241 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3
2022-01-25 11:00:56.075 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3']'
2022-01-25 11:00:56.075 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-01-25 11:00:56.076 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-01-25 11:00:56.080 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-01-25 11:00:56.092 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-01-25 11:00:56.160 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-01-25 11:00:56.191 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-01-25 11:00:56.193 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-01-25 11:00:56.193 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_low'
2022-01-25 11:00:56.194 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@25ddbbbb as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-01-25 11:00:56.212 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'LOWPRIORITY'
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-005.kb.dk
Starting all applications on: kb-test-har-005.kb.dk
Starting linux application: HarvestControllerApplication_browser_1
Starting linux application: HarvestControllerApplication_browser_2
11:00:58,044 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml]
11:00:58,342 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:00:58,345 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:00:58,358 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:00:58,371 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:00:58,430 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:00:58,435 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:00:58,467 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1107024580 - No compression will be used
11:00:58,468 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1107024580 - Will use the pattern ./log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log for the active file
11:00:58,476 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log'.
11:00:58,476 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - Roll-over at midnight.
11:00:58,480 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - Setting initial period to Tue Jan 25 11:00:58 CET 2022
11:00:58,480 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:00:58,480 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:00:58,481 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:00:58,484 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_1.log
11:00:58,484 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_1.log]
11:00:58,485 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:00:59,184 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:00:59,186 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:00:59,186 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:00:59,194 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:00:59,194 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:00:59,195 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:00:59,195 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:00:59,196 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@35ef1869 - Registering current configuration as safe fallback point
2022-01-25 11:00:59.200 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2022-01-25 11:00:59.214 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_312
2022-01-25 11:00:59.215 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2022-01-25 11:00:59.215 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-01-25 11:00:59.215 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-01-25 11:00:59.215 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_1.xml'
2022-01-25 11:00:59.432 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8170/8270
2022-01-25 11:00:59.433 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8270/jndi/rmi://kb-test-har-005.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-01-25 11:00:59.438 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-01-25 11:00:59.461 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-01-25 11:00:59.461 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'BROWSER'
2022-01-25 11:00:59.461 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_browser_1'
2022-01-25 11:00:59.462 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-01-25 11:00:59.464 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:00:59.464 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:00:59.465 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-01-25 11:00:59.704 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk
2022-01-25 11:01:02.165 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-01-25 11:01:02.165 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@4bff1903 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1
2022-01-25 11:01:02.189 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1']'
2022-01-25 11:01:02.190 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-01-25 11:01:02.190 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-01-25 11:01:02.194 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-01-25 11:01:02.211 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-01-25 11:01:02.328 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-01-25 11:01:02.371 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-01-25 11:01:02.372 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-01-25 11:01:02.374 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_1'
2022-01-25 11:01:02.377 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@acb0951 as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-01-25 11:01:02.413 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'BROWSER'
11:00:58,217 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml]
11:00:58,606 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:00:58,610 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:00:58,627 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:00:58,643 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:00:58,719 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:00:58,723 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:00:58,756 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1107024580 - No compression will be used
11:00:58,757 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1107024580 - Will use the pattern ./log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log for the active file
11:00:58,760 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log'.
11:00:58,760 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - Roll-over at midnight.
11:00:58,768 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - Setting initial period to Tue Jan 25 11:00:58 CET 2022
11:00:58,768 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:00:58,768 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3c407114 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:00:58,770 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:00:58,772 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_2.log
11:00:58,772 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_2.log]
11:00:58,773 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:00:59,594 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:00:59,596 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:00:59,596 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:00:59,597 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:00:59,597 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:00:59,597 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:00:59,597 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:00:59,598 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@35ef1869 - Registering current configuration as safe fallback point
2022-01-25 11:00:59.618 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2022-01-25 11:00:59.625 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_312
2022-01-25 11:00:59.625 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2022-01-25 11:00:59.626 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-01-25 11:00:59.626 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-01-25 11:00:59.626 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_2.xml'
2022-01-25 11:00:59.810 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8175/8275
2022-01-25 11:00:59.810 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8175 communicating on port 8275 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8275/jndi/rmi://kb-test-har-005.kb.dk:8175/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-01-25 11:00:59.815 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-01-25 11:00:59.836 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:00:59.837 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:00:59.837 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-01-25 11:00:59.854 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-01-25 11:00:59.854 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'BROWSER'
2022-01-25 11:00:59.854 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_browser_2'
2022-01-25 11:00:59.855 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-01-25 11:01:00.070 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk
2022-01-25 11:01:02.149 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-01-25 11:01:02.150 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@4bff1903 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2
2022-01-25 11:01:02.168 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2']'
2022-01-25 11:01:02.169 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config
2022-01-25 11:01:02.169 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-01-25 11:01:02.173 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-01-25 11:01:02.184 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-01-25 11:01:02.312 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-01-25 11:01:02.361 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-01-25 11:01:02.362 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-01-25 11:01:02.362 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_2'
2022-01-25 11:01:02.363 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@acb0951 as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-01-25 11:01:02.409 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'BROWSER'
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-004.kb.dk
Starting all applications on: kb-test-har-004.kb.dk
Starting linux application: HarvestControllerApplication_kblow002_h3
Starting linux application: HarvestControllerApplication_kbhigh_h3
11:01:03,592 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml]
11:01:04,229 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:01:04,237 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:01:04,259 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:01:04,298 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:04,426 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:01:04,436 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:01:04,500 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1259652483 - No compression will be used
11:01:04,505 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1259652483 - Will use the pattern ./log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
11:01:04,511 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
11:01:04,511 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - Roll-over at midnight.
11:01:04,521 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - Setting initial period to Tue Jan 25 11:01:04 CET 2022
11:01:04,521 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:01:04,521 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:01:04,523 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:04,528 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbhigh_h3.log
11:01:04,528 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbhigh_h3.log]
11:01:04,529 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:01:05,358 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:01:05,363 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:01:05,363 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:01:05,363 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:01:05,363 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:01:05,364 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:01:05,364 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:01:05,365 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4ddced80 - Registering current configuration as safe fallback point
2022-01-25 11:01:05.370 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2022-01-25 11:01:05.389 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_25
2022-01-25 11:01:05.390 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2022-01-25 11:01:05.390 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-01-25 11:01:05.390 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-01-25 11:01:05.391 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kbhigh_h3.xml'
2022-01-25 11:01:05.608 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8172/8272
2022-01-25 11:01:05.609 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8172 communicating on port 8272 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8272/jndi/rmi://kb-test-har-004.kb.dk:8172/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-01-25 11:01:05.629 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-01-25 11:01:05.644 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:01:05.645 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:01:05.645 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-01-25 11:01:05.673 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-01-25 11:01:05.673 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2022-01-25 11:01:05.674 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2022-01-25 11:01:05.674 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-01-25 11:01:05.902 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
11:01:03,640 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml]
11:01:04,401 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:01:04,411 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:01:04,428 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:01:04,450 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:04,523 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:01:04,531 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:01:04,569 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1259652483 - No compression will be used
11:01:04,572 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1259652483 - Will use the pattern ./log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log for the active file
11:01:04,575 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log'.
11:01:04,575 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - Roll-over at midnight.
11:01:04,585 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - Setting initial period to Tue Jan 25 11:01:04 CET 2022
11:01:04,586 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:01:04,586 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@65466a6a - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:01:04,588 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:04,598 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow002_h3.log
11:01:04,598 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow002_h3.log]
11:01:04,599 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:01:05,397 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:01:05,399 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:01:05,399 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:01:05,400 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:01:05,400 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:01:05,401 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:01:05,401 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:01:05,410 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4ddced80 - Registering current configuration as safe fallback point
2022-01-25 11:01:05.421 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2022-01-25 11:01:05.430 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_25
2022-01-25 11:01:05.431 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2022-01-25 11:01:05.432 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-01-25 11:01:05.432 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-01-25 11:01:05.432 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow002_h3.xml'
2022-01-25 11:01:05.610 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8170/8270
2022-01-25 11:01:05.611 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8270/jndi/rmi://kb-test-har-004.kb.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-01-25 11:01:05.624 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-01-25 11:01:05.638 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:01:05.638 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:01:05.638 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-01-25 11:01:05.644 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-01-25 11:01:05.644 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2022-01-25 11:01:05.644 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2022-01-25 11:01:05.650 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-01-25 11:01:05.830 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
--------------------------------------------
STARTING MACHINE: devel@kb-test-acs-001.kb.dk
Starting all applications on: kb-test-acs-001.kb.dk
Starting linux application: IndexServerApplication
Starting linux application: ViewerProxyApplication
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
11:01:10,768 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_IndexServerApplication.xml] at [file:/home/devel/Test6/conf/logback_IndexServerApplication.xml]
11:01:10,999 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:01:11,005 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:01:11,033 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:01:11,047 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:11,108 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:01:11,113 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:01:11,144 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@918312414 - No compression will be used
11:01:11,145 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@918312414 - Will use the pattern ./log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log for the active file
11:01:11,148 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@564fabc8 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log'.
11:01:11,148 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@564fabc8 - Roll-over at midnight.
11:01:11,156 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@564fabc8 - Setting initial period to Tue Jan 25 11:01:11 CET 2022
11:01:11,157 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@564fabc8 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:01:11,157 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@564fabc8 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:01:11,159 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:11,161 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/IndexServerApplication.log
11:01:11,161 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/IndexServerApplication.log]
11:01:11,163 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:01:11,697 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:01:11,711 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:01:11,711 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:01:11,712 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:01:11,712 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:01:11,712 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:01:11,712 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:01:11,713 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@16d04d3d - Registering current configuration as safe fallback point
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2022-01-25 11:01:11.724 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2022-01-25 11:01:11.731 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_312
2022-01-25 11:01:11.732 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2022-01-25 11:01:11.732 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-01-25 11:01:11.732 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-01-25 11:01:11.733 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_IndexServerApplication.xml'
2022-01-25 11:01:12.008 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8371/8471
2022-01-25 11:01:12.009 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8371 communicating on port 8471 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8471/jndi/rmi://kb-test-acs-001.kb.dk:8371/jmxrmi
dk.netarkivet.harvester.indexserver.IndexServer Running
2022-01-25 11:01:12.020 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.indexserver.IndexServer Running
2022-01-25 11:01:12.021 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:01:12.021 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:01:12.022 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-01-25 11:01:12.035 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata'
2022-01-25 11:01:12.102 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
11:01:10,137 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_ViewerProxyApplication.xml] at [file:/home/devel/Test6/conf/logback_ViewerProxyApplication.xml]
11:01:10,526 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:01:10,527 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:01:10,541 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:01:10,587 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:10,753 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:01:10,781 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:01:10,855 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1052245076 - No compression will be used
11:01:10,858 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1052245076 - Will use the pattern ./log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log for the active file
11:01:10,878 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log'.
11:01:10,878 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - Roll-over at midnight.
11:01:10,892 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - Setting initial period to Tue Jan 25 11:01:10 CET 2022
11:01:10,893 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:01:10,893 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7f552bd3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:01:10,897 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:10,902 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ViewerProxyApplication.log
11:01:10,902 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ViewerProxyApplication.log]
11:01:10,904 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:01:11,795 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:01:11,797 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:01:11,797 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:01:11,797 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:01:11,798 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:01:11,798 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:01:11,798 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:01:11,799 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3c22fc4c - Registering current configuration as safe fallback point
2022-01-25 11:01:11.806 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2022-01-25 11:01:11.812 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_312
2022-01-25 11:01:11.813 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
2022-01-25 11:01:11.814 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre
Working dir: /home/devel/Test6
2022-01-25 11:01:11.814 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-01-25 11:01:11.814 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_ViewerProxyApplication.xml'
2022-01-25 11:01:12.009 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8370/8470
2022-01-25 11:01:12.010 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8370 communicating on port 8470 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8470/jndi/rmi://kb-test-acs-001.kb.dk:8370/jmxrmi
dk.netarkivet.viewerproxy.ViewerProxy Running
2022-01-25 11:01:12.013 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.viewerproxy.ViewerProxy Running
2022-01-25 11:01:12.034 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:01:12.034 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:01:12.035 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-01-25 11:01:12.047 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
--------------------------------------------
STARTING MACHINE: devel@kb-test-way-001.kb.dk
Starting all applications on: kb-test-way-001.kb.dk
Starting linux application: WaybackIndexerApplication
Starting linux application: AggregatorApplication
11:01:16,484 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_AggregatorApplication.xml] at [file:/home/devel/Test6/conf/logback_AggregatorApplication.xml]
11:01:16,876 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:01:16,877 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:01:16,918 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:01:16,980 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:17,208 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:01:17,252 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:01:17,390 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@11902257 - No compression will be used
11:01:17,397 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@11902257 - Will use the pattern ./log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log for the active file
11:01:17,411 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@62fdb4a6 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log'.
11:01:17,411 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@62fdb4a6 - Roll-over at midnight.
11:01:17,427 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@62fdb4a6 - Setting initial period to Tue Jan 25 11:01:17 CET 2022
11:01:17,428 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@62fdb4a6 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:01:17,428 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@62fdb4a6 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:01:17,432 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:17,447 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/AggregatorApplication.log
11:01:17,447 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/AggregatorApplication.log]
11:01:17,452 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:01:18,921 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:01:18,937 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:01:18,937 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:01:18,938 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:01:18,938 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:01:18,939 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:01:18,939 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:01:18,943 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@11e21d0e - Registering current configuration as safe fallback point
2022-01-25 11:01:18.971 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.wayback.aggregator.AggregationWorker
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2022-01-25 11:01:19.002 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.wayback.aggregator.AggregationWorker
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_25
2022-01-25 11:01:19.002 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
2022-01-25 11:01:19.002 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-01-25 11:01:19.003 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-01-25 11:01:19.003 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_AggregatorApplication.xml'
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
11:01:16,944 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_WaybackIndexerApplication.xml] at [file:/home/devel/Test6/conf/logback_WaybackIndexerApplication.xml]
11:01:17,658 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:01:17,673 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:01:17,705 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:01:17,752 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:17,849 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:01:17,854 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:01:17,887 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1010856212 - No compression will be used
11:01:17,891 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1010856212 - Will use the pattern ./log/WaybackIndexerApplication.%d{yyyy-MM-dd}.%i.log for the active file
11:01:17,895 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@35ef1869 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/WaybackIndexerApplication.%d{yyyy-MM-dd}.%i.log'.
11:01:17,895 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@35ef1869 - Roll-over at midnight.
11:01:17,911 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@35ef1869 - Setting initial period to Tue Jan 25 11:01:17 CET 2022
11:01:17,912 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@35ef1869 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:01:17,912 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@35ef1869 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:01:17,914 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:17,917 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/WaybackIndexerApplication.log
11:01:17,917 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/WaybackIndexerApplication.log]
11:01:17,918 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:01:19,020 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:01:19,033 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:01:19,034 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:01:19,035 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:01:19,035 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:01:19,035 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:01:19,035 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:01:19,036 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@c33b74f - Registering current configuration as safe fallback point
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2022-01-25 11:01:19.056 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.wayback.indexer.WaybackIndexer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2022-01-25 11:01:19.087 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.wayback.indexer.WaybackIndexer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_25
2022-01-25 11:01:19.088 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
2022-01-25 11:01:19.088 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test6
2022-01-25 11:01:19.089 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6
2022-01-25 11:01:19.091 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_WaybackIndexerApplication.xml'
--------------------------------------------
--------------------------------------------
STARTING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
Starting all applications on: sb-test-har-001.statsbiblioteket.dk
Starting linux application: HarvestControllerApplication_sbhigh_h3
11:01:20,217 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] at [file:/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml]
11:01:20,425 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
11:01:20,428 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
11:01:20,433 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
11:01:20,442 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:20,486 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
11:01:20,488 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
11:01:20,513 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@517052730 - No compression will be used
11:01:20,514 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@517052730 - Will use the pattern ./log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
11:01:20,517 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f3f4916 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
11:01:20,517 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f3f4916 - Roll-over at midnight.
11:01:20,523 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f3f4916 - Setting initial period to Tue Jan 25 11:01:20 CET 2022
11:01:20,524 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f3f4916 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
11:01:20,524 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f3f4916 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
11:01:20,526 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
11:01:20,531 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_sbhigh_h3.log
11:01:20,531 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_sbhigh_h3.log]
11:01:20,535 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
11:01:20,825 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
11:01:20,827 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
11:01:20,827 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
11:01:20,828 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
11:01:20,828 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
11:01:20,829 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
11:01:20,829 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
11:01:20,832 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@794cb805 - Registering current configuration as safe fallback point
2022-01-25 11:01:20.839 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
2022-01-25 11:01:20.843 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 7.3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/22d8f391af675451ab3dbef953113f2d77d968a3)
Java VM: 1.8.0_232
2022-01-25 11:01:20.844 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_232
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
2022-01-25 11:01:20.844 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
Working dir: /home/netarkdv/Test6
2022-01-25 11:01:20.844 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/netarkdv/Test6
2022-01-25 11:01:20.844 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/netarkdv/Test6/conf/settings_HarvestControllerApplication_sbhigh_h3.xml'
2022-01-25 11:01:20.996 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'sb-test-har-001.statsbiblioteket.dk' and JMX/RMI ports 8170/8270
2022-01-25 11:01:20.997 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://sb-test-har-001.statsbiblioteket.dk:8270/jndi/rmi://sb-test-har-001.statsbiblioteket.dk:8170/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-01-25 11:01:21.001 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2022-01-25 11:01:21.011 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:01:21.013 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2022-01-25 11:01:21.013 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2022-01-25 11:01:21.025 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2022-01-25 11:01:21.025 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2022-01-25 11:01:21.030 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2022-01-25 11:01:21.031 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2022-01-25 11:01:21.171 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): sb-test-har-001.statsbiblioteket.dk
2022-01-25 11:01:22.395 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2022-01-25 11:01:22.397 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@37b70343 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3
2022-01-25 11:01:22.417 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3']'
2022-01-25 11:01:22.419 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/netarkdv/extra_configs/bitmag_config
2022-01-25 11:01:22.419 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID
2022-01-25 11:01:22.425 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2022-01-25 11:01:22.432 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries.
2022-01-25 11:01:22.521 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2022-01-25 11:01:22.552 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2022-01-25 11:01:22.556 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2022-01-25 11:01:22.556 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_high'
2022-01-25 11:01:22.558 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@2cac4385 as listener to Test6_COMMON_HCHAN_VAL_RESP
2022-01-25 11:01:22.593 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'HIGHPRIORITY'
2022-01-25 11:01:22.624 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'HIGHPRIORITY' is valid.
2022-01-25 11:01:22.627 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY']'
2022-01-25 11:01:22.629 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@2cac4385 as listener to Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY
--------------------------------------------
Completed the script all_test.sh
Finished: SUCCESS
Console Output
Help us localize this page