-har-004.kb.dk.warc: COMPLETE:
Deleting file 1-metadata-1.warc.gz with checksum d0c88ac9339e63247e9bd1fe2def47f5 in collection Test3 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-disk-devel-02 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01
12:42:52.518 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
12:42:52.602 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
12:42:52.965 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
12:42:53.022 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
12:42:53.884 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
12:42:53.900 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
12:42:53.901 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
12:42:54.055 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:42:54.056 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
12:42:54.968 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
12:42:55.047 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:42:55.049 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-12262]
12:42:55.051 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
12:42:55.051 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@446293d' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12262' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
12:42:55.052 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12262' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@446293d'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12262#71706941'.
12:42:55.052 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12262#71706941'.
12:42:55.070 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
12:42:55.079 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
12:42:55.081 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-tape-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@49c7b90e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@10d307f1[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-48,-56,-118,-55,51,-98,99,36,126,-101,-47,-2,45,-17,71,-11}, calculationTimestamp=2021-02-25T12:42:55.072+01:00]', while requested checksum 'null'. And the audit trail information 'null'.
12:42:55.094 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
12:42:55.599 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(f1e52cc7) collectionID Test3, to netarkiv-tape-devel-01, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz
12:42:55.600 DEBUG o.b.commandline.DeleteFileCmd - Received event: f1e52cc7: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
12:42:56.022 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(f1e52cc7) collectionID Test3, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.)
12:42:56.030 DEBUG o.b.c.c.ConversationEventMonitor - f1e52cc7: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01
12:42:56.252 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(f1e52cc7) collectionID Test3, from netarkiv-disk-devel-02: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.)
12:42:56.259 DEBUG o.b.c.c.ConversationEventMonitor - f1e52cc7: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-02
12:42:56.469 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(f1e52cc7) collectionID Test3, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
12:42:56.473 DEBUG o.b.c.c.ConversationEventMonitor - f1e52cc7: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
12:42:56.689 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(f1e52cc7) collectionID Test3, from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
12:42:56.689 DEBUG o.b.commandline.DeleteFileCmd - Received event: f1e52cc7: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01
12:42:56.690 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01
12:42:56.690 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: []
12:42:56.690 DEBUG o.b.commandline.DeleteFileCmd - Received event: f1e52cc7: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-tape-devel-01]
12:42:56.691 DEBUG o.b.commandline.DeleteFileCmd - Received event: f1e52cc7: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-tape-devel-01], Sending request for deleting file
12:42:56.912 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(f1e52cc7) collectionID Test3, to netarkiv-tape-devel-01, destination queue://netarkiv-tape-devel-01: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@49c7b90e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@10d307f1[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-48,-56,-118,-55,51,-98,99,36,126,-101,-47,-2,45,-17,71,-11}, calculationTimestamp=2021-02-25T12:42:55.072+01:00]
12:42:57.421 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(f1e52cc7) collectionID Test3, from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS)
12:42:57.422 DEBUG o.b.commandline.DeleteFileCmd - Received event: f1e52cc7: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS
12:42:57.661 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(f1e52cc7) collectionID Test3, from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED)
12:42:57.662 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01
12:42:57.662 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: []
12:42:57.662 DEBUG o.b.commandline.DeleteFileCmd - Complete: f1e52cc7: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE:
12:42:57.663 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz':
12:42:57.663 DEBUG o.b.commandline.DeleteFileCmd - f1e52cc7: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE:
12:42:58.789 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
12:42:58.858 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
12:42:59.215 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
12:42:59.257 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
12:42:59.874 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
12:42:59.890 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
12:42:59.891 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
12:43:00.046 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:43:00.047 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
12:43:00.911 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
12:43:00.994 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:43:00.996 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-12301]
12:43:00.998 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
12:43:00.998 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@2fd1433e' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12301' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
12:43:00.998 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12301' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@2fd1433e'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12301#802243390'.
12:43:00.998 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12301#802243390'.
12:43:01.013 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
12:43:01.020 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
12:43:01.021 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@3c73951[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3d5c822d[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-48,-56,-118,-55,51,-98,99,36,126,-101,-47,-2,45,-17,71,-11}, calculationTimestamp=2021-02-25T12:43:01.015+01:00]', while requested checksum 'null'. And the audit trail information 'null'.
12:43:01.032 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
12:43:01.610 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(ae5e1d36) collectionID Test3, to netarkiv-disk-devel-01, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz
12:43:01.611 DEBUG o.b.commandline.DeleteFileCmd - Received event: ae5e1d36: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
12:43:01.894 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(ae5e1d36) collectionID Test3, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.)
12:43:01.902 DEBUG o.b.c.c.ConversationEventMonitor - ae5e1d36: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01
12:43:02.135 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(ae5e1d36) collectionID Test3, from netarkiv-disk-devel-02: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.)
12:43:02.142 DEBUG o.b.c.c.ConversationEventMonitor - ae5e1d36: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-02
12:43:02.359 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(ae5e1d36) collectionID Test3, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
12:43:02.366 DEBUG o.b.c.c.ConversationEventMonitor - ae5e1d36: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
12:43:02.649 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(ae5e1d36) collectionID Test3, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE)
12:43:02.650 DEBUG o.b.commandline.DeleteFileCmd - Received event: ae5e1d36: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01
12:43:02.651 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01
12:43:02.651 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: []
12:43:02.652 DEBUG o.b.commandline.DeleteFileCmd - Received event: ae5e1d36: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-disk-devel-01]
12:43:02.652 DEBUG o.b.commandline.DeleteFileCmd - Received event: ae5e1d36: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-disk-devel-01], Sending request for deleting file
12:43:02.926 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(ae5e1d36) collectionID Test3, to netarkiv-disk-devel-01, destination queue://netarkiv-disk-devel-01: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@3c73951[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3d5c822d[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-48,-56,-118,-55,51,-98,99,36,126,-101,-47,-2,45,-17,71,-11}, calculationTimestamp=2021-02-25T12:43:01.015+01:00]
12:43:03.399 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(ae5e1d36) collectionID Test3, from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS)
12:43:03.400 DEBUG o.b.commandline.DeleteFileCmd - Received event: ae5e1d36: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS
12:43:03.616 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(ae5e1d36) collectionID Test3, from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED)
12:43:03.617 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01
12:43:03.617 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: []
12:43:03.617 DEBUG o.b.commandline.DeleteFileCmd - Complete: ae5e1d36: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE:
12:43:03.617 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz':
12:43:03.618 DEBUG o.b.commandline.DeleteFileCmd - ae5e1d36: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE:
12:43:04.782 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
12:43:04.878 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
12:43:05.214 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
12:43:05.251 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
12:43:05.853 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
12:43:05.872 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
12:43:05.873 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
12:43:06.037 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:43:06.038 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
12:43:06.975 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
12:43:07.050 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:43:07.052 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-12340]
12:43:07.054 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
12:43:07.054 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3514a4c0' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12340' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
12:43:07.054 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12340' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3514a4c0'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12340#890545344'.
12:43:07.054 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12340#890545344'.
12:43:07.070 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
12:43:07.078 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
12:43:07.079 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-disk-devel-02' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@6f46426d[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@73700b80[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-48,-56,-118,-55,51,-98,99,36,126,-101,-47,-2,45,-17,71,-11}, calculationTimestamp=2021-02-25T12:43:07.072+01:00]', while requested checksum 'null'. And the audit trail information 'null'.
12:43:07.091 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
12:43:07.633 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(77781d2d) collectionID Test3, to netarkiv-disk-devel-02, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz
12:43:07.636 DEBUG o.b.commandline.DeleteFileCmd - Received event: 77781d2d: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
12:43:07.938 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(77781d2d) collectionID Test3, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.)
12:43:07.952 DEBUG o.b.c.c.ConversationEventMonitor - 77781d2d: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01
12:43:08.176 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(77781d2d) collectionID Test3, from netarkiv-disk-devel-02: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.)
12:43:08.183 DEBUG o.b.commandline.DeleteFileCmd - Received event: 77781d2d: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-02
12:43:08.183 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-02
12:43:08.183 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02], components that have not answered: []
12:43:08.184 DEBUG o.b.commandline.DeleteFileCmd - Received event: 77781d2d: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-disk-devel-02]
12:43:08.184 DEBUG o.b.commandline.DeleteFileCmd - Received event: 77781d2d: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-disk-devel-02], Sending request for deleting file
12:43:08.801 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(77781d2d) collectionID Test3, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
12:43:08.805 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(77781d2d) collectionID Test3, to netarkiv-disk-devel-02, destination topic://netarkiv-devel.netarkiv-disk-devel-02: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@6f46426d[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@73700b80[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-48,-56,-118,-55,51,-98,99,36,126,-101,-47,-2,45,-17,71,-11}, calculationTimestamp=2021-02-25T12:43:07.072+01:00]
12:43:08.811 DEBUG o.b.c.c.ConversationEventMonitor - 77781d2d: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
12:43:09.007 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(77781d2d) collectionID Test3, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
12:43:09.017 DEBUG o.b.c.c.ConversationEventMonitor - 77781d2d: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
12:43:09.209 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(77781d2d) collectionID Test3, from netarkiv-disk-devel-02: OPERATION_COMPLETED(1-metadata-1.warc.gz deleted.)
12:43:09.210 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-02
12:43:09.210 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02], components that have not answered: []
12:43:09.211 DEBUG o.b.commandline.DeleteFileCmd - Complete: 77781d2d: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE:
12:43:09.211 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz':
12:43:09.211 DEBUG o.b.commandline.DeleteFileCmd - 77781d2d: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE:
12:43:10.356 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
12:43:10.443 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
12:43:10.725 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
12:43:10.756 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
12:43:11.404 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
12:43:11.421 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
12:43:11.422 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
12:43:11.568 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:43:11.569 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
12:43:12.474 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
12:43:12.557 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:43:12.559 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-12380]
12:43:12.562 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
12:43:12.562 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3514a4c0' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12380' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
12:43:12.562 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12380' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3514a4c0'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12380#890545344'.
12:43:12.562 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12380#890545344'.
12:43:12.579 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
12:43:12.587 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
12:43:12.589 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-checksum-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@6f46426d[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@73700b80[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-48,-56,-118,-55,51,-98,99,36,126,-101,-47,-2,45,-17,71,-11}, calculationTimestamp=2021-02-25T12:43:12.581+01:00]', while requested checksum 'null'. And the audit trail information 'null'.
12:43:12.603 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
12:43:13.106 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(c265005c) collectionID Test3, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz
12:43:13.106 DEBUG o.b.commandline.DeleteFileCmd - Received event: c265005c: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
12:43:13.449 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(c265005c) collectionID Test3, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.)
12:43:13.457 DEBUG o.b.c.c.ConversationEventMonitor - c265005c: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01
12:43:13.657 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(c265005c) collectionID Test3, from netarkiv-disk-devel-02: FILE_NOT_FOUND_FAILURE("1-metadata-1.warc.gz" not found in collection "Test3")
12:43:13.663 DEBUG o.b.c.c.ConversationEventMonitor - c265005c: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-02
12:43:13.907 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(c265005c) collectionID Test3, from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.)
12:43:13.917 DEBUG o.b.commandline.DeleteFileCmd - Received event: c265005c: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01
12:43:13.918 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
12:43:13.918 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: []
12:43:13.918 DEBUG o.b.commandline.DeleteFileCmd - Received event: c265005c: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-checksum-devel-01]
12:43:13.919 DEBUG o.b.commandline.DeleteFileCmd - Received event: c265005c: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01], Sending request for deleting file
12:43:14.400 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(c265005c) collectionID Test3, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@6f46426d[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@73700b80[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-48,-56,-118,-55,51,-98,99,36,126,-101,-47,-2,45,-17,71,-11}, calculationTimestamp=2021-02-25T12:43:12.581+01:00]
12:43:14.455 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(c265005c) collectionID Test3, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
12:43:14.461 DEBUG o.b.c.c.ConversationEventMonitor - c265005c: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
12:43:14.667 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(c265005c) collectionID Test3, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
12:43:14.668 DEBUG o.b.c.c.ConversationEventMonitor - c265005c: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
12:43:14.883 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(c265005c) collectionID Test3, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS
12:43:14.884 DEBUG o.b.commandline.DeleteFileCmd - Received event: c265005c: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-checksum-devel-01
12:43:15.044 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(c265005c) collectionID Test3, from netarkiv-checksum-devel-01: OPERATION_COMPLETED
12:43:15.045 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
12:43:15.045 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: []
12:43:15.045 DEBUG o.b.commandline.DeleteFileCmd - Complete: c265005c: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE:
12:43:15.045 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz':
12:43:15.045 DEBUG o.b.commandline.DeleteFileCmd - c265005c: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE:
12:43:16.200 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
12:43:16.304 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
12:43:16.731 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
12:43:16.760 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
12:43:17.516 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
12:43:17.531 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
12:43:17.532 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
12:43:17.718 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:43:17.719 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
12:43:18.731 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
12:43:18.815 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
12:43:18.817 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-12419]
12:43:18.819 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
12:43:18.819 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3514a4c0' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12419' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
12:43:18.820 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12419' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3514a4c0'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12419#890545344'.
12:43:18.820 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-12419#890545344'.
12:43:18.836 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
12:43:18.845 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation.
12:43:18.847 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-kbh-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@6f46426d[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@73700b80[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-48,-56,-118,-55,51,-98,99,36,126,-101,-47,-2,45,-17,71,-11}, calculationTimestamp=2021-02-25T12:43:18.839+01:00]', while requested checksum 'null'. And the audit trail information 'null'.
12:43:18.860 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd
12:43:19.322 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(89067289) collectionID Test3, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz
12:43:19.323 DEBUG o.b.commandline.DeleteFileCmd - Received event: 89067289: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file
12:43:19.630 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(89067289) collectionID Test3, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.)
12:43:19.638 DEBUG o.b.commandline.DeleteFileCmd - Received event: 89067289: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01
12:43:19.638 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
12:43:19.638 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: []
12:43:19.639 DEBUG o.b.commandline.DeleteFileCmd - Received event: 89067289: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01]
12:43:19.639 DEBUG o.b.commandline.DeleteFileCmd - Received event: 89067289: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-kbh-disk-devel-01], Sending request for deleting file
12:43:20.164 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(89067289) collectionID Test3, from netarkiv-disk-devel-02: FILE_NOT_FOUND_FAILURE("1-metadata-1.warc.gz" not found in collection "Test3")
12:43:20.183 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(89067289) collectionID Test3, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@6f46426d[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@73700b80[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], checksumValue={-48,-56,-118,-55,51,-98,99,36,126,-101,-47,-2,45,-17,71,-11}, calculationTimestamp=2021-02-25T12:43:18.839+01:00]
12:43:20.215 DEBUG o.b.c.c.ConversationEventMonitor - 89067289: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-02
12:43:20.412 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(89067289) collectionID Test3, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
12:43:20.413 DEBUG o.b.c.c.ConversationEventMonitor - 89067289: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01
12:43:20.629 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(89067289) collectionID Test3, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store)
12:43:20.635 DEBUG o.b.c.c.ConversationEventMonitor - 89067289: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01
12:43:20.815 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(89067289) collectionID Test3, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(1-metadata-1.warc.gz deleted.)
12:43:20.816 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
12:43:20.816 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: []
12:43:20.816 DEBUG o.b.commandline.DeleteFileCmd - Complete: 89067289: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE:
12:43:20.817 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz':
12:43:20.817 DEBUG o.b.commandline.DeleteFileCmd - 89067289: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE:
Now deleting actual files on Windows hosts for Test3
Nothing to delete in e:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Preparing to delete the following from f:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
1-1-20210224152434692-00001-ciblee_2015_kb-test-har-004.kb.dk.warc
OK
Preparing to delete the following from g:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
1-1-20210224152434689-00000-ciblee_2015_kb-test-har-004.kb.dk.warc
OK
Preparing to delete the following from h:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
1-metadata-1.warc.gz
OK
Nothing to delete in i:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in j:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Permission denied ().
Nothing to delete in e:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Permission denied ().
Nothing to delete in f:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Permission denied ().
Nothing to delete in g:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Permission denied ().
Nothing to delete in h:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Permission denied ().
Nothing to delete in i:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
Permission denied, please try again.
Permission denied, please try again.
Permission denied ().
Nothing to delete in j:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
calling cleanup_hosts
running cleanup_hosts
Removing installation on sb-test-har-001.statsbiblioteket.dk
Removing installation on kb-test-har-003.kb.dk
Removing installation on kb-test-har-004.kb.dk
Removing installation on kb-test-har-005.kb.dk
Removing installation on kb-test-adm-001.kb.dk
Removing installation on kb-test-acs-001.kb.dk
Removing installation on kb-test-way-001.kb.dk
calling cleanup_linuxbarhosts
running cleanup_linuxbarhosts
Removing installation on sb-test-bar-001.statsbiblioteket.dk
Removing bitarchive on sb-test-bar-001.statsbiblioteket.dk
Calling cleanup_windowsbarhosts
running cleanup_windowsbarhosts
Removing C:\bitarkiv\Test3 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing E:\bitarchive_1\Test3 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing F:\bitarchive_2\Test3 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing g:\bitarchive_3\Test3 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
TESTX=Test3
PORT=8076
MAILRECEIVERS=rbkr@kb.dk
VERSION=RBKR
DEPLOYCONF=deploy_config_bitmag.xml
H3ZIP=RBKR
BITMAGCONF=/home/devel/bitmag_test_config/client_config
Using bundler file /home/devel/nas_versions/bundler/NetarchiveSuite-heritrix3-bundler-RBKR.zip
Creating distribution files in /home/devel/prepared_software/Test3.
Will read source files using encoding 'UTF-8' (defaulted)
Branch in settings not found: common.warcRecordService
Branch in settings not found: common.trustStore
Branch in settings not found: common.arcrepositoryClient.bitrepository
Branch in settings not found: common.hadoop
Branch in settings not found: common.useBitmagHadoopBackend
Branch in settings not found: common.fileResolver
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Machine 'kb-test-adm-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-har-003.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test3/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test3/h3server.jks
Machine 'kb-test-har-005.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test3/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test3/h3server.jks
Machine 'kb-test-har-004.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test3/NetarchiveSuite-heritrix3-bundler.zip
Machine 'kb-test-acs-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-way-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'sb-test-har-001.statsbiblioteket.dk' configured with encoding 'UTF-8' (defaulted)
/home/devel/prepared_software/Test3/NetarchiveSuite-heritrix3-bundler.zip -> /home/netarkdv/Test3/NetarchiveSuite-heritrix3-bundler.zip
12:45:07.408 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:45:07.416 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:45:07.418 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:45:07.418 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:45:07.419 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:45:07.419 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:45:07.420 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:45:07.420 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:45:07.421 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:45:07.421 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:45:07.422 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:45:07.423 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
12:45:07.477 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
12:45:07.477 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-adm-001.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-adm-001.kb.dk
deleting devel@kb-test-adm-001.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-adm-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-003.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-har-003.kb.dk
deleting devel@kb-test-har-003.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-har-003.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-005.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-har-005.kb.dk
deleting devel@kb-test-har-005.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-har-005.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-004.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-har-004.kb.dk
deleting devel@kb-test-har-004.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-har-004.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-acs-001.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-acs-001.kb.dk
deleting devel@kb-test-acs-001.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-acs-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-way-001.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-way-001.kb.dk
deleting devel@kb-test-way-001.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-way-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
--------------------------------------------
INSTALLING TO MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
copying NetarchiveSuite-RBKR.zip to:sb-test-har-001.statsbiblioteket.dk
deleting netarkdv@sb-test-har-001.statsbiblioteket.dk:/home/netarkdv/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:sb-test-har-001.statsbiblioteket.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
Copying secondary installation scripts out to the machines where they need to be executed
scp '/home/devel/devel-config/scripts/link_bitmag.sh' 'netarkdv@sb-test-bar-001.statsbiblioteket.dk:Test3'
Linking Bitmag kbh-pillar and NAS bitarkiv directories on KBH
scp: Test3/link_kbh_bar_01.bat: Error writing file: Insufficient free space on the filesystem.
Permission denied, please try again.
Permission denied, please try again.
Received disconnect from 10.17.0.56: 11: Locked out due to too many failed login attempts.
lost connection
Linking bitmag and netarkivet storage directories on SB
ssh 'netarkdv@sb-test-bar-001.statsbiblioteket.dk' 'Test3/link_bitmag.sh Test3'
bash: Test3/link_bitmag.sh: Not a directory
Linking Bitmag kbh-pillar and NAS bitarkiv directories on KBH
ssh_exchange_identification: Connection closed by remote host
Initializing database for system Test3
+ host=devel@kb-test-adm-001
+ scp -p /home/devel/devel-config/scripts/db/setup_admindb.sh /home/devel/devel-config/scripts/db/setup_harvestdb.sh /home/devel/devel-config/scripts/db/teardown_admindb.sh /home/devel/devel-config/scripts/db/teardown_harvestdb.sh /home/devel/devel-config/scripts/../resources/harvestdb.testdata.sql /home/devel/devel-config/scripts/../resources/default_orderxml.cxml devel@kb-test-adm-001:bin/
+ ssh devel@kb-test-adm-001
Pseudo-terminal will not be allocated because stdin is not a terminal.
Destroying test3_admindb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
DROP DATABASE
Creating empty test3_admindb
CREATE DATABASE
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
Initialising test3_admindb
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "replica_pkey" for table "replica"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "replica_replica_id_key" for table "replica"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "replica_replica_name_key" for table "replica"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "replicafileinfo_pkey" for table "replicafileinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "file_pkey" for table "file"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "segment_pkey" for table "segment"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
Destroying test3_harvestdb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
DROP DATABASE
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
CREATE DATABASE
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "domains_pkey" for table "domains"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "domains_name_key" for table "domains"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "configurations_pkey" for table "configurations"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "config_passwords_pkey" for table "config_passwords"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "config_seedlists_pkey" for table "config_seedlists"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "seedlists_pkey" for table "seedlists"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "passwords_pkey" for table "passwords"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "ownerinfo_pkey" for table "ownerinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "historyinfo_pkey" for table "historyinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvestdefinitions_pkey" for table "harvestdefinitions"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "harvestdefinitions_name_key" for table "harvestdefinitions"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "fullharvests_pkey" for table "fullharvests"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "partialharvests_pkey" for table "partialharvests"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvest_configs_pkey" for table "harvest_configs"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "schedules_pkey" for table "schedules"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "schedules_name_key" for table "schedules"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "ordertemplates_pkey" for table "ordertemplates"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "ordertemplates_name_key" for table "ordertemplates"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "jobs_pkey" for table "jobs"
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "job_configs_pkey" for table "job_configs"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "global_crawler_trap_lists_pkey" for table "global_crawler_trap_lists"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "global_crawler_trap_lists_name_key" for table "global_crawler_trap_lists"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "global_crawler_trap_expressions_pkey" for table "global_crawler_trap_expressions"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "pkrunningjobshistory" for table "runningjobshistory"
CREATE TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "pkrunningjobsmonitor" for table "runningjobsmonitor"
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / UNIQUE will create implicit index "pkfrontierreportlines" for table "frontierreportmonitor"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfieldtype_pkey" for table "extendedfieldtype"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfield_pkey" for table "extendedfield"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfieldvalue_pkey" for table "extendedfieldvalue"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
INSERT 0 1
INSERT 0 1
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvestchannel_pkey" for table "harvestchannel"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "harvestchannel_name_key" for table "harvestchannel"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE TABLE
NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index "eav_type_attribute_pkey" for table "eav_type_attribute"
ALTER TABLE
CREATE INDEX
CREATE SEQUENCE
CREATE TABLE
NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index "eav_attribute_pkey" for table "eav_attribute"
ALTER TABLE
CREATE INDEX
GRANT
GRANT
GRANT
INSERT 0 1
INSERT 0 1
INSERT 0 1
SET
SET
SET
SET
SET
SET
SET
SET
SET
setval
--------
17
(1 row)
setval
--------
17
(1 row)
setval
--------
17
(1 row)
setval
--------
5
(1 row)
setval
--------
4
(1 row)
setval
--------
17
(1 row)
12:47:27.079 [main] INFO com.mchange.v2.log.MLog - MLog clients using log4j logging.
12:47:27.409 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.2.1 [built 20-March-2013 10:47:27 +0000; debug? true; trace: 10]
12:47:27.506 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52af1o7pd1m1aakcgn|150c158,name=10bdx52af1o7pd1m1aakcgn|150c158 registered.
12:47:27.551 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52af1o7pd1m1aakcgn|150c158,name=10bdx52af1o7pd1m1aakcgn|150c158 unregistered, in order to be reregistered after update.
12:47:27.552 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52af1o7pd1m1aakcgn|150c158,name=10bdx52af1o7pd1m1aakcgn|150c158 registered.
12:47:27.570 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
12:47:27.645 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, dataSourceName -> 10bdx52af1o7pd1m1aakcgn|150c158, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 10bdx52af1o7pd1m1aakcgn|150c158, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost:5432/test3_harvestdb, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 3600, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, preferredTestQuery -> null, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ]
12:47:27.666 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 1
12:47:27.666 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [1], attempts_remaining: 30
12:47:27.667 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1040f2f: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@c87930
12:47:27.667 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 2
12:47:27.667 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [2], attempts_remaining: 30
12:47:27.667 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1040f2f: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@cff1a
12:47:27.668 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 3
12:47:27.668 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [3], attempts_remaining: 30
12:47:27.668 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1040f2f: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@15710fc
12:47:27.668 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 4
12:47:27.668 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [4], attempts_remaining: 30
12:47:27.669 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1040f2f: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@5f1e4e
12:47:27.669 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 5
12:47:27.669 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [5], attempts_remaining: 30
12:47:27.669 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1040f2f: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@1f9eccc
12:47:27.677 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@aa2946 config: [start -> 3; min -> 5; max -> 20; inc -> 5; num_acq_attempts -> 30; acq_attempt_delay -> 1000; check_idle_resources_delay -> 0; mox_resource_age -> 3600000; max_idle_time -> 0; excess_max_idle_time -> 0; destroy_unreturned_resc_time -> 0; expiration_enforcement_delay -> 900000; break_on_acquisition_failure -> false; debug_store_checkout_exceptions -> false]
12:47:27.677 [main] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPoolManager - Created new pool for auth, username (masked): 'de******'.
12:47:27.678 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - acquire test -- pool size: 0; target_pool_size: 5; desired target? 1
12:47:27.678 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - awaitAvailable(): [unknown]
12:47:27.678 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@aa2946 [managed: 0, unused: 0, excluded: 0]
12:47:27.843 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#2] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@cc43c4.acquireResource() returning.
12:47:27.844 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#1] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@cc43c4.acquireResource() returning.
12:47:27.845 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@aa2946 [managed: 1, unused: 1, excluded: 0]
12:47:27.845 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 4
12:47:27.845 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [4], attempts_remaining: 30
12:47:27.846 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@aa2946 [managed: 1, unused: 0, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@61ff8)
12:47:27.851 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@aa2946 [managed: 2, unused: 1, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@61ff8)
12:47:27.851 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 3
12:47:27.851 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [3], attempts_remaining: 30
12:47:27.854 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#0] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@cc43c4.acquireResource() returning.
12:47:27.854 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@aa2946 [managed: 3, unused: 2, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@61ff8)
12:47:27.854 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 2
12:47:27.854 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [2], attempts_remaining: 30
12:47:27.893 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#1] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@cc43c4.acquireResource() returning.
12:47:27.893 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@aa2946 [managed: 4, unused: 3, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@61ff8)
12:47:27.893 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 1
12:47:27.893 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [1], attempts_remaining: 30
12:47:27.895 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#2] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@cc43c4.acquireResource() returning.
12:47:27.895 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@aa2946 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@61ff8)
12:47:27.895 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 0
12:47:27.895 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1o7pd1m1aakcgn|150c158]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [0], attempts_remaining: 30
12:47:27.914 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@1938003 closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@1a561cf
12:47:27.915 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1040f2f: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@646153
12:47:27.915 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@aa2946 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@61ff8)
12:47:27.924 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@aa2946 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@61ff8)
12:47:27.927 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@12f2cc1 closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@16a4e4b
12:47:27.928 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1040f2f: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@79870
12:47:27.928 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@aa2946 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@61ff8)
12:47:27.957 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@aa2946 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@61ff8)
12:47:27.958 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@1761df8 closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@417213
12:47:27.977 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1040f2f: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1dd4eda
12:47:27.977 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@aa2946 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@61ff8)
The template 'default_orderxml' has now been updated.
+ set +x
--------------------------------------------
STARTING MACHINE: devel@kb-test-adm-001.kb.dk
Starting all applications on: kb-test-adm-001.kb.dk
Starting linux application: GUIApplication
Starting linux application: ArcRepositoryApplication
Starting linux application: HarvestJobManagerApplication
12:47:29,607 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_ArcRepositoryApplication.xml] at [file:/home/devel/Test3/conf/logback_ArcRepositoryApplication.xml]
12:47:30,433 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:47:30,436 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:47:30,464 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:47:30,514 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:30,689 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:47:30,700 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:47:30,801 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@13876258 - No compression will be used
12:47:30,803 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@13876258 - Will use the pattern ./log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:47:30,826 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@d4bf7e - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log'.
12:47:30,826 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@d4bf7e - Roll-over at midnight.
12:47:30,843 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@d4bf7e - Setting initial period to Thu Feb 25 12:47:30 CET 2021
12:47:30,843 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@d4bf7e - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:47:30,843 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@d4bf7e - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:47:30,848 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:30,870 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ArcRepositoryApplication.log
12:47:30,871 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ArcRepositoryApplication.log]
12:47:30,874 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:47:32,318 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:47:32,333 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:47:32,333 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:47:32,335 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:47:32,335 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:47:32,344 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:47:32,345 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:47:32,346 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@1d9d4b - Registering current configuration as safe fallback point
2021-02-25 12:47:32.392 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
2021-02-25 12:47:32.424 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
Java VM: 1.8.0_20
2021-02-25 12:47:32.427 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_20
java.home: /usr/java/jdk1.8.0_20/jre
2021-02-25 12:47:32.433 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/java/jdk1.8.0_20/jre
Working dir: /home/devel/Test3
2021-02-25 12:47:32.436 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-25 12:47:32.437 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_ArcRepositoryApplication.xml'
2021-02-25 12:47:32.758 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8151/8251
2021-02-25 12:47:32.761 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8151 communicating on port 8251 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8251/jndi/rmi://kb-test-adm-001.kb.dk:8151/jmxrmi
dk.netarkivet.archive.arcrepository.ArcRepository Running
2021-02-25 12:47:32.769 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.archive.arcrepository.ArcRepository Running
2021-02-25 12:47:32.836 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:32.837 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:32.837 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-25 12:47:33.570 INFO d.n.a.a.ArchiveDBConnection.initDataSource - Using jdbc url: jdbc:postgresql://localhost:5432/test3_admindb
2021-02-25 12:47:33.588 INFO d.n.a.a.ArchiveDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=10
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=30
- idleConnTestQuery='SELECT COUNT(*) FROM replica'
- idleConnTestOnCheckin=false
12:47:29,491 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_GUIApplication.xml] at [file:/home/devel/Test3/conf/logback_GUIApplication.xml]
12:47:30,221 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:47:30,222 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:47:30,263 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:47:30,326 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:30,512 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:47:30,520 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:47:30,603 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@28594521 - No compression will be used
12:47:30,611 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@28594521 - Will use the pattern ./log/GUIApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:47:30,623 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@107227e - The date pattern is 'yyyy-MM-dd' from file name pattern './log/GUIApplication.%d{yyyy-MM-dd}.%i.log'.
12:47:30,623 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@107227e - Roll-over at midnight.
12:47:30,644 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@107227e - Setting initial period to Thu Feb 25 12:47:30 CET 2021
12:47:30,644 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@107227e - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:47:30,644 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@107227e - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:47:30,648 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:30,657 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/GUIApplication.log
12:47:30,657 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/GUIApplication.log]
12:47:30,660 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:47:31,878 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:47:31,880 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:47:31,880 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:47:31,890 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:47:31,890 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:47:31,891 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:47:31,891 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:47:31,892 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@417213 - Registering current configuration as safe fallback point
2021-02-25 12:47:31.918 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
2021-02-25 12:47:31.963 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
Java VM: 1.8.0_20
2021-02-25 12:47:31.965 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_20
java.home: /usr/java/jdk1.8.0_20/jre
2021-02-25 12:47:31.966 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/java/jdk1.8.0_20/jre
Working dir: /home/devel/Test3
2021-02-25 12:47:31.967 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-25 12:47:31.968 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_GUIApplication.xml'
2021-02-25 12:47:32.372 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8150/8250
2021-02-25 12:47:32.373 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8250/jndi/rmi://kb-test-adm-001.kb.dk:8150/jmxrmi
dk.netarkivet.common.webinterface.GUIWebServer Running
2021-02-25 12:47:32.391 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.common.webinterface.GUIWebServer Running
2021-02-25 12:47:32.392 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war
2021-02-25 12:47:32.392 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection
2021-02-25 12:47:32.392 INFO d.n.common.webinterface.GUIWebServer.<init> - Starting webserver. Port: 8076 deployment directories: 'webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war' classes: 'dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection'
2021-02-25 12:47:32.419 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:32.427 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:32.428 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-25 12:47:32.423 DEBUG d.n.common.webinterface.GUIWebServer.<init> - GUI using tempdir /home/devel/Test3/tmpdircommon
2021-02-25 12:47:32.430 DEBUG d.n.common.webinterface.GUIWebServer.<init> - GUI using basedir /home/devel/Test3
2021-02-25 12:47:32.431 INFO d.n.common.webinterface.GUIWebServer.<init> - Deleted existing tempdir '/home/devel/Test3/tmpdircommon'
2021-02-25 12:47:32.674 INFO d.n.common.webinterface.GUIWebServer.<init> - Scanning for taglibs is disabled as tomcat.util.scan.StandardJarScanFilter.jarsToSkip is unset.
12:47:29,779 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestJobManagerApplication.xml] at [file:/home/devel/Test3/conf/logback_HarvestJobManagerApplication.xml]
12:47:30,219 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:47:30,227 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:47:30,276 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:47:30,353 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:30,557 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:47:30,585 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:47:30,687 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@16208003 - No compression will be used
12:47:30,694 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@16208003 - Will use the pattern ./log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:47:30,698 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@698dc7 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log'.
12:47:30,698 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@698dc7 - Roll-over at midnight.
12:47:30,720 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@698dc7 - Setting initial period to Thu Feb 25 12:47:30 CET 2021
12:47:30,721 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@698dc7 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:47:30,721 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@698dc7 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:47:30,738 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:30,754 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestJobManagerApplication.log
12:47:30,754 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestJobManagerApplication.log]
12:47:30,757 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:47:32,237 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:47:32,247 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:47:32,247 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:47:32,259 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:47:32,259 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:47:32,260 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:47:32,260 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:47:32,261 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@1d7741f - Registering current configuration as safe fallback point
2021-02-25 12:47:32.286 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
2021-02-25 12:47:32.386 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:32.393 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:32.393 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-003.kb.dk
Starting all applications on: kb-test-har-003.kb.dk
Starting linux application: HarvestControllerApplication_kblow001_h3
12:47:34,543 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kblow001_h3.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kblow001_h3.xml]
12:47:34,864 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:47:34,867 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:47:34,874 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:47:34,887 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:34,946 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:47:34,949 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:47:34,982 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@501187768 - No compression will be used
12:47:34,985 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@501187768 - Will use the pattern ./log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log for the active file
12:47:34,990 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1139b2f3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log'.
12:47:34,990 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1139b2f3 - Roll-over at midnight.
12:47:34,998 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1139b2f3 - Setting initial period to Thu Feb 25 12:47:34 CET 2021
12:47:34,999 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1139b2f3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:47:34,999 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1139b2f3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:47:35,002 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:35,007 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow001_h3.log
12:47:35,007 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow001_h3.log]
12:47:35,009 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:47:35,615 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:47:35,618 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:47:35,618 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:47:35,619 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:47:35,619 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:47:35,619 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:47:35,619 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:47:35,620 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@7a69b07 - Registering current configuration as safe fallback point
2021-02-25 12:47:35.626 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
2021-02-25 12:47:35.637 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
Java VM: 1.8.0_282
2021-02-25 12:47:35.638 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-25 12:47:35.638 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-25 12:47:35.638 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-25 12:47:35.643 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kblow001_h3.xml'
2021-02-25 12:47:35.774 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-003.kb.dk' and JMX/RMI ports 8150/8250
2021-02-25 12:47:35.775 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-003.kb.dk:8250/jndi/rmi://kb-test-har-003.kb.dk:8150/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-25 12:47:35.781 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-25 12:47:35.794 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:35.794 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-25 12:47:35.794 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:35.794 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2021-02-25 12:47:35.795 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-25 12:47:35.795 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2021-02-25 12:47:35.795 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-25 12:47:35.981 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-003.kb.dk
2021-02-25 12:47:37.664 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2021-02-25 12:47:37.665 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@c5ee75e as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3
2021-02-25 12:47:37.675 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3']'
2021-02-25 12:47:37.675 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-25 12:47:37.676 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using default collectionID 'Test3'
2021-02-25 12:47:37.680 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2021-02-25 12:47:37.758 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2021-02-25 12:47:37.786 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2021-02-25 12:47:37.788 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2021-02-25 12:47:37.788 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_low'
2021-02-25 12:47:37.789 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@531c311e as listener to Test3_COMMON_HCHAN_VAL_RESP
2021-02-25 12:47:37.808 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'LOWPRIORITY'
2021-02-25 12:47:37.875 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'LOWPRIORITY' is valid.
2021-02-25 12:47:37.877 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test3_COMMON_JOB_SNAPSHOT_LOWPRIORITY']'
2021-02-25 12:47:37.878 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@531c311e as listener to Test3_COMMON_JOB_SNAPSHOT_LOWPRIORITY
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-005.kb.dk
Starting all applications on: kb-test-har-005.kb.dk
Starting linux application: HarvestControllerApplication_kbumbra_1
Starting linux application: HarvestControllerApplication_kbumbra_2
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-004.kb.dk
Starting all applications on: kb-test-har-004.kb.dk
Starting linux application: HarvestControllerApplication_kblow002_h3
Starting linux application: HarvestControllerApplication_kbhigh_h3
12:47:45,397 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kbhigh_h3.xml]
12:47:45,794 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:47:45,798 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:47:45,818 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:47:45,849 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:45,952 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:47:45,956 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:47:46,016 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@370440646 - No compression will be used
12:47:46,017 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@370440646 - Will use the pattern ./log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
12:47:46,026 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4313f5bc - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
12:47:46,026 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4313f5bc - Roll-over at midnight.
12:47:46,038 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4313f5bc - Setting initial period to Thu Feb 25 12:47:46 CET 2021
12:47:46,038 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4313f5bc - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:47:46,038 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4313f5bc - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:47:46,040 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:46,049 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbhigh_h3.log
12:47:46,049 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbhigh_h3.log]
12:47:46,050 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:47:46,611 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:47:46,616 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:47:46,616 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:47:46,616 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:47:46,616 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:47:46,617 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:47:46,617 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:47:46,617 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@7f010382 - Registering current configuration as safe fallback point
2021-02-25 12:47:46.627 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
2021-02-25 12:47:46.638 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
Java VM: 1.8.0_25
2021-02-25 12:47:46.639 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2021-02-25 12:47:46.639 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test3
2021-02-25 12:47:46.639 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-25 12:47:46.640 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kbhigh_h3.xml'
2021-02-25 12:47:46.796 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8152/8252
2021-02-25 12:47:46.797 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8152 communicating on port 8252 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8252/jndi/rmi://kb-test-har-004.kb.dk:8152/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-25 12:47:46.813 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-25 12:47:46.817 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:46.817 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:46.818 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-25 12:47:46.841 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-25 12:47:46.841 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2021-02-25 12:47:46.842 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2021-02-25 12:47:46.842 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-25 12:47:47.029 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
12:47:45,436 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kblow002_h3.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kblow002_h3.xml]
12:47:45,833 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:47:45,852 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:47:45,864 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:47:45,892 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:45,947 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:47:45,951 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:47:45,980 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@370440646 - No compression will be used
12:47:45,981 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@370440646 - Will use the pattern ./log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log for the active file
12:47:45,983 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4313f5bc - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log'.
12:47:45,983 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4313f5bc - Roll-over at midnight.
12:47:45,989 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4313f5bc - Setting initial period to Thu Feb 25 12:47:45 CET 2021
12:47:45,989 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4313f5bc - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:47:45,989 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4313f5bc - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:47:45,991 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:45,995 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow002_h3.log
12:47:45,995 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow002_h3.log]
12:47:45,995 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:47:46,557 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:47:46,558 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:47:46,558 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:47:46,570 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:47:46,570 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:47:46,570 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:47:46,570 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:47:46,571 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@7f010382 - Registering current configuration as safe fallback point
2021-02-25 12:47:46.576 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
2021-02-25 12:47:46.592 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
Java VM: 1.8.0_25
2021-02-25 12:47:46.593 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2021-02-25 12:47:46.593 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test3
2021-02-25 12:47:46.593 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-25 12:47:46.594 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kblow002_h3.xml'
2021-02-25 12:47:46.799 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8150/8250
2021-02-25 12:47:46.800 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8250/jndi/rmi://kb-test-har-004.kb.dk:8150/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-25 12:47:46.820 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-25 12:47:46.820 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:46.820 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:46.829 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-25 12:47:46.834 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-25 12:47:46.851 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2021-02-25 12:47:46.853 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2021-02-25 12:47:46.853 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-25 12:47:47.042 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
--------------------------------------------
STARTING MACHINE: devel@kb-test-acs-001.kb.dk
Starting all applications on: kb-test-acs-001.kb.dk
Starting linux application: IndexServerApplication
Starting linux application: ViewerProxyApplication
12:47:50,904 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_IndexServerApplication.xml] at [file:/home/devel/Test3/conf/logback_IndexServerApplication.xml]
12:47:51,279 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:47:51,279 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:47:51,286 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:47:51,312 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:51,395 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:47:51,400 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:47:51,457 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@831236296 - No compression will be used
12:47:51,458 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@831236296 - Will use the pattern ./log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:47:51,463 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6dbb137d - The date pattern is 'yyyy-MM-dd' from file name pattern './log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log'.
12:47:51,463 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6dbb137d - Roll-over at midnight.
12:47:51,473 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6dbb137d - Setting initial period to Thu Feb 25 12:47:51 CET 2021
12:47:51,474 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6dbb137d - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:47:51,474 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6dbb137d - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:47:51,482 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:51,486 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/IndexServerApplication.log
12:47:51,486 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/IndexServerApplication.log]
12:47:51,488 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:47:52,351 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:47:52,353 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:47:52,353 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:47:52,354 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:47:52,354 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:47:52,354 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:47:52,354 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:47:52,355 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3c9d0b9d - Registering current configuration as safe fallback point
2021-02-25 12:47:52.364 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
2021-02-25 12:47:52.373 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
Java VM: 1.8.0_282
2021-02-25 12:47:52.374 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-25 12:47:52.374 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-25 12:47:52.375 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-25 12:47:52.375 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_IndexServerApplication.xml'
2021-02-25 12:47:52.599 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8351/8451
2021-02-25 12:47:52.600 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8351 communicating on port 8451 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8451/jndi/rmi://kb-test-acs-001.kb.dk:8351/jmxrmi
dk.netarkivet.harvester.indexserver.IndexServer Running
2021-02-25 12:47:52.606 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.indexserver.IndexServer Running
2021-02-25 12:47:52.614 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test3/cache/cdxdata'
2021-02-25 12:47:52.634 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
2021-02-25 12:47:52.701 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:52.702 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:52.703 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-25 12:47:54.584 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2021-02-25 12:47:54.585 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@31dadd46 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS
2021-02-25 12:47:54.609 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS']'
2021-02-25 12:47:54.610 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-25 12:47:54.610 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using default collectionID 'Test3'
2021-02-25 12:47:54.615 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2021-02-25 12:47:54.741 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found
2021-02-25 12:47:54.752 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found
2021-02-25 12:47:54.808 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2021-02-25 12:47:54.809 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxindex' uses directory '/home/devel/Test3/cache/cdxindex'
2021-02-25 12:47:54.812 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'crawllog' uses directory '/home/devel/Test3/cache/crawllog'
2021-02-25 12:47:54.812 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled
2021-02-25 12:47:54.813 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'dedupcrawllogindex' uses directory '/home/devel/Test3/cache/dedupcrawllogindex'
2021-02-25 12:47:54.813 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test3/cache/cdxdata'
2021-02-25 12:47:54.814 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2021-02-25 12:47:54.814 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'crawllog' uses directory '/home/devel/Test3/cache/crawllog'
2021-02-25 12:47:54.815 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled
2021-02-25 12:47:54.815 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'fullcrawllogindex' uses directory '/home/devel/Test3/cache/fullcrawllogindex'
2021-02-25 12:47:54.816 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test3/cache/cdxdata'
2021-02-25 12:47:54.816 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2021-02-25 12:47:54.817 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test3/cache/cdxindex/empty-cache.working
2021-02-25 12:47:54.817 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test3/cache/cdxindex/empty-cache.working' (thread = main)
2021-02-25 12:47:54.824 DEBUG d.n.common.utils.ProcessUtils.runProcess - Running external program: sort /home/devel/Test3/cache/cdxindex/empty-cache -o /home/devel/Test3/cache/cdxindex/empty-cache.unsorted with environment LANG=C
2021-02-25 12:47:54.838 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@66fdec9
2021-02-25 12:47:54.839 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test3/cache/cdxindex/empty-cache' of id '[]', request was for '[]'
2021-02-25 12:47:54.840 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test3/cache/dedupcrawllogindex/empty-cache.working
2021-02-25 12:47:54.840 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test3/cache/dedupcrawllogindex/empty-cache.working' (thread = main)
2021-02-25 12:47:54.840 INFO d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate dedupcrawllogindex for the 0 jobs: []
2021-02-25 12:47:54.840 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main)
2021-02-25 12:47:54.963 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1)
2021-02-25 12:47:54.975 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)!
2021-02-25 12:47:54.976 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1
2021-02-25 12:47:54.977 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1
2021-02-25 12:47:54.984 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes
2021-02-25 12:47:54.986 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@67ab1c47
2021-02-25 12:47:54.986 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test3/cache/dedupcrawllogindex/empty-cache' of id '[]', request was for '[]'
2021-02-25 12:47:54.987 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test3/cache/fullcrawllogindex/empty-cache.working
2021-02-25 12:47:54.987 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test3/cache/fullcrawllogindex/empty-cache.working' (thread = main)
2021-02-25 12:47:54.987 INFO d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate fullcrawllogindex for the 0 jobs: []
2021-02-25 12:47:54.988 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main)
2021-02-25 12:47:54.991 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1)
2021-02-25 12:47:54.994 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)!
2021-02-25 12:47:54.995 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1
2021-02-25 12:47:54.996 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1
2021-02-25 12:47:54.998 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes
2021-02-25 12:47:54.999 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@30bcf3c1
2021-02-25 12:47:55.000 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test3/cache/fullcrawllogindex/empty-cache' of id '[]', request was for '[]'
12:47:50,903 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_ViewerProxyApplication.xml] at [file:/home/devel/Test3/conf/logback_ViewerProxyApplication.xml]
12:47:51,278 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:47:51,279 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:47:51,286 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:47:51,311 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:51,400 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:47:51,404 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:47:51,453 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@831236296 - No compression will be used
12:47:51,454 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@831236296 - Will use the pattern ./log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log for the active file
12:47:51,458 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6dbb137d - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log'.
12:47:51,458 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6dbb137d - Roll-over at midnight.
12:47:51,470 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6dbb137d - Setting initial period to Thu Feb 25 12:47:51 CET 2021
12:47:51,471 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6dbb137d - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:47:51,471 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6dbb137d - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:47:51,474 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:47:51,485 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ViewerProxyApplication.log
12:47:51,485 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ViewerProxyApplication.log]
12:47:51,487 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:47:52,337 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:47:52,346 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:47:52,346 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:47:52,346 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:47:52,347 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:47:52,347 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:47:52,347 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:47:52,348 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3c9d0b9d - Registering current configuration as safe fallback point
2021-02-25 12:47:52.355 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
2021-02-25 12:47:52.360 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
Java VM: 1.8.0_282
2021-02-25 12:47:52.361 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-25 12:47:52.363 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-25 12:47:52.364 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-25 12:47:52.364 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_ViewerProxyApplication.xml'
2021-02-25 12:47:52.601 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8350/8450
2021-02-25 12:47:52.602 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8350 communicating on port 8450 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8450/jndi/rmi://kb-test-acs-001.kb.dk:8350/jmxrmi
dk.netarkivet.viewerproxy.ViewerProxy Running
2021-02-25 12:47:52.605 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.viewerproxy.ViewerProxy Running
2021-02-25 12:47:52.628 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:52.629 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:47:52.630 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-25 12:47:52.641 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
2021-02-25 12:47:54.559 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2021-02-25 12:47:54.559 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@2766ca9d as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP
2021-02-25 12:47:54.584 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP']'
2021-02-25 12:47:54.585 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-25 12:47:54.585 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using default collectionID 'Test3'
2021-02-25 12:47:54.590 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2021-02-25 12:47:54.684 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found
2021-02-25 12:47:54.686 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found
2021-02-25 12:47:54.732 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'FULL_CRAWL_LOG' uses directory '/home/devel/Test3/cache/FULL_CRAWL_LOG'
2021-02-25 12:47:54.747 INFO d.n.viewerproxy.ARCArchiveAccess.<init> - Constructed instance of ARCArchiveAccess with TryToLookupUriAsFtp: false
2021-02-25 12:47:54.771 INFO dk.netarkivet.viewerproxy.WebProxy.<init> - Starting viewerproxy jetty on port 8076
--------------------------------------------
STARTING MACHINE: devel@kb-test-way-001.kb.dk
Starting all applications on: kb-test-way-001.kb.dk
Starting linux application: WaybackIndexerApplication
Starting linux application: AggregatorApplication
--------------------------------------------
--------------------------------------------
STARTING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
Starting all applications on: sb-test-har-001.statsbiblioteket.dk
Starting linux application: HarvestControllerApplication_sbhigh_h3
12:48:01,587 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/netarkdv/Test3/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] at [file:/home/netarkdv/Test3/conf/logback_HarvestControllerApplication_sbhigh_h3.xml]
12:48:01,712 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
12:48:01,714 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
12:48:01,719 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
12:48:01,726 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:48:01,756 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
12:48:01,758 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
12:48:01,771 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1907431275 - No compression will be used
12:48:01,771 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1907431275 - Will use the pattern ./log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
12:48:01,773 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6193932a - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
12:48:01,773 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6193932a - Roll-over at midnight.
12:48:01,777 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6193932a - Setting initial period to Thu Feb 25 12:48:01 CET 2021
12:48:01,777 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6193932a - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
12:48:01,777 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6193932a - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
12:48:01,779 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
12:48:01,781 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_sbhigh_h3.log
12:48:01,781 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_sbhigh_h3.log]
12:48:01,784 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
12:48:02,017 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
12:48:02,019 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
12:48:02,019 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
12:48:02,019 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
12:48:02,019 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
12:48:02,020 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
12:48:02,020 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
12:48:02,020 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@647fd8ce - Registering current configuration as safe fallback point
2021-02-25 12:48:02.024 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
2021-02-25 12:48:02.028 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/a114fff89a4046d8084f41be0a25f599dd785575)
Java VM: 1.8.0_232
2021-02-25 12:48:02.028 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_232
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
2021-02-25 12:48:02.028 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
Working dir: /home/netarkdv/Test3
2021-02-25 12:48:02.028 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/netarkdv/Test3
2021-02-25 12:48:02.029 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/netarkdv/Test3/conf/settings_HarvestControllerApplication_sbhigh_h3.xml'
2021-02-25 12:48:02.178 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'sb-test-har-001.statsbiblioteket.dk' and JMX/RMI ports 8150/8250
2021-02-25 12:48:02.178 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://sb-test-har-001.statsbiblioteket.dk:8250/jndi/rmi://sb-test-har-001.statsbiblioteket.dk:8150/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-25 12:48:02.182 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-25 12:48:02.187 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:48:02.187 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-25 12:48:02.188 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-25 12:48:02.201 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-25 12:48:02.201 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2021-02-25 12:48:02.202 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2021-02-25 12:48:02.203 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-25 12:48:02.321 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): sb-test-har-001.statsbiblioteket.dk
2021-02-25 12:48:03.304 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds.
2021-02-25 12:48:03.306 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@68044f4 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3
2021-02-25 12:48:03.324 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3']'
2021-02-25 12:48:03.326 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/netarkdv/Test3/conf/bitmag_client_config
2021-02-25 12:48:03.327 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using default collectionID 'Test3'
2021-02-25 12:48:03.334 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp'
2021-02-25 12:48:03.369 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2021-02-25 12:48:03.389 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2021-02-25 12:48:03.390 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2021-02-25 12:48:03.390 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_high'
2021-02-25 12:48:03.392 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@63b1d4fa as listener to Test3_COMMON_HCHAN_VAL_RESP
2021-02-25 12:48:03.427 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'HIGHPRIORITY'
2021-02-25 12:48:03.511 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'HIGHPRIORITY' is valid.
2021-02-25 12:48:03.513 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test3_COMMON_JOB_PARTIAL_HIGHPRIORITY']'
2021-02-25 12:48:03.514 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@63b1d4fa as listener to Test3_COMMON_JOB_PARTIAL_HIGHPRIORITY
--------------------------------------------
Completed the script all_test.sh
Finished: SUCCESS
Console Output
Help us localize this page