ssResponse(673acbe2) collectionID Test3, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS(Starting to calculate checksums.)
00:09:54.896 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 673acbe2: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-checksum-devel-01, Starting to calculate checksums.
00:09:55.103 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(673acbe2) collectionID Test3, from netarkiv-checksum-devel-01: OPERATION_COMPLETED, NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@4a070a3a[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
00:09:55.112 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01
00:09:55.112 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-kbh-disk-devel-01]
00:09:55.393 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(673acbe2) collectionID Test3, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(Completed checksum retrieval.), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@176802f8[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false
00:09:55.400 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01
00:09:55.400 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: []
Deleting file FileID: with checksum Checksum: in collection Test3 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-disk-devel-02 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01
00:09:56.714 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
00:09:56.839 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
00:09:57.321 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
00:09:57.358 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
00:09:58.245 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
00:09:58.260 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
00:09:58.260 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
00:09:58.536 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
00:09:58.537 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
00:09:59.578 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
00:09:59.699 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
00:09:59.700 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-26531]
00:09:59.713 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
00:09:59.713 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@446293d' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26531' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
00:09:59.713 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26531' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@446293d'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26531#71706941'.
00:09:59.713 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26531#71706941'.
00:09:59.727 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
java.lang.IllegalArgumentException: String hexString, 'Checksum:', must be an even number of characters.
at org.bitrepository.common.ArgumentValidator.checkTrue(ArgumentValidator.java:160)
at org.bitrepository.common.utils.Base16Utils.encodeBase16(Base16Utils.java:64)
at org.bitrepository.commandline.CommandLineClient.getChecksumDataForDeleteValidation(CommandLineClient.java:302)
at org.bitrepository.commandline.DeleteFileCmd.deleteTheFile(DeleteFileCmd.java:125)
at org.bitrepository.commandline.DeleteFileCmd.performOperation(DeleteFileCmd.java:107)
at org.bitrepository.commandline.CommandLineClient.runCommand(CommandLineClient.java:68)
at org.bitrepository.commandline.DeleteFileCmd.main(DeleteFileCmd.java:47)
xargs: ssh: exited with status 255; aborting
Now deleting actual files on Windows hosts for Test3
Nothing to delete in e:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in f:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in g:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in h:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in i:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in j:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Nothing to delete in e:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Nothing to delete in f:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Nothing to delete in g:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Nothing to delete in h:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Nothing to delete in i:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Nothing to delete in j:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
calling cleanup_hosts
running cleanup_hosts
Removing installation on sb-test-har-001.statsbiblioteket.dk
Removing installation on kb-test-har-003.kb.dk
Removing installation on kb-test-har-004.kb.dk
Removing installation on kb-test-har-005.kb.dk
Removing installation on kb-test-adm-001.kb.dk
Removing installation on kb-test-acs-001.kb.dk
Removing installation on kb-test-way-001.kb.dk
calling cleanup_linuxbarhosts
running cleanup_linuxbarhosts
Removing installation on sb-test-bar-001.statsbiblioteket.dk
Removing bitarchive on sb-test-bar-001.statsbiblioteket.dk
Calling cleanup_windowsbarhosts
running cleanup_windowsbarhosts
Removing C:\bitarkiv\Test3 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing E:\bitarchive_1\Test3 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing F:\bitarchive_2\Test3 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing g:\bitarchive_3\Test3 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing C:\bitarkiv\Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Removing E:\bitarchive_1\Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Removing F:\bitarchive_2\Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Removing g:\bitarchive_3\Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
TESTX=Test3
PORT=8076
MAILRECEIVERS=rbkr@kb.dk
VERSION=RBKR
DEPLOYCONF=deploy_config_bitmag.xml
H3ZIP=RBKR
BITMAGCONF=/home/devel/bitmag_test_config/client_config
Using bundler file /home/devel/nas_versions/bundler/NetarchiveSuite-heritrix3-bundler-RBKR.zip
Creating distribution files in /home/devel/prepared_software/Test3.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/prepared_software/Test3/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/prepared_software/Test3/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
Will read source files using encoding 'UTF-8' (defaulted)
Branch in settings not found: common.warcRecordService
Branch in settings not found: common.arcrepositoryClient.bitrepository
Branch in settings not found: common.hadoop
Branch in settings not found: common.useBitmagHadoopBackend
Branch in settings not found: common.fileResolver
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Machine 'kb-test-adm-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-har-003.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test3/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test3/h3server.jks
Machine 'kb-test-har-005.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test3/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test3/h3server.jks
Machine 'kb-test-har-004.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test3/NetarchiveSuite-heritrix3-bundler.zip
Machine 'kb-test-acs-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-way-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'sb-test-har-001.statsbiblioteket.dk' configured with encoding 'UTF-8' (defaulted)
/home/devel/prepared_software/Test3/NetarchiveSuite-heritrix3-bundler.zip -> /home/netarkdv/Test3/NetarchiveSuite-heritrix3-bundler.zip
00:10:40.414 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
00:10:40.419 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
00:10:40.420 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
00:10:40.420 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
00:10:40.420 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
00:10:40.420 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
00:10:40.421 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
00:10:40.421 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
00:10:40.421 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
00:10:40.421 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
00:10:40.422 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
00:10:40.422 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
00:10:40.492 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
00:10:40.492 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-adm-001.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-adm-001.kb.dk
deleting devel@kb-test-adm-001.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-adm-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-003.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-har-003.kb.dk
deleting devel@kb-test-har-003.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-har-003.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-005.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-har-005.kb.dk
deleting devel@kb-test-har-005.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-har-005.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-004.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-har-004.kb.dk
deleting devel@kb-test-har-004.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-har-004.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-acs-001.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-acs-001.kb.dk
deleting devel@kb-test-acs-001.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-acs-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-way-001.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-way-001.kb.dk
deleting devel@kb-test-way-001.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-way-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
--------------------------------------------
INSTALLING TO MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
copying NetarchiveSuite-RBKR.zip to:sb-test-har-001.statsbiblioteket.dk
deleting netarkdv@sb-test-har-001.statsbiblioteket.dk:/home/netarkdv/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:sb-test-har-001.statsbiblioteket.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
Copying secondary installation scripts out to the machines where they need to be executed
scp '/home/devel/devel-config/scripts/link_bitmag.sh' 'netarkdv@sb-test-bar-001.statsbiblioteket.dk:Test3'
Linking Bitmag kbh-pillar and NAS bitarkiv directories on KBH
ssh_exchange_identification: Connection closed by remote host
lost connection
Linking bitmag and netarkivet storage directories on SB
ssh 'netarkdv@sb-test-bar-001.statsbiblioteket.dk' 'Test3/link_bitmag.sh Test3'
bash: Test3/link_bitmag.sh: Not a directory
Linking Bitmag kbh-pillar and NAS bitarkiv directories on KBH
C:\Users\ba-devel>if not exist "e:\kbhpillar\collection-Test3" md e:\kbhpillar\collection-Test3
C:\Users\ba-devel>if not exist "e:\bitarkiv\Test3" md e:\bitarkiv\Test3
C:\Users\ba-devel>if exist "e:\bitarkiv\Test3\filedir" rd e:\bitarkiv\Test3\filedir
C:\Users\ba-devel>mklink /J e:\bitarkiv\Test3\filedir e:\kbhpillar\collection-Test3
Junction created for e:\bitarkiv\Test3\filedir <<===>> e:\kbhpillar\collection-Test3
C:\Users\ba-devel>if not exist "f:\kbhpillar\collection-Test3" md f:\kbhpillar\collection-Test3
C:\Users\ba-devel>if not exist "f:\bitarkiv\Test3" md f:\bitarkiv\Test3
C:\Users\ba-devel>if exist "f:\bitarkiv\Test3\filedir" rd f:\bitarkiv\Test3\filedir
C:\Users\ba-devel>mklink /J f:\bitarkiv\Test3\filedir f:\kbhpillar\collection-Test3
Junction created for f:\bitarkiv\Test3\filedir <<===>> f:\kbhpillar\collection-Test3
C:\Users\ba-devel>if not exist "g:\kbhpillar\collection-Test3" md g:\kbhpillar\collection-Test3
C:\Users\ba-devel>if not exist "g:\bitarkiv\Test3" md g:\bitarkiv\Test3
C:\Users\ba-devel>if exist "g:\bitarkiv\Test3\filedir" rd g:\bitarkiv\Test3\filedir
C:\Users\ba-devel>mklink /J g:\bitarkiv\Test3\filedir g:\kbhpillar\collection-Test3
Junction created for g:\bitarkiv\Test3\filedir <<===>> g:\kbhpillar\collection-Test3
C:\Users\ba-devel>if not exist "h:\kbhpillar\collection-Test3" md h:\kbhpillar\collection-Test3
C:\Users\ba-devel>if not exist "h:\bitarkiv\Test3" md h:\bitarkiv\Test3
C:\Users\ba-devel>if exist "h:\bitarkiv\Test3\filedir" rd h:\bitarkiv\Test3\filedir
C:\Users\ba-devel>mklink /J h:\bitarkiv\Test3\filedir h:\kbhpillar\collection-Test3
Junction created for h:\bitarkiv\Test3\filedir <<===>> h:\kbhpillar\collection-Test3
C:\Users\ba-devel>if not exist "i:\kbhpillar\collection-Test3" md i:\kbhpillar\collection-Test3
C:\Users\ba-devel>if not exist "i:\bitarkiv\Test3" md i:\bitarkiv\Test3
C:\Users\ba-devel>if exist "i:\bitarkiv\Test3\filedir" rd i:\bitarkiv\Test3\filedir
C:\Users\ba-devel>mklink /J i:\bitarkiv\Test3\filedir i:\kbhpillar\collection-Test3
Junction created for i:\bitarkiv\Test3\filedir <<===>> i:\kbhpillar\collection-Test3
C:\Users\ba-devel>if not exist "j:\kbhpillar\collection-Test3" md j:\kbhpillar\collection-Test3
C:\Users\ba-devel>if not exist "j:\bitarkiv\Test3" md j:\bitarkiv\Test3
C:\Users\ba-devel>if exist "j:\bitarkiv\Test3\filedir" rd j:\bitarkiv\Test3\filedir
C:\Users\ba-devel>mklink /J j:\bitarkiv\Test3\filedir j:\kbhpillar\collection-Test3
Junction created for j:\bitarkiv\Test3\filedir <<===>> j:\kbhpillar\collection-Test3
ssh_exchange_identification: Connection closed by remote host
Initializing database for system Test3
+ host=devel@kb-test-adm-001
+ scp -p /home/devel/devel-config/scripts/db/setup_admindb.sh /home/devel/devel-config/scripts/db/setup_harvestdb.sh /home/devel/devel-config/scripts/db/teardown_admindb.sh /home/devel/devel-config/scripts/db/teardown_harvestdb.sh /home/devel/devel-config/scripts/../resources/harvestdb.testdata.sql /home/devel/devel-config/scripts/../resources/default_orderxml.cxml devel@kb-test-adm-001:bin/
+ ssh devel@kb-test-adm-001
Pseudo-terminal will not be allocated because stdin is not a terminal.
Destroying test3_admindb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
DROP DATABASE
Creating empty test3_admindb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
CREATE DATABASE
Initialising test3_admindb
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "replica_pkey" for table "replica"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "replica_replica_id_key" for table "replica"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "replica_replica_name_key" for table "replica"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "replicafileinfo_pkey" for table "replicafileinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "file_pkey" for table "file"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "segment_pkey" for table "segment"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
Destroying test3_harvestdb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
DROP DATABASE
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
CREATE DATABASE
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "domains_pkey" for table "domains"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "domains_name_key" for table "domains"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "configurations_pkey" for table "configurations"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "config_passwords_pkey" for table "config_passwords"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "config_seedlists_pkey" for table "config_seedlists"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "seedlists_pkey" for table "seedlists"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "passwords_pkey" for table "passwords"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "ownerinfo_pkey" for table "ownerinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "historyinfo_pkey" for table "historyinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvestdefinitions_pkey" for table "harvestdefinitions"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "harvestdefinitions_name_key" for table "harvestdefinitions"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "fullharvests_pkey" for table "fullharvests"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "partialharvests_pkey" for table "partialharvests"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvest_configs_pkey" for table "harvest_configs"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "schedules_pkey" for table "schedules"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "schedules_name_key" for table "schedules"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "ordertemplates_pkey" for table "ordertemplates"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "ordertemplates_name_key" for table "ordertemplates"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "jobs_pkey" for table "jobs"
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "job_configs_pkey" for table "job_configs"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "global_crawler_trap_lists_pkey" for table "global_crawler_trap_lists"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "global_crawler_trap_lists_name_key" for table "global_crawler_trap_lists"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "global_crawler_trap_expressions_pkey" for table "global_crawler_trap_expressions"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "pkrunningjobshistory" for table "runningjobshistory"
CREATE TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "pkrunningjobsmonitor" for table "runningjobsmonitor"
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / UNIQUE will create implicit index "pkfrontierreportlines" for table "frontierreportmonitor"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfieldtype_pkey" for table "extendedfieldtype"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfield_pkey" for table "extendedfield"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfieldvalue_pkey" for table "extendedfieldvalue"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
INSERT 0 1
INSERT 0 1
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvestchannel_pkey" for table "harvestchannel"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "harvestchannel_name_key" for table "harvestchannel"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE TABLE
NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index "eav_type_attribute_pkey" for table "eav_type_attribute"
ALTER TABLE
CREATE INDEX
CREATE SEQUENCE
CREATE TABLE
NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index "eav_attribute_pkey" for table "eav_attribute"
ALTER TABLE
CREATE INDEX
GRANT
GRANT
GRANT
INSERT 0 1
INSERT 0 1
INSERT 0 1
SET
SET
SET
SET
SET
SET
SET
SET
SET
setval
--------
17
(1 row)
setval
--------
17
(1 row)
setval
--------
17
(1 row)
setval
--------
5
(1 row)
setval
--------
4
(1 row)
setval
--------
17
(1 row)
00:12:14.432 [main] INFO com.mchange.v2.log.MLog - MLog clients using log4j logging.
00:12:14.657 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.2.1 [built 20-March-2013 10:47:27 +0000; debug? true; trace: 10]
00:12:14.726 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52af1214dk0zi1edu|afc191,name=10bdx52af1214dk0zi1edu|afc191 registered.
00:12:14.763 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52af1214dk0zi1edu|afc191,name=10bdx52af1214dk0zi1edu|afc191 unregistered, in order to be reregistered after update.
00:12:14.763 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52af1214dk0zi1edu|afc191,name=10bdx52af1214dk0zi1edu|afc191 registered.
00:12:14.776 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
00:12:14.842 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, dataSourceName -> 10bdx52af1214dk0zi1edu|afc191, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 10bdx52af1214dk0zi1edu|afc191, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost:5432/test3_harvestdb, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 3600, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, preferredTestQuery -> null, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ]
00:12:14.868 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 1
00:12:14.868 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [1], attempts_remaining: 30
00:12:14.868 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@5b461a
00:12:14.869 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 2
00:12:14.869 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [2], attempts_remaining: 30
00:12:14.869 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@c1c010
00:12:14.869 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 3
00:12:14.869 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [3], attempts_remaining: 30
00:12:14.869 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@17f23d9
00:12:14.869 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 4
00:12:14.869 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [4], attempts_remaining: 30
00:12:14.870 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@1d47554
00:12:14.870 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 5
00:12:14.870 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [5], attempts_remaining: 30
00:12:14.870 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@1b794e2
00:12:14.871 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@1200884 config: [start -> 3; min -> 5; max -> 20; inc -> 5; num_acq_attempts -> 30; acq_attempt_delay -> 1000; check_idle_resources_delay -> 0; mox_resource_age -> 3600000; max_idle_time -> 0; excess_max_idle_time -> 0; destroy_unreturned_resc_time -> 0; expiration_enforcement_delay -> 900000; break_on_acquisition_failure -> false; debug_store_checkout_exceptions -> false]
00:12:14.871 [main] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPoolManager - Created new pool for auth, username (masked): 'de******'.
00:12:14.871 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - acquire test -- pool size: 0; target_pool_size: 5; desired target? 1
00:12:14.871 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - awaitAvailable(): [unknown]
00:12:14.871 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 0, unused: 0, excluded: 0]
00:12:15.071 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#2] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@564504.acquireResource() returning.
00:12:15.072 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 1, unused: 1, excluded: 0]
00:12:15.072 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 4
00:12:15.073 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [4], attempts_remaining: 30
00:12:15.073 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 1, unused: 0, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@4cf8a9)
00:12:15.073 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#1] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@564504.acquireResource() returning.
00:12:15.074 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 2, unused: 1, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@4cf8a9)
00:12:15.074 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 3
00:12:15.074 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [3], attempts_remaining: 30
00:12:15.077 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#0] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@564504.acquireResource() returning.
00:12:15.077 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 3, unused: 2, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@4cf8a9)
00:12:15.077 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 2
00:12:15.077 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [2], attempts_remaining: 30
00:12:15.096 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#2] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@564504.acquireResource() returning.
00:12:15.097 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 4, unused: 3, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@4cf8a9)
00:12:15.097 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 1
00:12:15.097 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [1], attempts_remaining: 30
00:12:15.097 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#1] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@564504.acquireResource() returning.
00:12:15.097 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@4cf8a9)
00:12:15.097 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 0
00:12:15.097 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1214dk0zi1edu|afc191]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [0], attempts_remaining: 30
00:12:15.134 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@1bc39f8 closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@a434c8
00:12:15.135 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@8bf312
00:12:15.136 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@4cf8a9)
00:12:15.142 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@4cf8a9)
00:12:15.145 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@1083305 closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@e677af
00:12:15.145 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@e0379d
00:12:15.146 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@4cf8a9)
00:12:15.192 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@4cf8a9)
00:12:15.194 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@1b485ba closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@11c7bf6
00:12:15.212 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@1f2a664: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@14b199c
00:12:15.214 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@1200884 [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@4cf8a9)
00:12:15.214 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyConnection - com.mchange.v2.c3p0.impl.NewProxyConnection@d3d15a: close() called more than once.
The template 'default_orderxml' has now been updated.
+ set +x
--------------------------------------------
STARTING MACHINE: devel@kb-test-adm-001.kb.dk
Starting all applications on: kb-test-adm-001.kb.dk
Starting linux application: GUIApplication
Starting linux application: ArcRepositoryApplication
Starting linux application: HarvestJobManagerApplication
00:12:16,403 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_ArcRepositoryApplication.xml] at [file:/home/devel/Test3/conf/logback_ArcRepositoryApplication.xml]
00:12:16,927 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:16,930 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:16,954 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:16,997 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:17,129 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:17,142 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:17,272 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@8086380 - No compression will be used
00:12:17,275 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@8086380 - Will use the pattern ./log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log for the active file
00:12:17,286 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1dd4eda - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log'.
00:12:17,286 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1dd4eda - Roll-over at midnight.
00:12:17,311 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1dd4eda - Setting initial period to Wed Feb 10 00:12:17 CET 2021
00:12:17,312 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1dd4eda - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:17,312 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1dd4eda - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:17,317 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:17,330 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ArcRepositoryApplication.log
00:12:17,330 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ArcRepositoryApplication.log]
00:12:17,336 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:18,138 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:18,150 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:18,151 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:18,153 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:18,153 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:18,153 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:18,153 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:18,155 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@611244 - Registering current configuration as safe fallback point
2021-02-10 00:12:18.172 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
2021-02-10 00:12:18.194 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
Java VM: 1.8.0_20
2021-02-10 00:12:18.202 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_20
java.home: /usr/java/jdk1.8.0_20/jre
2021-02-10 00:12:18.202 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/java/jdk1.8.0_20/jre
Working dir: /home/devel/Test3
2021-02-10 00:12:18.202 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-10 00:12:18.202 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_ArcRepositoryApplication.xml'
2021-02-10 00:12:18.402 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8151/8251
2021-02-10 00:12:18.404 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8151 communicating on port 8251 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8251/jndi/rmi://kb-test-adm-001.kb.dk:8151/jmxrmi
dk.netarkivet.archive.arcrepository.ArcRepository Running
2021-02-10 00:12:18.416 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.archive.arcrepository.ArcRepository Running
2021-02-10 00:12:18.430 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:18.450 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:18.451 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:19.302 INFO d.n.a.a.ArchiveDBConnection.initDataSource - Using jdbc url: jdbc:postgresql://localhost:5432/test3_admindb
2021-02-10 00:12:19.319 INFO d.n.a.a.ArchiveDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=10
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=30
- idleConnTestQuery='SELECT COUNT(*) FROM replica'
- idleConnTestOnCheckin=false
2021-02-10 00:12:19.853 DEBUG d.n.a.a.ReplicaCacheDatabase.initialiseDB - IDs for replicas already in the database:
2021-02-10 00:12:19.874 INFO d.n.a.a.ReplicaCacheDatabase.initialiseDB - Inserting replica 'BITARCHIVEReplica (SB) SBN' in database.
2021-02-10 00:12:19.875 DEBUG d.n.a.a.ReplicaCacheHelpers.insertReplicaIntoDB - Executing insert, conditional on SB not already existing in the database.
2021-02-10 00:12:19.884 DEBUG d.n.a.a.ReplicaCacheHelpers.insertReplicaIntoDB - Insert statement for SB returned 1
2021-02-10 00:12:19.891 INFO d.n.a.a.ReplicaCacheDatabase.initialiseDB - Inserting replica 'BITARCHIVEReplica (KB) KBN' in database.
2021-02-10 00:12:19.897 DEBUG d.n.a.a.ReplicaCacheHelpers.insertReplicaIntoDB - Executing insert, conditional on KB not already existing in the database.
2021-02-10 00:12:19.903 DEBUG d.n.a.a.ReplicaCacheHelpers.insertReplicaIntoDB - Insert statement for KB returned 1
2021-02-10 00:12:19.906 INFO d.n.a.a.ReplicaCacheDatabase.<init> - Initialization of database successful
2021-02-10 00:12:19.920 INFO d.n.a.a.d.NonFunctionalArcRepositoryServer.<init> - Listening for arc repository messages on channel '[Queue 'Test3_COMMON_THE_REPOS']'
2021-02-10 00:12:19.929 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.NonFunctionalArcRepositoryServer@17a5baa as listener to Test3_COMMON_THE_REPOS
2021-02-10 00:12:19.955 INFO d.n.a.arcrepository.ArcRepository.<init> - Starting the ArcRepository
00:12:16,694 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_GUIApplication.xml] at [file:/home/devel/Test3/conf/logback_GUIApplication.xml]
00:12:17,386 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:17,387 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:17,421 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:17,479 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:17,674 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:17,702 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:17,775 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@12779761 - No compression will be used
00:12:17,781 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@12779761 - Will use the pattern ./log/GUIApplication.%d{yyyy-MM-dd}.%i.log for the active file
00:12:17,788 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@2cd91f - The date pattern is 'yyyy-MM-dd' from file name pattern './log/GUIApplication.%d{yyyy-MM-dd}.%i.log'.
00:12:17,788 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@2cd91f - Roll-over at midnight.
00:12:17,803 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@2cd91f - Setting initial period to Wed Feb 10 00:12:17 CET 2021
00:12:17,803 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@2cd91f - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:17,803 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@2cd91f - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:17,809 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:17,822 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/GUIApplication.log
00:12:17,822 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/GUIApplication.log]
00:12:17,824 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:19,024 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:19,025 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:19,025 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:19,026 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:19,047 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:19,047 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:19,047 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:19,048 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3f1134 - Registering current configuration as safe fallback point
2021-02-10 00:12:19.084 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
2021-02-10 00:12:19.113 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
Java VM: 1.8.0_20
2021-02-10 00:12:19.114 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_20
java.home: /usr/java/jdk1.8.0_20/jre
2021-02-10 00:12:19.118 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/java/jdk1.8.0_20/jre
Working dir: /home/devel/Test3
2021-02-10 00:12:19.119 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-10 00:12:19.120 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_GUIApplication.xml'
2021-02-10 00:12:19.493 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8150/8250
2021-02-10 00:12:19.494 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8250/jndi/rmi://kb-test-adm-001.kb.dk:8150/jmxrmi
dk.netarkivet.common.webinterface.GUIWebServer Running
2021-02-10 00:12:19.495 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.common.webinterface.GUIWebServer Running
2021-02-10 00:12:19.495 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war
2021-02-10 00:12:19.496 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection
2021-02-10 00:12:19.496 INFO d.n.common.webinterface.GUIWebServer.<init> - Starting webserver. Port: 8076 deployment directories: 'webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war' classes: 'dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection'
2021-02-10 00:12:19.514 DEBUG d.n.common.webinterface.GUIWebServer.<init> - GUI using tempdir /home/devel/Test3/tmpdircommon
2021-02-10 00:12:19.515 DEBUG d.n.common.webinterface.GUIWebServer.<init> - GUI using basedir /home/devel/Test3
2021-02-10 00:12:19.516 INFO d.n.common.webinterface.GUIWebServer.<init> - Deleted existing tempdir '/home/devel/Test3/tmpdircommon'
2021-02-10 00:12:19.543 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:19.544 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:19.544 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:19.828 INFO d.n.common.webinterface.GUIWebServer.<init> - Scanning for taglibs is disabled as tomcat.util.scan.StandardJarScanFilter.jarsToSkip is unset.
2021-02-10 00:12:19.845 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection
2021-02-10 00:12:19.847 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading 5 site section(s).
2021-02-10 00:12:19.847 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.harvester.webinterface.DefinitionsSiteSection.
2021-02-10 00:12:19.857 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.harvester.webinterface.HistorySiteSection.
2021-02-10 00:12:19.866 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection.
2021-02-10 00:12:19.871 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.viewerproxy.webinterface.QASiteSection.
2021-02-10 00:12:19.872 DEBUG d.n.common.webinterface.SiteSection.getSections - Loading site section dk.netarkivet.monitor.webinterface.StatusSiteSection.
2021-02-10 00:12:20.295 INFO d.n.h.datamodel.HarvestDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
2021-02-10 00:12:20.758 INFO d.n.h.h.monitor.HarvestMonitor.<init> - Initializing HarvestMonitor with refreshInterval=60 seconds
2021-02-10 00:12:20.792 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.harvesting.monitor.HarvestMonitor@127a732 as listener to Test3_COMMON_HARVESTMON
2021-02-10 00:12:20.808 INFO d.n.h.h.monitor.HarvestMonitor.<init> - Started listening to queue [Queue 'Test3_COMMON_HARVESTMON']
2021-02-10 00:12:20.809 INFO d.n.common.webinterface.GUIWebServer.<init> - Deploying webapp with context /HarvestDefinition at docbase /home/devel/Test3/webpages/HarvestDefinition.war.
Feb 10, 2021 12:12:20 AM org.apache.catalina.core.StandardContext setPath
WARNING: A context path must either be an empty string or start with a '/' and do not end with a '/'. The path [/] does not meet these criteria and has been changed to []
2021-02-10 00:12:20.925 INFO d.n.common.webinterface.GUIWebServer.<init> - Deploying webapp with context /History at docbase /home/devel/Test3/webpages/History.war.
00:12:16,905 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestJobManagerApplication.xml] at [file:/home/devel/Test3/conf/logback_HarvestJobManagerApplication.xml]
00:12:17,561 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:17,567 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:17,605 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:17,646 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:17,801 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:17,822 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:17,900 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@17315878 - No compression will be used
00:12:17,906 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@17315878 - Will use the pattern ./log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log for the active file
00:12:17,912 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5fece7 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log'.
00:12:17,912 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5fece7 - Roll-over at midnight.
00:12:17,938 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5fece7 - Setting initial period to Wed Feb 10 00:12:17 CET 2021
00:12:17,938 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5fece7 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:17,938 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5fece7 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:17,941 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:17,953 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestJobManagerApplication.log
00:12:17,953 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestJobManagerApplication.log]
00:12:17,956 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:19,311 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:19,313 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:19,314 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:19,316 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:19,316 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:19,317 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:19,317 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:19,321 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@c300f1 - Registering current configuration as safe fallback point
2021-02-10 00:12:19.357 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
2021-02-10 00:12:19.419 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:19.421 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:19.425 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:20.625 INFO d.n.h.datamodel.HarvestDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-003.kb.dk
Starting all applications on: kb-test-har-003.kb.dk
Starting linux application: HarvestControllerApplication_kblow001_h3
00:12:21,739 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kblow001_h3.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kblow001_h3.xml]
00:12:22,052 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:22,068 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:22,075 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:22,094 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:22,194 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:22,197 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:22,241 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2025221430 - No compression will be used
00:12:22,242 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2025221430 - Will use the pattern ./log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log for the active file
00:12:22,245 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log'.
00:12:22,245 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - Roll-over at midnight.
00:12:22,249 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - Setting initial period to Wed Feb 10 00:12:22 CET 2021
00:12:22,250 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:22,250 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:22,251 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:22,253 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow001_h3.log
00:12:22,253 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow001_h3.log]
00:12:22,254 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:22,847 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:22,849 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:22,849 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:22,861 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:22,861 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:22,866 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:22,866 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:22,866 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@bef2d72 - Registering current configuration as safe fallback point
2021-02-10 00:12:22.871 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
2021-02-10 00:12:22.888 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
Java VM: 1.8.0_282
2021-02-10 00:12:22.888 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-10 00:12:22.889 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-10 00:12:22.889 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-10 00:12:22.889 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kblow001_h3.xml'
2021-02-10 00:12:23.025 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-003.kb.dk' and JMX/RMI ports 8150/8250
2021-02-10 00:12:23.025 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-003.kb.dk:8250/jndi/rmi://kb-test-har-003.kb.dk:8150/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-10 00:12:23.030 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-10 00:12:23.052 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:23.052 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:23.053 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:23.066 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-10 00:12:23.066 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2021-02-10 00:12:23.066 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2021-02-10 00:12:23.067 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-10 00:12:23.239 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-10 00:12:23.239 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@49ec71f8 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3
2021-02-10 00:12:23.279 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3']'
2021-02-10 00:12:23.279 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:23.280 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-10 00:12:23.284 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-10 00:12:23.664 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-10 00:12:23.664 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:23.665 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-10 00:12:23.665 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-10 00:12:23.670 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-003.kb.dk
2021-02-10 00:12:23.671 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-har-003.kb.dk-aae80f54-57c6-4720-a3b7-ab1a808f2501
2021-02-10 00:12:24.415 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
2021-02-10 00:12:25.128 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Getting bitrepository message bus
2021-02-10 00:12:25.910 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository clients
2021-02-10 00:12:25.951 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2021-02-10 00:12:25.954 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2021-02-10 00:12:25.954 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_low'
2021-02-10 00:12:25.955 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7813cb11 as listener to Test3_COMMON_HCHAN_VAL_RESP
2021-02-10 00:12:25.983 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'LOWPRIORITY'
2021-02-10 00:12:26.071 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'LOWPRIORITY' is valid.
2021-02-10 00:12:26.075 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test3_COMMON_JOB_SNAPSHOT_LOWPRIORITY']'
2021-02-10 00:12:26.076 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7813cb11 as listener to Test3_COMMON_JOB_SNAPSHOT_LOWPRIORITY
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-005.kb.dk
Starting all applications on: kb-test-har-005.kb.dk
Starting linux application: HarvestControllerApplication_kbumbra_1
Starting linux application: HarvestControllerApplication_kbumbra_2
00:12:27,211 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kbumbra_1.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kbumbra_1.xml]
00:12:27,785 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:27,788 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:27,794 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:27,858 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:28,065 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:28,069 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:28,114 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2025221430 - No compression will be used
00:12:28,115 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2025221430 - Will use the pattern ./log/HarvestControllerApplication_kbumbra_1.%d{yyyy-MM-dd}.%i.log for the active file
00:12:28,117 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbumbra_1.%d{yyyy-MM-dd}.%i.log'.
00:12:28,117 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - Roll-over at midnight.
00:12:28,120 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - Setting initial period to Wed Feb 10 00:12:28 CET 2021
00:12:28,121 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:28,121 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:28,205 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:28,207 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbumbra_1.log
00:12:28,207 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbumbra_1.log]
00:12:28,208 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:29,466 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:29,468 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:29,468 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:29,468 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:29,468 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:29,469 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:29,469 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:29,469 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@bef2d72 - Registering current configuration as safe fallback point
2021-02-10 00:12:29.512 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
2021-02-10 00:12:29.518 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
Java VM: 1.8.0_282
2021-02-10 00:12:29.519 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-10 00:12:29.519 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-10 00:12:29.519 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-10 00:12:29.519 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kbumbra_1.xml'
2021-02-10 00:12:29.981 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8150/8250
2021-02-10 00:12:29.982 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8250/jndi/rmi://kb-test-har-005.kb.dk:8150/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-10 00:12:29.986 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-10 00:12:29.998 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:29.998 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:29.998 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:30.018 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-10 00:12:30.019 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'UMBRA'
2021-02-10 00:12:30.019 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_umbra_1'
2021-02-10 00:12:30.019 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-10 00:12:30.441 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-10 00:12:30.442 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@49ec71f8 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_KBUMBRA_1
2021-02-10 00:12:30.460 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_KBUMBRA_1']'
2021-02-10 00:12:30.460 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:30.460 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-10 00:12:30.464 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-10 00:12:31.227 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-10 00:12:31.227 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:31.227 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-10 00:12:31.228 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-10 00:12:31.287 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk
2021-02-10 00:12:31.288 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-har-005.kb.dk-3fc578da-66bc-4239-9c83-887395e1da83
00:12:27,623 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kbumbra_2.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kbumbra_2.xml]
00:12:28,158 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:28,194 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:28,199 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:28,255 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:28,394 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:28,401 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:28,454 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2025221430 - No compression will be used
00:12:28,455 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2025221430 - Will use the pattern ./log/HarvestControllerApplication_kbumbra_2.%d{yyyy-MM-dd}.%i.log for the active file
00:12:28,457 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbumbra_2.%d{yyyy-MM-dd}.%i.log'.
00:12:28,457 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - Roll-over at midnight.
00:12:28,492 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - Setting initial period to Wed Feb 10 00:12:28 CET 2021
00:12:28,493 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:28,493 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5223e5ee - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:28,494 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:28,497 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbumbra_2.log
00:12:28,497 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbumbra_2.log]
00:12:28,497 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:29,791 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:29,793 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:29,793 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:29,794 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:29,794 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:29,794 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:29,794 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:29,795 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@bef2d72 - Registering current configuration as safe fallback point
2021-02-10 00:12:29.817 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
2021-02-10 00:12:29.835 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
Java VM: 1.8.0_282
2021-02-10 00:12:29.836 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-10 00:12:29.836 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-10 00:12:29.836 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-10 00:12:29.871 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kbumbra_2.xml'
2021-02-10 00:12:30.233 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8155/8255
2021-02-10 00:12:30.234 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8155 communicating on port 8255 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8255/jndi/rmi://kb-test-har-005.kb.dk:8155/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-10 00:12:30.238 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-10 00:12:30.250 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:30.250 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:30.251 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:30.265 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-10 00:12:30.265 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'UMBRA'
2021-02-10 00:12:30.265 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_umbra_2'
2021-02-10 00:12:30.266 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-10 00:12:30.569 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-10 00:12:30.569 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@49ec71f8 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_KBUMBRA_2
2021-02-10 00:12:30.619 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_KBUMBRA_2']'
2021-02-10 00:12:30.620 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:30.620 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-10 00:12:30.624 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-10 00:12:31.379 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-10 00:12:31.379 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:31.380 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-10 00:12:31.380 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-10 00:12:31.383 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk
2021-02-10 00:12:31.384 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-har-005.kb.dk-5908c9f8-7de9-42bf-a118-0c6b41d13a51
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-004.kb.dk
Starting all applications on: kb-test-har-004.kb.dk
Starting linux application: HarvestControllerApplication_kblow002_h3
Starting linux application: HarvestControllerApplication_kbhigh_h3
00:12:32,470 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kbhigh_h3.xml]
00:12:32,788 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:32,802 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:32,809 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:32,828 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:32,874 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:32,878 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:32,908 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@349420578 - No compression will be used
00:12:32,909 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@349420578 - Will use the pattern ./log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
00:12:32,911 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
00:12:32,911 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - Roll-over at midnight.
00:12:32,917 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - Setting initial period to Wed Feb 10 00:12:32 CET 2021
00:12:32,917 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:32,917 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:32,918 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:32,923 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbhigh_h3.log
00:12:32,923 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbhigh_h3.log]
00:12:32,924 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:33,381 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:33,385 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:33,385 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:33,386 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:33,386 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:33,387 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:33,387 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:33,387 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4c1d9d4b - Registering current configuration as safe fallback point
2021-02-10 00:12:33.392 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
2021-02-10 00:12:33.397 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
Java VM: 1.8.0_25
2021-02-10 00:12:33.398 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2021-02-10 00:12:33.398 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test3
2021-02-10 00:12:33.398 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-10 00:12:33.398 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kbhigh_h3.xml'
2021-02-10 00:12:33.527 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8152/8252
2021-02-10 00:12:33.528 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8152 communicating on port 8252 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8252/jndi/rmi://kb-test-har-004.kb.dk:8152/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-10 00:12:33.535 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-10 00:12:33.555 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:33.555 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:33.557 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-10 00:12:33.557 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2021-02-10 00:12:33.557 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2021-02-10 00:12:33.557 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-10 00:12:33.562 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:33.758 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-10 00:12:33.758 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@35ef1869 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_11_HCS_KBHIGH_H3
2021-02-10 00:12:33.778 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_11_HCS_KBHIGH_H3']'
2021-02-10 00:12:33.779 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:33.779 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-10 00:12:33.789 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-10 00:12:34.127 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-10 00:12:34.127 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:34.128 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-10 00:12:34.135 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-10 00:12:34.139 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
2021-02-10 00:12:34.145 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-har-004.kb.dk-6cdee5fd-e2c1-4f28-825f-d1e747abbfac
2021-02-10 00:12:34.942 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
00:12:32,596 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kblow002_h3.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kblow002_h3.xml]
00:12:32,909 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:32,918 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:32,933 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:32,952 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:33,006 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:33,010 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:33,048 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@349420578 - No compression will be used
00:12:33,049 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@349420578 - Will use the pattern ./log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log for the active file
00:12:33,052 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log'.
00:12:33,052 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - Roll-over at midnight.
00:12:33,058 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - Setting initial period to Wed Feb 10 00:12:33 CET 2021
00:12:33,058 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:33,058 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@12d4bf7e - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:33,060 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:33,067 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow002_h3.log
00:12:33,067 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow002_h3.log]
00:12:33,068 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:33,645 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:33,646 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:33,646 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:33,647 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:33,647 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:33,647 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:33,647 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:33,648 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4c1d9d4b - Registering current configuration as safe fallback point
2021-02-10 00:12:33.658 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
2021-02-10 00:12:33.670 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
Java VM: 1.8.0_25
2021-02-10 00:12:33.670 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2021-02-10 00:12:33.671 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test3
2021-02-10 00:12:33.671 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-10 00:12:33.671 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kblow002_h3.xml'
2021-02-10 00:12:33.810 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8150/8250
2021-02-10 00:12:33.810 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8250/jndi/rmi://kb-test-har-004.kb.dk:8150/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-10 00:12:33.814 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-10 00:12:33.831 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:33.831 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:33.832 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:33.852 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-10 00:12:33.852 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2021-02-10 00:12:33.852 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2021-02-10 00:12:33.853 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-10 00:12:33.998 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-10 00:12:33.999 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@35ef1869 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_11_HCS_KBLOW002_H3
2021-02-10 00:12:34.019 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_11_HCS_KBLOW002_H3']'
2021-02-10 00:12:34.019 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:34.020 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-10 00:12:34.029 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-10 00:12:34.361 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-10 00:12:34.362 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:34.369 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-10 00:12:34.369 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-10 00:12:34.375 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
2021-02-10 00:12:34.382 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-har-004.kb.dk-0045a259-109b-4952-9148-a193c352db2e
2021-02-10 00:12:35.182 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
--------------------------------------------
STARTING MACHINE: devel@kb-test-acs-001.kb.dk
Starting all applications on: kb-test-acs-001.kb.dk
Starting linux application: IndexServerApplication
Starting linux application: ViewerProxyApplication
00:12:38,700 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_IndexServerApplication.xml] at [file:/home/devel/Test3/conf/logback_IndexServerApplication.xml]
00:12:39,124 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:39,125 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:39,131 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:39,157 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:39,285 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:39,291 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:39,340 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@597190999 - No compression will be used
00:12:39,342 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@597190999 - Will use the pattern ./log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log for the active file
00:12:39,347 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - The date pattern is 'yyyy-MM-dd' from file name pattern './log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log'.
00:12:39,347 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - Roll-over at midnight.
00:12:39,358 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - Setting initial period to Wed Feb 10 00:12:39 CET 2021
00:12:39,359 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:39,359 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:39,364 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:39,369 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/IndexServerApplication.log
00:12:39,369 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/IndexServerApplication.log]
00:12:39,370 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:40,339 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:40,341 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:40,341 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:40,342 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:40,342 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:40,342 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:40,342 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:40,355 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@1e730495 - Registering current configuration as safe fallback point
2021-02-10 00:12:40.360 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
2021-02-10 00:12:40.368 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
Java VM: 1.8.0_282
2021-02-10 00:12:40.369 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-10 00:12:40.369 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-10 00:12:40.370 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-10 00:12:40.371 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_IndexServerApplication.xml'
2021-02-10 00:12:40.630 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8351/8451
2021-02-10 00:12:40.631 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8351 communicating on port 8451 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8451/jndi/rmi://kb-test-acs-001.kb.dk:8351/jmxrmi
dk.netarkivet.harvester.indexserver.IndexServer Running
2021-02-10 00:12:40.644 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.indexserver.IndexServer Running
2021-02-10 00:12:40.654 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:40.659 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:40.660 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:40.663 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test3/cache/cdxdata'
2021-02-10 00:12:40.686 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-10 00:12:40.893 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@6ca8564a as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS
2021-02-10 00:12:40.918 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS']'
2021-02-10 00:12:40.919 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:40.920 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-10 00:12:40.933 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-10 00:12:41.300 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-10 00:12:41.300 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:41.301 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-10 00:12:41.301 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-10 00:12:41.305 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
2021-02-10 00:12:41.306 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-acs-001.kb.dk-f64a895d-6b80-4d70-8bfb-4d57b5a32381
2021-02-10 00:12:42.018 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
00:12:38,702 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_ViewerProxyApplication.xml] at [file:/home/devel/Test3/conf/logback_ViewerProxyApplication.xml]
00:12:39,127 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:39,128 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:39,134 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:39,156 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:39,284 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:39,287 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:39,338 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@597190999 - No compression will be used
00:12:39,340 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@597190999 - Will use the pattern ./log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log for the active file
00:12:39,346 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log'.
00:12:39,346 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - Roll-over at midnight.
00:12:39,358 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - Setting initial period to Wed Feb 10 00:12:39 CET 2021
00:12:39,359 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:39,359 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@23f7d05d - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:39,362 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:39,368 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ViewerProxyApplication.log
00:12:39,368 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ViewerProxyApplication.log]
00:12:39,370 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:40,309 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:40,311 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:40,334 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:40,334 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:40,334 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:40,335 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:40,335 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:40,336 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@1e730495 - Registering current configuration as safe fallback point
2021-02-10 00:12:40.348 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
2021-02-10 00:12:40.365 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
Java VM: 1.8.0_282
2021-02-10 00:12:40.366 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-10 00:12:40.367 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-10 00:12:40.367 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-10 00:12:40.367 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_ViewerProxyApplication.xml'
2021-02-10 00:12:40.626 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8350/8450
2021-02-10 00:12:40.627 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8350 communicating on port 8450 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8450/jndi/rmi://kb-test-acs-001.kb.dk:8350/jmxrmi
dk.netarkivet.viewerproxy.ViewerProxy Running
2021-02-10 00:12:40.630 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.viewerproxy.ViewerProxy Running
2021-02-10 00:12:40.635 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:40.635 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:40.640 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-10 00:12:40.651 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:40.838 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@6a400542 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP
2021-02-10 00:12:40.857 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP']'
2021-02-10 00:12:40.857 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:40.858 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-10 00:12:40.863 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-10 00:12:41.218 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-10 00:12:41.219 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-10 00:12:41.219 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-10 00:12:41.219 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-10 00:12:41.223 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
2021-02-10 00:12:41.224 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-acs-001.kb.dk-6e2500f9-b199-47dc-aa33-8c69423ef165
2021-02-10 00:12:41.996 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
--------------------------------------------
STARTING MACHINE: devel@kb-test-way-001.kb.dk
Starting all applications on: kb-test-way-001.kb.dk
Starting linux application: WaybackIndexerApplication
Starting linux application: AggregatorApplication
00:12:44,325 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_AggregatorApplication.xml] at [file:/home/devel/Test3/conf/logback_AggregatorApplication.xml]
00:12:45,083 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:45,088 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:45,123 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:45,199 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:45,355 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:45,367 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:45,479 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@898406901 - No compression will be used
00:12:45,480 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@898406901 - Will use the pattern ./log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log for the active file
00:12:45,487 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3ee0fea4 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log'.
00:12:45,487 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3ee0fea4 - Roll-over at midnight.
00:12:45,512 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3ee0fea4 - Setting initial period to Wed Feb 10 00:12:45 CET 2021
00:12:45,513 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3ee0fea4 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:45,513 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3ee0fea4 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:45,520 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:45,530 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/AggregatorApplication.log
00:12:45,530 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/AggregatorApplication.log]
00:12:45,531 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:46,893 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:46,898 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:46,898 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:46,915 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:46,915 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:46,915 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:46,915 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:46,916 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@48524010 - Registering current configuration as safe fallback point
2021-02-10 00:12:46.939 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.wayback.aggregator.AggregationWorker
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
2021-02-10 00:12:46.960 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.wayback.aggregator.AggregationWorker
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
Java VM: 1.8.0_25
2021-02-10 00:12:46.970 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
2021-02-10 00:12:46.970 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test3
2021-02-10 00:12:46.971 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-10 00:12:46.971 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_AggregatorApplication.xml'
2021-02-10 00:12:47.381 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-way-001.kb.dk' and JMX/RMI ports 9150/9250
2021-02-10 00:12:47.390 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 9150 communicating on port 9250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-way-001.kb.dk:9250/jndi/rmi://kb-test-way-001.kb.dk:9150/jmxrmi
dk.netarkivet.wayback.aggregator.AggregationWorker Running
2021-02-10 00:12:47.408 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.wayback.aggregator.AggregationWorker Running
2021-02-10 00:12:47.470 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:47.476 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:47.477 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:47.489 DEBUG d.n.w.aggregator.AggregationWorker.runAggregation - No new raw index files found in '/home/devel/Test3/batchOutputDir' skipping aggregation
00:12:44,329 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_WaybackIndexerApplication.xml] at [file:/home/devel/Test3/conf/logback_WaybackIndexerApplication.xml]
00:12:45,080 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:45,090 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:45,121 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:45,198 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:45,351 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:45,365 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:45,476 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@339099861 - No compression will be used
00:12:45,482 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@339099861 - Will use the pattern ./log/WaybackIndexerApplication.%d{yyyy-MM-dd}.%i.log for the active file
00:12:45,488 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6295d394 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/WaybackIndexerApplication.%d{yyyy-MM-dd}.%i.log'.
00:12:45,488 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6295d394 - Roll-over at midnight.
00:12:45,507 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6295d394 - Setting initial period to Wed Feb 10 00:12:45 CET 2021
00:12:45,508 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6295d394 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:45,508 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6295d394 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:45,515 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:45,525 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/WaybackIndexerApplication.log
00:12:45,525 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/WaybackIndexerApplication.log]
00:12:45,533 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:46,904 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:46,908 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:46,908 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:46,909 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:46,909 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:46,921 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:46,921 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:46,922 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@475e586c - Registering current configuration as safe fallback point
2021-02-10 00:12:46.945 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.wayback.indexer.WaybackIndexer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
2021-02-10 00:12:46.977 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.wayback.indexer.WaybackIndexer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
Java VM: 1.8.0_25
2021-02-10 00:12:46.978 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
2021-02-10 00:12:46.979 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test3
2021-02-10 00:12:46.980 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-10 00:12:46.987 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_WaybackIndexerApplication.xml'
2021-02-10 00:12:47.364 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-way-001.kb.dk' and JMX/RMI ports 8151/8251
2021-02-10 00:12:47.367 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8151 communicating on port 8251 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-way-001.kb.dk:8251/jndi/rmi://kb-test-way-001.kb.dk:8151/jmxrmi
dk.netarkivet.wayback.indexer.WaybackIndexer Running
2021-02-10 00:12:47.382 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.wayback.indexer.WaybackIndexer Running
2021-02-10 00:12:47.441 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:47.442 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:47.456 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:47.550 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-way-001.kb.dk
--------------------------------------------
--------------------------------------------
STARTING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
Starting all applications on: sb-test-har-001.statsbiblioteket.dk
Starting linux application: HarvestControllerApplication_sbhigh_h3
00:12:48,704 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/netarkdv/Test3/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] at [file:/home/netarkdv/Test3/conf/logback_HarvestControllerApplication_sbhigh_h3.xml]
00:12:48,793 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
00:12:48,795 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
00:12:48,799 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
00:12:48,806 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:48,842 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
00:12:48,844 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
00:12:48,856 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1543148593 - No compression will be used
00:12:48,857 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1543148593 - Will use the pattern ./log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
00:12:48,858 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5db250b4 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
00:12:48,858 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5db250b4 - Roll-over at midnight.
00:12:48,862 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5db250b4 - Setting initial period to Wed Feb 10 00:12:48 CET 2021
00:12:48,862 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5db250b4 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
00:12:48,862 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5db250b4 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
00:12:48,864 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
00:12:48,866 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_sbhigh_h3.log
00:12:48,866 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_sbhigh_h3.log]
00:12:48,868 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
00:12:49,096 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
00:12:49,098 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
00:12:49,098 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
00:12:49,098 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
00:12:49,098 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
00:12:49,098 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
00:12:49,098 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
00:12:49,099 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@223f3642 - Registering current configuration as safe fallback point
2021-02-10 00:12:49.102 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
2021-02-10 00:12:49.106 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/f0f4a71edd0773f7fd35d30bfb5f80abe93057eb)
Java VM: 1.8.0_232
2021-02-10 00:12:49.106 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_232
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
2021-02-10 00:12:49.106 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
Working dir: /home/netarkdv/Test3
2021-02-10 00:12:49.106 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/netarkdv/Test3
2021-02-10 00:12:49.107 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/netarkdv/Test3/conf/settings_HarvestControllerApplication_sbhigh_h3.xml'
2021-02-10 00:12:49.232 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'sb-test-har-001.statsbiblioteket.dk' and JMX/RMI ports 8150/8250
2021-02-10 00:12:49.233 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://sb-test-har-001.statsbiblioteket.dk:8250/jndi/rmi://sb-test-har-001.statsbiblioteket.dk:8150/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-10 00:12:49.236 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-10 00:12:49.242 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-10 00:12:49.242 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2021-02-10 00:12:49.246 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:49.246 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-10 00:12:49.246 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-10 00:12:49.248 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2021-02-10 00:12:49.248 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-10 00:12:49.359 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-10 00:12:49.360 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@a514af7 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3
2021-02-10 00:12:49.376 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3']'
2021-02-10 00:12:49.376 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/netarkdv/Test3/conf/bitmag_client_config
2021-02-10 00:12:49.377 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-10 00:12:49.383 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-10 00:12:49.509 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-10 00:12:49.511 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/netarkdv/Test3/conf/bitmag_client_config
2021-02-10 00:12:49.517 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/netarkdv/Test3/conf/bitmag_client_config/client.pem
2021-02-10 00:12:49.518 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-10 00:12:49.520 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): sb-test-har-001.statsbiblioteket.dk
2021-02-10 00:12:49.521 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-sb-test-har-001.statsbiblioteket.dk-64f4b725-3ba9-4869-bea5-4124e480fd40
2021-02-10 00:12:49.932 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
2021-02-10 00:12:50.412 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Getting bitrepository message bus
2021-02-10 00:12:50.782 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository clients
2021-02-10 00:12:50.794 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2021-02-10 00:12:50.797 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2021-02-10 00:12:50.797 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_high'
2021-02-10 00:12:50.798 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@72a85671 as listener to Test3_COMMON_HCHAN_VAL_RESP
2021-02-10 00:12:50.830 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'HIGHPRIORITY'
2021-02-10 00:12:50.865 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'HIGHPRIORITY' is valid.
2021-02-10 00:12:50.868 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test3_COMMON_JOB_PARTIAL_HIGHPRIORITY']'
2021-02-10 00:12:50.868 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@72a85671 as listener to Test3_COMMON_JOB_PARTIAL_HIGHPRIORITY
--------------------------------------------
Completed the script all_test.sh
Sending e-mails to: rbkr@kb.dk
Finished: SUCCESS
Console Output
Help us localize this page