tarkiv-kbh-disk-devel-01
14:22:04.432 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd
14:22:04.550 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'.
14:22:05.047 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd
14:22:05.084 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'.
14:22:05.696 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found
14:22:05.715 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair
14:22:05.716 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found
14:22:05.915 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
14:22:05.916 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd
14:22:06.944 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true
14:22:07.027 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@14cd1699[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'.
14:22:07.030 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-15637]
14:22:07.033 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator
14:22:07.033 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3514a4c0' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-15637' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'.
14:22:07.034 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-15637' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@3514a4c0'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-15637#890545344'.
14:22:07.034 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-15637#890545344'.
14:22:07.056 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation.
java.lang.IllegalArgumentException: String hexString, 'Checksum:', must be an even number of characters.
at org.bitrepository.common.ArgumentValidator.checkTrue(ArgumentValidator.java:160)
at org.bitrepository.common.utils.Base16Utils.encodeBase16(Base16Utils.java:64)
at org.bitrepository.commandline.CommandLineClient.getChecksumDataForDeleteValidation(CommandLineClient.java:302)
at org.bitrepository.commandline.DeleteFileCmd.deleteTheFile(DeleteFileCmd.java:125)
at org.bitrepository.commandline.DeleteFileCmd.performOperation(DeleteFileCmd.java:107)
at org.bitrepository.commandline.CommandLineClient.runCommand(CommandLineClient.java:68)
at org.bitrepository.commandline.DeleteFileCmd.main(DeleteFileCmd.java:47)
xargs: ssh: exited with status 255; aborting
Now deleting actual files on Windows hosts for Test3
Nothing to delete in e:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in f:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in g:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in h:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in i:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
Nothing to delete in j:kbhpillar\collection-Test3 on kb-test-bar-01.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Nothing to delete in e:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Nothing to delete in f:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Nothing to delete in g:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Nothing to delete in h:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Nothing to delete in i:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
ssh_exchange_identification: Connection closed by remote host
Nothing to delete in j:kbhpillar\collection-Test3 on kb-test-bar-016.bitarkiv.kb.dk
calling cleanup_hosts
running cleanup_hosts
Removing installation on sb-test-har-001.statsbiblioteket.dk
Removing installation on kb-test-har-003.kb.dk
Removing installation on kb-test-har-004.kb.dk
Removing installation on kb-test-har-005.kb.dk
Removing installation on kb-test-adm-001.kb.dk
Removing installation on kb-test-acs-001.kb.dk
Removing installation on kb-test-way-001.kb.dk
calling cleanup_linuxbarhosts
running cleanup_linuxbarhosts
Removing installation on sb-test-bar-001.statsbiblioteket.dk
Removing bitarchive on sb-test-bar-001.statsbiblioteket.dk
Calling cleanup_windowsbarhosts
running cleanup_windowsbarhosts
Removing C:\bitarkiv\Test3 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing E:\bitarchive_1\Test3 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing F:\bitarchive_2\Test3 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
Removing g:\bitarchive_3\Test3 on kb-test-bar-01.bitarkiv.kb.dk
The system cannot find the file specified.
TESTX=Test3
PORT=8076
MAILRECEIVERS=rbkr@kb.dk
VERSION=RBKR
DEPLOYCONF=deploy_config_bitmag.xml
H3ZIP=RBKR
BITMAGCONF=/home/devel/bitmag_test_config/client_config
Using bundler file /home/devel/nas_versions/bundler/NetarchiveSuite-heritrix3-bundler-RBKR.zip
Creating distribution files in /home/devel/prepared_software/Test3.
Will read source files using encoding 'UTF-8' (defaulted)
Branch in settings not found: common.warcRecordService
Branch in settings not found: common.trustStore
Branch in settings not found: common.arcrepositoryClient.bitrepository
Branch in settings not found: common.hadoop
Branch in settings not found: common.useBitmagHadoopBackend
Branch in settings not found: common.fileResolver
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.certificate
Branch in settings not found: harvester.harvesting.umbra
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Branch in settings not found: harvester.harvesting.heritrix3.bundle
Machine 'kb-test-adm-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-har-003.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test3/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test3/h3server.jks
Machine 'kb-test-har-005.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test3/NetarchiveSuite-heritrix3-bundler.zip
/home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test3/h3server.jks
Machine 'kb-test-har-004.kb.dk' configured with encoding 'UTF-8' (defaulted)
NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test3/NetarchiveSuite-heritrix3-bundler.zip
Machine 'kb-test-acs-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'kb-test-way-001.kb.dk' configured with encoding 'UTF-8' (defaulted)
Machine 'sb-test-har-001.statsbiblioteket.dk' configured with encoding 'UTF-8' (defaulted)
/home/devel/prepared_software/Test3/NetarchiveSuite-heritrix3-bundler.zip -> /home/netarkdv/Test3/NetarchiveSuite-heritrix3-bundler.zip
14:22:24.862 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
14:22:24.866 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
14:22:24.868 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
14:22:24.868 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
14:22:24.870 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
14:22:24.870 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
14:22:24.871 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
14:22:24.871 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
14:22:24.871 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
14:22:24.871 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
14:22:24.872 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
14:22:24.872 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
14:22:24.942 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned
14:22:24.942 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-adm-001.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-adm-001.kb.dk
deleting devel@kb-test-adm-001.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-adm-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-003.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-har-003.kb.dk
deleting devel@kb-test-har-003.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-har-003.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-005.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-har-005.kb.dk
deleting devel@kb-test-har-005.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-har-005.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-har-004.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-har-004.kb.dk
deleting devel@kb-test-har-004.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-har-004.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-acs-001.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-acs-001.kb.dk
deleting devel@kb-test-acs-001.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-acs-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
INSTALLING TO MACHINE: devel@kb-test-way-001.kb.dk
copying NetarchiveSuite-RBKR.zip to:kb-test-way-001.kb.dk
deleting devel@kb-test-way-001.kb.dk:/home/devel/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:kb-test-way-001.kb.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
--------------------------------------------
INSTALLING TO MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
copying NetarchiveSuite-RBKR.zip to:sb-test-har-001.statsbiblioteket.dk
deleting netarkdv@sb-test-har-001.statsbiblioteket.dk:/home/netarkdv/Test3/lib
unzipping NetarchiveSuite-RBKR.zip at:sb-test-har-001.statsbiblioteket.dk
Creating directories.
preparing for copying of settings and scripts
copying settings and scripts
make scripts executable
make password and access files readonly
--------------------------------------------
Copying secondary installation scripts out to the machines where they need to be executed
scp '/home/devel/devel-config/scripts/link_bitmag.sh' 'netarkdv@sb-test-bar-001.statsbiblioteket.dk:Test3'
Linking Bitmag kbh-pillar and NAS bitarkiv directories on KBH
scp: Test3/link_kbh_bar_01.bat: Error writing file: Insufficient free space on the filesystem.
ssh_exchange_identification: Connection closed by remote host
lost connection
Linking bitmag and netarkivet storage directories on SB
ssh 'netarkdv@sb-test-bar-001.statsbiblioteket.dk' 'Test3/link_bitmag.sh Test3'
bash: Test3/link_bitmag.sh: Not a directory
Linking Bitmag kbh-pillar and NAS bitarkiv directories on KBH
ssh_exchange_identification: Connection closed by remote host
Initializing database for system Test3
+ host=devel@kb-test-adm-001
+ scp -p /home/devel/devel-config/scripts/db/setup_admindb.sh /home/devel/devel-config/scripts/db/setup_harvestdb.sh /home/devel/devel-config/scripts/db/teardown_admindb.sh /home/devel/devel-config/scripts/db/teardown_harvestdb.sh /home/devel/devel-config/scripts/../resources/harvestdb.testdata.sql /home/devel/devel-config/scripts/../resources/default_orderxml.cxml devel@kb-test-adm-001:bin/
+ ssh devel@kb-test-adm-001
Pseudo-terminal will not be allocated because stdin is not a terminal.
Destroying test3_admindb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
DROP DATABASE
Creating empty test3_admindb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
CREATE DATABASE
Initialising test3_admindb
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "replica_pkey" for table "replica"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "replica_replica_id_key" for table "replica"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "replica_replica_name_key" for table "replica"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "replicafileinfo_pkey" for table "replicafileinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "file_pkey" for table "file"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "segment_pkey" for table "segment"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
Destroying test3_harvestdb
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
DROP DATABASE
DEBUG: transaction ID wrap limit is 2257721481, limited by database "test2056_harvestdb"
CREATE DATABASE
CREATE TABLE
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
INSERT 0 1
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "domains_pkey" for table "domains"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "domains_name_key" for table "domains"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "configurations_pkey" for table "configurations"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "config_passwords_pkey" for table "config_passwords"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "config_seedlists_pkey" for table "config_seedlists"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "seedlists_pkey" for table "seedlists"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "passwords_pkey" for table "passwords"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "ownerinfo_pkey" for table "ownerinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "historyinfo_pkey" for table "historyinfo"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvestdefinitions_pkey" for table "harvestdefinitions"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "harvestdefinitions_name_key" for table "harvestdefinitions"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "fullharvests_pkey" for table "fullharvests"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "partialharvests_pkey" for table "partialharvests"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvest_configs_pkey" for table "harvest_configs"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "schedules_pkey" for table "schedules"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "schedules_name_key" for table "schedules"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "ordertemplates_pkey" for table "ordertemplates"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "ordertemplates_name_key" for table "ordertemplates"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "jobs_pkey" for table "jobs"
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "job_configs_pkey" for table "job_configs"
CREATE TABLE
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "global_crawler_trap_lists_pkey" for table "global_crawler_trap_lists"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "global_crawler_trap_lists_name_key" for table "global_crawler_trap_lists"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "global_crawler_trap_expressions_pkey" for table "global_crawler_trap_expressions"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
CREATE INDEX
GRANT
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "pkrunningjobshistory" for table "runningjobshistory"
CREATE TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "pkrunningjobsmonitor" for table "runningjobsmonitor"
CREATE TABLE
CREATE INDEX
CREATE INDEX
GRANT
NOTICE: CREATE TABLE / UNIQUE will create implicit index "pkfrontierreportlines" for table "frontierreportmonitor"
CREATE TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfieldtype_pkey" for table "extendedfieldtype"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfield_pkey" for table "extendedfield"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "extendedfieldvalue_pkey" for table "extendedfieldvalue"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
GRANT
INSERT 0 1
INSERT 0 1
NOTICE: CREATE TABLE / PRIMARY KEY will create implicit index "harvestchannel_pkey" for table "harvestchannel"
NOTICE: CREATE TABLE / UNIQUE will create implicit index "harvestchannel_name_key" for table "harvestchannel"
CREATE TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE INDEX
GRANT
GRANT
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE TABLE
NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index "eav_type_attribute_pkey" for table "eav_type_attribute"
ALTER TABLE
CREATE INDEX
CREATE SEQUENCE
CREATE TABLE
NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index "eav_attribute_pkey" for table "eav_attribute"
ALTER TABLE
CREATE INDEX
GRANT
GRANT
GRANT
INSERT 0 1
INSERT 0 1
INSERT 0 1
SET
SET
SET
SET
SET
SET
SET
SET
SET
setval
--------
17
(1 row)
setval
--------
17
(1 row)
setval
--------
17
(1 row)
setval
--------
5
(1 row)
setval
--------
4
(1 row)
setval
--------
17
(1 row)
14:23:57.619 [main] INFO com.mchange.v2.log.MLog - MLog clients using log4j logging.
14:23:58.007 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.2.1 [built 20-March-2013 10:47:27 +0000; debug? true; trace: 10]
14:23:58.093 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52af1eb2ifg1rozabu|c8211c,name=10bdx52af1eb2ifg1rozabu|c8211c registered.
14:23:58.153 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52af1eb2ifg1rozabu|c8211c,name=10bdx52af1eb2ifg1rozabu|c8211c unregistered, in order to be reregistered after update.
14:23:58.158 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52af1eb2ifg1rozabu|c8211c,name=10bdx52af1eb2ifg1rozabu|c8211c registered.
14:23:58.185 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=20
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
14:23:58.295 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, dataSourceName -> 10bdx52af1eb2ifg1rozabu|c8211c, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 10bdx52af1eb2ifg1rozabu|c8211c, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost:5432/test3_harvestdb, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 3600, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, preferredTestQuery -> null, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ]
14:23:58.323 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 1
14:23:58.324 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [1], attempts_remaining: 30
14:23:58.324 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@67a738: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@f0f1be
14:23:58.324 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 2
14:23:58.325 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [2], attempts_remaining: 30
14:23:58.325 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@67a738: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@17632c9
14:23:58.326 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 3
14:23:58.326 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [3], attempts_remaining: 30
14:23:58.326 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@67a738: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@e12bac
14:23:58.326 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 4
14:23:58.326 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [4], attempts_remaining: 30
14:23:58.327 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@67a738: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@1040f2f
14:23:58.327 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - incremented pending_acquires: 5
14:23:58.327 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Starting acquisition series. Incremented pending_acquires [5], attempts_remaining: 30
14:23:58.327 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@67a738: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@c87930
14:23:58.339 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@cff1a config: [start -> 3; min -> 5; max -> 20; inc -> 5; num_acq_attempts -> 30; acq_attempt_delay -> 1000; check_idle_resources_delay -> 0; mox_resource_age -> 3600000; max_idle_time -> 0; excess_max_idle_time -> 0; destroy_unreturned_resc_time -> 0; expiration_enforcement_delay -> 900000; break_on_acquisition_failure -> false; debug_store_checkout_exceptions -> false]
14:23:58.339 [main] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPoolManager - Created new pool for auth, username (masked): 'de******'.
14:23:58.339 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - acquire test -- pool size: 0; target_pool_size: 5; desired target? 1
14:23:58.343 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - awaitAvailable(): [unknown]
14:23:58.343 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@cff1a [managed: 0, unused: 0, excluded: 0]
14:23:58.540 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#0] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@172da4f.acquireResource() returning.
14:23:58.541 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#2] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@172da4f.acquireResource() returning.
14:23:58.541 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@cff1a [managed: 1, unused: 1, excluded: 0]
14:23:58.541 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 4
14:23:58.541 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [4], attempts_remaining: 30
14:23:58.541 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@cff1a [managed: 2, unused: 2, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@1e9b88a)
14:23:58.542 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 3
14:23:58.542 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#1] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@172da4f.acquireResource() returning.
14:23:58.542 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [3], attempts_remaining: 30
14:23:58.542 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@cff1a [managed: 3, unused: 3, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@1e9b88a)
14:23:58.542 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 2
14:23:58.542 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#1] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [2], attempts_remaining: 30
14:23:58.542 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@cff1a [managed: 3, unused: 2, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@1e9b88a)
14:23:58.564 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#0] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@172da4f.acquireResource() returning.
14:23:58.564 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@cff1a [managed: 4, unused: 3, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@1e9b88a)
14:23:58.564 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 1
14:23:58.564 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#0] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [1], attempts_remaining: 30
14:23:58.578 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#2] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool - com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager@172da4f.acquireResource() returning.
14:23:58.578 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@cff1a [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@1e9b88a)
14:23:58.578 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - decremented pending_acquires: 0
14:23:58.578 [C3P0PooledConnectionPoolManager[identityToken->10bdx52af1eb2ifg1rozabu|c8211c]-HelperThread-#2] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - Acquisition series terminated successfully. Decremented pending_acquires [0], attempts_remaining: 30
14:23:58.626 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@106ebcb closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@12da18f
14:23:58.629 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@67a738: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1a561cf
14:23:58.630 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@cff1a [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@1e9b88a)
14:23:58.641 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@cff1a [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@1e9b88a)
14:23:58.643 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@95d394 closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@3640d5
14:23:58.644 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@67a738: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@15e586c
14:23:58.644 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@cff1a [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@1e9b88a)
14:23:58.696 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@cff1a [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@1e9b88a)
14:23:58.698 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@16856dd closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@1e547da
14:23:58.716 [main] DEBUG com.mchange.v2.async.ThreadPoolAsynchronousRunner - com.mchange.v2.async.ThreadPoolAsynchronousRunner@67a738: Adding task to queue -- com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@417213
14:23:58.717 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - trace com.mchange.v2.resourcepool.BasicResourcePool@cff1a [managed: 5, unused: 4, excluded: 0] (e.g. com.mchange.v2.c3p0.impl.NewPooledConnection@1e9b88a)
14:23:58.717 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyConnection - com.mchange.v2.c3p0.impl.NewProxyConnection@1761df8: close() called more than once.
The template 'default_orderxml' has now been updated.
+ set +x
--------------------------------------------
STARTING MACHINE: devel@kb-test-adm-001.kb.dk
Starting all applications on: kb-test-adm-001.kb.dk
Starting linux application: GUIApplication
Starting linux application: ArcRepositoryApplication
Starting linux application: HarvestJobManagerApplication
14:24:00,129 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_ArcRepositoryApplication.xml] at [file:/home/devel/Test3/conf/logback_ArcRepositoryApplication.xml]
14:24:00,727 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:00,732 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:00,759 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:00,816 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:01,004 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:01,016 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:01,098 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@22192110 - No compression will be used
14:24:01,100 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@22192110 - Will use the pattern ./log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log for the active file
14:24:01,106 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e767f3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log'.
14:24:01,106 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e767f3 - Roll-over at midnight.
14:24:01,122 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e767f3 - Setting initial period to Thu Feb 18 14:24:01 CET 2021
14:24:01,123 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e767f3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:01,123 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e767f3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:01,125 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:01,133 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ArcRepositoryApplication.log
14:24:01,133 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ArcRepositoryApplication.log]
14:24:01,137 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:02,247 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:02,258 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:02,258 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:02,258 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:02,258 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:02,259 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:02,259 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:02,266 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@5c96b - Registering current configuration as safe fallback point
2021-02-18 14:24:02.282 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
2021-02-18 14:24:02.316 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
Java VM: 1.8.0_20
2021-02-18 14:24:02.319 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_20
java.home: /usr/java/jdk1.8.0_20/jre
2021-02-18 14:24:02.320 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/java/jdk1.8.0_20/jre
Working dir: /home/devel/Test3
2021-02-18 14:24:02.322 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-18 14:24:02.324 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_ArcRepositoryApplication.xml'
2021-02-18 14:24:02.578 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8151/8251
2021-02-18 14:24:02.578 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8151 communicating on port 8251 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8251/jndi/rmi://kb-test-adm-001.kb.dk:8151/jmxrmi
dk.netarkivet.archive.arcrepository.ArcRepository Running
2021-02-18 14:24:02.592 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.archive.arcrepository.ArcRepository Running
2021-02-18 14:24:02.621 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:02.621 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:02.622 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-18 14:24:03.407 INFO d.n.a.a.ArchiveDBConnection.initDataSource - Using jdbc url: jdbc:postgresql://localhost:5432/test3_admindb
2021-02-18 14:24:03.414 INFO d.n.a.a.ArchiveDBConnection.initDataSource - Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=10
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=30
- idleConnTestQuery='SELECT COUNT(*) FROM replica'
- idleConnTestOnCheckin=false
2021-02-18 14:24:04.030 DEBUG d.n.a.a.ReplicaCacheDatabase.initialiseDB - IDs for replicas already in the database:
2021-02-18 14:24:04.031 INFO d.n.a.a.ReplicaCacheDatabase.initialiseDB - Inserting replica 'BITARCHIVEReplica (SB) SBN' in database.
2021-02-18 14:24:04.037 DEBUG d.n.a.a.ReplicaCacheHelpers.insertReplicaIntoDB - Executing insert, conditional on SB not already existing in the database.
2021-02-18 14:24:04.047 DEBUG d.n.a.a.ReplicaCacheHelpers.insertReplicaIntoDB - Insert statement for SB returned 1
2021-02-18 14:24:04.053 INFO d.n.a.a.ReplicaCacheDatabase.initialiseDB - Inserting replica 'BITARCHIVEReplica (KB) KBN' in database.
2021-02-18 14:24:04.054 DEBUG d.n.a.a.ReplicaCacheHelpers.insertReplicaIntoDB - Executing insert, conditional on KB not already existing in the database.
2021-02-18 14:24:04.059 DEBUG d.n.a.a.ReplicaCacheHelpers.insertReplicaIntoDB - Insert statement for KB returned 1
2021-02-18 14:24:04.077 INFO d.n.a.a.ReplicaCacheDatabase.<init> - Initialization of database successful
2021-02-18 14:24:04.111 INFO d.n.a.a.d.NonFunctionalArcRepositoryServer.<init> - Listening for arc repository messages on channel '[Queue 'Test3_COMMON_THE_REPOS']'
2021-02-18 14:24:04.112 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.NonFunctionalArcRepositoryServer@1d5509a as listener to Test3_COMMON_THE_REPOS
2021-02-18 14:24:04.152 INFO d.n.a.arcrepository.ArcRepository.<init> - Starting the ArcRepository
14:23:59,993 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_GUIApplication.xml] at [file:/home/devel/Test3/conf/logback_GUIApplication.xml]
14:24:00,829 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:00,832 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:00,864 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:00,938 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:01,127 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:01,142 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:01,271 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@28094673 - No compression will be used
14:24:01,272 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@28094673 - Will use the pattern ./log/GUIApplication.%d{yyyy-MM-dd}.%i.log for the active file
14:24:01,294 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3047e6 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/GUIApplication.%d{yyyy-MM-dd}.%i.log'.
14:24:01,294 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3047e6 - Roll-over at midnight.
14:24:01,303 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3047e6 - Setting initial period to Thu Feb 18 14:24:01 CET 2021
14:24:01,304 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3047e6 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:01,304 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3047e6 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:01,312 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:01,334 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/GUIApplication.log
14:24:01,334 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/GUIApplication.log]
14:24:01,336 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:03,476 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:03,494 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:03,494 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:03,494 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:03,494 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:03,495 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:03,495 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:03,517 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@1e547da - Registering current configuration as safe fallback point
2021-02-18 14:24:03.534 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
2021-02-18 14:24:03.564 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
Java VM: 1.8.0_20
2021-02-18 14:24:03.568 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_20
java.home: /usr/java/jdk1.8.0_20/jre
2021-02-18 14:24:03.569 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/java/jdk1.8.0_20/jre
Working dir: /home/devel/Test3
2021-02-18 14:24:03.577 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-18 14:24:03.578 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_GUIApplication.xml'
2021-02-18 14:24:04.061 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8150/8250
2021-02-18 14:24:04.061 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8250/jndi/rmi://kb-test-adm-001.kb.dk:8150/jmxrmi
dk.netarkivet.common.webinterface.GUIWebServer Running
2021-02-18 14:24:04.063 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.common.webinterface.GUIWebServer Running
2021-02-18 14:24:04.066 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war
2021-02-18 14:24:04.066 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection
2021-02-18 14:24:04.066 INFO d.n.common.webinterface.GUIWebServer.<init> - Starting webserver. Port: 8076 deployment directories: 'webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war' classes: 'dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection'
2021-02-18 14:24:04.097 DEBUG d.n.common.webinterface.GUIWebServer.<init> - GUI using tempdir /home/devel/Test3/tmpdircommon
2021-02-18 14:24:04.097 DEBUG d.n.common.webinterface.GUIWebServer.<init> - GUI using basedir /home/devel/Test3
2021-02-18 14:24:04.098 INFO d.n.common.webinterface.GUIWebServer.<init> - Deleted existing tempdir '/home/devel/Test3/tmpdircommon'
2021-02-18 14:24:04.114 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:04.115 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:04.115 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
14:24:00,337 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestJobManagerApplication.xml] at [file:/home/devel/Test3/conf/logback_HarvestJobManagerApplication.xml]
14:24:00,765 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:00,766 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:00,805 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:00,853 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:01,080 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:01,094 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:01,214 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@4092174 - No compression will be used
14:24:01,221 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@4092174 - Will use the pattern ./log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log for the active file
14:24:01,232 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f23557 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log'.
14:24:01,232 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f23557 - Roll-over at midnight.
14:24:01,265 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f23557 - Setting initial period to Thu Feb 18 14:24:01 CET 2021
14:24:01,265 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f23557 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:01,265 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1f23557 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:01,275 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:01,282 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestJobManagerApplication.log
14:24:01,282 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestJobManagerApplication.log]
14:24:01,286 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:03,384 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:03,397 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:03,397 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:03,398 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:03,398 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:03,399 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:03,399 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:03,411 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@10f8e03 - Registering current configuration as safe fallback point
2021-02-18 14:24:03.429 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
2021-02-18 14:24:03.522 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:03.537 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:03.538 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-003.kb.dk
Starting all applications on: kb-test-har-003.kb.dk
Starting linux application: HarvestControllerApplication_kblow001_h3
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test3/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test3/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
14:24:05,233 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kblow001_h3.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kblow001_h3.xml]
14:24:05,422 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:05,425 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:05,434 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:05,448 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:05,508 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:05,512 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:05,554 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@128359175 - No compression will be used
14:24:05,556 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@128359175 - Will use the pattern ./log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log for the active file
14:24:05,562 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log'.
14:24:05,562 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - Roll-over at midnight.
14:24:05,569 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - Setting initial period to Thu Feb 18 14:24:05 CET 2021
14:24:05,570 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:05,570 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:05,573 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:05,579 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow001_h3.log
14:24:05,579 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow001_h3.log]
14:24:05,581 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:06,140 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:06,142 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:06,142 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:06,143 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:06,143 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:06,143 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:06,143 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:06,144 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3f197a46 - Registering current configuration as safe fallback point
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2021-02-18 14:24:06.162 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
2021-02-18 14:24:06.175 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
Java VM: 1.8.0_282
2021-02-18 14:24:06.176 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-18 14:24:06.176 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-18 14:24:06.177 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-18 14:24:06.177 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kblow001_h3.xml'
2021-02-18 14:24:06.296 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-003.kb.dk' and JMX/RMI ports 8150/8250
2021-02-18 14:24:06.297 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-003.kb.dk:8250/jndi/rmi://kb-test-har-003.kb.dk:8150/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-18 14:24:06.307 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-18 14:24:06.315 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:06.315 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:06.316 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-18 14:24:06.333 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-18 14:24:06.333 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2021-02-18 14:24:06.334 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2021-02-18 14:24:06.334 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-18 14:24:06.453 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-18 14:24:06.454 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@5c6648b0 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3
2021-02-18 14:24:06.464 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3']'
2021-02-18 14:24:06.465 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:06.467 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-18 14:24:06.479 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-18 14:24:07.006 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2021-02-18 14:24:07.095 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-18 14:24:07.096 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:07.096 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-18 14:24:07.096 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-18 14:24:07.101 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-003.kb.dk
2021-02-18 14:24:07.102 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-har-003.kb.dk-ba9be06e-af21-46bf-af3a-0b9f56f93da3
2021-02-18 14:24:08.014 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
2021-02-18 14:24:08.260 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Getting bitrepository message bus
2021-02-18 14:24:09.131 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository clients
2021-02-18 14:24:09.183 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2021-02-18 14:24:09.186 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2021-02-18 14:24:09.187 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_low'
2021-02-18 14:24:09.188 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@4b85880b as listener to Test3_COMMON_HCHAN_VAL_RESP
2021-02-18 14:24:09.218 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'LOWPRIORITY'
2021-02-18 14:24:09.278 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'LOWPRIORITY' is valid.
2021-02-18 14:24:09.282 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test3_COMMON_JOB_SNAPSHOT_LOWPRIORITY']'
2021-02-18 14:24:09.283 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@4b85880b as listener to Test3_COMMON_JOB_SNAPSHOT_LOWPRIORITY
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-005.kb.dk
Starting all applications on: kb-test-har-005.kb.dk
Starting linux application: HarvestControllerApplication_kbumbra_1
Starting linux application: HarvestControllerApplication_kbumbra_2
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test3/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test3/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
14:24:10,738 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kbumbra_1.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kbumbra_1.xml]
14:24:11,150 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:11,158 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:11,164 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:11,204 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:11,263 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:11,265 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:11,293 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@128359175 - No compression will be used
14:24:11,294 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@128359175 - Will use the pattern ./log/HarvestControllerApplication_kbumbra_1.%d{yyyy-MM-dd}.%i.log for the active file
14:24:11,296 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbumbra_1.%d{yyyy-MM-dd}.%i.log'.
14:24:11,296 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - Roll-over at midnight.
14:24:11,302 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - Setting initial period to Thu Feb 18 14:24:11 CET 2021
14:24:11,302 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:11,302 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:11,303 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:11,305 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbumbra_1.log
14:24:11,305 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbumbra_1.log]
14:24:11,306 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:11,982 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:11,983 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:11,984 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:11,984 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:11,984 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:11,985 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:11,985 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:11,985 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3f197a46 - Registering current configuration as safe fallback point
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2021-02-18 14:24:11.997 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
2021-02-18 14:24:12.002 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
Java VM: 1.8.0_282
2021-02-18 14:24:12.003 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-18 14:24:12.003 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-18 14:24:12.004 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-18 14:24:12.004 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kbumbra_1.xml'
2021-02-18 14:24:12.212 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8150/8250
2021-02-18 14:24:12.212 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8250/jndi/rmi://kb-test-har-005.kb.dk:8150/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-18 14:24:12.217 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-18 14:24:12.228 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-18 14:24:12.228 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'UMBRA'
2021-02-18 14:24:12.228 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_umbra_1'
2021-02-18 14:24:12.229 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-18 14:24:12.242 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:12.242 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:12.243 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-18 14:24:12.410 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-18 14:24:12.418 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@2638011 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_KBUMBRA_1
2021-02-18 14:24:12.501 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_KBUMBRA_1']'
2021-02-18 14:24:12.502 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:12.502 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-18 14:24:12.506 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-18 14:24:13.396 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2021-02-18 14:24:13.527 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-18 14:24:13.528 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:13.528 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-18 14:24:13.528 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-18 14:24:13.533 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk
2021-02-18 14:24:13.533 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-har-005.kb.dk-f53b2eb5-4b13-40cf-82c9-87d9cc1fd0b7
2021-02-18 14:24:14.407 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
2021-02-18 14:24:14.828 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Getting bitrepository message bus
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test3/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test3/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
14:24:10,743 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kbumbra_2.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kbumbra_2.xml]
14:24:11,087 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:11,091 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:11,101 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:11,116 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:11,186 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:11,189 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:11,221 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@128359175 - No compression will be used
14:24:11,222 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@128359175 - Will use the pattern ./log/HarvestControllerApplication_kbumbra_2.%d{yyyy-MM-dd}.%i.log for the active file
14:24:11,225 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbumbra_2.%d{yyyy-MM-dd}.%i.log'.
14:24:11,225 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - Roll-over at midnight.
14:24:11,237 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - Setting initial period to Thu Feb 18 14:24:11 CET 2021
14:24:11,238 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:11,238 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5e82df6a - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:11,239 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:11,242 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbumbra_2.log
14:24:11,242 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbumbra_2.log]
14:24:11,242 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:11,925 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:11,933 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:11,933 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:11,934 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:11,934 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:11,934 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:11,934 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:11,935 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3f197a46 - Registering current configuration as safe fallback point
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2021-02-18 14:24:11.939 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
2021-02-18 14:24:11.952 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
Java VM: 1.8.0_282
2021-02-18 14:24:11.957 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-18 14:24:11.957 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-18 14:24:11.957 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-18 14:24:11.961 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kbumbra_2.xml'
2021-02-18 14:24:12.140 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8155/8255
2021-02-18 14:24:12.140 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8155 communicating on port 8255 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8255/jndi/rmi://kb-test-har-005.kb.dk:8155/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-18 14:24:12.145 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-18 14:24:12.155 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:12.155 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:12.155 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-18 14:24:12.165 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-18 14:24:12.165 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'UMBRA'
2021-02-18 14:24:12.166 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_umbra_2'
2021-02-18 14:24:12.166 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-18 14:24:12.329 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-18 14:24:12.330 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@5c6648b0 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_KBUMBRA_2
2021-02-18 14:24:12.340 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_KBUMBRA_2']'
2021-02-18 14:24:12.341 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:12.341 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-18 14:24:12.347 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-18 14:24:13.193 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2021-02-18 14:24:13.412 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-18 14:24:13.412 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:13.413 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-18 14:24:13.413 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-18 14:24:13.417 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk
2021-02-18 14:24:13.418 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-har-005.kb.dk-c87b6eb1-dd08-4d69-bb14-034c81de4144
2021-02-18 14:24:14.498 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
2021-02-18 14:24:14.894 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Getting bitrepository message bus
--------------------------------------------
STARTING MACHINE: devel@kb-test-har-004.kb.dk
Starting all applications on: kb-test-har-004.kb.dk
Starting linux application: HarvestControllerApplication_kblow002_h3
Starting linux application: HarvestControllerApplication_kbhigh_h3
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test3/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test3/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
14:24:16,082 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kbhigh_h3.xml]
14:24:16,484 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:16,495 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:16,522 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:16,552 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:16,612 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:16,616 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:16,649 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2130772866 - No compression will be used
14:24:16,650 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2130772866 - Will use the pattern ./log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
14:24:16,653 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e802ef9 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
14:24:16,653 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e802ef9 - Roll-over at midnight.
14:24:16,660 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e802ef9 - Setting initial period to Thu Feb 18 14:24:16 CET 2021
14:24:16,660 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e802ef9 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:16,660 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e802ef9 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:16,662 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:16,669 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbhigh_h3.log
14:24:16,670 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbhigh_h3.log]
14:24:16,670 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:17,224 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:17,247 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:17,247 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:17,248 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:17,248 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:17,248 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:17,248 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:17,249 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2b6faea6 - Registering current configuration as safe fallback point
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2021-02-18 14:24:17.253 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
2021-02-18 14:24:17.266 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
Java VM: 1.8.0_25
2021-02-18 14:24:17.267 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2021-02-18 14:24:17.267 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test3
2021-02-18 14:24:17.267 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-18 14:24:17.267 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kbhigh_h3.xml'
2021-02-18 14:24:17.438 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8152/8252
2021-02-18 14:24:17.439 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8152 communicating on port 8252 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8252/jndi/rmi://kb-test-har-004.kb.dk:8152/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-18 14:24:17.445 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-18 14:24:17.464 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:17.465 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:17.465 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-18 14:24:17.471 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-18 14:24:17.471 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2021-02-18 14:24:17.472 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2021-02-18 14:24:17.472 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-18 14:24:17.662 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-18 14:24:17.663 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@47af7f3d as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_11_HCS_KBHIGH_H3
2021-02-18 14:24:17.672 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_11_HCS_KBHIGH_H3']'
2021-02-18 14:24:17.675 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:17.682 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-18 14:24:17.694 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-18 14:24:18.620 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2021-02-18 14:24:18.696 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-18 14:24:18.697 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:18.697 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-18 14:24:18.697 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-18 14:24:18.701 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
2021-02-18 14:24:18.702 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-har-004.kb.dk-9341baf2-0d18-411a-a50e-161af4b6bd4e
2021-02-18 14:24:19.584 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/devel/Test3/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/devel/Test3/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
14:24:16,050 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_HarvestControllerApplication_kblow002_h3.xml] at [file:/home/devel/Test3/conf/logback_HarvestControllerApplication_kblow002_h3.xml]
14:24:16,472 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:16,481 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:16,509 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:16,538 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:16,611 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:16,615 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:16,649 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2130772866 - No compression will be used
14:24:16,651 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2130772866 - Will use the pattern ./log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log for the active file
14:24:16,653 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e802ef9 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log'.
14:24:16,653 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e802ef9 - Roll-over at midnight.
14:24:16,659 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e802ef9 - Setting initial period to Thu Feb 18 14:24:16 CET 2021
14:24:16,660 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e802ef9 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:16,660 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1e802ef9 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:16,661 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:16,667 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow002_h3.log
14:24:16,667 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow002_h3.log]
14:24:16,668 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:17,288 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:17,289 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:17,289 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:17,290 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:17,290 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:17,290 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:17,290 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:17,291 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2b6faea6 - Registering current configuration as safe fallback point
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2021-02-18 14:24:17.305 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
2021-02-18 14:24:17.318 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
Java VM: 1.8.0_25
2021-02-18 14:24:17.319 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java/jdk1.8.0_25_x64/jre
2021-02-18 14:24:17.319 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test3
2021-02-18 14:24:17.320 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-18 14:24:17.320 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_HarvestControllerApplication_kblow002_h3.xml'
2021-02-18 14:24:17.480 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8150/8250
2021-02-18 14:24:17.480 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8250/jndi/rmi://kb-test-har-004.kb.dk:8150/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-18 14:24:17.489 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-18 14:24:17.503 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:17.503 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:17.503 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-18 14:24:17.526 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-18 14:24:17.527 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY'
2021-02-18 14:24:17.527 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low'
2021-02-18 14:24:17.527 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-18 14:24:17.655 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-18 14:24:17.655 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@47af7f3d as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_11_HCS_KBLOW002_H3
2021-02-18 14:24:17.672 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_11_HCS_KBLOW002_H3']'
2021-02-18 14:24:17.673 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:17.675 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-18 14:24:17.691 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-18 14:24:18.623 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2021-02-18 14:24:18.702 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-18 14:24:18.703 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:18.703 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-18 14:24:18.703 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-18 14:24:18.707 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk
2021-02-18 14:24:18.708 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-har-004.kb.dk-013d0e01-986c-4ae1-a7d1-5d4f6e6438cc
2021-02-18 14:24:19.580 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
--------------------------------------------
STARTING MACHINE: devel@kb-test-acs-001.kb.dk
Starting all applications on: kb-test-acs-001.kb.dk
Starting linux application: IndexServerApplication
Starting linux application: ViewerProxyApplication
14:24:21,364 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_IndexServerApplication.xml] at [file:/home/devel/Test3/conf/logback_IndexServerApplication.xml]
14:24:21,655 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:21,655 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:21,662 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:21,675 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:21,732 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:21,736 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:21,764 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1307904972 - No compression will be used
14:24:21,765 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1307904972 - Will use the pattern ./log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log for the active file
14:24:21,768 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b26e945 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log'.
14:24:21,768 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b26e945 - Roll-over at midnight.
14:24:21,772 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b26e945 - Setting initial period to Thu Feb 18 14:24:21 CET 2021
14:24:21,772 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b26e945 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:21,772 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b26e945 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:21,774 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:21,777 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/IndexServerApplication.log
14:24:21,777 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/IndexServerApplication.log]
14:24:21,778 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:22,353 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:22,355 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:22,355 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:22,356 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:22,356 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:22,357 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:22,357 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:22,357 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@63a65a25 - Registering current configuration as safe fallback point
2021-02-18 14:24:22.362 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
2021-02-18 14:24:22.368 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
Java VM: 1.8.0_282
2021-02-18 14:24:22.369 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-18 14:24:22.369 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-18 14:24:22.369 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-18 14:24:22.370 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_IndexServerApplication.xml'
2021-02-18 14:24:22.510 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8351/8451
2021-02-18 14:24:22.511 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8351 communicating on port 8451 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8451/jndi/rmi://kb-test-acs-001.kb.dk:8351/jmxrmi
dk.netarkivet.harvester.indexserver.IndexServer Running
2021-02-18 14:24:22.514 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.indexserver.IndexServer Running
2021-02-18 14:24:22.522 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:22.522 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:22.526 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-18 14:24:22.528 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test3/cache/cdxdata'
2021-02-18 14:24:22.558 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-18 14:24:22.679 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@6e171cd7 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS
2021-02-18 14:24:22.691 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS']'
2021-02-18 14:24:22.692 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:22.693 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-18 14:24:22.699 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-18 14:24:23.523 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found
2021-02-18 14:24:23.549 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found
2021-02-18 14:24:23.670 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-18 14:24:23.671 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:23.671 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-18 14:24:23.671 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-18 14:24:23.676 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
2021-02-18 14:24:23.677 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-acs-001.kb.dk-2a884830-cb66-4569-aab4-b1676d2e5521
2021-02-18 14:24:24.535 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
2021-02-18 14:24:24.647 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Getting bitrepository message bus
2021-02-18 14:24:25.840 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository clients
2021-02-18 14:24:25.893 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2021-02-18 14:24:25.894 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxindex' uses directory '/home/devel/Test3/cache/cdxindex'
2021-02-18 14:24:25.901 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'crawllog' uses directory '/home/devel/Test3/cache/crawllog'
2021-02-18 14:24:25.903 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled
2021-02-18 14:24:25.904 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'dedupcrawllogindex' uses directory '/home/devel/Test3/cache/dedupcrawllogindex'
2021-02-18 14:24:25.905 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test3/cache/cdxdata'
2021-02-18 14:24:25.906 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2021-02-18 14:24:25.907 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'crawllog' uses directory '/home/devel/Test3/cache/crawllog'
2021-02-18 14:24:25.908 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled
2021-02-18 14:24:25.909 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'fullcrawllogindex' uses directory '/home/devel/Test3/cache/fullcrawllogindex'
2021-02-18 14:24:25.910 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test3/cache/cdxdata'
2021-02-18 14:24:25.911 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled
2021-02-18 14:24:25.912 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test3/cache/cdxindex/empty-cache.working
2021-02-18 14:24:25.912 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test3/cache/cdxindex/empty-cache.working' (thread = main)
2021-02-18 14:24:25.918 DEBUG d.n.common.utils.ProcessUtils.runProcess - Running external program: sort /home/devel/Test3/cache/cdxindex/empty-cache -o /home/devel/Test3/cache/cdxindex/empty-cache.unsorted with environment LANG=C
14:24:21,359 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_ViewerProxyApplication.xml] at [file:/home/devel/Test3/conf/logback_ViewerProxyApplication.xml]
14:24:21,660 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:21,661 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:21,667 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:21,681 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:21,731 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:21,736 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:21,760 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1307904972 - No compression will be used
14:24:21,761 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1307904972 - Will use the pattern ./log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log for the active file
14:24:21,764 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b26e945 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log'.
14:24:21,764 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b26e945 - Roll-over at midnight.
14:24:21,768 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b26e945 - Setting initial period to Thu Feb 18 14:24:21 CET 2021
14:24:21,768 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b26e945 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:21,768 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b26e945 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:21,770 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:21,772 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ViewerProxyApplication.log
14:24:21,772 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ViewerProxyApplication.log]
14:24:21,773 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:22,307 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:22,331 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:22,331 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:22,331 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:22,331 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:22,332 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:22,332 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:22,333 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@63a65a25 - Registering current configuration as safe fallback point
2021-02-18 14:24:22.337 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
2021-02-18 14:24:22.355 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
Java VM: 1.8.0_282
2021-02-18 14:24:22.355 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_282
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
2021-02-18 14:24:22.356 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.282.b08-1.el7_9.x86_64/jre
Working dir: /home/devel/Test3
2021-02-18 14:24:22.356 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-18 14:24:22.356 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_ViewerProxyApplication.xml'
2021-02-18 14:24:22.509 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8350/8450
2021-02-18 14:24:22.510 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8350 communicating on port 8450 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8450/jndi/rmi://kb-test-acs-001.kb.dk:8350/jmxrmi
dk.netarkivet.viewerproxy.ViewerProxy Running
2021-02-18 14:24:22.512 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.viewerproxy.ViewerProxy Running
2021-02-18 14:24:22.521 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-18 14:24:22.526 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:22.529 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:22.529 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-18 14:24:22.658 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@7193666c as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP
2021-02-18 14:24:22.668 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP']'
2021-02-18 14:24:22.668 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:22.669 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-18 14:24:22.673 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-18 14:24:23.422 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found
2021-02-18 14:24:23.470 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found
2021-02-18 14:24:23.585 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-18 14:24:23.585 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/devel/Test3/conf/bitmag_client_config
2021-02-18 14:24:23.585 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/devel/Test3/conf/bitmag_client_config/client.pem
2021-02-18 14:24:23.585 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-18 14:24:23.590 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk
2021-02-18 14:24:23.591 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-kb-test-acs-001.kb.dk-d3b93e57-e9a6-4fb9-99ab-2f2327717d8b
2021-02-18 14:24:24.266 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
2021-02-18 14:24:24.428 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Getting bitrepository message bus
2021-02-18 14:24:25.781 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository clients
2021-02-18 14:24:25.822 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'FULL_CRAWL_LOG' uses directory '/home/devel/Test3/cache/FULL_CRAWL_LOG'
2021-02-18 14:24:25.839 INFO d.n.viewerproxy.ARCArchiveAccess.<init> - Constructed instance of ARCArchiveAccess with TryToLookupUriAsFtp: false
2021-02-18 14:24:25.875 INFO dk.netarkivet.viewerproxy.WebProxy.<init> - Starting viewerproxy jetty on port 8076
--------------------------------------------
STARTING MACHINE: devel@kb-test-way-001.kb.dk
Starting all applications on: kb-test-way-001.kb.dk
Starting linux application: WaybackIndexerApplication
Starting linux application: AggregatorApplication
14:24:28,262 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_AggregatorApplication.xml] at [file:/home/devel/Test3/conf/logback_AggregatorApplication.xml]
14:24:28,689 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:28,697 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:28,732 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:28,812 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:29,073 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:29,099 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:29,208 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1004095028 - No compression will be used
14:24:29,217 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1004095028 - Will use the pattern ./log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log for the active file
14:24:29,237 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@58a90037 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log'.
14:24:29,237 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@58a90037 - Roll-over at midnight.
14:24:29,250 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@58a90037 - Setting initial period to Thu Feb 18 14:24:29 CET 2021
14:24:29,250 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@58a90037 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:29,250 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@58a90037 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:29,256 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:29,265 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/AggregatorApplication.log
14:24:29,265 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/AggregatorApplication.log]
14:24:29,270 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:30,688 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:30,700 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:30,700 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:30,700 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:30,700 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:30,710 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:30,710 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:30,711 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@74294adb - Registering current configuration as safe fallback point
2021-02-18 14:24:30.729 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.wayback.aggregator.AggregationWorker
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
2021-02-18 14:24:30.767 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.wayback.aggregator.AggregationWorker
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
Java VM: 1.8.0_25
2021-02-18 14:24:30.771 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
2021-02-18 14:24:30.772 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test3
2021-02-18 14:24:30.773 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-18 14:24:30.773 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_AggregatorApplication.xml'
2021-02-18 14:24:31.038 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-way-001.kb.dk' and JMX/RMI ports 9150/9250
2021-02-18 14:24:31.039 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 9150 communicating on port 9250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-way-001.kb.dk:9250/jndi/rmi://kb-test-way-001.kb.dk:9150/jmxrmi
dk.netarkivet.wayback.aggregator.AggregationWorker Running
2021-02-18 14:24:31.040 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.wayback.aggregator.AggregationWorker Running
2021-02-18 14:24:31.071 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:31.098 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:31.099 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-18 14:24:31.108 DEBUG d.n.w.aggregator.AggregationWorker.runAggregation - No new raw index files found in '/home/devel/Test3/batchOutputDir' skipping aggregation
14:24:28,448 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test3/conf/logback_WaybackIndexerApplication.xml] at [file:/home/devel/Test3/conf/logback_WaybackIndexerApplication.xml]
14:24:29,171 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:29,175 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:29,213 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:29,255 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:29,352 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:29,361 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:29,415 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@576936864 - No compression will be used
14:24:29,417 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@576936864 - Will use the pattern ./log/WaybackIndexerApplication.%d{yyyy-MM-dd}.%i.log for the active file
14:24:29,420 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@13c10b87 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/WaybackIndexerApplication.%d{yyyy-MM-dd}.%i.log'.
14:24:29,420 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@13c10b87 - Roll-over at midnight.
14:24:29,426 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@13c10b87 - Setting initial period to Thu Feb 18 14:24:29 CET 2021
14:24:29,426 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@13c10b87 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:29,426 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@13c10b87 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:29,428 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:29,431 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/WaybackIndexerApplication.log
14:24:29,431 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/WaybackIndexerApplication.log]
14:24:29,432 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:30,701 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:30,712 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:30,712 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:30,713 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:30,713 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:30,713 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:30,713 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:30,714 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@6a01e23 - Registering current configuration as safe fallback point
2021-02-18 14:24:30.734 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.wayback.indexer.WaybackIndexer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
2021-02-18 14:24:30.768 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.wayback.indexer.WaybackIndexer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
Java VM: 1.8.0_25
2021-02-18 14:24:30.769 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25
java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
2021-02-18 14:24:30.769 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre
Working dir: /home/devel/Test3
2021-02-18 14:24:30.770 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test3
2021-02-18 14:24:30.771 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test3/conf/settings_WaybackIndexerApplication.xml'
2021-02-18 14:24:31.033 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-way-001.kb.dk' and JMX/RMI ports 8151/8251
2021-02-18 14:24:31.034 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8151 communicating on port 8251 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://kb-test-way-001.kb.dk:8251/jndi/rmi://kb-test-way-001.kb.dk:8151/jmxrmi
dk.netarkivet.wayback.indexer.WaybackIndexer Running
2021-02-18 14:24:31.036 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.wayback.indexer.WaybackIndexer Running
2021-02-18 14:24:31.089 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:31.090 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:31.091 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-18 14:24:31.208 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-way-001.kb.dk
--------------------------------------------
--------------------------------------------
STARTING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk
Starting all applications on: sb-test-har-001.statsbiblioteket.dk
Starting linux application: HarvestControllerApplication_sbhigh_h3
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/netarkdv/Test3/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/netarkdv/Test3/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
14:24:32,295 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/netarkdv/Test3/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] at [file:/home/netarkdv/Test3/conf/logback_HarvestControllerApplication_sbhigh_h3.xml]
14:24:32,414 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
14:24:32,416 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:24:32,421 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:24:32,428 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:32,458 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:24:32,460 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
14:24:32,473 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1686100174 - No compression will be used
14:24:32,474 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1686100174 - Will use the pattern ./log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file
14:24:32,476 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@159f197 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log'.
14:24:32,476 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@159f197 - Roll-over at midnight.
14:24:32,479 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@159f197 - Setting initial period to Thu Feb 18 14:24:32 CET 2021
14:24:32,480 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@159f197 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:24:32,480 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@159f197 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:24:32,482 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:24:32,484 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_sbhigh_h3.log
14:24:32,484 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_sbhigh_h3.log]
14:24:32,487 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender]
14:24:32,744 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR]
14:24:32,746 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
14:24:32,746 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:24:32,746 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
14:24:32,746 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT]
14:24:32,747 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG
14:24:32,747 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:24:32,747 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@78aab498 - Registering current configuration as safe fallback point
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2021-02-18 14:24:32.750 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB
SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are
SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system.
SLF4J: See also http://www.slf4j.org/codes.html#replay
Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
2021-02-18 14:24:32.754 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer
Version: 5.7-IIPCH3-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/61d8dc988ab5ce94ac1937af95db4d3cc31abd78)
Java VM: 1.8.0_232
2021-02-18 14:24:32.755 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_232
java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
2021-02-18 14:24:32.755 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre
Working dir: /home/netarkdv/Test3
2021-02-18 14:24:32.755 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/netarkdv/Test3
2021-02-18 14:24:32.755 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/netarkdv/Test3/conf/settings_HarvestControllerApplication_sbhigh_h3.xml'
2021-02-18 14:24:32.891 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'sb-test-har-001.statsbiblioteket.dk' and JMX/RMI ports 8150/8250
2021-02-18 14:24:32.892 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8150 communicating on port 8250 using password file 'conf/jmxremote.password'.
Service URL is service:jmx:rmi://sb-test-har-001.statsbiblioteket.dk:8250/jndi/rmi://sb-test-har-001.statsbiblioteket.dk:8150/jmxrmi
dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-18 14:24:32.896 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running
2021-02-18 14:24:32.902 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer.
2021-02-18 14:24:32.902 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY'
2021-02-18 14:24:32.907 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:32.908 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ
2021-02-18 14:24:32.908 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676'
2021-02-18 14:24:32.910 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high'
2021-02-18 14:24:32.911 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free.
2021-02-18 14:24:33.064 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each getrequest after 300000 milliseconds.
2021-02-18 14:24:33.065 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@9597028 as listener to Test3_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3
2021-02-18 14:24:33.090 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test3_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3']'
2021-02-18 14:24:33.091 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/netarkdv/Test3/conf/bitmag_client_config
2021-02-18 14:24:33.091 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - No collectionId set so using default value Test3
2021-02-18 14:24:33.100 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder arcrepositoryTemp
2021-02-18 14:24:33.429 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist!
2021-02-18 14:24:33.476 DEBUG d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository
2021-02-18 14:24:33.476 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Reading bitrepository settings from /home/netarkdv/Test3/conf/bitmag_client_config
2021-02-18 14:24:33.477 INFO d.n.c.d.bitrepository.Bitrepository.<init> - keyfile: /home/netarkdv/Test3/conf/bitmag_client_config/client.pem
2021-02-18 14:24:33.477 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository settings.
2021-02-18 14:24:33.480 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): sb-test-har-001.statsbiblioteket.dk
2021-02-18 14:24:33.480 INFO d.n.c.d.bitrepository.Bitrepository.<init> - componentId: NetarchivesuiteClient-sb-test-har-001.statsbiblioteket.dk-a2db204e-496f-40e3-bd69-ca9da395a325
2021-02-18 14:24:33.981 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository security manager.
2021-02-18 14:24:34.163 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Getting bitrepository message bus
2021-02-18 14:24:34.563 INFO d.n.c.d.bitrepository.Bitrepository.<init> - Initialising bitrepository clients
2021-02-18 14:24:34.581 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection.
2021-02-18 14:24:34.583 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300
2021-02-18 14:24:34.583 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_high'
2021-02-18 14:24:34.585 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@5241cf67 as listener to Test3_COMMON_HCHAN_VAL_RESP
2021-02-18 14:24:34.641 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'HIGHPRIORITY'
2021-02-18 14:24:34.701 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'HIGHPRIORITY' is valid.
2021-02-18 14:24:34.704 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test3_COMMON_JOB_PARTIAL_HIGHPRIORITY']'
2021-02-18 14:24:34.704 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@5241cf67 as listener to Test3_COMMON_JOB_PARTIAL_HIGHPRIORITY
--------------------------------------------
Completed the script all_test.sh
Finished: SUCCESS
Console Output
Help us localize this page