Started by user Colin Rosenthal (csr) Building remotely on NetarchiveSuite in workspace /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Done Cloning the remote Git repository Cloning repository https://github.com/netarchivesuite/netarchivesuite.git > git init /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click # timeout=10 Fetching upstream changes from https://github.com/netarchivesuite/netarchivesuite.git > git --version # timeout=10 > git -c core.askpass=true fetch --tags --progress https://github.com/netarchivesuite/netarchivesuite.git +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/netarchivesuite/netarchivesuite.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/netarchivesuite/netarchivesuite.git # timeout=10 Fetching upstream changes from https://github.com/netarchivesuite/netarchivesuite.git > git -c core.askpass=true fetch --tags --progress https://github.com/netarchivesuite/netarchivesuite.git +refs/heads/*:refs/remotes/origin/* > git rev-parse refs/remotes/origin/NARK-2214-oom^{commit} # timeout=10 > git rev-parse refs/remotes/origin/origin/NARK-2214-oom^{commit} # timeout=10 Checking out Revision 1ecfd3917eea680d0c84a1809b54b87104643555 (refs/remotes/origin/NARK-2214-oom) > git config core.sparsecheckout # timeout=10 > git checkout -f 1ecfd3917eea680d0c84a1809b54b87104643555 > git rev-list 1ecfd3917eea680d0c84a1809b54b87104643555 # timeout=10 [NetarchiveSuite-Colin-1-Click] $ /bin/sh -xe /tmp/hudson3137203324023256114.sh + cd /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click + pwd /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click + ls -lart total 136 drwxrwxr-x. 20 cibuild02 cibuild02 4096 Jul 11 12:08 .. -rw-rw-r--. 1 cibuild02 cibuild02 748 Jul 11 12:09 .travis.yml drwxrwxr-x. 2 cibuild02 cibuild02 4096 Jul 11 12:09 .run -rw-rw-r--. 1 cibuild02 cibuild02 2055 Jul 11 12:09 README.md -rw-rw-r--. 1 cibuild02 cibuild02 4686 Jul 11 12:09 Narcana.md -rw-rw-r--. 1 cibuild02 cibuild02 816 Jul 11 12:09 LICENSE.txt -rw-rw-r--. 1 cibuild02 cibuild02 1283 Jul 11 12:09 .gitignore drwxrwxr-x. 3 cibuild02 cibuild02 4096 Jul 11 12:09 build-tools drwxrwxr-x. 5 cibuild02 cibuild02 4096 Jul 11 12:09 archive drwxrwxr-x. 5 cibuild02 cibuild02 4096 Jul 11 12:09 common drwxrwxr-x. 3 cibuild02 cibuild02 4096 Jul 11 12:09 hadoop-uber-jar-invoker drwxrwxr-x. 3 cibuild02 cibuild02 4096 Jul 11 12:09 hadoop-uber-jar drwxrwxr-x. 5 cibuild02 cibuild02 4096 Jul 11 12:09 deploy drwxrwxr-x. 10 cibuild02 cibuild02 4096 Jul 11 12:09 harvester drwxrwxr-x. 3 cibuild02 cibuild02 4096 Jul 11 12:09 integration-test drwxrwxr-x. 5 cibuild02 cibuild02 4096 Jul 11 12:09 monitor -rwxrwxr-x. 1 cibuild02 cibuild02 429 Jul 11 12:09 precommit.sh -rw-rw-r--. 1 cibuild02 cibuild02 39984 Jul 11 12:09 pom.xml drwxrwxr-x. 2 cibuild02 cibuild02 4096 Jul 11 12:09 quickstart-vagrant-environment -rw-rw-r--. 1 cibuild02 cibuild02 87 Jul 11 12:09 reset_gitignore_files.sh drwxrwxr-x. 3 cibuild02 cibuild02 4096 Jul 11 12:09 quickstart drwxrwxr-x. 16 cibuild02 cibuild02 4096 Jul 11 12:09 . drwxrwxr-x. 5 cibuild02 cibuild02 4096 Jul 11 12:09 wayback drwxrwxr-x. 8 cibuild02 cibuild02 4096 Jul 11 12:09 .git + rm -rf './lib/*' + rm -rf './deploy/distribution/target/*' Parsing POMs Established TCP socket on 46254 maven32-agent.jar already up to date maven32-interceptor.jar already up to date maven3-interceptor-commons.jar already up to date [NetarchiveSuite-Colin-1-Click] $ /bin/java -cp /home/cibuild02/maven32-agent.jar:/home/cibuild02/tools/hudson.tasks.Maven_MavenInstallation/Maven3.2/boot/plexus-classworlds-2.5.2.jar:/home/cibuild02/tools/hudson.tasks.Maven_MavenInstallation/Maven3.2/conf/logging jenkins.maven3.agent.Maven32Main /home/cibuild02/tools/hudson.tasks.Maven_MavenInstallation/Maven3.2 /home/cibuild02/slave.jar /home/cibuild02/maven32-interceptor.jar /home/cibuild02/maven3-interceptor-commons.jar 46254 <===[JENKINS REMOTING CAPACITY]===>channel started Executing Maven: -B -f /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml -U -DskipTests clean package [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:build-tools:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:archive-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:archive-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:bitpreservation-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:archive:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:netarchivesuite-test-utils:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:common-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:common-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:common:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:deploy-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:distribution:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:deploy-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:deploy:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvester-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3-extensions:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3-bundler:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3-controller:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3-monitor:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvest-scheduler:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvestchannel-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvestdefinition-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:history-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:qa-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvester-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvester:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:monitor-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:monitor-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:status-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:monitor:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:wayback-indexer:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:wayback-resourcestore:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:wayback-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:wayback:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:system-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:integration-test:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:hadoop-uber-jar:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:hadoop-uber-jar-invoker:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:netarchivesuite:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ line 929, column 17 [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] ------------------------------------------------------------------------ [INFO] Reactor Build Order: [INFO] [INFO] NetarchiveSuite [INFO] NetarchiveSuite - build-tools [INFO] NetarchiveSuite - common [INFO] NetarchiveSuite - test utils [INFO] NetarchiveSuite - common - core [INFO] NetarchiveSuite - common - test [INFO] NetarchiveSuite - archive [INFO] NetarchiveSuite - archive - core [INFO] NetarchiveSuite - harvester [INFO] NetarchiveSuite - harvester - core [INFO] NetarchiveSuite - archive - test [INFO] NetarchiveSuite - bitpreservation - webapp [INFO] NetarchiveSuite - Harvest Scheduler [INFO] NetarchiveSuite - monitor [INFO] NetarchiveSuite - monitor - core [INFO] NetarchiveSuite - wayback [INFO] NetarchiveSuite - wayback - indexer [INFO] NetarchiveSuite - deploy [INFO] NetarchiveSuite - deploy - core [INFO] NetarchiveSuite - harvester - heritrix3 [INFO] NetarchiveSuite - Heritrix3 Extensions [INFO] NetarchiveSuite - heritrix3 controller [INFO] hadoop-uber-jar [INFO] hadoop-uber-jar-invoker [INFO] NetarchiveSuite - Status - Webapp [INFO] NetarchiveSuite - qa - webapp [INFO] NetarchiveSuite - history - webapp [INFO] NetarchiveSuite - harvestDefinition - webapp [INFO] NetarchiveSuite - harvestChannel - webapp [INFO] NetarchiveSuite - heritrix3 monitor [INFO] NetarchiveSuite - deploy - distribution [INFO] NetarchiveSuite - deploy - test [INFO] NetarchiveSuite - Heritrix3 Bundler [INFO] NetarchiveSuite - harvester - test [INFO] NetarchiveSuite - monitor - test [INFO] NetarchiveSuite - wayback resourceStore [INFO] NetarchiveSuite - wayback - test [INFO] NetarchiveSuite - integration tests [INFO] NetarchiveSuite System test [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ netarchivesuite --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ netarchivesuite --- [INFO] Git info extracted, revision: '1ecfd39', branch: '', tag: '', commitsCount: '4724', buildnumber: 'UNNAMED.4724.1ecfd39' [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ netarchivesuite --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - build-tools 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ build-tools --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ build-tools --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ build-tools --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ build-tools --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/build-tools/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ build-tools --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ build-tools --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ build-tools --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ build-tools --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/build-tools/target/build-tools-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ build-tools --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/build-tools/target/build-tools-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - common 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ common --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ common --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ common --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - test utils 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ netarchivesuite-test-utils --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ netarchivesuite-test-utils --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/../target/jacoco.exec,append=true,excludes=**com.steadystate*:**com.gargoylesoftware* [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ netarchivesuite-test-utils --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ netarchivesuite-test-utils --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 6 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ netarchivesuite-test-utils --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ netarchivesuite-test-utils --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ netarchivesuite-test-utils --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ netarchivesuite-test-utils --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ netarchivesuite-test-utils --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/target/netarchivesuite-test-utils-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ netarchivesuite-test-utils --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/target/netarchivesuite-test-utils-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - common - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ common-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ common-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ common-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 18 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ common-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 198 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/webinterface/GUIWebServer.java:[49,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[33,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/JMXUtils.java:[50,33] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[54,73] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[59,26] sun.security.krb5.Config is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[68,49] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[73,26] sun.security.krb5.Config is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/JMXUtils.java:[105,63] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/JMXUtils.java:[107,21] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/is/hi/bok/deduplicator/CommandLineParser.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/is/hi/bok/deduplicator/CommandLineParser.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ common-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ common-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 11 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ common-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ common-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ common-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/target/common-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ common-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/target/common-core-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - common - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ common-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ common-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ common-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ common-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 44 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/java/dk/netarkivet/common/webinterface/WebinterfaceTestCase.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/java/dk/netarkivet/common/webinterface/WebinterfaceTestCase.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/java/dk/netarkivet/common/webinterface/WebinterfaceTestCase.java: Some input files use unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/java/dk/netarkivet/common/webinterface/WebinterfaceTestCase.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ common-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 386 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ common-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 78 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/test/java/dk/netarkivet/common/utils/StringUtilsTester.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/test/java/dk/netarkivet/common/utils/StringUtilsTester.java uses unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/test/java/dk/netarkivet/common/utils/StringUtilsTester.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ common-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ common-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ common-test --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/target/common-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ common-test --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/target/common-test-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - archive 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ archive --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ archive --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ archive --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - archive - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ archive-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ archive-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ archive-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 8 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ archive-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 93 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/main/java/dk/netarkivet/archive/tools/RunBatch.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/main/java/dk/netarkivet/archive/tools/RunBatch.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ archive-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ archive-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 12 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/test/java/dk/netarkivet/archive/arcrepository/distribute/ArcRepositoryServerTester.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/test/java/dk/netarkivet/archive/arcrepository/distribute/ArcRepositoryServerTester.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/test/java/dk/netarkivet/archive/arcrepository/distribute/ArcRepositoryServerTester.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ archive-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ archive-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ archive-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/target/archive-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ archive-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/target/archive-core-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvester 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvester --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvester --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvester --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvester - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/org/netarchivesuite/heritrix3-wrapper/1.0.5-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/org/netarchivesuite/heritrix3-wrapper/1.0.5-SNAPSHOT/maven-metadata.xml (2 KB at 1.2 KB/sec) [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvester-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ harvester-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvester-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 12 resources [INFO] Copying 3 resources to sql-migration/postgresql/ [INFO] Copying 1 resource to sql-migration/mysql/ [INFO] Copying 2 resources to sql-migration/derby/ [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvester-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 237 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/indexserver/distribute/IndexRequestServer.java:[69,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/indexserver/distribute/IndexRequestServer.java:[135,22] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/tools/CreateIndex.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/tools/CreateIndex.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/datamodel/H1HeritrixTemplate.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/datamodel/H1HeritrixTemplate.java uses unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/datamodel/H1HeritrixTemplate.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvester-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 16 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvester-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 12 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvester-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvester-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvester-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/harvester-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvester-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/harvester-core-7.4-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-jar-plugin:2.4:test-jar (default) @ harvester-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/harvester-core-7.4-SNAPSHOT-tests.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - archive - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ archive-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ archive-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ archive-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ archive-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ archive-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 280 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ archive-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 78 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/test/java/dk/netarkivet/archive/arcrepository/ArcRepositoryTesterLog.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/test/java/dk/netarkivet/archive/arcrepository/ArcRepositoryTesterLog.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/test/java/dk/netarkivet/archive/webinterface/BatchGUITester.java: Some input files use unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/test/java/dk/netarkivet/archive/webinterface/BatchGUITester.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ archive-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ archive-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ archive-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/target/archive-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ archive-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - bitpreservation - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ bitpreservation-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ bitpreservation-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ bitpreservation-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ bitpreservation-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ bitpreservation-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ bitpreservation-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ bitpreservation-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ bitpreservation-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [bitpreservation-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/target/BitPreservation] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/src/main/webapp] [INFO] Webapp assembled in [153 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/target/BitPreservation.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ bitpreservation-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Harvest Scheduler 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvest-scheduler --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ harvest-scheduler --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvest-scheduler --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvest-scheduler --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 14 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvest-scheduler --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvest-scheduler --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 5 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvest-scheduler --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvest-scheduler --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvest-scheduler --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/target/harvest-scheduler-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvest-scheduler --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/target/harvest-scheduler-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - monitor 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ monitor --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ monitor --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ monitor --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - monitor - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ monitor-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ monitor-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ monitor-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 7 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ monitor-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 23 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/main/java/dk/netarkivet/monitor/webinterface/JMXSummaryUtils.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/main/java/dk/netarkivet/monitor/webinterface/JMXSummaryUtils.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/main/java/dk/netarkivet/monitor/webinterface/JMXSummaryUtils.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ monitor-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ monitor-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 6 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/test/java/dk/netarkivet/monitor/jmx/JMXUtilsTester.java:[30,33] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/test/java/dk/netarkivet/monitor/jmx/JMXUtilsTester.java:[72,63] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/test/java/dk/netarkivet/monitor/jmx/JMXUtilsTester.java:[74,23] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ monitor-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ monitor-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ monitor-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/target/monitor-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ monitor-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/target/monitor-core-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - wayback 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - wayback - indexer 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback-indexer --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ wayback-indexer --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-indexer --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-indexer --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 27 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/ArchiveFile.java:[76,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/WaybackIndexer.java:[49,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/ArchiveFile.java:[253,51] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/WaybackIndexer.java:[96,22] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-indexer --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-indexer --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 2 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-indexer --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-indexer --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-indexer --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/target/wayback-indexer-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-indexer --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/target/wayback-indexer-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - deploy 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ deploy --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ deploy --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ deploy --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - deploy - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ deploy-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ deploy-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ deploy-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ deploy-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 16 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/src/main/java/dk/netarkivet/deploy/DeployApplication.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/src/main/java/dk/netarkivet/deploy/DeployApplication.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/src/main/java/dk/netarkivet/deploy/DeployApplication.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ deploy-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 8 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ deploy-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 3 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ deploy-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ deploy-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ deploy-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/target/deploy-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ deploy-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/target/deploy-core-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvester - heritrix3 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3 --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3 --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3 --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Heritrix3 Extensions 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-extensions --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix3-extensions --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix3-extensions --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 16 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/main/java/dk/netarkivet/harvester/harvesting/NasWARCProcessor.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/main/java/dk/netarkivet/harvester/harvesting/NasWARCProcessor.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix3-extensions --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix3-extensions --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 9 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/test/java/dk/netarkivet/harvester/harvesting/extractor/ExtractorOAITest.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/test/java/dk/netarkivet/harvester/harvesting/extractor/ExtractorOAITest.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/test/java/dk/netarkivet/harvester/harvesting/extractor/ExtractorOAITest.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ heritrix3-extensions --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-extensions --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix3-extensions --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/target/heritrix3-extensions-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3-extensions --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/target/heritrix3-extensions-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - heritrix3 controller 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-controller --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix3-controller --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix3-controller --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 23 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/src/main/java/dk/netarkivet/harvester/tools/CreateCDXMetadataFile.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/src/main/java/dk/netarkivet/harvester/tools/CreateCDXMetadataFile.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/src/main/java/dk/netarkivet/harvester/tools/CreateCDXMetadataFile.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix3-controller --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix3-controller --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 3 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ heritrix3-controller --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-controller --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix3-controller --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/target/heritrix3-controller-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3-controller --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/target/heritrix3-controller-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building hadoop-uber-jar 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-uber-jar --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-uber-jar --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-uber-jar --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 1 source file to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/src/main/java/MetadataIndexingApplication.java:[28,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hadoop-uber-jar --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hadoop-uber-jar --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-uber-jar --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ hadoop-uber-jar --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ hadoop-uber-jar --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/target/hadoop-uber-jar-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ hadoop-uber-jar --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/target/hadoop-uber-jar-7.4-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-shade-plugin:3.2.4:shade (default) @ hadoop-uber-jar --- [INFO] Including commons-cli:commons-cli:jar:1.4 in the shaded jar. [INFO] Including org.apache.commons:commons-math3:jar:3.1.1 in the shaded jar. [INFO] Including org.apache.httpcomponents:httpclient:jar:4.5.12 in the shaded jar. [INFO] Including commons-codec:commons-codec:jar:1.9 in the shaded jar. [INFO] Including commons-io:commons-io:jar:2.4 in the shaded jar. [INFO] Including commons-net:commons-net:jar:3.0.1 in the shaded jar. [INFO] Including commons-collections:commons-collections:jar:3.1 in the shaded jar. [INFO] Including log4j:log4j:jar:1.2.17 in the shaded jar. [INFO] Including javax.xml.bind:jaxb-api:jar:2.2.11 in the shaded jar. [INFO] Including org.apache.commons:commons-compress:jar:1.19 in the shaded jar. [INFO] Including javax.ws.rs:jsr311-api:jar:1.1.1 in the shaded jar. [INFO] Including aopalliance:aopalliance:jar:1.0 in the shaded jar. [INFO] Including org.codehaus.jettison:jettison:jar:1.1 in the shaded jar. [INFO] Including org.slf4j:slf4j-api:jar:1.7.25 in the shaded jar. [INFO] Including dnsjava:dnsjava:jar:3.3.1 in the shaded jar. [INFO] Including com.google.guava:guava:jar:27.0-jre in the shaded jar. [INFO] Including com.google.guava:failureaccess:jar:1.0 in the shaded jar. [INFO] Including com.google.guava:listenablefuture:jar:9999.0-empty-to-avoid-conflict-with-guava in the shaded jar. [INFO] Including com.google.code.findbugs:jsr305:jar:3.0.2 in the shaded jar. [INFO] Including org.checkerframework:checker-qual:jar:2.5.2 in the shaded jar. [INFO] Including com.google.errorprone:error_prone_annotations:jar:2.2.0 in the shaded jar. [INFO] Including com.google.j2objc:j2objc-annotations:jar:1.1 in the shaded jar. [INFO] Including org.codehaus.mojo:animal-sniffer-annotations:jar:1.17 in the shaded jar. [INFO] Including org.netarchivesuite:wayback-indexer:jar:7.4-SNAPSHOT in the shaded jar. [INFO] Including org.netarchivesuite:common-core:jar:7.4-SNAPSHOT in the shaded jar. [INFO] Including org.bitrepository.reference:bitrepository-core:jar:1.9 in the shaded jar. [INFO] Including org.bitrepository.reference:bitrepository-reference-settings:jar:1.9 in the shaded jar. [INFO] Including org.bitrepository.repository-settings:bitrepository-repository-settings-xsd:jar:12 in the shaded jar. [INFO] Including org.bitrepository.repository-settings:bitrepository-repository-settings-java:jar:12 in the shaded jar. [INFO] Including org.bitrepository:bitrepository-message-xml-xsd:jar:30 in the shaded jar. [INFO] Including org.bitrepository:bitrepository-message-xml-java:jar:30 in the shaded jar. [INFO] Including org.apache.activemq:activemq-client:jar:5.13.3 in the shaded jar. [INFO] Including org.apache.geronimo.specs:geronimo-jms_1.1_spec:jar:1.1.1 in the shaded jar. [INFO] Including org.fusesource.hawtbuf:hawtbuf:jar:1.11 in the shaded jar. [INFO] Including org.apache.geronimo.specs:geronimo-j2ee-management_1.1_spec:jar:1.0.1 in the shaded jar. [INFO] Including org.jvnet.jaxb2_commons:jaxb2-basics-runtime:jar:0.11.1 in the shaded jar. [INFO] Including org.bitrepository.reference:bitrepository-client:jar:1.9 in the shaded jar. [INFO] Including org.eclipse.jdt:ecj:jar:3.12.3 in the shaded jar. [INFO] Including org.apache.httpcomponents:httpcore:jar:4.4.1 in the shaded jar. [INFO] Including xalan:xalan:jar:2.7.1 in the shaded jar. [INFO] Including xalan:serializer:jar:2.7.1 in the shaded jar. [INFO] Including xml-apis:xml-apis:jar:1.4.01 in the shaded jar. [INFO] Including ant:ant:jar:1.6.5 in the shaded jar. [INFO] Including commons-fileupload:commons-fileupload:jar:1.3.3 in the shaded jar. [INFO] Including org.eclipse.jdt.core.compiler:ecj:jar:4.4.2 in the shaded jar. [INFO] Including dom4j:dom4j:jar:1.6.1 in the shaded jar. [INFO] Including javax.mail:mail:jar:1.4 in the shaded jar. [INFO] Including javax.activation:activation:jar:1.1 in the shaded jar. [INFO] Including commons-httpclient:commons-httpclient:jar:3.1 in the shaded jar. [INFO] Including org.jwat:jwat-common:jar:1.0.4 in the shaded jar. [INFO] Including org.jwat:jwat-arc:jar:1.0.4 in the shaded jar. [INFO] Including org.jwat:jwat-archive-common:jar:1.0.4 in the shaded jar. [INFO] Including org.jwat:jwat-gzip:jar:1.0.4 in the shaded jar. [INFO] Including org.jwat:jwat-warc:jar:1.0.4 in the shaded jar. [INFO] Including berkeleydb:je:jar:3.2.76 in the shaded jar. [INFO] Including org.archive.heritrix:heritrix-commons:jar:3.4.0-NAS-7.3 in the shaded jar. [INFO] Including org.apache.httpcomponents:httpmime:jar:4.5.13 in the shaded jar. [INFO] Including net.htmlparser.jericho:jericho-html:jar:2.6.1 in the shaded jar. [INFO] Including poi:poi:jar:2.5.1-final-20040804 in the shaded jar. [INFO] Including poi:poi-scratchpad:jar:2.5.1-final-20040804 in the shaded jar. [INFO] Including com.lowagie:itext:jar:1.3 in the shaded jar. [INFO] Including com.anotherbigidea:javaswf:jar:CVS-SNAPSHOT-1 in the shaded jar. [INFO] Including com.esotericsoftware:kryo:jar:1.01 in the shaded jar. [INFO] Including com.esotericsoftware:reflectasm:jar:0.8 in the shaded jar. [INFO] Including com.esotericsoftware:minlog:jar:1.2 in the shaded jar. [INFO] Including net.java.dev.jna:jna:jar:3.2.3 in the shaded jar. [INFO] Including com.jcraft:jsch:jar:0.1.52 in the shaded jar. [INFO] Including org.slf4j:jul-to-slf4j:jar:1.7.25 in the shaded jar. [INFO] Including org.slf4j:jcl-over-slf4j:jar:1.7.25 in the shaded jar. [INFO] Including ch.qos.logback:logback-core:jar:1.2.3 in the shaded jar. [INFO] Including org.gnu.inet:libidn:jar:0.6.5 in the shaded jar. [INFO] Including javassist:javassist:jar:3.9.0.GA in the shaded jar. [INFO] Including org.htmlparser:htmlparser:jar:1.6 in the shaded jar. [INFO] Including org.apache.commons:commons-lang3:jar:3.5 in the shaded jar. [INFO] Including org.netpreserve.openwayback:openwayback-core:jar:2.0.0 in the shaded jar. [INFO] Including org.netpreserve.openwayback:openwayback-cdx-server:jar:classes:2.0.0 in the shaded jar. [INFO] Including org.netpreserve.openwayback:openwayback-access-control-core:jar:1.0.2 in the shaded jar. [INFO] Including com.thoughtworks.xstream:xstream:jar:1.2.2 in the shaded jar. [INFO] Including xpp3:xpp3_min:jar:1.1.3.4.O in the shaded jar. [INFO] Including commons-dbcp:commons-dbcp:jar:1.2.2 in the shaded jar. [INFO] Including com.googlecode.juniversalchardet:juniversalchardet:jar:1.0.3 in the shaded jar. [INFO] Including org.beanshell:bsh:jar:2.0b4 in the shaded jar. [INFO] Including com.flagstone:transform:jar:3.0.2 in the shaded jar. [INFO] Including redis.clients:jedis:jar:2.0.0 in the shaded jar. [INFO] Including org.netpreserve.commons:webarchive-commons:jar:1.1.5 in the shaded jar. [INFO] Including it.unimi.dsi:dsiutils:jar:2.0.12 in the shaded jar. [INFO] Including it.unimi.dsi:fastutil:jar:6.5.2 in the shaded jar. [INFO] Including com.martiansoftware:jsap:jar:2.1 in the shaded jar. [INFO] Including commons-configuration:commons-configuration:jar:1.8 in the shaded jar. [INFO] Including org.netarchivesuite:harvester-core:jar:7.4-SNAPSHOT in the shaded jar. [INFO] Including org.netarchivesuite:heritrix3-wrapper:jar:1.0.5-SNAPSHOT in the shaded jar. [INFO] Including com.sun.xml.bind:jaxb-impl:jar:2.2.11 in the shaded jar. [INFO] Including com.sun.xml.bind:jaxb-core:jar:2.2.11 in the shaded jar. [INFO] Including com.sun.activation:javax.activation:jar:1.2.0 in the shaded jar. [INFO] Including jaxen:jaxen:jar:1.1.6 in the shaded jar. [INFO] Including commons-pool:commons-pool:jar:1.6 in the shaded jar. [INFO] Including commons-lang:commons-lang:jar:2.3 in the shaded jar. [INFO] Including jfree:jfreechart:jar:1.0.13 in the shaded jar. [INFO] Including jfree:jcommon:jar:1.0.16 in the shaded jar. [INFO] Including com.hp.gagawa:gagawa:jar:1.0.1 in the shaded jar. [INFO] Including javax.inject:javax.inject:jar:1 in the shaded jar. [INFO] Including commons-logging:commons-logging:jar:1.2 in the shaded jar. [INFO] Including org.postgresql:postgresql:jar:42.2.10 in the shaded jar. [INFO] Including com.antiaction:raptor-dbl:jar:0.1.0-RC2 in the shaded jar. [INFO] Including com.antiaction:common-servlet:jar:0.1.0-NAS in the shaded jar. [INFO] Including com.antiaction:common-html:jar:0.1.0-NAS in the shaded jar. [INFO] Including com.antiaction:common-template-engine:jar:0.3.0-NAS in the shaded jar. [INFO] Excluding com.sun.jersey:jersey-core:jar:1.19 from the shaded jar. [INFO] Excluding com.sun.jersey:jersey-server:jar:1.19 from the shaded jar. [INFO] Excluding org.bouncycastle:bcprov-jdk15on:jar:1.54 from the shaded jar. [INFO] Excluding org.bouncycastle:bcmail-jdk15on:jar:1.54 from the shaded jar. [INFO] Excluding org.bouncycastle:bcpkix-jdk15on:jar:1.54 from the shaded jar. [INFO] Excluding org.apache.tomcat.embed:tomcat-embed-core:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-annotations-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat.embed:tomcat-embed-logging-juli:jar:8.5.2 from the shaded jar. [INFO] Excluding org.apache.tomcat.embed:tomcat-embed-jasper:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat.embed:tomcat-embed-el:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-jasper:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-servlet-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-juli:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-el-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-util-scan:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-util:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-jasper-el:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-jsp-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jetty-sslengine:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jetty-ajp:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:servlet-api:jar:2.5-20081211 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jsp-2.1-glassfish:jar:2.1.v20091210 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jsp-2.1-jetty:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jsp-api-2.1-glassfish:jar:2.1.v20091210 from the shaded jar. [INFO] Excluding com.sun.messaging.mq:jms:jar:4.4.1 from the shaded jar. [INFO] Excluding com.sun.messaging.mq:imq:jar:4.4.1 from the shaded jar. [INFO] Excluding org.apache.lucene:lucene-core:jar:4.4.0 from the shaded jar. [INFO] Excluding org.apache.lucene:lucene-analyzers-common:jar:4.4.0 from the shaded jar. [INFO] Excluding fastutil:fastutil:jar:5.0.4 from the shaded jar. [INFO] Excluding org.springframework:spring-context:jar:5.3.3 from the shaded jar. [INFO] Excluding org.springframework:spring-aop:jar:5.3.3 from the shaded jar. [INFO] Excluding org.springframework:spring-expression:jar:5.3.3 from the shaded jar. [INFO] Excluding org.slf4j:log4j-over-slf4j:jar:1.7.25 from the shaded jar. [INFO] Excluding ch.qos.logback:logback-classic:jar:1.2.3 from the shaded jar. [INFO] Excluding org.apache.derby:derbyclient:jar:10.12.1.1 from the shaded jar. [INFO] Excluding org.apache.derby:derby:jar:10.12.1.1 from the shaded jar. [INFO] Excluding org.apache.derby:derbytools:jar:10.12.1.1 from the shaded jar. [INFO] Excluding org.springframework:spring-web:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding org.springframework:spring-webmvc:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding org.springframework:spring-context-support:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding javax.servlet:jstl:jar:1.2 from the shaded jar. [INFO] Excluding org.springframework:spring-core:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding org.springframework:spring-asm:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding org.springframework:spring-beans:jar:3.0.6.RELEASE from the shaded jar. [WARNING] failureaccess-1.0.jar, guava-27.0-jre.jar define 2 overlapping classes: [WARNING] - com.google.common.util.concurrent.internal.InternalFutureFailureAccess [WARNING] - com.google.common.util.concurrent.internal.InternalFutures [WARNING] ecj-3.12.3.jar, ecj-4.4.2.jar define 600 overlapping classes and resources: [WARNING] - META-INF/eclipse.inf [WARNING] - about.html [WARNING] - ecj.1 [WARNING] - org.eclipse.jdt.core.BuildJarIndex [WARNING] - org.eclipse.jdt.core.CheckDebugAttributes [WARNING] - org.eclipse.jdt.core.JDTCompilerAdapter [WARNING] - org.eclipse.jdt.core.JDTCompilerAdapter$1 [WARNING] - org.eclipse.jdt.core.compiler.CategorizedProblem [WARNING] - org.eclipse.jdt.core.compiler.CharOperation [WARNING] - org.eclipse.jdt.core.compiler.CompilationProgress [WARNING] - 590 more... [WARNING] jaxen-1.1.6.jar, xml-apis-1.4.01.jar define 1 overlapping classes: [WARNING] - org.w3c.dom.UserDataHandler [WARNING] activation-1.1.jar, javax.activation-1.2.0.jar define 40 overlapping classes and resources: [WARNING] - META-INF/mailcap.default [WARNING] - META-INF/mimetypes.default [WARNING] - com.sun.activation.registries.LineTokenizer [WARNING] - com.sun.activation.registries.LogSupport [WARNING] - com.sun.activation.registries.MailcapFile [WARNING] - com.sun.activation.registries.MailcapParseException [WARNING] - com.sun.activation.registries.MailcapTokenizer [WARNING] - com.sun.activation.registries.MimeTypeEntry [WARNING] - com.sun.activation.registries.MimeTypeFile [WARNING] - com.sun.activation.viewers.ImageViewer [WARNING] - 30 more... [WARNING] heritrix-commons-3.4.0-NAS-7.3.jar, webarchive-commons-1.1.5.jar define 1 overlapping classes: [WARNING] - org.archive.util.Base32 [WARNING] commons-logging-1.2.jar, jcl-over-slf4j-1.7.25.jar define 6 overlapping classes: [WARNING] - org.apache.commons.logging.Log [WARNING] - org.apache.commons.logging.LogConfigurationException [WARNING] - org.apache.commons.logging.LogFactory [WARNING] - org.apache.commons.logging.impl.NoOpLog [WARNING] - org.apache.commons.logging.impl.SimpleLog [WARNING] - org.apache.commons.logging.impl.SimpleLog$1 [WARNING] maven-shade-plugin has detected that some class files are [WARNING] present in two or more JARs. When this happens, only one [WARNING] single version of the class is copied to the uber jar. [WARNING] Usually this is not harmful and you can skip these warnings, [WARNING] otherwise try to manually exclude artifacts based on [WARNING] mvn dependency:tree -Ddetail=true and the above output. [WARNING] See http://maven.apache.org/plugins/maven-shade-plugin/ [INFO] Attaching shaded artifact. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building hadoop-uber-jar-invoker 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-uber-jar-invoker --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-uber-jar-invoker --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-uber-jar-invoker --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hadoop-uber-jar-invoker --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hadoop-uber-jar-invoker --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-uber-jar-invoker --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ hadoop-uber-jar-invoker --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ hadoop-uber-jar-invoker --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/target/hadoop-uber-jar-invoker-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ hadoop-uber-jar-invoker --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/target/hadoop-uber-jar-invoker-7.4-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-assembly-plugin:2.4.1:single (default) @ hadoop-uber-jar-invoker --- [INFO] Reading assembly descriptor: src/main/assembly/assembly.xml [INFO] Copying files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/target/hadoop-uber-jar-invoker-7.4-SNAPSHOT [WARNING] Assembly file: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/target/hadoop-uber-jar-invoker-7.4-SNAPSHOT is not a regular file (it may be a directory). It cannot be attached to the project build for installation or deployment. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Status - Webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ status-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ status-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ status-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ status-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ status-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ status-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ status-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ status-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [status-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/target/Status] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/src/main/webapp] [INFO] Webapp assembled in [82 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/target/Status.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ status-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - qa - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ qa-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ qa-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ qa-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ qa-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ qa-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ qa-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ qa-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ qa-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [qa-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/target/QA] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/src/main/webapp] [INFO] Webapp assembled in [26 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/target/QA.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ qa-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - history - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ history-gui --- [INFO] [INFO] --- maven-resources-plugin:3.2.0:copy-resources (copy-h3-resources) @ history-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Using 'UTF-8' encoding to copy filtered properties files. [INFO] Copying 16 resources [INFO] [INFO] --- maven-resources-plugin:3.2.0:resources (default-resources) @ history-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Using 'UTF-8' encoding to copy filtered properties files. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ history-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:3.2.0:testResources (default-testResources) @ history-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Using 'UTF-8' encoding to copy filtered properties files. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ history-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ history-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ history-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ history-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [history-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/target/History] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/src/main/webapp] [INFO] Webapp assembled in [99 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/target/History.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ history-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvestDefinition - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvestdefinition-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvestdefinition-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvestdefinition-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvestdefinition-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvestdefinition-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvestdefinition-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvestdefinition-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ harvestdefinition-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [harvestdefinition-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/target/HarvestDefinition] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/src/main/webapp] [INFO] Webapp assembled in [92 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/target/HarvestDefinition.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvestdefinition-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvestChannel - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvestchannel-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvestchannel-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvestchannel-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvestchannel-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvestchannel-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvestchannel-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvestchannel-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ harvestchannel-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [harvestchannel-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/target/HarvestChannel] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/src/main/webapp] [INFO] Webapp assembled in [10 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/target/HarvestChannel.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvestchannel-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - heritrix3 monitor 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap-agent-tomcat/0.2.0-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap-agent-tomcat/0.2.0-SNAPSHOT/maven-metadata.xml (3 KB at 22.2 KB/sec) [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap/0.2.0-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap/0.2.0-SNAPSHOT/maven-metadata.xml (600 B at 29.3 KB/sec) [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap-core/0.2.0-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap-core/0.2.0-SNAPSHOT/maven-metadata.xml (2 KB at 73.6 KB/sec) [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-monitor --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix3-monitor --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix3-monitor --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 27 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix3-monitor --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix3-monitor --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 1 source file to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ heritrix3-monitor --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-monitor --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix3-monitor --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/heritrix3-monitor-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3-monitor --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/heritrix3-monitor-7.4-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-assembly-plugin:2.4.1:single (distro-assembly) @ heritrix3-monitor --- [INFO] Reading assembly descriptor: src/main/assembly/assembly.xml [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.eclipse.jetty.orbit:*:jar' o 'org.glassfish:*:jar' o 'org.glassfish.web:*:jar' o 'jdom:jdom:jar' o 'xom:xom:jar' o 'com.ibm.icu:icu4j:jar' o 'commons-configuration:commons-configuration:jar:1.6' o 'org.apache.httpcomponents:httpclient:jar:4.2.5' o 'org.apache.httpcomponents:httpcore:jar:4.2.4' [INFO] Building tar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/NetarchiveSuite-heritrix3-monitor-7.4-SNAPSHOT.tar.gz [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.eclipse.jetty.orbit:*:jar' o 'org.glassfish:*:jar' o 'org.glassfish.web:*:jar' o 'jdom:jdom:jar' o 'xom:xom:jar' o 'com.ibm.icu:icu4j:jar' o 'commons-configuration:commons-configuration:jar:1.6' o 'org.apache.httpcomponents:httpclient:jar:4.2.5' o 'org.apache.httpcomponents:httpcore:jar:4.2.4' [INFO] Building zip: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/NetarchiveSuite-heritrix3-monitor-7.4-SNAPSHOT.zip [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - deploy - distribution 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ distribution --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ distribution --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ distribution --- [INFO] [INFO] --- maven-assembly-plugin:2.4.1:single (distro-assembly) @ distribution --- [INFO] Reading assembly descriptor: src/main/assembly/distribution.xml [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.netarchivesuite:hadoop-uber-jar:*' [INFO] Building zip: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/distribution/target/NetarchiveSuite-7.4-SNAPSHOT.zip [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - deploy - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ deploy-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ deploy-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ deploy-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ deploy-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ deploy-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] Copying 502 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ deploy-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 10 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-test/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ deploy-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ deploy-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ deploy-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-test/target/deploy-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ deploy-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Heritrix3 Bundler 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-bundler --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-bundler --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3-bundler --- [INFO] [INFO] --- maven-assembly-plugin:2.4.1:single (distro-assembly) @ heritrix3-bundler --- [INFO] Reading assembly descriptor: src/main/assembly/distribution.xml [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/is/landsbokasafn/crawl-rss/crawl-rss/0.0.2-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/is/landsbokasafn/crawl-rss/crawl-rss/0.0.2-SNAPSHOT/maven-metadata.xml (2 KB at 28.8 KB/sec) [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.eclipse.jetty.orbit:*:jar' o 'org.glassfish:*:jar' o 'org.glassfish.web:*:jar' o 'org.ow2.asm:*:jar' o 'xom:xom:jar' o 'xerces:*:jar' o 'com.ibm.icu:icu4j:jar' o 'commons-configuration:commons-configuration:jar:1.6' o 'org.apache.httpcomponents:httpclient:jar:4.2.5' o 'org.apache.httpcomponents:httpcomponents-client:jar:4.2.5' o 'org.apache.httpcomponents:httpcore:jar:4.2.4' o '*/lib/httpclient-4.2.5.jar' o 'lib/httpclient-4.2.5.jar' [INFO] Building zip: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-bundler/target/NetarchiveSuite-heritrix3-bundler-7.4-SNAPSHOT.zip [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvester - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvester-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ harvester-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvester-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvester-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvester-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 14 resources [INFO] Copying 441 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvester-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 128 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/viewerproxy/ARCArchiveAccessTester.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/viewerproxy/ARCArchiveAccessTester.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/CombiningMultiFileBasedCacheTester.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/CombiningMultiFileBasedCacheTester.java uses unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/CombiningMultiFileBasedCacheTester.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvester-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvester-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvester-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/target/harvester-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvester-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - monitor - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ monitor-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ monitor-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ monitor-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ monitor-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ monitor-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 8 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ monitor-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 4 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ monitor-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ monitor-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ monitor-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/target/monitor-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ monitor-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - wayback resourceStore 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback-resourcestore --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ wayback-resourcestore --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-resourcestore --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-resourcestore --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 7 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-resourcestore --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-resourcestore --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 4 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-resourcestore --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-resourcestore --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-resourcestore --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/wayback-resourcestore-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-resourcestore --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/wayback-resourcestore-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - wayback - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ wayback-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 28 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 17 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/test/java/dk/netarkivet/wayback/hadoop/CDXMapperTester.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/test/java/dk/netarkivet/wayback/hadoop/CDXMapperTester.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/target/wayback-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - integration tests 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ integration-test --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ integration-test --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ integration-test --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite System test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ system-test --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ system-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ system-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ system-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 22 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ system-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 34 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java uses unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ system-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ system-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ system-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/target/system-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ system-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] NetarchiveSuite .................................... SUCCESS [ 4.644 s] [INFO] NetarchiveSuite - build-tools ...................... SUCCESS [ 4.306 s] [INFO] NetarchiveSuite - common ........................... SUCCESS [ 0.171 s] [INFO] NetarchiveSuite - test utils ....................... SUCCESS [ 6.090 s] [INFO] NetarchiveSuite - common - core .................... SUCCESS [ 28.451 s] [INFO] NetarchiveSuite - common - test .................... SUCCESS [ 14.537 s] [INFO] NetarchiveSuite - archive .......................... SUCCESS [ 0.252 s] [INFO] NetarchiveSuite - archive - core ................... SUCCESS [ 13.588 s] [INFO] NetarchiveSuite - harvester ........................ SUCCESS [ 0.129 s] [INFO] NetarchiveSuite - harvester - core ................. SUCCESS [ 21.067 s] [INFO] NetarchiveSuite - archive - test ................... SUCCESS [ 10.543 s] [INFO] NetarchiveSuite - bitpreservation - webapp ......... SUCCESS [ 1.683 s] [INFO] NetarchiveSuite - Harvest Scheduler ................ SUCCESS [ 7.688 s] [INFO] NetarchiveSuite - monitor .......................... SUCCESS [ 0.140 s] [INFO] NetarchiveSuite - monitor - core ................... SUCCESS [ 5.856 s] [INFO] NetarchiveSuite - wayback .......................... SUCCESS [ 0.165 s] [INFO] NetarchiveSuite - wayback - indexer ................ SUCCESS [ 6.167 s] [INFO] NetarchiveSuite - deploy ........................... SUCCESS [ 0.108 s] [INFO] NetarchiveSuite - deploy - core .................... SUCCESS [ 8.494 s] [INFO] NetarchiveSuite - harvester - heritrix3 ............ SUCCESS [ 0.124 s] [INFO] NetarchiveSuite - Heritrix3 Extensions ............. SUCCESS [ 7.191 s] [INFO] NetarchiveSuite - heritrix3 controller ............. SUCCESS [ 10.057 s] [INFO] hadoop-uber-jar .................................... SUCCESS [ 42.978 s] [INFO] hadoop-uber-jar-invoker ............................ SUCCESS [ 22.118 s] [INFO] NetarchiveSuite - Status - Webapp .................. SUCCESS [ 3.927 s] [INFO] NetarchiveSuite - qa - webapp ...................... SUCCESS [ 0.578 s] [INFO] NetarchiveSuite - history - webapp ................. SUCCESS [ 4.315 s] [INFO] NetarchiveSuite - harvestDefinition - webapp ....... SUCCESS [ 2.620 s] [INFO] NetarchiveSuite - harvestChannel - webapp .......... SUCCESS [ 0.555 s] [INFO] NetarchiveSuite - heritrix3 monitor ................ SUCCESS [01:05 min] [INFO] NetarchiveSuite - deploy - distribution ............ SUCCESS [01:06 min] [INFO] NetarchiveSuite - deploy - test .................... SUCCESS [ 8.377 s] [INFO] NetarchiveSuite - Heritrix3 Bundler ................ SUCCESS [ 41.671 s] [INFO] NetarchiveSuite - harvester - test ................. SUCCESS [ 14.424 s] [INFO] NetarchiveSuite - monitor - test ................... SUCCESS [ 4.579 s] [INFO] NetarchiveSuite - wayback resourceStore ............ SUCCESS [ 6.444 s] [INFO] NetarchiveSuite - wayback - test ................... SUCCESS [ 5.739 s] [INFO] NetarchiveSuite - integration tests ................ SUCCESS [ 0.118 s] [INFO] NetarchiveSuite System test ........................ SUCCESS [ 3.449 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 07:53 min [INFO] Finished at: 2022-07-11T12:17:15+02:00 [INFO] Final Memory: 120M/306M [INFO] ------------------------------------------------------------------------ [NetarchiveSuite-Colin-1-Click] $ /bin/bash /tmp/hudson3766059783249182803.sh channel stopped Do a total cleanup of system Test6 start tunning cleanup script end part of script -------------------------------------------- KILLING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk Killing all applications on: sb-test-har-001.statsbiblioteket.dk Killing linux application: HarvestControllerApplication_sbhigh_h3 -------------------------------------------- -------------------------------------------- KILLING MACHINE: devel@kb-test-adm-001.kb.dk Killing all applications on: kb-test-adm-001.kb.dk Killing linux application: GUIApplication Killing linux application: ArcRepositoryApplication Killing linux application: HarvestJobManagerApplication -------------------------------------------- KILLING MACHINE: devel@kb-test-har-003.kb.dk Killing all applications on: kb-test-har-003.kb.dk Killing linux application: HarvestControllerApplication_kblow001_h3 -------------------------------------------- KILLING MACHINE: devel@kb-test-har-005.kb.dk Killing all applications on: kb-test-har-005.kb.dk Killing linux application: HarvestControllerApplication_browser_1 Killing linux application: HarvestControllerApplication_browser_2 -------------------------------------------- KILLING MACHINE: devel@kb-test-har-004.kb.dk Killing all applications on: kb-test-har-004.kb.dk Killing linux application: HarvestControllerApplication_kblow002_h3 Killing linux application: HarvestControllerApplication_kbhigh_h3 -------------------------------------------- KILLING MACHINE: devel@kb-test-acs-001.kb.dk Killing all applications on: kb-test-acs-001.kb.dk Killing linux application: IndexServerApplication Killing linux application: ViewerProxyApplication -------------------------------------------- KILLING MACHINE: devel@kb-test-way-001.kb.dk Killing all applications on: kb-test-way-001.kb.dk Killing linux application: WaybackIndexerApplication Killing linux application: AggregatorApplication -------------------------------------------- running cleanup_bitmag Resetting Collection Test6 Delete content in collection=Test6 12:18:21.407 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 12:18:21.811 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 12:18:21.868 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 12:18:22.875 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 12:18:22.888 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 12:18:22.889 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 12:18:23.030 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:18:23.032 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 12:18:23.875 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 12:18:24.004 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:18:24.005 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-6959] 12:18:24.007 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 12:18:24.007 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@49c7b90e' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6959' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 12:18:24.007 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6959' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@49c7b90e'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6959#1237825806'. 12:18:24.007 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6959#1237825806'. Checksum: Count: FileID: 12:18:24.029 INFO o.b.a.g.ConversationBasedGetChecksumsClient - Requesting the checksums for file '' with the specifications 'org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@32ee6fee[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)]null' with query [ContributorQuery{componentID='netarkiv-tape-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-disk-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-disk-devel-02, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-checksum-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-kbh-disk-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}]. 12:18:24.044 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 12:18:24.587 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent IdentifyPillarsForGetChecksumsRequest(8ea6c89d) collectionID Test6, destination topic://netarkiv-devel: FileIDs=AllFiles 12:18:24.588 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 8ea6c89d: GET_CHECKSUMS: IDENTIFY_REQUEST_SENT: , Identifying pillars for GetChecksums 12:18:25.149 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(8ea6c89d) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(Checksum operation available.) 12:18:25.182 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 8ea6c89d: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01 12:18:25.183 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 12:18:25.183 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01] 12:18:25.497 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(8ea6c89d) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 12:18:25.507 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 8ea6c89d: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01 12:18:25.508 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 12:18:25.508 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01] 12:18:25.854 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(8ea6c89d) collectionID Test6, from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.) 12:18:25.886 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 8ea6c89d: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01 12:18:25.886 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 12:18:25.886 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-tape-devel-01] 12:18:26.187 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(8ea6c89d) collectionID Test6, from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 12:18:26.187 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 8ea6c89d: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01 12:18:26.188 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 12:18:26.188 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02] 12:18:34.043 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 8ea6c89d: GET_CHECKSUMS: IDENTIFY_TIMEOUT: , Time has run out for looking up contributors The following contributors didn't respond: [netarkiv-disk-devel-02] 12:18:34.044 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 8ea6c89d: GET_CHECKSUMS: COMPONENT_FAILED: ContributorID netarkiv-disk-devel-02 ResponseCode: null, Timeout for identifying contributor 12:18:34.044 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 8ea6c89d: GET_CHECKSUMS: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-tape-devel-01, netarkiv-kbh-disk-devel-01, netarkiv-checksum-devel-01, netarkiv-disk-devel-01] 12:18:34.046 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 8ea6c89d: GET_CHECKSUMS: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], Sending GetFileIDsRequest's 12:18:34.359 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(8ea6c89d) collectionID Test6, destination queue://netarkiv-tape-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@32ee6fee[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00 12:18:34.744 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(8ea6c89d) collectionID Test6, destination queue://netarkiv-disk-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@32ee6fee[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00 12:18:35.112 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(8ea6c89d) collectionID Test6, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@32ee6fee[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00 12:18:35.319 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(8ea6c89d) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 12:18:35.322 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 8ea6c89d: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS 12:18:35.672 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(8ea6c89d) collectionID Test6, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@32ee6fee[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00 12:18:35.704 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(8ea6c89d) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED), NumberOfChecksums=2, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@36e8bd7c[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], PartialResult=false 12:18:35.778 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 12:18:35.778 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01] 12:18:35.968 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(8ea6c89d) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 12:18:35.979 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 8ea6c89d: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS 12:18:36.244 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(8ea6c89d) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED), NumberOfChecksums=2, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@550e392f[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], PartialResult=false 12:18:36.257 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 12:18:36.257 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-kbh-disk-devel-01] 12:18:36.551 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(8ea6c89d) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS(Starting to calculate checksums.) 12:18:36.559 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 8ea6c89d: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-checksum-devel-01, Starting to calculate checksums. 12:18:36.826 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(8ea6c89d) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_COMPLETED, NumberOfChecksums=2, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@418869cb[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], PartialResult=false 12:18:36.833 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 12:18:36.833 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-kbh-disk-devel-01] 12:18:37.123 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(8ea6c89d) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(Completed checksum retrieval.), NumberOfChecksums=2, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@11f7d39e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], PartialResult=false 12:18:37.129 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 12:18:37.129 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [] daae18d2c9d96e146bb214266109e00b 4 1-metadata-1.warc.gz 9b28e74c51e599c1b40ab4ea5905ece8 4 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz Deleting file FileID: with checksum Checksum: in collection Test6 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01 12:18:38.609 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 12:18:38.717 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 12:18:39.128 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 12:18:39.191 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 12:18:40.102 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 12:18:40.114 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 12:18:40.115 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 12:18:40.453 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:18:40.453 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 12:18:41.338 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 12:18:41.431 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:18:41.433 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-7183] 12:18:41.447 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 12:18:41.448 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7183' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 12:18:41.448 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7183' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7183#282265585'. 12:18:41.448 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7183#282265585'. 12:18:41.465 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. java.lang.IllegalArgumentException: String hexString, 'Checksum:', must be an even number of characters. at org.bitrepository.common.ArgumentValidator.checkTrue(ArgumentValidator.java:160) at org.bitrepository.common.utils.Base16Utils.encodeBase16(Base16Utils.java:64) at org.bitrepository.commandline.CommandLineClient.getChecksumDataForDeleteValidation(CommandLineClient.java:302) at org.bitrepository.commandline.DeleteFileCmd.deleteTheFile(DeleteFileCmd.java:125) at org.bitrepository.commandline.DeleteFileCmd.performOperation(DeleteFileCmd.java:107) at org.bitrepository.commandline.CommandLineClient.runCommand(CommandLineClient.java:68) at org.bitrepository.commandline.DeleteFileCmd.main(DeleteFileCmd.java:47) xargs: ssh: exited with status 255; aborting Deleting file 1-metadata-1.warc.gz with checksum daae18d2c9d96e146bb214266109e00b in collection Test6 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01 12:18:42.735 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 12:18:42.868 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 12:18:43.286 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 12:18:43.323 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 12:18:44.290 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 12:18:44.325 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 12:18:44.326 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 12:18:44.599 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:18:44.600 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 12:18:45.488 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 12:18:45.592 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:18:45.593 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-7257] 12:18:45.595 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 12:18:45.595 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7257' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 12:18:45.595 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7257' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7257#1297836716'. 12:18:45.596 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7257#1297836716'. 12:18:45.610 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 12:18:45.619 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 12:18:45.622 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-tape-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-38,-82,24,-46,-55,-39,110,20,107,-78,20,38,97,9,-32,11}, calculationTimestamp=2022-07-11T12:18:45.612+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 12:18:45.634 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 12:18:46.290 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(c1cb9790) collectionID Test6, to netarkiv-tape-devel-01, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz 12:18:46.290 DEBUG o.b.commandline.DeleteFileCmd - Received event: c1cb9790: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 12:18:46.716 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(c1cb9790) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.) 12:18:46.734 DEBUG o.b.c.c.ConversationEventMonitor - c1cb9790: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01 12:18:47.025 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(c1cb9790) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 12:18:47.037 DEBUG o.b.c.c.ConversationEventMonitor - c1cb9790: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01 12:18:47.260 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(c1cb9790) collectionID Test6, from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 12:18:47.261 DEBUG o.b.commandline.DeleteFileCmd - Received event: c1cb9790: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01 12:18:47.261 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 12:18:47.261 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: [] 12:18:47.262 DEBUG o.b.commandline.DeleteFileCmd - Received event: c1cb9790: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-tape-devel-01] 12:18:47.262 DEBUG o.b.commandline.DeleteFileCmd - Received event: c1cb9790: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-tape-devel-01], Sending request for deleting file 12:18:47.579 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(c1cb9790) collectionID Test6, to netarkiv-tape-devel-01, destination queue://netarkiv-tape-devel-01: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-38,-82,24,-46,-55,-39,110,20,107,-78,20,38,97,9,-32,11}, calculationTimestamp=2022-07-11T12:18:45.612+02:00] 12:18:48.264 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(c1cb9790) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 12:18:48.272 DEBUG o.b.commandline.DeleteFileCmd - Received event: c1cb9790: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS 12:18:48.595 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(c1cb9790) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED) 12:18:48.596 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 12:18:48.596 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: [] 12:18:48.596 DEBUG o.b.commandline.DeleteFileCmd - Complete: c1cb9790: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 12:18:48.597 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz': 12:18:48.597 DEBUG o.b.commandline.DeleteFileCmd - c1cb9790: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 12:18:49.895 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 12:18:50.000 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 12:18:50.272 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 12:18:50.309 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 12:18:51.012 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 12:18:51.046 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 12:18:51.047 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 12:18:51.215 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:18:51.216 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 12:18:52.213 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 12:18:52.349 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:18:52.350 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-7336] 12:18:52.371 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 12:18:52.371 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7336' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 12:18:52.371 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7336' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7336#1249875355'. 12:18:52.371 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7336#1249875355'. 12:18:52.384 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 12:18:52.389 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 12:18:52.391 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-38,-82,24,-46,-55,-39,110,20,107,-78,20,38,97,9,-32,11}, calculationTimestamp=2022-07-11T12:18:52.385+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 12:18:52.399 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 12:18:52.835 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(5b1e125a) collectionID Test6, to netarkiv-disk-devel-01, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz 12:18:52.836 DEBUG o.b.commandline.DeleteFileCmd - Received event: 5b1e125a: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 12:18:53.158 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(5b1e125a) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.) 12:18:53.184 DEBUG o.b.c.c.ConversationEventMonitor - 5b1e125a: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01 12:18:53.371 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(5b1e125a) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 12:18:53.392 DEBUG o.b.commandline.DeleteFileCmd - Received event: 5b1e125a: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01 12:18:53.393 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 12:18:53.393 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: [] 12:18:53.393 DEBUG o.b.commandline.DeleteFileCmd - Received event: 5b1e125a: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-disk-devel-01] 12:18:53.394 DEBUG o.b.commandline.DeleteFileCmd - Received event: 5b1e125a: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-disk-devel-01], Sending request for deleting file 12:18:53.825 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(5b1e125a) collectionID Test6, to netarkiv-disk-devel-01, destination queue://netarkiv-disk-devel-01: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-38,-82,24,-46,-55,-39,110,20,107,-78,20,38,97,9,-32,11}, calculationTimestamp=2022-07-11T12:18:52.385+02:00] 12:18:53.961 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(5b1e125a) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 12:18:53.966 DEBUG o.b.c.c.ConversationEventMonitor - 5b1e125a: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01 12:18:54.424 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(5b1e125a) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 12:18:54.432 DEBUG o.b.commandline.DeleteFileCmd - Received event: 5b1e125a: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS 12:18:54.724 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(5b1e125a) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED) 12:18:54.725 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 12:18:54.725 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: [] 12:18:54.725 DEBUG o.b.commandline.DeleteFileCmd - Complete: 5b1e125a: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 12:18:54.726 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz': 12:18:54.726 DEBUG o.b.commandline.DeleteFileCmd - 5b1e125a: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 12:18:56.062 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 12:18:56.199 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 12:18:56.495 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 12:18:56.554 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 12:18:57.575 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 12:18:57.610 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 12:18:57.610 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 12:18:57.799 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:18:57.800 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 12:18:58.862 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 12:18:59.008 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:18:59.009 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-7413] 12:18:59.023 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 12:18:59.023 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7413' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 12:18:59.023 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7413' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7413#1297836716'. 12:18:59.023 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7413#1297836716'. 12:18:59.070 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 12:18:59.076 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 12:18:59.077 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-checksum-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-38,-82,24,-46,-55,-39,110,20,107,-78,20,38,97,9,-32,11}, calculationTimestamp=2022-07-11T12:18:59.071+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 12:18:59.086 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 12:18:59.681 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(83181e4e) collectionID Test6, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz 12:18:59.682 DEBUG o.b.commandline.DeleteFileCmd - Received event: 83181e4e: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 12:18:59.999 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(83181e4e) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.) 12:19:00.012 DEBUG o.b.c.c.ConversationEventMonitor - 83181e4e: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01 12:19:00.234 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(83181e4e) collectionID Test6, from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.) 12:19:00.235 DEBUG o.b.commandline.DeleteFileCmd - Received event: 83181e4e: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01 12:19:00.236 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 12:19:00.236 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: [] 12:19:00.236 DEBUG o.b.commandline.DeleteFileCmd - Received event: 83181e4e: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-checksum-devel-01] 12:19:00.236 DEBUG o.b.commandline.DeleteFileCmd - Received event: 83181e4e: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01], Sending request for deleting file 12:19:00.774 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(83181e4e) collectionID Test6, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 12:19:00.806 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(83181e4e) collectionID Test6, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-38,-82,24,-46,-55,-39,110,20,107,-78,20,38,97,9,-32,11}, calculationTimestamp=2022-07-11T12:18:59.071+02:00] 12:19:00.812 DEBUG o.b.c.c.ConversationEventMonitor - 83181e4e: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01 12:19:01.002 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(83181e4e) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 12:19:01.009 DEBUG o.b.c.c.ConversationEventMonitor - 83181e4e: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01 12:19:01.220 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(83181e4e) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS 12:19:01.228 DEBUG o.b.commandline.DeleteFileCmd - Received event: 83181e4e: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-checksum-devel-01 12:19:01.472 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(83181e4e) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_COMPLETED 12:19:01.477 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 12:19:01.477 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: [] 12:19:01.477 DEBUG o.b.commandline.DeleteFileCmd - Complete: 83181e4e: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 12:19:01.477 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz': 12:19:01.477 DEBUG o.b.commandline.DeleteFileCmd - 83181e4e: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 12:19:03.725 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 12:19:03.898 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 12:19:04.272 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 12:19:04.296 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 12:19:04.986 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 12:19:05.010 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 12:19:05.011 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 12:19:05.169 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:19:05.170 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 12:19:06.456 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 12:19:06.584 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:19:06.585 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-7547] 12:19:06.603 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 12:19:06.603 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7547' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 12:19:06.603 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7547' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7547#1297836716'. 12:19:06.603 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7547#1297836716'. 12:19:06.637 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 12:19:06.642 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 12:19:06.642 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-kbh-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-38,-82,24,-46,-55,-39,110,20,107,-78,20,38,97,9,-32,11}, calculationTimestamp=2022-07-11T12:19:06.638+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 12:19:06.670 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 12:19:07.272 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(0de07e0a) collectionID Test6, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz 12:19:07.272 DEBUG o.b.commandline.DeleteFileCmd - Received event: 0de07e0a: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 12:19:07.599 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(0de07e0a) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.) 12:19:07.605 DEBUG o.b.commandline.DeleteFileCmd - Received event: 0de07e0a: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01 12:19:07.606 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 12:19:07.606 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: [] 12:19:07.606 DEBUG o.b.commandline.DeleteFileCmd - Received event: 0de07e0a: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01] 12:19:07.607 DEBUG o.b.commandline.DeleteFileCmd - Received event: 0de07e0a: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-kbh-disk-devel-01], Sending request for deleting file 12:19:08.011 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(0de07e0a) collectionID Test6, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-38,-82,24,-46,-55,-39,110,20,107,-78,20,38,97,9,-32,11}, calculationTimestamp=2022-07-11T12:19:06.638+02:00] 12:19:08.060 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(0de07e0a) collectionID Test6, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 12:19:08.061 DEBUG o.b.c.c.ConversationEventMonitor - 0de07e0a: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01 12:19:08.270 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(0de07e0a) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 12:19:08.271 DEBUG o.b.c.c.ConversationEventMonitor - 0de07e0a: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01 12:19:08.520 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(0de07e0a) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(Deleting..) 12:19:08.527 DEBUG o.b.commandline.DeleteFileCmd - Received event: 0de07e0a: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-kbh-disk-devel-01, Deleting.. 12:19:08.764 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(0de07e0a) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(1-metadata-1.warc.gz deleted.) 12:19:08.765 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 12:19:08.765 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: [] 12:19:08.765 DEBUG o.b.commandline.DeleteFileCmd - Complete: 0de07e0a: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 12:19:08.772 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz': 12:19:08.772 DEBUG o.b.commandline.DeleteFileCmd - 0de07e0a: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: Deleting file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz with checksum 9b28e74c51e599c1b40ab4ea5905ece8 in collection Test6 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01 12:19:10.017 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 12:19:10.134 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 12:19:10.430 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 12:19:10.470 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 12:19:11.181 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 12:19:11.193 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 12:19:11.194 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 12:19:11.348 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:19:11.348 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 12:19:12.340 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 12:19:12.401 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:19:12.403 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-7640] 12:19:12.404 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 12:19:12.404 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7640' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 12:19:12.404 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7640' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7640#1249875355'. 12:19:12.405 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7640#1249875355'. 12:19:12.419 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 12:19:12.424 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 12:19:12.425 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-tape-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-101,40,-25,76,81,-27,-103,-63,-76,10,-76,-22,89,5,-20,-24}, calculationTimestamp=2022-07-11T12:19:12.420+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 12:19:12.462 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 12:19:13.253 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(d6b17f4c) collectionID Test6, to netarkiv-tape-devel-01, destination topic://netarkiv-devel: FileID=1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz 12:19:13.254 DEBUG o.b.commandline.DeleteFileCmd - Received event: d6b17f4c: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 12:19:13.569 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(d6b17f4c) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.) 12:19:13.573 DEBUG o.b.c.c.ConversationEventMonitor - d6b17f4c: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01 12:19:13.824 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(d6b17f4c) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 12:19:13.826 DEBUG o.b.c.c.ConversationEventMonitor - d6b17f4c: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01 12:19:14.046 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(d6b17f4c) collectionID Test6, from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 12:19:14.047 DEBUG o.b.commandline.DeleteFileCmd - Received event: d6b17f4c: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01 12:19:14.047 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 12:19:14.047 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: [] 12:19:14.048 DEBUG o.b.commandline.DeleteFileCmd - Received event: d6b17f4c: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-tape-devel-01] 12:19:14.048 DEBUG o.b.commandline.DeleteFileCmd - Received event: d6b17f4c: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-tape-devel-01], Sending request for deleting file 12:19:14.282 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(d6b17f4c) collectionID Test6, to netarkiv-tape-devel-01, destination queue://netarkiv-tape-devel-01: FileID=1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-101,40,-25,76,81,-27,-103,-63,-76,10,-76,-22,89,5,-20,-24}, calculationTimestamp=2022-07-11T12:19:12.420+02:00] 12:19:14.777 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(d6b17f4c) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 12:19:14.789 DEBUG o.b.commandline.DeleteFileCmd - Received event: d6b17f4c: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS 12:19:15.107 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(d6b17f4c) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED) 12:19:15.109 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 12:19:15.109 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: [] 12:19:15.109 DEBUG o.b.commandline.DeleteFileCmd - Complete: d6b17f4c: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 12:19:15.110 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 12:19:15.110 DEBUG o.b.commandline.DeleteFileCmd - d6b17f4c: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 12:19:16.413 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 12:19:16.502 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 12:19:16.771 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 12:19:16.806 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 12:19:17.681 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 12:19:17.709 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 12:19:17.709 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 12:19:17.975 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:19:17.976 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 12:19:18.887 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 12:19:18.955 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:19:18.957 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-7718] 12:19:18.958 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 12:19:18.958 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7718' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 12:19:18.958 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7718' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7718#1249875355'. 12:19:18.958 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7718#1249875355'. 12:19:18.971 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 12:19:18.982 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 12:19:18.984 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-101,40,-25,76,81,-27,-103,-63,-76,10,-76,-22,89,5,-20,-24}, calculationTimestamp=2022-07-11T12:19:18.974+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 12:19:19.002 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 12:19:19.621 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(928bc089) collectionID Test6, to netarkiv-disk-devel-01, destination topic://netarkiv-devel: FileID=1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz 12:19:19.622 DEBUG o.b.commandline.DeleteFileCmd - Received event: 928bc089: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 12:19:20.076 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(928bc089) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.) 12:19:20.103 DEBUG o.b.c.c.ConversationEventMonitor - 928bc089: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01 12:19:20.629 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(928bc089) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 12:19:20.658 DEBUG o.b.commandline.DeleteFileCmd - Received event: 928bc089: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01 12:19:20.658 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 12:19:20.658 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: [] 12:19:20.659 DEBUG o.b.commandline.DeleteFileCmd - Received event: 928bc089: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-disk-devel-01] 12:19:20.659 DEBUG o.b.commandline.DeleteFileCmd - Received event: 928bc089: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-disk-devel-01], Sending request for deleting file 12:19:21.005 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(928bc089) collectionID Test6, to netarkiv-disk-devel-01, destination queue://netarkiv-disk-devel-01: FileID=1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-101,40,-25,76,81,-27,-103,-63,-76,10,-76,-22,89,5,-20,-24}, calculationTimestamp=2022-07-11T12:19:18.974+02:00] 12:19:21.273 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(928bc089) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 12:19:21.284 DEBUG o.b.c.c.ConversationEventMonitor - 928bc089: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01 12:19:21.642 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(928bc089) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 12:19:21.651 DEBUG o.b.commandline.DeleteFileCmd - Received event: 928bc089: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS 12:19:21.939 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(928bc089) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED) 12:19:21.944 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 12:19:21.944 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: [] 12:19:21.944 DEBUG o.b.commandline.DeleteFileCmd - Complete: 928bc089: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 12:19:21.944 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 12:19:21.944 DEBUG o.b.commandline.DeleteFileCmd - 928bc089: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 12:19:23.226 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 12:19:23.356 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 12:19:23.750 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 12:19:23.788 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 12:19:24.767 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 12:19:24.817 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 12:19:24.818 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 12:19:25.073 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:19:25.073 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 12:19:26.060 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 12:19:26.135 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:19:26.137 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-7800] 12:19:26.139 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 12:19:26.140 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7800' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 12:19:26.140 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7800' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7800#1297836716'. 12:19:26.140 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7800#1297836716'. 12:19:26.155 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 12:19:26.163 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 12:19:26.165 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-checksum-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-101,40,-25,76,81,-27,-103,-63,-76,10,-76,-22,89,5,-20,-24}, calculationTimestamp=2022-07-11T12:19:26.157+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 12:19:26.178 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 12:19:26.683 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(4e36ca2b) collectionID Test6, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel: FileID=1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz 12:19:26.684 DEBUG o.b.commandline.DeleteFileCmd - Received event: 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 12:19:27.133 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(4e36ca2b) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.) 12:19:27.153 DEBUG o.b.c.c.ConversationEventMonitor - 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01 12:19:27.421 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(4e36ca2b) collectionID Test6, from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.) 12:19:27.434 DEBUG o.b.commandline.DeleteFileCmd - Received event: 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01 12:19:27.435 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 12:19:27.435 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: [] 12:19:27.435 DEBUG o.b.commandline.DeleteFileCmd - Received event: 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-checksum-devel-01] 12:19:27.436 DEBUG o.b.commandline.DeleteFileCmd - Received event: 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01], Sending request for deleting file 12:19:27.959 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(4e36ca2b) collectionID Test6, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileID=1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-101,40,-25,76,81,-27,-103,-63,-76,10,-76,-22,89,5,-20,-24}, calculationTimestamp=2022-07-11T12:19:26.157+02:00] 12:19:28.045 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(4e36ca2b) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 12:19:28.049 DEBUG o.b.c.c.ConversationEventMonitor - 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01 12:19:28.426 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(4e36ca2b) collectionID Test6, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 12:19:28.435 DEBUG o.b.c.c.ConversationEventMonitor - 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01 12:19:28.815 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(4e36ca2b) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS 12:19:28.822 DEBUG o.b.commandline.DeleteFileCmd - Received event: 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-checksum-devel-01 12:19:29.185 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(4e36ca2b) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_COMPLETED 12:19:29.186 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 12:19:29.187 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: [] 12:19:29.187 DEBUG o.b.commandline.DeleteFileCmd - Complete: 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 12:19:29.187 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 12:19:29.187 DEBUG o.b.commandline.DeleteFileCmd - 4e36ca2b: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 12:19:30.449 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 12:19:30.550 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 12:19:30.937 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 12:19:30.992 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 12:19:31.937 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 12:19:31.959 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 12:19:31.959 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 12:19:32.216 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:19:32.217 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 12:19:33.129 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 12:19:33.191 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 12:19:33.192 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-7878] 12:19:33.194 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 12:19:33.194 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7878' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 12:19:33.194 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7878' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7878#282265585'. 12:19:33.194 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-7878#282265585'. 12:19:33.206 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 12:19:33.211 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 12:19:33.212 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-kbh-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@25084a1e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@156b88f5[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-101,40,-25,76,81,-27,-103,-63,-76,10,-76,-22,89,5,-20,-24}, calculationTimestamp=2022-07-11T12:19:33.207+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 12:19:33.222 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 12:19:33.859 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(2c0975e6) collectionID Test6, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel: FileID=1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz 12:19:33.859 DEBUG o.b.commandline.DeleteFileCmd - Received event: 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 12:19:34.293 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(2c0975e6) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.) 12:19:34.315 DEBUG o.b.commandline.DeleteFileCmd - Received event: 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01 12:19:34.316 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 12:19:34.316 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: [] 12:19:34.317 DEBUG o.b.commandline.DeleteFileCmd - Received event: 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01] 12:19:34.318 DEBUG o.b.commandline.DeleteFileCmd - Received event: 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-kbh-disk-devel-01], Sending request for deleting file 12:19:34.961 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(2c0975e6) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 12:19:35.188 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(2c0975e6) collectionID Test6, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileID=1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@25084a1e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@156b88f5[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-101,40,-25,76,81,-27,-103,-63,-76,10,-76,-22,89,5,-20,-24}, calculationTimestamp=2022-07-11T12:19:33.207+02:00] 12:19:35.189 DEBUG o.b.c.c.ConversationEventMonitor - 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01 12:19:35.468 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(2c0975e6) collectionID Test6, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 12:19:35.477 DEBUG o.b.c.c.ConversationEventMonitor - 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01 12:19:35.754 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(2c0975e6) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(Deleting..) 12:19:35.759 DEBUG o.b.commandline.DeleteFileCmd - Received event: 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-kbh-disk-devel-01, Deleting.. 12:19:36.269 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(2c0975e6) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz deleted.) 12:19:36.270 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 12:19:36.270 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: [] 12:19:36.270 DEBUG o.b.commandline.DeleteFileCmd - Complete: 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 12:19:36.270 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 12:19:36.270 DEBUG o.b.commandline.DeleteFileCmd - 2c0975e6: DELETE_FILE for file 1-1-20220711093242097-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: calling cleanup_hosts running cleanup_hosts Removing installation on sb-test-har-001.statsbiblioteket.dk Removing installation on kb-test-har-003.kb.dk Removing installation on kb-test-har-004.kb.dk Removing installation on kb-test-har-005.kb.dk Removing installation on kb-test-adm-001.kb.dk Removing installation on kb-test-acs-001.kb.dk Removing installation on kb-test-way-001.kb.dk calling cleanup_linuxbarhosts running cleanup_linuxbarhosts Removing installation on sb-test-bar-001.statsbiblioteket.dk Removing bitarchive on sb-test-bar-001.statsbiblioteket.dk Calling cleanup_windowsbarhosts running cleanup_windowsbarhosts Removing C:\bitarkiv\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out Removing E:\bitarchive_1\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out Removing F:\bitarchive_2\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out Removing g:\bitarchive_3\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out Removing C:\Users\ba-devel\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out TESTX=Test6 PORT=8078 MAILRECEIVERS=csr@kb.dk VERSION=CSR DEPLOYCONF=deploy_config_bitmag.xml H3ZIP=CSR BITMAGCONF=/home/devel/bitmag_test_config/client_config Using bundler file /home/devel/nas_versions/bundler/NetarchiveSuite-heritrix3-bundler-CSR.zip Creating distribution files in /home/devel/prepared_software/Test6. Will read source files using encoding 'UTF-8' (defaulted) Branch in settings not found: common.warcRecordService Branch in settings not found: common.arcrepositoryClient.bitrepository.getFileIDsMaxResults Branch in settings not found: common.hadoop.kerberos Branch in settings not found: common.hadoop.username Branch in settings not found: common.hadoop.mapred.hadoopUberJar Branch in settings not found: common.hadoop.mapred.inputFilesParentDir Branch in settings not found: common.hadoop.mapred.cdxJob Branch in settings not found: common.hadoop.mapred.metadataExtractionJob Branch in settings not found: common.hadoop.mapred.metadataCDXExtractionJob Branch in settings not found: common.hadoop.mapred.crawlLogExtractionJob Branch in settings not found: common.fileResolver.class Branch in settings not found: common.fileResolver.baseUrl Branch in settings not found: common.fileResolver.keyfile Branch in settings not found: common.webinterface.metadata_cache_dir Branch in settings not found: harvester.harvesting.heritrix3.bundle Branch in settings not found: harvester.harvesting.heritrix3.certificate Branch in settings not found: harvester.harvesting.heritrix3.bundle Branch in settings not found: harvester.harvesting.heritrix3.certificate Branch in settings not found: harvester.harvesting.umbra Branch in settings not found: harvester.harvesting.heritrix3.bundle Branch in settings not found: harvester.harvesting.heritrix3.certificate Branch in settings not found: harvester.harvesting.umbra Branch in settings not found: harvester.harvesting.heritrix3.bundle Branch in settings not found: harvester.harvesting.heritrix3.bundle Machine 'kb-test-adm-001.kb.dk' configured with encoding 'UTF-8' (defaulted) Machine 'kb-test-har-003.kb.dk' configured with encoding 'UTF-8' (defaulted) NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip /home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks Machine 'kb-test-har-005.kb.dk' configured with encoding 'UTF-8' (defaulted) NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip /home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks Machine 'kb-test-har-004.kb.dk' configured with encoding 'UTF-8' (defaulted) NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip Machine 'kb-test-acs-001.kb.dk' configured with encoding 'UTF-8' (defaulted) Machine 'kb-test-way-001.kb.dk' configured with encoding 'UTF-8' (defaulted) Machine 'sb-test-har-001.statsbiblioteket.dk' configured with encoding 'UTF-8' (defaulted) /home/devel/prepared_software/Test6/NetarchiveSuite-heritrix3-bundler.zip -> /home/netarkdv/Test6/NetarchiveSuite-heritrix3-bundler.zip 12:25:05.439 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 12:25:05.444 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 12:25:05.445 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 12:25:05.445 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 12:25:05.445 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 12:25:05.445 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 12:25:05.447 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 12:25:05.447 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 12:25:05.447 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 12:25:05.447 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 12:25:05.448 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 12:25:05.448 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 12:25:05.536 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 12:25:05.542 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-adm-001.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-adm-001.kb.dk deleting devel@kb-test-adm-001.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-adm-001.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-har-003.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-har-003.kb.dk deleting devel@kb-test-har-003.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-har-003.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-har-005.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-har-005.kb.dk deleting devel@kb-test-har-005.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-har-005.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-har-004.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-har-004.kb.dk deleting devel@kb-test-har-004.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-har-004.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-acs-001.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-acs-001.kb.dk deleting devel@kb-test-acs-001.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-acs-001.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-way-001.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-way-001.kb.dk deleting devel@kb-test-way-001.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-way-001.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- -------------------------------------------- INSTALLING TO MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk copying NetarchiveSuite-CSR.zip to:sb-test-har-001.statsbiblioteket.dk deleting netarkdv@sb-test-har-001.statsbiblioteket.dk:/home/netarkdv/Test6/lib unzipping NetarchiveSuite-CSR.zip at:sb-test-har-001.statsbiblioteket.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- Initializing database for system Test6 + host=devel@kb-test-adm-001 + scp -p /home/devel/devel-config/scripts/db/setup_admindb.sh /home/devel/devel-config/scripts/db/setup_harvestdb.sh /home/devel/devel-config/scripts/db/teardown_admindb.sh /home/devel/devel-config/scripts/db/teardown_harvestdb.sh /home/devel/devel-config/scripts/../resources/harvestdb.testdata.sql /home/devel/devel-config/scripts/../resources/default_orderxml.cxml devel@kb-test-adm-001:bin/ + ssh devel@kb-test-adm-001 Pseudo-terminal will not be allocated because stdin is not a terminal. Dette system må kun tilgås af brugere autoriserede af Det Kgl. Bibliotek. This system is only to be used by users authorized by the Royal Danish Library. Destroying test6_admindb DROP DATABASE Creating empty test6_admindb CREATE DATABASE Initialising test6_admindb CREATE TABLE INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX CREATE INDEX CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE TABLE CREATE SEQUENCE ALTER TABLE Destroying test6_harvestdb DROP DATABASE CREATE DATABASE CREATE TABLE INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE GRANT CREATE TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX CREATE INDEX CREATE INDEX CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE INDEX GRANT CREATE TABLE GRANT CREATE TABLE CREATE INDEX GRANT CREATE TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT GRANT CREATE TABLE CREATE INDEX CREATE INDEX GRANT CREATE TABLE CREATE INDEX GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE INDEX CREATE INDEX CREATE INDEX GRANT CREATE TABLE CREATE INDEX CREATE INDEX GRANT CREATE TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT INSERT 0 1 INSERT 0 1 CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX GRANT GRANT ALTER TABLE ALTER TABLE ALTER TABLE ALTER TABLE CREATE TABLE ALTER TABLE CREATE INDEX CREATE SEQUENCE CREATE TABLE ALTER TABLE CREATE INDEX GRANT GRANT GRANT INSERT 0 1 INSERT 0 1 INSERT 0 1 SET SET SET SET SET SET SET SET SET COPY 16 COPY 16 setval -------- 17 (1 row) COPY 16 setval -------- 17 (1 row) COPY 3 setval -------- 17 (1 row) COPY 2 setval -------- 5 (1 row) COPY 4 setval -------- 4 (1 row) COPY 25 COPY 16 setval -------- 17 (1 row) 12:27:11.306 [MLog-Init-Reporter] INFO com.mchange.v2.log.MLog - MLog clients using slf4j logging. 12:27:11.321 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - Reading VM config for path list /com/mchange/v2/log/default-mchange-log.properties, /mchange-commons.properties, /c3p0.properties, hocon:/reference,/application,/c3p0,/, /mchange-log.properties, / 12:27:11.322 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping. 12:27:11.322 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping. 12:27:11.322 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping. 12:27:11.322 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping. 12:27:11.328 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping. 12:27:11.328 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping. 12:27:11.329 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping. 12:27:11.329 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping. 12:27:11.674 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.5.4 [built 23-March-2019 23:00:48 -0700; debug? true; trace: 10] 12:27:11.747 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ap1tpbdee1mefscm|f4168b8,name=10bdx52ap1tpbdee1mefscm|f4168b8 registered. 12:27:11.811 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ap1tpbdee1mefscm|f4168b8,name=10bdx52ap1tpbdee1mefscm|f4168b8 unregistered, in order to be reregistered after update. 12:27:11.811 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ap1tpbdee1mefscm|f4168b8,name=10bdx52ap1tpbdee1mefscm|f4168b8 registered. 12:27:11.833 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values: - minPoolSize=5 - maxPoolSize=20 - acquireIncrement=5 - maxStatements=0 - maxStatementsPerConnection=0 - idleConnTestPeriod=0 - idleConnTestQuery='null' - idleConnTestOnCheckin=false 12:27:11.894 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, dataSourceName -> 10bdx52ap1tpbdee1mefscm|f4168b8, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, extensions -> {}, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, forceUseNamedDriverClass -> false, identityToken -> 10bdx52ap1tpbdee1mefscm|f4168b8, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost:5432/test6_harvestdb, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 3600, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, preferredTestQuery -> null, privilegeSpawnedThreads -> false, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ] 12:27:11.919 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping. 12:27:11.919 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping. 12:27:11.919 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping. 12:27:11.919 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping. 12:27:11.919 [main] WARN com.mchange.v2.resourcepool.BasicResourcePool - Bad pool size config, start 3 < min 5. Using 5 as start. 12:27:11.922 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@5be6e01c config: [start -> 5; min -> 5; max -> 20; inc -> 5; num_acq_attempts -> 30; acq_attempt_delay -> 1000; check_idle_resources_delay -> 0; max_resource_age -> 3600000; max_idle_time -> 0; excess_max_idle_time -> 0; destroy_unreturned_resc_time -> 0; expiration_enforcement_delay -> 900000; break_on_acquisition_failure -> false; debug_store_checkout_exceptions -> false; force_synchronous_checkins -> false] 12:27:11.923 [main] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPoolManager - Created new pool for auth, username (masked): 'de******'. 12:27:11.923 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - acquire test -- pool size: 0; target_pool_size: 5; desired target? 1 12:27:11.923 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - awaitAvailable(): [unknown] 12:27:12.100 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@3911c2a7 [wrapping: SELECT version FROM schemaversions WHERE tablename = 'ordertemplates'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@1725dc0f [wrapping: null] 12:27:12.116 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@2145b572 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@15eb5ee5 [wrapping: null] 12:27:12.137 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@35ef1869 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@3c407114 [wrapping: null] The template 'default_orderxml' has now been updated. + set +x -------------------------------------------- STARTING MACHINE: devel@kb-test-adm-001.kb.dk Starting all applications on: kb-test-adm-001.kb.dk Starting linux application: GUIApplication Starting linux application: ArcRepositoryApplication Starting linux application: HarvestJobManagerApplication 12:27:13,915 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_ArcRepositoryApplication.xml] at [file:/home/devel/Test6/conf/logback_ArcRepositoryApplication.xml] 12:27:14,493 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:14,495 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:14,523 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:14,561 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:14,740 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:14,762 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:14,856 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1254344205 - No compression will be used 12:27:14,863 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1254344205 - Will use the pattern ./log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log for the active file 12:27:14,885 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4facf68f - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ArcRepositoryApplication.%d{yyyy-MM-dd}.%i.log'. 12:27:14,885 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4facf68f - Roll-over at midnight. 12:27:14,895 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4facf68f - Setting initial period to Mon Jul 11 12:27:14 CEST 2022 12:27:14,896 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4facf68f - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:14,896 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4facf68f - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:14,900 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:14,906 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ArcRepositoryApplication.log 12:27:14,907 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ArcRepositoryApplication.log] 12:27:14,911 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:16,471 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:16,481 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:16,481 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:16,484 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:16,484 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:16,486 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:16,486 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:16,490 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@76508ed1 - Registering current configuration as safe fallback point 2022-07-11 12:27:16.512 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.archive.arcrepository.ArcRepository Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 12:27:16.542 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.archive.arcrepository.ArcRepository Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_322 2022-07-11 12:27:16.545 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_322 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.322.b06-2.el8_5.x86_64/jre 2022-07-11 12:27:16.546 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.322.b06-2.el8_5.x86_64/jre Working dir: /home/devel/Test6 2022-07-11 12:27:16.547 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 12:27:16.549 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_ArcRepositoryApplication.xml' 2022-07-11 12:27:16.970 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8171/8271 2022-07-11 12:27:16.970 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8171 communicating on port 8271 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8271/jndi/rmi://kb-test-adm-001.kb.dk:8171/jmxrmi dk.netarkivet.archive.arcrepository.ArcRepository Running 2022-07-11 12:27:16.980 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.archive.arcrepository.ArcRepository Running 2022-07-11 12:27:17.025 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:17.029 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:17.031 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 12:27:17.740 INFO d.n.a.a.ArchiveDBConnection.initDataSource - Using jdbc url: jdbc:postgresql://localhost:5432/test6_admindb 2022-07-11 12:27:17.758 INFO d.n.a.a.ArchiveDBConnection.initDataSource - Connection pool initialized with the following values: - minPoolSize=5 - maxPoolSize=10 - acquireIncrement=5 - maxStatements=0 - maxStatementsPerConnection=0 - idleConnTestPeriod=30 - idleConnTestQuery='SELECT COUNT(*) FROM replica' - idleConnTestOnCheckin=false SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 12:27:14,140 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_GUIApplication.xml] at [file:/home/devel/Test6/conf/logback_GUIApplication.xml] 12:27:14,752 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:14,760 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:14,793 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:14,835 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:15,018 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:15,073 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:15,138 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@798981583 - No compression will be used 12:27:15,141 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@798981583 - Will use the pattern ./log/GUIApplication.%d{yyyy-MM-dd}.%i.log for the active file 12:27:15,150 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@747ddf94 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/GUIApplication.%d{yyyy-MM-dd}.%i.log'. 12:27:15,150 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@747ddf94 - Roll-over at midnight. 12:27:15,160 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@747ddf94 - Setting initial period to Mon Jul 11 12:27:15 CEST 2022 12:27:15,161 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@747ddf94 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:15,161 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@747ddf94 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:15,166 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:15,178 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/GUIApplication.log 12:27:15,178 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/GUIApplication.log] 12:27:15,182 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:16,562 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:16,572 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:16,572 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:16,573 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:16,573 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:16,573 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:16,573 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:16,581 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@35e2d654 - Registering current configuration as safe fallback point SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder] 2022-07-11 12:27:16.600 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.common.webinterface.GUIWebServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 12:27:16.627 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.common.webinterface.GUIWebServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_322 2022-07-11 12:27:16.633 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_322 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.322.b06-2.el8_5.x86_64/jre 2022-07-11 12:27:16.636 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.322.b06-2.el8_5.x86_64/jre Working dir: /home/devel/Test6 2022-07-11 12:27:16.636 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 12:27:16.638 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_GUIApplication.xml' 2022-07-11 12:27:16.971 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-adm-001.kb.dk' and JMX/RMI ports 8170/8270 2022-07-11 12:27:16.971 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-adm-001.kb.dk:8270/jndi/rmi://kb-test-adm-001.kb.dk:8170/jmxrmi dk.netarkivet.common.webinterface.GUIWebServer Running 2022-07-11 12:27:16.972 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.common.webinterface.GUIWebServer Running 2022-07-11 12:27:16.972 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war 2022-07-11 12:27:16.973 DEBUG dk.netarkivet.common.utils.Settings.debug - Value found in loaded data: dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection 2022-07-11 12:27:16.973 INFO d.n.common.webinterface.GUIWebServer. - Starting webserver. Port: 8078 deployment directories: 'webpages/HarvestDefinition.war,webpages/History.war,webpages/HarvestChannel.war,webpages/QA.war,webpages/Status.war' classes: 'dk.netarkivet.harvester.webinterface.DefinitionsSiteSection,dk.netarkivet.harvester.webinterface.HistorySiteSection,dk.netarkivet.harvester.webinterface.HarvestChannelSiteSection,dk.netarkivet.viewerproxy.webinterface.QASiteSection,dk.netarkivet.monitor.webinterface.StatusSiteSection' 2022-07-11 12:27:16.998 DEBUG d.n.common.webinterface.GUIWebServer. - GUI using tempdir /home/devel/Test6/tmpdircommon 2022-07-11 12:27:16.998 DEBUG d.n.common.webinterface.GUIWebServer. - GUI using basedir /home/devel/Test6 2022-07-11 12:27:16.998 INFO d.n.common.webinterface.GUIWebServer. - Deleted existing tempdir '/home/devel/Test6/tmpdircommon' 2022-07-11 12:27:17.003 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:17.003 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:17.004 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 12:27:17.143 INFO d.n.common.webinterface.GUIWebServer. - Scanning for taglibs is disabled as tomcat.util.scan.StandardJarScanFilter.jarsToSkip is unset. 12:27:13,923 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestJobManagerApplication.xml] at [file:/home/devel/Test6/conf/logback_HarvestJobManagerApplication.xml] 12:27:14,193 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:14,197 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:14,234 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:14,290 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:14,488 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:14,507 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:14,597 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1742920067 - No compression will be used 12:27:14,601 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1742920067 - Will use the pattern ./log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log for the active file 12:27:14,608 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5d47c63f - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestJobManagerApplication.%d{yyyy-MM-dd}.%i.log'. 12:27:14,608 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5d47c63f - Roll-over at midnight. 12:27:14,630 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5d47c63f - Setting initial period to Mon Jul 11 12:27:14 CEST 2022 12:27:14,631 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5d47c63f - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:14,631 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5d47c63f - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:14,636 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:14,643 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestJobManagerApplication.log 12:27:14,643 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestJobManagerApplication.log] 12:27:14,646 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:16,135 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:16,156 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:16,158 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:16,163 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:16,163 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:16,167 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:16,167 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:16,169 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@5ea434c8 - Registering current configuration as safe fallback point 2022-07-11 12:27:16.187 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay 2022-07-11 12:27:16.254 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:16.261 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:16.263 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 12:27:17.407 INFO d.n.h.datamodel.HarvestDBConnection.initDataSource - Connection pool initialized with the following values: - minPoolSize=5 - maxPoolSize=20 - acquireIncrement=5 - maxStatements=0 - maxStatementsPerConnection=0 - idleConnTestPeriod=0 - idleConnTestQuery='null' - idleConnTestOnCheckin=false 2022-07-11 12:27:17.580 WARN c.m.v.resourcepool.BasicResourcePool.log - Bad pool size config, start 3 < min 5. Using 5 as start. -------------------------------------------- STARTING MACHINE: devel@kb-test-har-003.kb.dk Starting all applications on: kb-test-har-003.kb.dk Starting linux application: HarvestControllerApplication_kblow001_h3 12:27:18,862 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml] 12:27:19,057 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:19,060 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:19,067 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:19,082 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:19,139 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:19,144 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:19,166 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - No compression will be used 12:27:19,167 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - Will use the pattern ./log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log for the active file 12:27:19,170 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log'. 12:27:19,170 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Roll-over at midnight. 12:27:19,174 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Setting initial period to Mon Jul 11 12:27:19 CEST 2022 12:27:19,174 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:19,174 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:19,176 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:19,178 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow001_h3.log 12:27:19,178 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow001_h3.log] 12:27:19,179 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:19,673 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:19,679 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:19,679 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:19,679 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:19,680 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:19,680 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:19,680 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:19,681 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@40ef3420 - Registering current configuration as safe fallback point 2022-07-11 12:27:19.687 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 12:27:19.695 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_332 2022-07-11 12:27:19.696 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre 2022-07-11 12:27:19.696 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-07-11 12:27:19.696 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 12:27:19.701 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow001_h3.xml' 2022-07-11 12:27:19.844 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-003.kb.dk' and JMX/RMI ports 8170/8270 2022-07-11 12:27:19.844 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-003.kb.dk:8270/jndi/rmi://kb-test-har-003.kb.dk:8170/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 12:27:19.852 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 12:27:19.859 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:19.860 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:19.862 INFO d.n.h.h.HarvestControllerServer. - Starting HarvestControllerServer. 2022-07-11 12:27:19.862 INFO d.n.h.h.HarvestControllerServer. - Bound to harvest channel 'LOWPRIORITY' 2022-07-11 12:27:19.862 INFO d.n.h.h.HarvestControllerServer. - Serverdir: 'harvester_low' 2022-07-11 12:27:19.863 INFO d.n.h.h.HarvestControllerServer. - Harvesting requires at least 400000000 bytes free. 2022-07-11 12:27:19.864 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 12:27:20.009 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:20.010 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:20.015 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-003.kb.dk 2022-07-11 12:27:21.447 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-07-11 12:27:21.448 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@56a4479a as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3 2022-07-11 12:27:21.456 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3']' 2022-07-11 12:27:21.457 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-07-11 12:27:21.457 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Using 'Test6' as default collectionID 2022-07-11 12:27:21.462 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Storing tempfiles in folder 'arcrepositoryTemp' 2022-07-11 12:27:21.483 INFO d.n.common.utils.HttpsClientBuilder. - Creating Aggressive retry handler for https queries. 2022-07-11 12:27:21.534 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist! 2022-07-11 12:27:21.557 DEBUG d.n.h.h.HarvestControllerServer. - Obtained JMS connection. 2022-07-11 12:27:21.558 INFO d.n.h.h.HarvestControllerServer. - SEND_READY_DELAY used by HarvestControllerServer is 300 2022-07-11 12:27:21.558 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_low' 2022-07-11 12:27:21.558 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@557a1e2d as listener to Test6_COMMON_HCHAN_VAL_RESP 2022-07-11 12:27:21.567 INFO d.n.h.h.HarvestControllerServer. - Requested to check the validity of harvest channel 'LOWPRIORITY' 2022-07-11 12:27:21.581 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'LOWPRIORITY' is valid. 2022-07-11 12:27:21.582 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY']' 2022-07-11 12:27:21.583 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@557a1e2d as listener to Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY -------------------------------------------- STARTING MACHINE: devel@kb-test-har-005.kb.dk Starting all applications on: kb-test-har-005.kb.dk Starting linux application: HarvestControllerApplication_browser_1 Starting linux application: HarvestControllerApplication_browser_2 12:27:24,451 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml] 12:27:24,819 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:24,822 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:24,847 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:24,872 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:24,955 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:24,960 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:24,996 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - No compression will be used 12:27:24,997 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - Will use the pattern ./log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log for the active file 12:27:25,000 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log'. 12:27:25,000 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Roll-over at midnight. 12:27:25,003 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Setting initial period to Mon Jul 11 12:27:25 CEST 2022 12:27:25,003 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:25,003 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:25,008 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:25,010 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_1.log 12:27:25,010 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_1.log] 12:27:25,011 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:25,756 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:25,757 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:25,757 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:25,770 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:25,770 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:25,771 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:25,771 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:25,772 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@333291e3 - Registering current configuration as safe fallback point 2022-07-11 12:27:25.776 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 12:27:25.793 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_312 2022-07-11 12:27:25.794 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre 2022-07-11 12:27:25.794 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-07-11 12:27:25.794 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 12:27:25.798 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_1.xml' 2022-07-11 12:27:26.057 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8170/8270 2022-07-11 12:27:26.058 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8270/jndi/rmi://kb-test-har-005.kb.dk:8170/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 12:27:26.063 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 12:27:26.087 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:26.087 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:26.088 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 12:27:26.129 INFO d.n.h.h.HarvestControllerServer. - Starting HarvestControllerServer. 2022-07-11 12:27:26.129 INFO d.n.h.h.HarvestControllerServer. - Bound to harvest channel 'BROWSER' 2022-07-11 12:27:26.129 INFO d.n.h.h.HarvestControllerServer. - Serverdir: 'harvester_browser_1' 2022-07-11 12:27:26.130 INFO d.n.h.h.HarvestControllerServer. - Harvesting requires at least 400000000 bytes free. 2022-07-11 12:27:26.315 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:26.316 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:26.324 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk 2022-07-11 12:27:28.138 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-07-11 12:27:28.138 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@26425897 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1 2022-07-11 12:27:28.177 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1']' 2022-07-11 12:27:28.178 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-07-11 12:27:28.178 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Using 'Test6' as default collectionID 2022-07-11 12:27:28.182 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Storing tempfiles in folder 'arcrepositoryTemp' 2022-07-11 12:27:28.200 INFO d.n.common.utils.HttpsClientBuilder. - Creating Aggressive retry handler for https queries. 2022-07-11 12:27:28.283 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist! 2022-07-11 12:27:28.330 DEBUG d.n.h.h.HarvestControllerServer. - Obtained JMS connection. 2022-07-11 12:27:28.331 INFO d.n.h.h.HarvestControllerServer. - SEND_READY_DELAY used by HarvestControllerServer is 300 2022-07-11 12:27:28.331 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_1' 2022-07-11 12:27:28.332 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_HCHAN_VAL_RESP 2022-07-11 12:27:28.374 INFO d.n.h.h.HarvestControllerServer. - Requested to check the validity of harvest channel 'BROWSER' 2022-07-11 12:27:28.420 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'BROWSER' is valid. 2022-07-11 12:27:28.428 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_BROWSER']' 2022-07-11 12:27:28.428 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_JOB_PARTIAL_BROWSER 12:27:24,398 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml] 12:27:24,745 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:24,761 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:24,767 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:24,792 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:24,894 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:24,906 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:24,935 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - No compression will be used 12:27:24,936 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - Will use the pattern ./log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log for the active file 12:27:24,941 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log'. 12:27:24,941 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Roll-over at midnight. 12:27:24,946 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Setting initial period to Mon Jul 11 12:27:24 CEST 2022 12:27:24,946 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:24,946 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:24,958 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:24,961 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_2.log 12:27:24,961 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_2.log] 12:27:24,961 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:25,644 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:25,656 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:25,656 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:25,657 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:25,657 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:25,657 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:25,658 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:25,658 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@333291e3 - Registering current configuration as safe fallback point 2022-07-11 12:27:25.662 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 12:27:25.683 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_312 2022-07-11 12:27:25.684 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre 2022-07-11 12:27:25.684 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-07-11 12:27:25.684 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 12:27:25.684 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_2.xml' 2022-07-11 12:27:25.919 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8175/8275 2022-07-11 12:27:25.919 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8175 communicating on port 8275 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8275/jndi/rmi://kb-test-har-005.kb.dk:8175/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 12:27:25.924 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 12:27:25.930 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:25.931 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:25.931 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 12:27:25.955 INFO d.n.h.h.HarvestControllerServer. - Starting HarvestControllerServer. 2022-07-11 12:27:25.956 INFO d.n.h.h.HarvestControllerServer. - Bound to harvest channel 'BROWSER' 2022-07-11 12:27:25.956 INFO d.n.h.h.HarvestControllerServer. - Serverdir: 'harvester_browser_2' 2022-07-11 12:27:25.956 INFO d.n.h.h.HarvestControllerServer. - Harvesting requires at least 400000000 bytes free. 2022-07-11 12:27:26.070 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:26.071 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:26.075 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk 2022-07-11 12:27:27.956 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-07-11 12:27:27.956 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@6f8f9349 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2 2022-07-11 12:27:27.979 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2']' 2022-07-11 12:27:27.980 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-07-11 12:27:27.980 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Using 'Test6' as default collectionID 2022-07-11 12:27:27.984 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Storing tempfiles in folder 'arcrepositoryTemp' 2022-07-11 12:27:27.999 INFO d.n.common.utils.HttpsClientBuilder. - Creating Aggressive retry handler for https queries. 2022-07-11 12:27:28.115 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist! 2022-07-11 12:27:28.167 DEBUG d.n.h.h.HarvestControllerServer. - Obtained JMS connection. 2022-07-11 12:27:28.168 INFO d.n.h.h.HarvestControllerServer. - SEND_READY_DELAY used by HarvestControllerServer is 300 2022-07-11 12:27:28.168 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_2' 2022-07-11 12:27:28.184 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@2c3dec30 as listener to Test6_COMMON_HCHAN_VAL_RESP 2022-07-11 12:27:28.241 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'BROWSER' is valid. 2022-07-11 12:27:28.243 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_BROWSER']' 2022-07-11 12:27:28.243 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@2c3dec30 as listener to Test6_COMMON_JOB_PARTIAL_BROWSER 2022-07-11 12:27:28.294 INFO d.n.h.h.HarvestControllerServer. - Requested to check the validity of harvest channel 'BROWSER' -------------------------------------------- STARTING MACHINE: devel@kb-test-har-004.kb.dk Starting all applications on: kb-test-har-004.kb.dk Starting linux application: HarvestControllerApplication_kblow002_h3 Starting linux application: HarvestControllerApplication_kbhigh_h3 12:27:30,393 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] 12:27:31,009 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:31,021 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:31,048 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:31,095 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:31,200 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:31,218 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:31,279 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - No compression will be used 12:27:31,282 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - Will use the pattern ./log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file 12:27:31,287 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log'. 12:27:31,287 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Roll-over at midnight. 12:27:31,297 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Setting initial period to Mon Jul 11 12:27:31 CEST 2022 12:27:31,298 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:31,298 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:31,301 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:31,313 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbhigh_h3.log 12:27:31,313 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbhigh_h3.log] 12:27:31,315 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:32,073 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:32,081 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:32,081 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:32,082 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:32,082 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:32,082 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:32,082 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:32,083 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2473d930 - Registering current configuration as safe fallback point 2022-07-11 12:27:32.092 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 12:27:32.109 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_25 2022-07-11 12:27:32.110 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25 java.home: /usr/local/java/jdk1.8.0_25_x64/jre 2022-07-11 12:27:32.112 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre Working dir: /home/devel/Test6 2022-07-11 12:27:32.113 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 12:27:32.113 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kbhigh_h3.xml' 2022-07-11 12:27:32.327 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8172/8272 2022-07-11 12:27:32.328 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8172 communicating on port 8272 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8272/jndi/rmi://kb-test-har-004.kb.dk:8172/jmxrmi 2022-07-11 12:27:32.346 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:32.347 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:32.348 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 12:27:32.355 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 12:27:32.382 INFO d.n.h.h.HarvestControllerServer. - Starting HarvestControllerServer. 2022-07-11 12:27:32.382 INFO d.n.h.h.HarvestControllerServer. - Bound to harvest channel 'HIGHPRIORITY' 2022-07-11 12:27:32.382 INFO d.n.h.h.HarvestControllerServer. - Serverdir: 'harvester_high' 2022-07-11 12:27:32.392 INFO d.n.h.h.HarvestControllerServer. - Harvesting requires at least 400000000 bytes free. 2022-07-11 12:27:32.594 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:32.622 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:32.638 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk 12:27:30,520 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml] 12:27:31,071 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:31,082 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:31,099 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:31,131 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:31,200 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:31,204 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:31,246 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - No compression will be used 12:27:31,247 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - Will use the pattern ./log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log for the active file 12:27:31,250 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log'. 12:27:31,250 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Roll-over at midnight. 12:27:31,257 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Setting initial period to Mon Jul 11 12:27:31 CEST 2022 12:27:31,258 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:31,258 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:31,259 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:31,265 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow002_h3.log 12:27:31,265 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow002_h3.log] 12:27:31,266 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:31,959 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:31,970 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:31,970 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:31,972 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:31,972 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:31,974 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:31,975 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:31,977 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2473d930 - Registering current configuration as safe fallback point 2022-07-11 12:27:31.993 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 12:27:32.022 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_25 2022-07-11 12:27:32.024 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25 java.home: /usr/local/java/jdk1.8.0_25_x64/jre 2022-07-11 12:27:32.026 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre Working dir: /home/devel/Test6 2022-07-11 12:27:32.027 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 12:27:32.029 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow002_h3.xml' 2022-07-11 12:27:32.242 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8170/8270 2022-07-11 12:27:32.243 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8270/jndi/rmi://kb-test-har-004.kb.dk:8170/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 12:27:32.270 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 12:27:32.284 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:32.284 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:32.289 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 12:27:32.294 INFO d.n.h.h.HarvestControllerServer. - Starting HarvestControllerServer. 2022-07-11 12:27:32.303 INFO d.n.h.h.HarvestControllerServer. - Bound to harvest channel 'LOWPRIORITY' 2022-07-11 12:27:32.303 INFO d.n.h.h.HarvestControllerServer. - Serverdir: 'harvester_low' 2022-07-11 12:27:32.304 INFO d.n.h.h.HarvestControllerServer. - Harvesting requires at least 400000000 bytes free. 2022-07-11 12:27:32.528 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:32.539 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:32.555 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk -------------------------------------------- STARTING MACHINE: devel@kb-test-acs-001.kb.dk Starting all applications on: kb-test-acs-001.kb.dk Starting linux application: IndexServerApplication Starting linux application: ViewerProxyApplication SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 12:27:35,892 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_IndexServerApplication.xml] at [file:/home/devel/Test6/conf/logback_IndexServerApplication.xml] 12:27:36,196 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:36,199 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:36,206 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:36,218 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:36,279 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:36,286 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:36,314 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@29183965 - No compression will be used 12:27:36,315 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@29183965 - Will use the pattern ./log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log for the active file 12:27:36,318 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log'. 12:27:36,318 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - Roll-over at midnight. 12:27:36,323 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - Setting initial period to Mon Jul 11 12:27:36 CEST 2022 12:27:36,323 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:36,323 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:36,325 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:36,327 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/IndexServerApplication.log 12:27:36,327 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/IndexServerApplication.log] 12:27:36,328 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:36,914 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:36,916 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:36,916 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:36,927 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:36,927 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:36,927 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:36,928 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:36,928 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4f83df68 - Registering current configuration as safe fallback point SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder] 2022-07-11 12:27:36.936 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.indexserver.IndexServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 12:27:36.945 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.indexserver.IndexServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_332 2022-07-11 12:27:36.946 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre 2022-07-11 12:27:36.946 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-07-11 12:27:36.947 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 12:27:36.947 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_IndexServerApplication.xml' 2022-07-11 12:27:37.239 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8371/8471 2022-07-11 12:27:37.240 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8371 communicating on port 8471 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8471/jndi/rmi://kb-test-acs-001.kb.dk:8371/jmxrmi dk.netarkivet.harvester.indexserver.IndexServer Running 2022-07-11 12:27:37.247 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.indexserver.IndexServer Running 2022-07-11 12:27:37.254 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata' 2022-07-11 12:27:37.257 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:37.258 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:37.267 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:37.268 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:37.275 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk 2022-07-11 12:27:37.259 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 12:27:39.061 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-07-11 12:27:39.061 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@7a527389 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS 2022-07-11 12:27:39.069 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS']' 2022-07-11 12:27:39.070 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-07-11 12:27:39.070 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Using 'Test6' as default collectionID 2022-07-11 12:27:39.074 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Storing tempfiles in folder 'arcrepositoryTemp' 2022-07-11 12:27:39.081 INFO d.n.common.utils.HttpsClientBuilder. - Creating Aggressive retry handler for https queries. 2022-07-11 12:27:39.150 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found 2022-07-11 12:27:39.151 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found 2022-07-11 12:27:39.211 INFO d.n.h.indexserver.RawMetadataCache. - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled 2022-07-11 12:27:39.212 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'cdxindex' uses directory '/home/devel/Test6/cache/cdxindex' 2022-07-11 12:27:39.214 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'crawllog' uses directory '/home/devel/Test6/cache/crawllog' 2022-07-11 12:27:39.215 INFO d.n.h.indexserver.RawMetadataCache. - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled 2022-07-11 12:27:39.215 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'dedupcrawllogindex' uses directory '/home/devel/Test6/cache/dedupcrawllogindex' 2022-07-11 12:27:39.216 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata' 2022-07-11 12:27:39.216 INFO d.n.h.indexserver.RawMetadataCache. - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled 2022-07-11 12:27:39.217 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'crawllog' uses directory '/home/devel/Test6/cache/crawllog' 2022-07-11 12:27:39.217 INFO d.n.h.indexserver.RawMetadataCache. - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled 2022-07-11 12:27:39.217 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'fullcrawllogindex' uses directory '/home/devel/Test6/cache/fullcrawllogindex' 2022-07-11 12:27:39.218 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata' 2022-07-11 12:27:39.218 INFO d.n.h.indexserver.RawMetadataCache. - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled 2022-07-11 12:27:39.219 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/cdxindex/empty-cache.working 2022-07-11 12:27:39.219 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/cdxindex/empty-cache.working' (thread = main) 2022-07-11 12:27:39.233 DEBUG d.n.common.utils.ProcessUtils.runProcess - Running external program: sort /home/devel/Test6/cache/cdxindex/empty-cache -o /home/devel/Test6/cache/cdxindex/empty-cache.unsorted with environment LANG=C 2022-07-11 12:27:39.246 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@5cc126dc 2022-07-11 12:27:39.246 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/cdxindex/empty-cache' of id '[]', request was for '[]' 2022-07-11 12:27:39.247 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/dedupcrawllogindex/empty-cache.working 2022-07-11 12:27:39.247 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/dedupcrawllogindex/empty-cache.working' (thread = main) 2022-07-11 12:27:39.247 INFO d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate dedupcrawllogindex for the 0 jobs: [] 2022-07-11 12:27:39.248 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main) 2022-07-11 12:27:39.352 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1) 2022-07-11 12:27:39.358 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)! 2022-07-11 12:27:39.358 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1 2022-07-11 12:27:39.358 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1 2022-07-11 12:27:39.361 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes 2022-07-11 12:27:39.362 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@d1f74b8 2022-07-11 12:27:39.362 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/dedupcrawllogindex/empty-cache' of id '[]', request was for '[]' 2022-07-11 12:27:39.362 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/fullcrawllogindex/empty-cache.working 2022-07-11 12:27:39.362 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/fullcrawllogindex/empty-cache.working' (thread = main) 2022-07-11 12:27:39.363 INFO d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate fullcrawllogindex for the 0 jobs: [] 2022-07-11 12:27:39.363 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main) 2022-07-11 12:27:39.364 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1) 2022-07-11 12:27:39.367 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)! 2022-07-11 12:27:39.368 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1 2022-07-11 12:27:39.368 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1 2022-07-11 12:27:39.369 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes 2022-07-11 12:27:39.369 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@3a0807b7 2022-07-11 12:27:39.369 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/fullcrawllogindex/empty-cache' of id '[]', request was for '[]' 2022-07-11 12:27:39.396 INFO d.n.c.utils.hadoop.HadoopJobUtils.doKerberosLogin - Kerberos: /home/devel/extra_configs/kerberos_config/krb5.conf, /home/devel/extra_configs/kerberos_config/nat-nas-devel.keytab, nat-nas-devel@KBHPC.KB.DK 2022-07-11 12:27:39.683 WARN o.a.hadoop.util.NativeCodeLoader. - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2022-07-11 12:27:39.864 INFO d.n.h.i.d.IndexRequestServer.setHandler - Setting handler for RequestType: CDX 2022-07-11 12:27:39.865 INFO d.n.h.i.d.IndexRequestServer.setHandler - Setting handler for RequestType: DEDUP_CRAWL_LOG 2022-07-11 12:27:39.865 INFO d.n.h.i.d.IndexRequestServer.setHandler - Setting handler for RequestType: FULL_CRAWL_LOG 2022-07-11 12:27:39.865 INFO d.n.h.i.d.IndexRequestServer.restoreRequestsfromRequestDir - requestdir not found: creating request dir 2022-07-11 12:27:39.866 INFO d.n.h.i.d.IndexRequestServer.start - 0 indexing jobs in progress that was stored in requestdir: /home/devel/Test6/requests 2022-07-11 12:27:39.867 INFO d.n.h.i.d.IndexRequestServer.run - Enabling listening to the indexserver channel '[Queue 'Test6_COMMON_INDEX_SERVER']' 2022-07-11 12:27:39.868 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer@5511437b as listener to Test6_COMMON_INDEX_SERVER 12:27:35,892 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_ViewerProxyApplication.xml] at [file:/home/devel/Test6/conf/logback_ViewerProxyApplication.xml] 12:27:36,183 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:36,185 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:36,192 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:36,205 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:36,286 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:36,296 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:36,338 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@117009527 - No compression will be used 12:27:36,341 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@117009527 - Will use the pattern ./log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log for the active file 12:27:36,351 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log'. 12:27:36,351 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - Roll-over at midnight. 12:27:36,358 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - Setting initial period to Mon Jul 11 12:27:36 CEST 2022 12:27:36,359 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:36,359 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:36,363 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:36,368 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ViewerProxyApplication.log 12:27:36,368 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ViewerProxyApplication.log] 12:27:36,370 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:37,016 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:37,026 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:37,027 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:37,027 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:37,027 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:37,028 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:37,028 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:37,029 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3ba9ad43 - Registering current configuration as safe fallback point 2022-07-11 12:27:37.034 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.viewerproxy.ViewerProxy Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 12:27:37.040 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.viewerproxy.ViewerProxy Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_332 2022-07-11 12:27:37.040 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre 2022-07-11 12:27:37.041 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-07-11 12:27:37.041 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 12:27:37.041 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_ViewerProxyApplication.xml' 2022-07-11 12:27:37.239 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8370/8470 2022-07-11 12:27:37.240 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8370 communicating on port 8470 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8470/jndi/rmi://kb-test-acs-001.kb.dk:8370/jmxrmi dk.netarkivet.viewerproxy.ViewerProxy Running 2022-07-11 12:27:37.243 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.viewerproxy.ViewerProxy Running 2022-07-11 12:27:37.261 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:37.262 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:37.255 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:37.263 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:37.269 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk 2022-07-11 12:27:37.263 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 12:27:39.037 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-07-11 12:27:39.043 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@5c18016b as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP 2022-07-11 12:27:39.060 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP']' 2022-07-11 12:27:39.061 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-07-11 12:27:39.061 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Using 'Test6' as default collectionID 2022-07-11 12:27:39.075 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Storing tempfiles in folder 'arcrepositoryTemp' 2022-07-11 12:27:39.088 INFO d.n.common.utils.HttpsClientBuilder. - Creating Aggressive retry handler for https queries. 2022-07-11 12:27:39.148 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found 2022-07-11 12:27:39.150 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found 2022-07-11 12:27:39.185 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'FULL_CRAWL_LOG' uses directory '/home/devel/Test6/cache/FULL_CRAWL_LOG' 2022-07-11 12:27:39.194 INFO d.n.viewerproxy.ARCArchiveAccess. - Constructed instance of ARCArchiveAccess with TryToLookupUriAsFtp: false 2022-07-11 12:27:39.225 INFO dk.netarkivet.viewerproxy.WebProxy. - Starting viewerproxy jetty on port 8078 -------------------------------------------- STARTING MACHINE: devel@kb-test-way-001.kb.dk Starting all applications on: kb-test-way-001.kb.dk Starting linux application: WaybackIndexerApplication Starting linux application: AggregatorApplication 12:27:42,498 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_AggregatorApplication.xml] at [file:/home/devel/Test6/conf/logback_AggregatorApplication.xml] 12:27:42,913 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:42,914 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:42,952 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:43,004 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:43,198 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:43,240 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:43,382 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@477289012 - No compression will be used 12:27:43,383 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@477289012 - Will use the pattern ./log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log for the active file 12:27:43,392 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log'. 12:27:43,392 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - Roll-over at midnight. 12:27:43,424 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - Setting initial period to Mon Jul 11 12:27:43 CEST 2022 12:27:43,425 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:43,425 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:43,429 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:43,435 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/AggregatorApplication.log 12:27:43,435 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/AggregatorApplication.log] 12:27:43,443 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:44,764 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:44,777 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:44,777 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:44,778 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:44,778 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:44,778 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:44,778 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:44,785 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3d3fcdb0 - Registering current configuration as safe fallback point 2022-07-11 12:27:44.805 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.wayback.aggregator.AggregationWorker Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 12:27:44.828 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.wayback.aggregator.AggregationWorker Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_25 2022-07-11 12:27:44.829 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25 java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre 2022-07-11 12:27:44.831 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre Working dir: /home/devel/Test6 2022-07-11 12:27:44.831 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 12:27:44.838 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_AggregatorApplication.xml' 2022-07-11 12:27:45.164 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-way-001.kb.dk' and JMX/RMI ports 9170/9270 2022-07-11 12:27:45.167 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 9170 communicating on port 9270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-way-001.kb.dk:9270/jndi/rmi://kb-test-way-001.kb.dk:9170/jmxrmi dk.netarkivet.wayback.aggregator.AggregationWorker Running 2022-07-11 12:27:45.168 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.wayback.aggregator.AggregationWorker Running 2022-07-11 12:27:45.196 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:45.225 DEBUG d.n.w.aggregator.AggregationWorker.runAggregation - No new raw index files found in '/home/devel/Test6/batchOutputDir' skipping aggregation 2022-07-11 12:27:45.196 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:45.225 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 12:27:42,738 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_WaybackIndexerApplication.xml] at [file:/home/devel/Test6/conf/logback_WaybackIndexerApplication.xml] 12:27:43,309 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:43,315 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:43,329 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:43,367 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:43,502 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:43,509 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:43,580 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1201484275 - No compression will be used 12:27:43,581 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1201484275 - Will use the pattern ./log/WaybackIndexerApplication.%d{yyyy-MM-dd}.%i.log for the active file 12:27:43,591 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@40ef3420 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/WaybackIndexerApplication.%d{yyyy-MM-dd}.%i.log'. 12:27:43,591 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@40ef3420 - Roll-over at midnight. 12:27:43,612 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@40ef3420 - Setting initial period to Mon Jul 11 12:27:43 CEST 2022 12:27:43,613 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@40ef3420 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:43,613 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@40ef3420 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:43,620 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:43,633 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/WaybackIndexerApplication.log 12:27:43,633 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/WaybackIndexerApplication.log] 12:27:43,634 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:44,755 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:44,759 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:44,759 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:44,771 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:44,771 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:44,771 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:44,771 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:44,772 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@498d318c - Registering current configuration as safe fallback point SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder] 2022-07-11 12:27:44.791 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.wayback.indexer.WaybackIndexer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 12:27:44.820 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.wayback.indexer.WaybackIndexer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_25 2022-07-11 12:27:44.821 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25 java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre 2022-07-11 12:27:44.821 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre Working dir: /home/devel/Test6 2022-07-11 12:27:44.822 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 12:27:44.822 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_WaybackIndexerApplication.xml' 2022-07-11 12:27:45.166 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-way-001.kb.dk' and JMX/RMI ports 8171/8271 2022-07-11 12:27:45.170 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8171 communicating on port 8271 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-way-001.kb.dk:8271/jndi/rmi://kb-test-way-001.kb.dk:8171/jmxrmi dk.netarkivet.wayback.indexer.WaybackIndexer Running 2022-07-11 12:27:45.193 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.wayback.indexer.WaybackIndexer Running 2022-07-11 12:27:45.211 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:45.227 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:45.227 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 12:27:45.245 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:45.300 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 12:27:45.316 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-way-001.kb.dk -------------------------------------------- -------------------------------------------- STARTING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk Starting all applications on: sb-test-har-001.statsbiblioteket.dk Starting linux application: HarvestControllerApplication_sbhigh_h3 12:27:46,083 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] at [file:/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] 12:27:46,222 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 12:27:46,224 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 12:27:46,230 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 12:27:46,240 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:46,278 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 12:27:46,280 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 12:27:46,293 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - No compression will be used 12:27:46,294 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - Will use the pattern ./log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file 12:27:46,295 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log'. 12:27:46,295 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Roll-over at midnight. 12:27:46,298 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Setting initial period to Mon Jul 11 12:27:46 CEST 2022 12:27:46,298 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 12:27:46,298 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 12:27:46,299 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 12:27:46,300 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_sbhigh_h3.log 12:27:46,300 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_sbhigh_h3.log] 12:27:46,301 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 12:27:46,551 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 12:27:46,552 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 12:27:46,552 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 12:27:46,553 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 12:27:46,553 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 12:27:46,553 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 12:27:46,553 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 12:27:46,553 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@40ef3420 - Registering current configuration as safe fallback point 2022-07-11 12:27:46.556 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 12:27:46.559 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_332 2022-07-11 12:27:46.560 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-2.el8_6.x86_64/jre 2022-07-11 12:27:46.560 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-2.el8_6.x86_64/jre Working dir: /home/netarkdv/Test6 2022-07-11 12:27:46.560 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/netarkdv/Test6 2022-07-11 12:27:46.560 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/netarkdv/Test6/conf/settings_HarvestControllerApplication_sbhigh_h3.xml' 2022-07-11 12:27:46.648 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'sb-test-har-001.statsbiblioteket.dk' and JMX/RMI ports 8170/8270 2022-07-11 12:27:46.649 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://sb-test-har-001.statsbiblioteket.dk:8270/jndi/rmi://sb-test-har-001.statsbiblioteket.dk:8170/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 12:27:46.653 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 12:27:46.660 INFO d.n.h.h.HarvestControllerServer. - Starting HarvestControllerServer. 2022-07-11 12:27:46.660 INFO d.n.h.h.HarvestControllerServer. - Bound to harvest channel 'HIGHPRIORITY' 2022-07-11 12:27:46.660 INFO d.n.h.h.HarvestControllerServer. - Serverdir: 'harvester_high' 2022-07-11 12:27:46.660 INFO d.n.h.h.HarvestControllerServer. - Harvesting requires at least 400000000 bytes free. 2022-07-11 12:27:46.665 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:46.665 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 12:27:46.665 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 12:27:47.037 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/netarkdv/extra_configs/bitmag_config. 2022-07-11 12:27:47.037 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/netarkdv/extra_configs/bitmag_config. 2022-07-11 12:27:47.040 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): sb-test-har-001.statsbiblioteket.dk 2022-07-11 12:27:47.881 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-07-11 12:27:47.882 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@fd8294b as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3 2022-07-11 12:27:48.114 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3']' 2022-07-11 12:27:48.115 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/netarkdv/extra_configs/bitmag_config 2022-07-11 12:27:48.115 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Using 'Test6' as default collectionID 2022-07-11 12:27:48.120 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Storing tempfiles in folder 'arcrepositoryTemp' 2022-07-11 12:27:48.127 INFO d.n.common.utils.HttpsClientBuilder. - Creating Aggressive retry handler for https queries. 2022-07-11 12:27:48.192 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist! 2022-07-11 12:27:48.219 DEBUG d.n.h.h.HarvestControllerServer. - Obtained JMS connection. 2022-07-11 12:27:48.225 INFO d.n.h.h.HarvestControllerServer. - SEND_READY_DELAY used by HarvestControllerServer is 300 2022-07-11 12:27:48.225 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_high' 2022-07-11 12:27:48.226 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@51850751 as listener to Test6_COMMON_HCHAN_VAL_RESP 2022-07-11 12:27:48.375 INFO d.n.h.h.HarvestControllerServer. - Requested to check the validity of harvest channel 'HIGHPRIORITY' 2022-07-11 12:27:48.495 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'HIGHPRIORITY' is valid. 2022-07-11 12:27:48.496 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY']' 2022-07-11 12:27:48.497 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@51850751 as listener to Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY -------------------------------------------- Completed the script all_test.sh Finished: SUCCESS