Started by user Colin Rosenthal (csr) Building remotely on NetarchiveSuite in workspace /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Done Cloning the remote Git repository Cloning repository https://github.com/netarchivesuite/netarchivesuite.git > git init /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click # timeout=10 Fetching upstream changes from https://github.com/netarchivesuite/netarchivesuite.git > git --version # timeout=10 > git -c core.askpass=true fetch --tags --progress https://github.com/netarchivesuite/netarchivesuite.git +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/netarchivesuite/netarchivesuite.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/netarchivesuite/netarchivesuite.git # timeout=10 Fetching upstream changes from https://github.com/netarchivesuite/netarchivesuite.git > git -c core.askpass=true fetch --tags --progress https://github.com/netarchivesuite/netarchivesuite.git +refs/heads/*:refs/remotes/origin/* > git rev-parse refs/remotes/origin/NARK-2214-oom^{commit} # timeout=10 > git rev-parse refs/remotes/origin/origin/NARK-2214-oom^{commit} # timeout=10 Checking out Revision 1ecfd3917eea680d0c84a1809b54b87104643555 (refs/remotes/origin/NARK-2214-oom) > git config core.sparsecheckout # timeout=10 > git checkout -f 1ecfd3917eea680d0c84a1809b54b87104643555 > git rev-list 530d443d1c093ced66f5fc473e516c6b5c0373f6 # timeout=10 [NetarchiveSuite-Colin-1-Click] $ /bin/sh -xe /tmp/hudson1710106540533205385.sh + cd /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click + pwd /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click + ls -lart total 136 drwxrwxr-x. 19 cibuild02 cibuild02 4096 Jul 11 10:44 .. drwxrwxr-x. 2 cibuild02 cibuild02 4096 Jul 11 10:44 .run -rw-rw-r--. 1 cibuild02 cibuild02 1283 Jul 11 10:44 .gitignore -rw-rw-r--. 1 cibuild02 cibuild02 748 Jul 11 10:44 .travis.yml -rw-rw-r--. 1 cibuild02 cibuild02 2055 Jul 11 10:44 README.md -rw-rw-r--. 1 cibuild02 cibuild02 4686 Jul 11 10:44 Narcana.md -rw-rw-r--. 1 cibuild02 cibuild02 816 Jul 11 10:44 LICENSE.txt drwxrwxr-x. 3 cibuild02 cibuild02 4096 Jul 11 10:44 build-tools drwxrwxr-x. 5 cibuild02 cibuild02 4096 Jul 11 10:44 archive drwxrwxr-x. 5 cibuild02 cibuild02 4096 Jul 11 10:44 common drwxrwxr-x. 3 cibuild02 cibuild02 4096 Jul 11 10:44 hadoop-uber-jar-invoker drwxrwxr-x. 3 cibuild02 cibuild02 4096 Jul 11 10:44 hadoop-uber-jar drwxrwxr-x. 5 cibuild02 cibuild02 4096 Jul 11 10:44 deploy drwxrwxr-x. 10 cibuild02 cibuild02 4096 Jul 11 10:44 harvester drwxrwxr-x. 3 cibuild02 cibuild02 4096 Jul 11 10:44 integration-test drwxrwxr-x. 5 cibuild02 cibuild02 4096 Jul 11 10:44 monitor drwxrwxr-x. 2 cibuild02 cibuild02 4096 Jul 11 10:44 quickstart-vagrant-environment -rwxrwxr-x. 1 cibuild02 cibuild02 429 Jul 11 10:44 precommit.sh -rw-rw-r--. 1 cibuild02 cibuild02 39984 Jul 11 10:44 pom.xml -rw-rw-r--. 1 cibuild02 cibuild02 87 Jul 11 10:44 reset_gitignore_files.sh drwxrwxr-x. 3 cibuild02 cibuild02 4096 Jul 11 10:44 quickstart drwxrwxr-x. 16 cibuild02 cibuild02 4096 Jul 11 10:44 . drwxrwxr-x. 5 cibuild02 cibuild02 4096 Jul 11 10:44 wayback drwxrwxr-x. 8 cibuild02 cibuild02 4096 Jul 11 10:44 .git + rm -rf './lib/*' + rm -rf './deploy/distribution/target/*' Parsing POMs Established TCP socket on 42847 maven32-agent.jar already up to date maven32-interceptor.jar already up to date maven3-interceptor-commons.jar already up to date [NetarchiveSuite-Colin-1-Click] $ /bin/java -cp /home/cibuild02/maven32-agent.jar:/home/cibuild02/tools/hudson.tasks.Maven_MavenInstallation/Maven3.2/boot/plexus-classworlds-2.5.2.jar:/home/cibuild02/tools/hudson.tasks.Maven_MavenInstallation/Maven3.2/conf/logging jenkins.maven3.agent.Maven32Main /home/cibuild02/tools/hudson.tasks.Maven_MavenInstallation/Maven3.2 /home/cibuild02/slave.jar /home/cibuild02/maven32-interceptor.jar /home/cibuild02/maven3-interceptor-commons.jar 42847 <===[JENKINS REMOTING CAPACITY]===>channel started Executing Maven: -B -f /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml -U -DskipTests clean package [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:build-tools:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:archive-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:archive-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:bitpreservation-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:archive:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:netarchivesuite-test-utils:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:common-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:common-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:common:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:deploy-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:distribution:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:deploy-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:deploy:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvester-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3-extensions:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3-bundler:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3-controller:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3-monitor:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvest-scheduler:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvestchannel-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvestdefinition-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:history-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:qa-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvester-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvester:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:monitor-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:monitor-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:status-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:monitor:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:wayback-indexer:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:wayback-resourcestore:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:wayback-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:wayback:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:system-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:integration-test:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:hadoop-uber-jar:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:hadoop-uber-jar-invoker:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:netarchivesuite:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ line 929, column 17 [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] ------------------------------------------------------------------------ [INFO] Reactor Build Order: [INFO] [INFO] NetarchiveSuite [INFO] NetarchiveSuite - build-tools [INFO] NetarchiveSuite - common [INFO] NetarchiveSuite - test utils [INFO] NetarchiveSuite - common - core [INFO] NetarchiveSuite - common - test [INFO] NetarchiveSuite - archive [INFO] NetarchiveSuite - archive - core [INFO] NetarchiveSuite - harvester [INFO] NetarchiveSuite - harvester - core [INFO] NetarchiveSuite - archive - test [INFO] NetarchiveSuite - bitpreservation - webapp [INFO] NetarchiveSuite - Harvest Scheduler [INFO] NetarchiveSuite - monitor [INFO] NetarchiveSuite - monitor - core [INFO] NetarchiveSuite - wayback [INFO] NetarchiveSuite - wayback - indexer [INFO] NetarchiveSuite - deploy [INFO] NetarchiveSuite - deploy - core [INFO] NetarchiveSuite - harvester - heritrix3 [INFO] NetarchiveSuite - Heritrix3 Extensions [INFO] NetarchiveSuite - heritrix3 controller [INFO] hadoop-uber-jar [INFO] hadoop-uber-jar-invoker [INFO] NetarchiveSuite - Status - Webapp [INFO] NetarchiveSuite - qa - webapp [INFO] NetarchiveSuite - history - webapp [INFO] NetarchiveSuite - harvestDefinition - webapp [INFO] NetarchiveSuite - harvestChannel - webapp [INFO] NetarchiveSuite - heritrix3 monitor [INFO] NetarchiveSuite - deploy - distribution [INFO] NetarchiveSuite - deploy - test [INFO] NetarchiveSuite - Heritrix3 Bundler [INFO] NetarchiveSuite - harvester - test [INFO] NetarchiveSuite - monitor - test [INFO] NetarchiveSuite - wayback resourceStore [INFO] NetarchiveSuite - wayback - test [INFO] NetarchiveSuite - integration tests [INFO] NetarchiveSuite System test [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ netarchivesuite --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ netarchivesuite --- [INFO] Git info extracted, revision: '1ecfd39', branch: '', tag: '', commitsCount: '4724', buildnumber: 'UNNAMED.4724.1ecfd39' [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ netarchivesuite --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - build-tools 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ build-tools --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ build-tools --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ build-tools --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ build-tools --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/build-tools/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ build-tools --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ build-tools --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ build-tools --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ build-tools --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/build-tools/target/build-tools-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ build-tools --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/build-tools/target/build-tools-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - common 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ common --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ common --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ common --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - test utils 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ netarchivesuite-test-utils --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ netarchivesuite-test-utils --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/../target/jacoco.exec,append=true,excludes=**com.steadystate*:**com.gargoylesoftware* [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ netarchivesuite-test-utils --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ netarchivesuite-test-utils --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 6 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ netarchivesuite-test-utils --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ netarchivesuite-test-utils --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ netarchivesuite-test-utils --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ netarchivesuite-test-utils --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ netarchivesuite-test-utils --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/target/netarchivesuite-test-utils-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ netarchivesuite-test-utils --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/target/netarchivesuite-test-utils-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - common - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ common-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ common-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ common-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 18 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ common-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 198 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/webinterface/GUIWebServer.java:[49,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[33,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/JMXUtils.java:[50,33] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[54,73] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[59,26] sun.security.krb5.Config is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[68,49] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[73,26] sun.security.krb5.Config is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/JMXUtils.java:[105,63] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/JMXUtils.java:[107,21] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/is/hi/bok/deduplicator/CommandLineParser.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/is/hi/bok/deduplicator/CommandLineParser.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ common-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ common-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 11 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ common-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ common-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ common-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/target/common-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ common-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/target/common-core-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - common - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ common-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ common-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ common-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ common-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 44 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/java/dk/netarkivet/common/webinterface/WebinterfaceTestCase.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/java/dk/netarkivet/common/webinterface/WebinterfaceTestCase.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/java/dk/netarkivet/common/webinterface/WebinterfaceTestCase.java: Some input files use unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/java/dk/netarkivet/common/webinterface/WebinterfaceTestCase.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ common-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 386 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ common-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 78 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/test/java/dk/netarkivet/common/utils/StringUtilsTester.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/test/java/dk/netarkivet/common/utils/StringUtilsTester.java uses unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/test/java/dk/netarkivet/common/utils/StringUtilsTester.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ common-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ common-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ common-test --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/target/common-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ common-test --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/target/common-test-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - archive 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ archive --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ archive --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ archive --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - archive - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ archive-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ archive-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ archive-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 8 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ archive-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 93 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/main/java/dk/netarkivet/archive/tools/RunBatch.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/main/java/dk/netarkivet/archive/tools/RunBatch.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ archive-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ archive-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 12 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/test/java/dk/netarkivet/archive/arcrepository/distribute/ArcRepositoryServerTester.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/test/java/dk/netarkivet/archive/arcrepository/distribute/ArcRepositoryServerTester.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/test/java/dk/netarkivet/archive/arcrepository/distribute/ArcRepositoryServerTester.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ archive-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ archive-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ archive-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/target/archive-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ archive-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/target/archive-core-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvester 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvester --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvester --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvester --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvester - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/org/netarchivesuite/heritrix3-wrapper/1.0.5-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/org/netarchivesuite/heritrix3-wrapper/1.0.5-SNAPSHOT/maven-metadata.xml (2 KB at 2.4 KB/sec) [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvester-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ harvester-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvester-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 12 resources [INFO] Copying 3 resources to sql-migration/postgresql/ [INFO] Copying 1 resource to sql-migration/mysql/ [INFO] Copying 2 resources to sql-migration/derby/ [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvester-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 237 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/indexserver/distribute/IndexRequestServer.java:[69,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/indexserver/distribute/IndexRequestServer.java:[135,22] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/tools/CreateIndex.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/tools/CreateIndex.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/datamodel/H1HeritrixTemplate.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/datamodel/H1HeritrixTemplate.java uses unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/datamodel/H1HeritrixTemplate.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvester-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 16 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvester-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 12 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvester-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvester-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvester-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/harvester-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvester-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/harvester-core-7.4-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-jar-plugin:2.4:test-jar (default) @ harvester-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/harvester-core-7.4-SNAPSHOT-tests.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - archive - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ archive-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ archive-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ archive-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ archive-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ archive-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 280 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ archive-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 78 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/test/java/dk/netarkivet/archive/arcrepository/ArcRepositoryTesterLog.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/test/java/dk/netarkivet/archive/arcrepository/ArcRepositoryTesterLog.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/test/java/dk/netarkivet/archive/webinterface/BatchGUITester.java: Some input files use unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/test/java/dk/netarkivet/archive/webinterface/BatchGUITester.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ archive-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ archive-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ archive-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/target/archive-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ archive-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - bitpreservation - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ bitpreservation-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ bitpreservation-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ bitpreservation-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ bitpreservation-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ bitpreservation-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ bitpreservation-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ bitpreservation-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ bitpreservation-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [bitpreservation-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/target/BitPreservation] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/src/main/webapp] [INFO] Webapp assembled in [61 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/target/BitPreservation.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ bitpreservation-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Harvest Scheduler 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvest-scheduler --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ harvest-scheduler --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvest-scheduler --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvest-scheduler --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 14 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvest-scheduler --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvest-scheduler --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 5 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvest-scheduler --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvest-scheduler --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvest-scheduler --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/target/harvest-scheduler-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvest-scheduler --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/target/harvest-scheduler-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - monitor 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ monitor --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ monitor --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ monitor --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - monitor - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ monitor-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ monitor-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ monitor-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 7 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ monitor-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 23 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/main/java/dk/netarkivet/monitor/webinterface/JMXSummaryUtils.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/main/java/dk/netarkivet/monitor/webinterface/JMXSummaryUtils.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/main/java/dk/netarkivet/monitor/webinterface/JMXSummaryUtils.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ monitor-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ monitor-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 6 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/test/java/dk/netarkivet/monitor/jmx/JMXUtilsTester.java:[30,33] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/test/java/dk/netarkivet/monitor/jmx/JMXUtilsTester.java:[72,63] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/test/java/dk/netarkivet/monitor/jmx/JMXUtilsTester.java:[74,23] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ monitor-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ monitor-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ monitor-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/target/monitor-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ monitor-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/target/monitor-core-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - wayback 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - wayback - indexer 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback-indexer --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ wayback-indexer --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-indexer --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-indexer --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 27 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/ArchiveFile.java:[76,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/WaybackIndexer.java:[49,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/ArchiveFile.java:[253,51] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/WaybackIndexer.java:[96,22] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-indexer --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-indexer --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 2 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-indexer --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-indexer --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-indexer --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/target/wayback-indexer-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-indexer --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/target/wayback-indexer-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - deploy 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ deploy --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ deploy --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ deploy --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - deploy - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ deploy-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ deploy-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ deploy-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ deploy-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 16 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/src/main/java/dk/netarkivet/deploy/DeployApplication.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/src/main/java/dk/netarkivet/deploy/DeployApplication.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/src/main/java/dk/netarkivet/deploy/DeployApplication.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ deploy-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 8 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ deploy-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 3 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ deploy-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ deploy-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ deploy-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/target/deploy-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ deploy-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/target/deploy-core-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvester - heritrix3 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3 --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3 --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3 --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Heritrix3 Extensions 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-extensions --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix3-extensions --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix3-extensions --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 16 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/main/java/dk/netarkivet/harvester/harvesting/NasWARCProcessor.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/main/java/dk/netarkivet/harvester/harvesting/NasWARCProcessor.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix3-extensions --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix3-extensions --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 9 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/test/java/dk/netarkivet/harvester/harvesting/extractor/ExtractorOAITest.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/test/java/dk/netarkivet/harvester/harvesting/extractor/ExtractorOAITest.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/test/java/dk/netarkivet/harvester/harvesting/extractor/ExtractorOAITest.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ heritrix3-extensions --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-extensions --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix3-extensions --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/target/heritrix3-extensions-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3-extensions --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/target/heritrix3-extensions-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - heritrix3 controller 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-controller --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix3-controller --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix3-controller --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 23 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/src/main/java/dk/netarkivet/harvester/tools/CreateCDXMetadataFile.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/src/main/java/dk/netarkivet/harvester/tools/CreateCDXMetadataFile.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/src/main/java/dk/netarkivet/harvester/tools/CreateCDXMetadataFile.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix3-controller --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix3-controller --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 3 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ heritrix3-controller --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-controller --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix3-controller --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/target/heritrix3-controller-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3-controller --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/target/heritrix3-controller-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building hadoop-uber-jar 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-uber-jar --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-uber-jar --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-uber-jar --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 1 source file to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/src/main/java/MetadataIndexingApplication.java:[28,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hadoop-uber-jar --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hadoop-uber-jar --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-uber-jar --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ hadoop-uber-jar --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ hadoop-uber-jar --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/target/hadoop-uber-jar-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ hadoop-uber-jar --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/target/hadoop-uber-jar-7.4-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-shade-plugin:3.2.4:shade (default) @ hadoop-uber-jar --- [INFO] Including commons-cli:commons-cli:jar:1.4 in the shaded jar. [INFO] Including org.apache.commons:commons-math3:jar:3.1.1 in the shaded jar. [INFO] Including org.apache.httpcomponents:httpclient:jar:4.5.12 in the shaded jar. [INFO] Including commons-codec:commons-codec:jar:1.9 in the shaded jar. [INFO] Including commons-io:commons-io:jar:2.4 in the shaded jar. [INFO] Including commons-net:commons-net:jar:3.0.1 in the shaded jar. [INFO] Including commons-collections:commons-collections:jar:3.1 in the shaded jar. [INFO] Including log4j:log4j:jar:1.2.17 in the shaded jar. [INFO] Including javax.xml.bind:jaxb-api:jar:2.2.11 in the shaded jar. [INFO] Including org.apache.commons:commons-compress:jar:1.19 in the shaded jar. [INFO] Including javax.ws.rs:jsr311-api:jar:1.1.1 in the shaded jar. [INFO] Including aopalliance:aopalliance:jar:1.0 in the shaded jar. [INFO] Including org.codehaus.jettison:jettison:jar:1.1 in the shaded jar. [INFO] Including org.slf4j:slf4j-api:jar:1.7.25 in the shaded jar. [INFO] Including dnsjava:dnsjava:jar:3.3.1 in the shaded jar. [INFO] Including com.google.guava:guava:jar:27.0-jre in the shaded jar. [INFO] Including com.google.guava:failureaccess:jar:1.0 in the shaded jar. [INFO] Including com.google.guava:listenablefuture:jar:9999.0-empty-to-avoid-conflict-with-guava in the shaded jar. [INFO] Including com.google.code.findbugs:jsr305:jar:3.0.2 in the shaded jar. [INFO] Including org.checkerframework:checker-qual:jar:2.5.2 in the shaded jar. [INFO] Including com.google.errorprone:error_prone_annotations:jar:2.2.0 in the shaded jar. [INFO] Including com.google.j2objc:j2objc-annotations:jar:1.1 in the shaded jar. [INFO] Including org.codehaus.mojo:animal-sniffer-annotations:jar:1.17 in the shaded jar. [INFO] Including org.netarchivesuite:wayback-indexer:jar:7.4-SNAPSHOT in the shaded jar. [INFO] Including org.netarchivesuite:common-core:jar:7.4-SNAPSHOT in the shaded jar. [INFO] Including org.bitrepository.reference:bitrepository-core:jar:1.9 in the shaded jar. [INFO] Including org.bitrepository.reference:bitrepository-reference-settings:jar:1.9 in the shaded jar. [INFO] Including org.bitrepository.repository-settings:bitrepository-repository-settings-xsd:jar:12 in the shaded jar. [INFO] Including org.bitrepository.repository-settings:bitrepository-repository-settings-java:jar:12 in the shaded jar. [INFO] Including org.bitrepository:bitrepository-message-xml-xsd:jar:30 in the shaded jar. [INFO] Including org.bitrepository:bitrepository-message-xml-java:jar:30 in the shaded jar. [INFO] Including org.apache.activemq:activemq-client:jar:5.13.3 in the shaded jar. [INFO] Including org.apache.geronimo.specs:geronimo-jms_1.1_spec:jar:1.1.1 in the shaded jar. [INFO] Including org.fusesource.hawtbuf:hawtbuf:jar:1.11 in the shaded jar. [INFO] Including org.apache.geronimo.specs:geronimo-j2ee-management_1.1_spec:jar:1.0.1 in the shaded jar. [INFO] Including org.jvnet.jaxb2_commons:jaxb2-basics-runtime:jar:0.11.1 in the shaded jar. [INFO] Including org.bitrepository.reference:bitrepository-client:jar:1.9 in the shaded jar. [INFO] Including org.eclipse.jdt:ecj:jar:3.12.3 in the shaded jar. [INFO] Including org.apache.httpcomponents:httpcore:jar:4.4.1 in the shaded jar. [INFO] Including xalan:xalan:jar:2.7.1 in the shaded jar. [INFO] Including xalan:serializer:jar:2.7.1 in the shaded jar. [INFO] Including xml-apis:xml-apis:jar:1.4.01 in the shaded jar. [INFO] Including ant:ant:jar:1.6.5 in the shaded jar. [INFO] Including commons-fileupload:commons-fileupload:jar:1.3.3 in the shaded jar. [INFO] Including org.eclipse.jdt.core.compiler:ecj:jar:4.4.2 in the shaded jar. [INFO] Including dom4j:dom4j:jar:1.6.1 in the shaded jar. [INFO] Including javax.mail:mail:jar:1.4 in the shaded jar. [INFO] Including javax.activation:activation:jar:1.1 in the shaded jar. [INFO] Including commons-httpclient:commons-httpclient:jar:3.1 in the shaded jar. [INFO] Including org.jwat:jwat-common:jar:1.0.4 in the shaded jar. [INFO] Including org.jwat:jwat-arc:jar:1.0.4 in the shaded jar. [INFO] Including org.jwat:jwat-archive-common:jar:1.0.4 in the shaded jar. [INFO] Including org.jwat:jwat-gzip:jar:1.0.4 in the shaded jar. [INFO] Including org.jwat:jwat-warc:jar:1.0.4 in the shaded jar. [INFO] Including berkeleydb:je:jar:3.2.76 in the shaded jar. [INFO] Including org.archive.heritrix:heritrix-commons:jar:3.4.0-NAS-7.3 in the shaded jar. [INFO] Including org.apache.httpcomponents:httpmime:jar:4.5.13 in the shaded jar. [INFO] Including net.htmlparser.jericho:jericho-html:jar:2.6.1 in the shaded jar. [INFO] Including poi:poi:jar:2.5.1-final-20040804 in the shaded jar. [INFO] Including poi:poi-scratchpad:jar:2.5.1-final-20040804 in the shaded jar. [INFO] Including com.lowagie:itext:jar:1.3 in the shaded jar. [INFO] Including com.anotherbigidea:javaswf:jar:CVS-SNAPSHOT-1 in the shaded jar. [INFO] Including com.esotericsoftware:kryo:jar:1.01 in the shaded jar. [INFO] Including com.esotericsoftware:reflectasm:jar:0.8 in the shaded jar. [INFO] Including com.esotericsoftware:minlog:jar:1.2 in the shaded jar. [INFO] Including net.java.dev.jna:jna:jar:3.2.3 in the shaded jar. [INFO] Including com.jcraft:jsch:jar:0.1.52 in the shaded jar. [INFO] Including org.slf4j:jul-to-slf4j:jar:1.7.25 in the shaded jar. [INFO] Including org.slf4j:jcl-over-slf4j:jar:1.7.25 in the shaded jar. [INFO] Including ch.qos.logback:logback-core:jar:1.2.3 in the shaded jar. [INFO] Including org.gnu.inet:libidn:jar:0.6.5 in the shaded jar. [INFO] Including javassist:javassist:jar:3.9.0.GA in the shaded jar. [INFO] Including org.htmlparser:htmlparser:jar:1.6 in the shaded jar. [INFO] Including org.apache.commons:commons-lang3:jar:3.5 in the shaded jar. [INFO] Including org.netpreserve.openwayback:openwayback-core:jar:2.0.0 in the shaded jar. [INFO] Including org.netpreserve.openwayback:openwayback-cdx-server:jar:classes:2.0.0 in the shaded jar. [INFO] Including org.netpreserve.openwayback:openwayback-access-control-core:jar:1.0.2 in the shaded jar. [INFO] Including com.thoughtworks.xstream:xstream:jar:1.2.2 in the shaded jar. [INFO] Including xpp3:xpp3_min:jar:1.1.3.4.O in the shaded jar. [INFO] Including commons-dbcp:commons-dbcp:jar:1.2.2 in the shaded jar. [INFO] Including com.googlecode.juniversalchardet:juniversalchardet:jar:1.0.3 in the shaded jar. [INFO] Including org.beanshell:bsh:jar:2.0b4 in the shaded jar. [INFO] Including com.flagstone:transform:jar:3.0.2 in the shaded jar. [INFO] Including redis.clients:jedis:jar:2.0.0 in the shaded jar. [INFO] Including org.netpreserve.commons:webarchive-commons:jar:1.1.5 in the shaded jar. [INFO] Including it.unimi.dsi:dsiutils:jar:2.0.12 in the shaded jar. [INFO] Including it.unimi.dsi:fastutil:jar:6.5.2 in the shaded jar. [INFO] Including com.martiansoftware:jsap:jar:2.1 in the shaded jar. [INFO] Including commons-configuration:commons-configuration:jar:1.8 in the shaded jar. [INFO] Including org.netarchivesuite:harvester-core:jar:7.4-SNAPSHOT in the shaded jar. [INFO] Including org.netarchivesuite:heritrix3-wrapper:jar:1.0.5-SNAPSHOT in the shaded jar. [INFO] Including com.sun.xml.bind:jaxb-impl:jar:2.2.11 in the shaded jar. [INFO] Including com.sun.xml.bind:jaxb-core:jar:2.2.11 in the shaded jar. [INFO] Including com.sun.activation:javax.activation:jar:1.2.0 in the shaded jar. [INFO] Including jaxen:jaxen:jar:1.1.6 in the shaded jar. [INFO] Including commons-pool:commons-pool:jar:1.6 in the shaded jar. [INFO] Including commons-lang:commons-lang:jar:2.3 in the shaded jar. [INFO] Including jfree:jfreechart:jar:1.0.13 in the shaded jar. [INFO] Including jfree:jcommon:jar:1.0.16 in the shaded jar. [INFO] Including com.hp.gagawa:gagawa:jar:1.0.1 in the shaded jar. [INFO] Including javax.inject:javax.inject:jar:1 in the shaded jar. [INFO] Including commons-logging:commons-logging:jar:1.2 in the shaded jar. [INFO] Including org.postgresql:postgresql:jar:42.2.10 in the shaded jar. [INFO] Including com.antiaction:raptor-dbl:jar:0.1.0-RC2 in the shaded jar. [INFO] Including com.antiaction:common-servlet:jar:0.1.0-NAS in the shaded jar. [INFO] Including com.antiaction:common-html:jar:0.1.0-NAS in the shaded jar. [INFO] Including com.antiaction:common-template-engine:jar:0.3.0-NAS in the shaded jar. [INFO] Excluding com.sun.jersey:jersey-core:jar:1.19 from the shaded jar. [INFO] Excluding com.sun.jersey:jersey-server:jar:1.19 from the shaded jar. [INFO] Excluding org.bouncycastle:bcprov-jdk15on:jar:1.54 from the shaded jar. [INFO] Excluding org.bouncycastle:bcmail-jdk15on:jar:1.54 from the shaded jar. [INFO] Excluding org.bouncycastle:bcpkix-jdk15on:jar:1.54 from the shaded jar. [INFO] Excluding org.apache.tomcat.embed:tomcat-embed-core:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-annotations-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat.embed:tomcat-embed-logging-juli:jar:8.5.2 from the shaded jar. [INFO] Excluding org.apache.tomcat.embed:tomcat-embed-jasper:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat.embed:tomcat-embed-el:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-jasper:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-servlet-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-juli:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-el-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-util-scan:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-util:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-jasper-el:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-jsp-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jetty-sslengine:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jetty-ajp:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:servlet-api:jar:2.5-20081211 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jsp-2.1-glassfish:jar:2.1.v20091210 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jsp-2.1-jetty:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jsp-api-2.1-glassfish:jar:2.1.v20091210 from the shaded jar. [INFO] Excluding com.sun.messaging.mq:jms:jar:4.4.1 from the shaded jar. [INFO] Excluding com.sun.messaging.mq:imq:jar:4.4.1 from the shaded jar. [INFO] Excluding org.apache.lucene:lucene-core:jar:4.4.0 from the shaded jar. [INFO] Excluding org.apache.lucene:lucene-analyzers-common:jar:4.4.0 from the shaded jar. [INFO] Excluding fastutil:fastutil:jar:5.0.4 from the shaded jar. [INFO] Excluding org.springframework:spring-context:jar:5.3.3 from the shaded jar. [INFO] Excluding org.springframework:spring-aop:jar:5.3.3 from the shaded jar. [INFO] Excluding org.springframework:spring-expression:jar:5.3.3 from the shaded jar. [INFO] Excluding org.slf4j:log4j-over-slf4j:jar:1.7.25 from the shaded jar. [INFO] Excluding ch.qos.logback:logback-classic:jar:1.2.3 from the shaded jar. [INFO] Excluding org.apache.derby:derbyclient:jar:10.12.1.1 from the shaded jar. [INFO] Excluding org.apache.derby:derby:jar:10.12.1.1 from the shaded jar. [INFO] Excluding org.apache.derby:derbytools:jar:10.12.1.1 from the shaded jar. [INFO] Excluding org.springframework:spring-web:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding org.springframework:spring-webmvc:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding org.springframework:spring-context-support:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding javax.servlet:jstl:jar:1.2 from the shaded jar. [INFO] Excluding org.springframework:spring-core:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding org.springframework:spring-asm:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding org.springframework:spring-beans:jar:3.0.6.RELEASE from the shaded jar. [WARNING] failureaccess-1.0.jar, guava-27.0-jre.jar define 2 overlapping classes: [WARNING] - com.google.common.util.concurrent.internal.InternalFutureFailureAccess [WARNING] - com.google.common.util.concurrent.internal.InternalFutures [WARNING] ecj-3.12.3.jar, ecj-4.4.2.jar define 600 overlapping classes and resources: [WARNING] - META-INF/eclipse.inf [WARNING] - about.html [WARNING] - ecj.1 [WARNING] - org.eclipse.jdt.core.BuildJarIndex [WARNING] - org.eclipse.jdt.core.CheckDebugAttributes [WARNING] - org.eclipse.jdt.core.JDTCompilerAdapter [WARNING] - org.eclipse.jdt.core.JDTCompilerAdapter$1 [WARNING] - org.eclipse.jdt.core.compiler.CategorizedProblem [WARNING] - org.eclipse.jdt.core.compiler.CharOperation [WARNING] - org.eclipse.jdt.core.compiler.CompilationProgress [WARNING] - 590 more... [WARNING] jaxen-1.1.6.jar, xml-apis-1.4.01.jar define 1 overlapping classes: [WARNING] - org.w3c.dom.UserDataHandler [WARNING] activation-1.1.jar, javax.activation-1.2.0.jar define 40 overlapping classes and resources: [WARNING] - META-INF/mailcap.default [WARNING] - META-INF/mimetypes.default [WARNING] - com.sun.activation.registries.LineTokenizer [WARNING] - com.sun.activation.registries.LogSupport [WARNING] - com.sun.activation.registries.MailcapFile [WARNING] - com.sun.activation.registries.MailcapParseException [WARNING] - com.sun.activation.registries.MailcapTokenizer [WARNING] - com.sun.activation.registries.MimeTypeEntry [WARNING] - com.sun.activation.registries.MimeTypeFile [WARNING] - com.sun.activation.viewers.ImageViewer [WARNING] - 30 more... [WARNING] heritrix-commons-3.4.0-NAS-7.3.jar, webarchive-commons-1.1.5.jar define 1 overlapping classes: [WARNING] - org.archive.util.Base32 [WARNING] commons-logging-1.2.jar, jcl-over-slf4j-1.7.25.jar define 6 overlapping classes: [WARNING] - org.apache.commons.logging.Log [WARNING] - org.apache.commons.logging.LogConfigurationException [WARNING] - org.apache.commons.logging.LogFactory [WARNING] - org.apache.commons.logging.impl.NoOpLog [WARNING] - org.apache.commons.logging.impl.SimpleLog [WARNING] - org.apache.commons.logging.impl.SimpleLog$1 [WARNING] maven-shade-plugin has detected that some class files are [WARNING] present in two or more JARs. When this happens, only one [WARNING] single version of the class is copied to the uber jar. [WARNING] Usually this is not harmful and you can skip these warnings, [WARNING] otherwise try to manually exclude artifacts based on [WARNING] mvn dependency:tree -Ddetail=true and the above output. [WARNING] See http://maven.apache.org/plugins/maven-shade-plugin/ [INFO] Attaching shaded artifact. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building hadoop-uber-jar-invoker 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-uber-jar-invoker --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-uber-jar-invoker --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-uber-jar-invoker --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hadoop-uber-jar-invoker --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hadoop-uber-jar-invoker --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-uber-jar-invoker --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ hadoop-uber-jar-invoker --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ hadoop-uber-jar-invoker --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/target/hadoop-uber-jar-invoker-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ hadoop-uber-jar-invoker --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/target/hadoop-uber-jar-invoker-7.4-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-assembly-plugin:2.4.1:single (default) @ hadoop-uber-jar-invoker --- [INFO] Reading assembly descriptor: src/main/assembly/assembly.xml [INFO] Copying files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/target/hadoop-uber-jar-invoker-7.4-SNAPSHOT [WARNING] Assembly file: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/target/hadoop-uber-jar-invoker-7.4-SNAPSHOT is not a regular file (it may be a directory). It cannot be attached to the project build for installation or deployment. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Status - Webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ status-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ status-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ status-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ status-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ status-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ status-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ status-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ status-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [status-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/target/Status] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/src/main/webapp] [INFO] Webapp assembled in [24 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/target/Status.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ status-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - qa - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ qa-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ qa-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ qa-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ qa-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ qa-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ qa-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ qa-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ qa-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [qa-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/target/QA] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/src/main/webapp] [INFO] Webapp assembled in [16 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/target/QA.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ qa-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - history - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ history-gui --- [INFO] [INFO] --- maven-resources-plugin:3.2.0:copy-resources (copy-h3-resources) @ history-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Using 'UTF-8' encoding to copy filtered properties files. [INFO] Copying 16 resources [INFO] [INFO] --- maven-resources-plugin:3.2.0:resources (default-resources) @ history-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Using 'UTF-8' encoding to copy filtered properties files. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ history-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:3.2.0:testResources (default-testResources) @ history-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Using 'UTF-8' encoding to copy filtered properties files. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ history-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ history-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ history-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ history-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [history-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/target/History] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/src/main/webapp] [INFO] Webapp assembled in [55 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/target/History.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ history-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvestDefinition - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvestdefinition-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvestdefinition-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvestdefinition-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvestdefinition-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvestdefinition-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvestdefinition-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvestdefinition-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ harvestdefinition-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [harvestdefinition-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/target/HarvestDefinition] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/src/main/webapp] [INFO] Webapp assembled in [129 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/target/HarvestDefinition.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvestdefinition-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvestChannel - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvestchannel-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvestchannel-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvestchannel-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvestchannel-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvestchannel-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvestchannel-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvestchannel-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ harvestchannel-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [harvestchannel-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/target/HarvestChannel] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/src/main/webapp] [INFO] Webapp assembled in [11 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/target/HarvestChannel.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvestchannel-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - heritrix3 monitor 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap-agent-tomcat/0.2.0-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap-agent-tomcat/0.2.0-SNAPSHOT/maven-metadata.xml (3 KB at 51.8 KB/sec) [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap/0.2.0-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap/0.2.0-SNAPSHOT/maven-metadata.xml (600 B at 32.6 KB/sec) [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap-core/0.2.0-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap-core/0.2.0-SNAPSHOT/maven-metadata.xml (2 KB at 56.1 KB/sec) [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-monitor --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix3-monitor --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix3-monitor --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 27 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix3-monitor --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix3-monitor --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 1 source file to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ heritrix3-monitor --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-monitor --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix3-monitor --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/heritrix3-monitor-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3-monitor --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/heritrix3-monitor-7.4-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-assembly-plugin:2.4.1:single (distro-assembly) @ heritrix3-monitor --- [INFO] Reading assembly descriptor: src/main/assembly/assembly.xml [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.eclipse.jetty.orbit:*:jar' o 'org.glassfish:*:jar' o 'org.glassfish.web:*:jar' o 'jdom:jdom:jar' o 'xom:xom:jar' o 'com.ibm.icu:icu4j:jar' o 'commons-configuration:commons-configuration:jar:1.6' o 'org.apache.httpcomponents:httpclient:jar:4.2.5' o 'org.apache.httpcomponents:httpcore:jar:4.2.4' [INFO] Building tar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/NetarchiveSuite-heritrix3-monitor-7.4-SNAPSHOT.tar.gz [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.eclipse.jetty.orbit:*:jar' o 'org.glassfish:*:jar' o 'org.glassfish.web:*:jar' o 'jdom:jdom:jar' o 'xom:xom:jar' o 'com.ibm.icu:icu4j:jar' o 'commons-configuration:commons-configuration:jar:1.6' o 'org.apache.httpcomponents:httpclient:jar:4.2.5' o 'org.apache.httpcomponents:httpcore:jar:4.2.4' [INFO] Building zip: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/NetarchiveSuite-heritrix3-monitor-7.4-SNAPSHOT.zip [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - deploy - distribution 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ distribution --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ distribution --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ distribution --- [INFO] [INFO] --- maven-assembly-plugin:2.4.1:single (distro-assembly) @ distribution --- [INFO] Reading assembly descriptor: src/main/assembly/distribution.xml [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.netarchivesuite:hadoop-uber-jar:*' [INFO] Building zip: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/distribution/target/NetarchiveSuite-7.4-SNAPSHOT.zip [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - deploy - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ deploy-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ deploy-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ deploy-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ deploy-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ deploy-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] Copying 502 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ deploy-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 10 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-test/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ deploy-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ deploy-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ deploy-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-test/target/deploy-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ deploy-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Heritrix3 Bundler 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-bundler --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-bundler --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3-bundler --- [INFO] [INFO] --- maven-assembly-plugin:2.4.1:single (distro-assembly) @ heritrix3-bundler --- [INFO] Reading assembly descriptor: src/main/assembly/distribution.xml [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/is/landsbokasafn/crawl-rss/crawl-rss/0.0.2-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/is/landsbokasafn/crawl-rss/crawl-rss/0.0.2-SNAPSHOT/maven-metadata.xml (2 KB at 30.3 KB/sec) [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.eclipse.jetty.orbit:*:jar' o 'org.glassfish:*:jar' o 'org.glassfish.web:*:jar' o 'org.ow2.asm:*:jar' o 'xom:xom:jar' o 'xerces:*:jar' o 'com.ibm.icu:icu4j:jar' o 'commons-configuration:commons-configuration:jar:1.6' o 'org.apache.httpcomponents:httpclient:jar:4.2.5' o 'org.apache.httpcomponents:httpcomponents-client:jar:4.2.5' o 'org.apache.httpcomponents:httpcore:jar:4.2.4' o '*/lib/httpclient-4.2.5.jar' o 'lib/httpclient-4.2.5.jar' [INFO] Building zip: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-bundler/target/NetarchiveSuite-heritrix3-bundler-7.4-SNAPSHOT.zip [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvester - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvester-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ harvester-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvester-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvester-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvester-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 14 resources [INFO] Copying 441 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvester-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 128 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/viewerproxy/ARCArchiveAccessTester.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/viewerproxy/ARCArchiveAccessTester.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/CombiningMultiFileBasedCacheTester.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/CombiningMultiFileBasedCacheTester.java uses unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/CombiningMultiFileBasedCacheTester.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvester-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvester-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvester-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/target/harvester-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvester-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - monitor - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ monitor-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ monitor-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ monitor-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ monitor-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ monitor-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 8 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ monitor-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 4 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ monitor-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ monitor-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ monitor-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/target/monitor-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ monitor-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - wayback resourceStore 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback-resourcestore --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ wayback-resourcestore --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-resourcestore --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-resourcestore --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 7 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-resourcestore --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-resourcestore --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 4 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-resourcestore --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-resourcestore --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-resourcestore --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/wayback-resourcestore-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-resourcestore --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/wayback-resourcestore-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - wayback - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ wayback-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 28 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 17 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/test/java/dk/netarkivet/wayback/hadoop/CDXMapperTester.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/test/java/dk/netarkivet/wayback/hadoop/CDXMapperTester.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/target/wayback-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - integration tests 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ integration-test --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ integration-test --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ integration-test --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite System test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ system-test --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ system-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ system-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ system-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 22 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ system-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 34 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java uses unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ system-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ system-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ system-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/target/system-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ system-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] NetarchiveSuite .................................... SUCCESS [ 1.467 s] [INFO] NetarchiveSuite - build-tools ...................... SUCCESS [ 1.454 s] [INFO] NetarchiveSuite - common ........................... SUCCESS [ 0.150 s] [INFO] NetarchiveSuite - test utils ....................... SUCCESS [ 2.115 s] [INFO] NetarchiveSuite - common - core .................... SUCCESS [ 8.692 s] [INFO] NetarchiveSuite - common - test .................... SUCCESS [ 3.891 s] [INFO] NetarchiveSuite - archive .......................... SUCCESS [ 0.142 s] [INFO] NetarchiveSuite - archive - core ................... SUCCESS [ 3.683 s] [INFO] NetarchiveSuite - harvester ........................ SUCCESS [ 0.188 s] [INFO] NetarchiveSuite - harvester - core ................. SUCCESS [ 6.670 s] [INFO] NetarchiveSuite - archive - test ................... SUCCESS [ 3.471 s] [INFO] NetarchiveSuite - bitpreservation - webapp ......... SUCCESS [ 0.956 s] [INFO] NetarchiveSuite - Harvest Scheduler ................ SUCCESS [ 2.677 s] [INFO] NetarchiveSuite - monitor .......................... SUCCESS [ 0.108 s] [INFO] NetarchiveSuite - monitor - core ................... SUCCESS [ 2.057 s] [INFO] NetarchiveSuite - wayback .......................... SUCCESS [ 0.116 s] [INFO] NetarchiveSuite - wayback - indexer ................ SUCCESS [ 2.476 s] [INFO] NetarchiveSuite - deploy ........................... SUCCESS [ 0.123 s] [INFO] NetarchiveSuite - deploy - core .................... SUCCESS [ 3.113 s] [INFO] NetarchiveSuite - harvester - heritrix3 ............ SUCCESS [ 0.112 s] [INFO] NetarchiveSuite - Heritrix3 Extensions ............. SUCCESS [ 3.157 s] [INFO] NetarchiveSuite - heritrix3 controller ............. SUCCESS [ 2.483 s] [INFO] hadoop-uber-jar .................................... SUCCESS [ 9.454 s] [INFO] hadoop-uber-jar-invoker ............................ SUCCESS [ 8.562 s] [INFO] NetarchiveSuite - Status - Webapp .................. SUCCESS [ 1.424 s] [INFO] NetarchiveSuite - qa - webapp ...................... SUCCESS [ 0.521 s] [INFO] NetarchiveSuite - history - webapp ................. SUCCESS [ 1.825 s] [INFO] NetarchiveSuite - harvestDefinition - webapp ....... SUCCESS [ 1.350 s] [INFO] NetarchiveSuite - harvestChannel - webapp .......... SUCCESS [ 0.482 s] [INFO] NetarchiveSuite - heritrix3 monitor ................ SUCCESS [ 19.558 s] [INFO] NetarchiveSuite - deploy - distribution ............ SUCCESS [ 18.963 s] [INFO] NetarchiveSuite - deploy - test .................... SUCCESS [ 2.475 s] [INFO] NetarchiveSuite - Heritrix3 Bundler ................ SUCCESS [ 16.830 s] [INFO] NetarchiveSuite - harvester - test ................. SUCCESS [ 3.786 s] [INFO] NetarchiveSuite - monitor - test ................... SUCCESS [ 1.856 s] [INFO] NetarchiveSuite - wayback resourceStore ............ SUCCESS [ 2.300 s] [INFO] NetarchiveSuite - wayback - test ................... SUCCESS [ 1.834 s] [INFO] NetarchiveSuite - integration tests ................ SUCCESS [ 0.149 s] [INFO] NetarchiveSuite System test ........................ SUCCESS [ 1.760 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:36 min [INFO] Finished at: 2022-07-11T10:47:14+02:00 [INFO] Final Memory: 134M/325M [INFO] ------------------------------------------------------------------------ channel stopped [NetarchiveSuite-Colin-1-Click] $ /bin/bash /tmp/hudson6397039232499554292.sh Do a total cleanup of system Test6 start tunning cleanup script end part of script -------------------------------------------- KILLING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk Killing all applications on: sb-test-har-001.statsbiblioteket.dk Killing linux application: HarvestControllerApplication_sbhigh_h3 -------------------------------------------- -------------------------------------------- KILLING MACHINE: devel@kb-test-adm-001.kb.dk Killing all applications on: kb-test-adm-001.kb.dk Killing linux application: GUIApplication Killing linux application: ArcRepositoryApplication Killing linux application: HarvestJobManagerApplication -------------------------------------------- KILLING MACHINE: devel@kb-test-har-003.kb.dk Killing all applications on: kb-test-har-003.kb.dk Killing linux application: HarvestControllerApplication_kblow001_h3 -------------------------------------------- KILLING MACHINE: devel@kb-test-har-005.kb.dk Killing all applications on: kb-test-har-005.kb.dk Killing linux application: HarvestControllerApplication_browser_1 Killing linux application: HarvestControllerApplication_browser_2 -------------------------------------------- KILLING MACHINE: devel@kb-test-har-004.kb.dk Killing all applications on: kb-test-har-004.kb.dk Killing linux application: HarvestControllerApplication_kblow002_h3 Killing linux application: HarvestControllerApplication_kbhigh_h3 -------------------------------------------- KILLING MACHINE: devel@kb-test-acs-001.kb.dk Killing all applications on: kb-test-acs-001.kb.dk Killing linux application: IndexServerApplication Killing linux application: ViewerProxyApplication -------------------------------------------- KILLING MACHINE: devel@kb-test-way-001.kb.dk Killing all applications on: kb-test-way-001.kb.dk Killing linux application: WaybackIndexerApplication Killing linux application: AggregatorApplication -------------------------------------------- running cleanup_bitmag Resetting Collection Test6 Delete content in collection=Test6 10:48:22.527 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 10:48:22.916 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 10:48:22.961 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 10:48:23.714 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 10:48:23.729 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 10:48:23.729 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 10:48:23.881 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:48:23.881 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 10:48:24.748 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 10:48:24.836 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:48:24.839 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-5826] 10:48:24.842 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 10:48:24.843 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5826' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 10:48:24.843 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5826' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5826#1297836716'. 10:48:24.843 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5826#1297836716'. Checksum: Count: FileID: 10:48:24.879 INFO o.b.a.g.ConversationBasedGetChecksumsClient - Requesting the checksums for file '' with the specifications 'org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@7133da86[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)]null' with query [ContributorQuery{componentID='netarkiv-tape-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-disk-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-disk-devel-02, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-checksum-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-kbh-disk-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}]. 10:48:24.899 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 10:48:25.578 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent IdentifyPillarsForGetChecksumsRequest(05845ec4) collectionID Test6, destination topic://netarkiv-devel: FileIDs=AllFiles 10:48:25.579 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 05845ec4: GET_CHECKSUMS: IDENTIFY_REQUEST_SENT: , Identifying pillars for GetChecksums 10:48:25.938 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(05845ec4) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(Checksum operation available.) 10:48:25.954 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 05845ec4: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01 10:48:25.954 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 10:48:25.954 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01] 10:48:26.204 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(05845ec4) collectionID Test6, from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 10:48:26.220 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 05845ec4: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01 10:48:26.220 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 10:48:26.220 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-disk-devel-01] 10:48:26.579 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(05845ec4) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 10:48:26.585 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 05845ec4: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01 10:48:26.585 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 10:48:26.585 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01] 10:48:26.813 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(05845ec4) collectionID Test6, from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.) 10:48:26.814 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 05845ec4: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01 10:48:26.815 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 10:48:26.815 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02] 10:48:34.896 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 05845ec4: GET_CHECKSUMS: IDENTIFY_TIMEOUT: , Time has run out for looking up contributors The following contributors didn't respond: [netarkiv-disk-devel-02] 10:48:34.897 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 05845ec4: GET_CHECKSUMS: COMPONENT_FAILED: ContributorID netarkiv-disk-devel-02 ResponseCode: null, Timeout for identifying contributor 10:48:34.898 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 05845ec4: GET_CHECKSUMS: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01] 10:48:34.899 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 05845ec4: GET_CHECKSUMS: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], Sending GetFileIDsRequest's 10:48:35.257 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(05845ec4) collectionID Test6, destination queue://netarkiv-tape-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@7133da86[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00 10:48:35.861 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(05845ec4) collectionID Test6, destination queue://netarkiv-disk-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@7133da86[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00 10:48:35.974 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(05845ec4) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 10:48:35.978 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 05845ec4: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS 10:48:36.363 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(05845ec4) collectionID Test6, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@7133da86[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00 10:48:36.589 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(05845ec4) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED), NumberOfChecksums=2, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@5a4dc731[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], PartialResult=false 10:48:36.605 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 10:48:36.606 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01] 10:48:36.945 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(05845ec4) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 10:48:36.952 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 05845ec4: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS 10:48:36.964 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(05845ec4) collectionID Test6, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@7133da86[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00 10:48:37.166 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(05845ec4) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED), NumberOfChecksums=2, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@6a213518[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], PartialResult=false 10:48:37.176 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 10:48:37.176 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-kbh-disk-devel-01] 10:48:37.387 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(05845ec4) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS(Starting to calculate checksums.) 10:48:37.388 DEBUG o.b.commandline.GetChecksumsCmd - Received event: 05845ec4: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-checksum-devel-01, Starting to calculate checksums. 10:48:37.575 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(05845ec4) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_COMPLETED, NumberOfChecksums=2, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@41795b1[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], PartialResult=false 10:48:37.576 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 10:48:37.576 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-kbh-disk-devel-01] 10:48:37.769 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(05845ec4) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(Completed checksum retrieval.), NumberOfChecksums=2, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@70624b03[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], PartialResult=false 10:48:37.770 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 10:48:37.770 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [] 0a5f1cbef3440bdb7eccede63d02aaed 4 1-metadata-1.warc.gz e7062a763a61fb537d4ffcb471cc8ceb 4 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz Deleting file FileID: with checksum Checksum: in collection Test6 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01 10:48:39.169 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 10:48:39.252 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 10:48:39.580 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 10:48:39.630 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 10:48:40.377 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 10:48:40.396 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 10:48:40.396 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 10:48:40.555 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:48:40.556 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 10:48:41.455 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 10:48:41.541 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:48:41.543 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-5858] 10:48:41.546 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 10:48:41.546 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@73700b80' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5858' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 10:48:41.546 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5858' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@73700b80'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5858#1936722816'. 10:48:41.546 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5858#1936722816'. 10:48:41.561 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. java.lang.IllegalArgumentException: String hexString, 'Checksum:', must be an even number of characters. at org.bitrepository.common.ArgumentValidator.checkTrue(ArgumentValidator.java:160) at org.bitrepository.common.utils.Base16Utils.encodeBase16(Base16Utils.java:64) at org.bitrepository.commandline.CommandLineClient.getChecksumDataForDeleteValidation(CommandLineClient.java:302) at org.bitrepository.commandline.DeleteFileCmd.deleteTheFile(DeleteFileCmd.java:125) at org.bitrepository.commandline.DeleteFileCmd.performOperation(DeleteFileCmd.java:107) at org.bitrepository.commandline.CommandLineClient.runCommand(CommandLineClient.java:68) at org.bitrepository.commandline.DeleteFileCmd.main(DeleteFileCmd.java:47) xargs: ssh: exited with status 255; aborting Deleting file 1-metadata-1.warc.gz with checksum 0a5f1cbef3440bdb7eccede63d02aaed in collection Test6 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01 10:48:43.030 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 10:48:43.137 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 10:48:43.520 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 10:48:43.559 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 10:48:44.300 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 10:48:44.316 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 10:48:44.317 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 10:48:44.495 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:48:44.496 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 10:48:45.383 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 10:48:45.483 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:48:45.486 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-5894] 10:48:45.490 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 10:48:45.490 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5894' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 10:48:45.491 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5894' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5894#1297836716'. 10:48:45.491 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5894#1297836716'. 10:48:45.512 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 10:48:45.526 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 10:48:45.528 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-tape-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={10,95,28,-66,-13,68,11,-37,126,-52,-19,-26,61,2,-86,-19}, calculationTimestamp=2022-07-11T10:48:45.515+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 10:48:45.549 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 10:48:46.164 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(da830916) collectionID Test6, to netarkiv-tape-devel-01, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz 10:48:46.165 DEBUG o.b.commandline.DeleteFileCmd - Received event: da830916: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 10:48:46.512 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(da830916) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.) 10:48:46.528 DEBUG o.b.c.c.ConversationEventMonitor - da830916: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01 10:48:46.779 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(da830916) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 10:48:46.784 DEBUG o.b.c.c.ConversationEventMonitor - da830916: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01 10:48:47.054 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(da830916) collectionID Test6, from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 10:48:47.055 DEBUG o.b.commandline.DeleteFileCmd - Received event: da830916: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01 10:48:47.056 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 10:48:47.056 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: [] 10:48:47.056 DEBUG o.b.commandline.DeleteFileCmd - Received event: da830916: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-tape-devel-01] 10:48:47.057 DEBUG o.b.commandline.DeleteFileCmd - Received event: da830916: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-tape-devel-01], Sending request for deleting file 10:48:47.285 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(da830916) collectionID Test6, to netarkiv-tape-devel-01, destination queue://netarkiv-tape-devel-01: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={10,95,28,-66,-13,68,11,-37,126,-52,-19,-26,61,2,-86,-19}, calculationTimestamp=2022-07-11T10:48:45.515+02:00] 10:48:47.914 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(da830916) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 10:48:47.915 DEBUG o.b.commandline.DeleteFileCmd - Received event: da830916: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS 10:48:48.182 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(da830916) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED) 10:48:48.183 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 10:48:48.183 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: [] 10:48:48.183 DEBUG o.b.commandline.DeleteFileCmd - Complete: da830916: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 10:48:48.183 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz': 10:48:48.184 DEBUG o.b.commandline.DeleteFileCmd - da830916: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 10:48:49.396 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 10:48:49.502 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 10:48:49.861 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 10:48:49.893 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 10:48:50.614 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 10:48:50.630 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 10:48:50.631 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 10:48:50.815 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:48:50.816 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 10:48:51.681 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 10:48:51.777 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:48:51.779 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-5933] 10:48:51.782 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 10:48:51.782 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5933' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 10:48:51.782 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5933' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5933#1297836716'. 10:48:51.782 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5933#1297836716'. 10:48:51.799 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 10:48:51.808 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 10:48:51.809 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={10,95,28,-66,-13,68,11,-37,126,-52,-19,-26,61,2,-86,-19}, calculationTimestamp=2022-07-11T10:48:51.801+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 10:48:51.823 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 10:48:52.377 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(fe37ff37) collectionID Test6, to netarkiv-disk-devel-01, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz 10:48:52.378 DEBUG o.b.commandline.DeleteFileCmd - Received event: fe37ff37: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 10:48:52.775 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fe37ff37) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.) 10:48:52.779 DEBUG o.b.c.c.ConversationEventMonitor - fe37ff37: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01 10:48:53.033 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fe37ff37) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 10:48:53.034 DEBUG o.b.commandline.DeleteFileCmd - Received event: fe37ff37: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01 10:48:53.035 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 10:48:53.035 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: [] 10:48:53.035 DEBUG o.b.commandline.DeleteFileCmd - Received event: fe37ff37: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-disk-devel-01] 10:48:53.036 DEBUG o.b.commandline.DeleteFileCmd - Received event: fe37ff37: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-disk-devel-01], Sending request for deleting file 10:48:53.703 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(fe37ff37) collectionID Test6, to netarkiv-disk-devel-01, destination queue://netarkiv-disk-devel-01: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={10,95,28,-66,-13,68,11,-37,126,-52,-19,-26,61,2,-86,-19}, calculationTimestamp=2022-07-11T10:48:51.801+02:00] 10:48:53.715 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fe37ff37) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 10:48:53.716 DEBUG o.b.c.c.ConversationEventMonitor - fe37ff37: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01 10:48:54.242 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(fe37ff37) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 10:48:54.247 DEBUG o.b.commandline.DeleteFileCmd - Received event: fe37ff37: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS 10:48:54.550 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(fe37ff37) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED) 10:48:54.551 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 10:48:54.551 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: [] 10:48:54.552 DEBUG o.b.commandline.DeleteFileCmd - Complete: fe37ff37: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 10:48:54.553 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz': 10:48:54.553 DEBUG o.b.commandline.DeleteFileCmd - fe37ff37: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 10:48:56.001 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 10:48:56.110 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 10:48:56.386 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 10:48:56.433 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 10:48:57.233 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 10:48:57.250 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 10:48:57.250 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 10:48:57.426 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:48:57.426 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 10:48:58.231 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 10:48:58.341 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:48:58.344 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-5973] 10:48:58.348 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 10:48:58.348 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5973' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 10:48:58.349 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5973' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5973#282265585'. 10:48:58.349 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-5973#282265585'. 10:48:58.374 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 10:48:58.388 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 10:48:58.391 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-checksum-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@25084a1e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@156b88f5[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={10,95,28,-66,-13,68,11,-37,126,-52,-19,-26,61,2,-86,-19}, calculationTimestamp=2022-07-11T10:48:58.377+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 10:48:58.414 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 10:48:59.064 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(683cde5f) collectionID Test6, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz 10:48:59.066 DEBUG o.b.commandline.DeleteFileCmd - Received event: 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 10:48:59.462 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(683cde5f) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.) 10:48:59.475 DEBUG o.b.c.c.ConversationEventMonitor - 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01 10:48:59.743 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(683cde5f) collectionID Test6, from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.) 10:48:59.752 DEBUG o.b.commandline.DeleteFileCmd - Received event: 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01 10:48:59.754 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 10:48:59.754 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: [] 10:48:59.755 DEBUG o.b.commandline.DeleteFileCmd - Received event: 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-checksum-devel-01] 10:48:59.756 DEBUG o.b.commandline.DeleteFileCmd - Received event: 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01], Sending request for deleting file 10:49:00.371 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(683cde5f) collectionID Test6, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 10:49:00.525 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(683cde5f) collectionID Test6, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@25084a1e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@156b88f5[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={10,95,28,-66,-13,68,11,-37,126,-52,-19,-26,61,2,-86,-19}, calculationTimestamp=2022-07-11T10:48:58.377+02:00] 10:49:00.533 DEBUG o.b.c.c.ConversationEventMonitor - 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01 10:49:00.721 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(683cde5f) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 10:49:00.723 DEBUG o.b.c.c.ConversationEventMonitor - 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01 10:49:00.980 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(683cde5f) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS 10:49:00.987 DEBUG o.b.commandline.DeleteFileCmd - Received event: 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-checksum-devel-01 10:49:01.257 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(683cde5f) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_COMPLETED 10:49:01.258 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 10:49:01.258 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: [] 10:49:01.259 DEBUG o.b.commandline.DeleteFileCmd - Complete: 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 10:49:01.259 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz': 10:49:01.259 DEBUG o.b.commandline.DeleteFileCmd - 683cde5f: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 10:49:02.576 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 10:49:02.654 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 10:49:02.943 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 10:49:02.995 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 10:49:03.733 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 10:49:03.753 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 10:49:03.753 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 10:49:03.984 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:49:03.985 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 10:49:04.953 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 10:49:05.042 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:49:05.044 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-6014] 10:49:05.047 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 10:49:05.047 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6014' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 10:49:05.048 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6014' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4a7f959b'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6014#1249875355'. 10:49:05.048 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6014#1249875355'. 10:49:05.062 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 10:49:05.072 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 10:49:05.074 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-metadata-1.warc.gz' from the pillar 'netarkiv-kbh-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={10,95,28,-66,-13,68,11,-37,126,-52,-19,-26,61,2,-86,-19}, calculationTimestamp=2022-07-11T10:49:05.064+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 10:49:05.094 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 10:49:05.725 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(e5df53d4) collectionID Test6, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel: FileID=1-metadata-1.warc.gz 10:49:05.726 DEBUG o.b.commandline.DeleteFileCmd - Received event: e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 10:49:06.104 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(e5df53d4) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-metadata-1.warc.gz is in collection and can be deleted.) 10:49:06.129 DEBUG o.b.commandline.DeleteFileCmd - Received event: e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01 10:49:06.130 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 10:49:06.130 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: [] 10:49:06.130 DEBUG o.b.commandline.DeleteFileCmd - Received event: e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01] 10:49:06.131 DEBUG o.b.commandline.DeleteFileCmd - Received event: e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: REQUEST_SENT: ContributorID [netarkiv-kbh-disk-devel-01], Sending request for deleting file 10:49:06.742 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(e5df53d4) collectionID Test6, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 10:49:06.750 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(e5df53d4) collectionID Test6, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileID=1-metadata-1.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@16610890[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@71def8f8[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={10,95,28,-66,-13,68,11,-37,126,-52,-19,-26,61,2,-86,-19}, calculationTimestamp=2022-07-11T10:49:05.064+02:00] 10:49:06.768 DEBUG o.b.c.c.ConversationEventMonitor - e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01 10:49:07.027 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(e5df53d4) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 10:49:07.028 DEBUG o.b.c.c.ConversationEventMonitor - e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01 10:49:07.291 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(e5df53d4) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(Deleting..) 10:49:07.306 DEBUG o.b.commandline.DeleteFileCmd - Received event: e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: PROGRESS: ContributorID netarkiv-kbh-disk-devel-01, Deleting.. 10:49:07.565 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(e5df53d4) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(1-metadata-1.warc.gz deleted.) 10:49:07.566 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 10:49:07.566 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: [] 10:49:07.566 DEBUG o.b.commandline.DeleteFileCmd - Complete: e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: 10:49:07.567 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-metadata-1.warc.gz': 10:49:07.567 DEBUG o.b.commandline.DeleteFileCmd - e5df53d4: DELETE_FILE for file 1-metadata-1.warc.gz: COMPLETE: Deleting file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz with checksum e7062a763a61fb537d4ffcb471cc8ceb in collection Test6 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01 10:49:08.920 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 10:49:09.048 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 10:49:09.398 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 10:49:09.443 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 10:49:10.172 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 10:49:10.191 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 10:49:10.191 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 10:49:10.368 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:49:10.369 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 10:49:11.224 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 10:49:11.358 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:49:11.361 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-6054] 10:49:11.365 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 10:49:11.366 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6054' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 10:49:11.366 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6054' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6054#1297836716'. 10:49:11.366 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6054#1297836716'. 10:49:11.394 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 10:49:11.408 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 10:49:11.410 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-tape-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:11.397+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 10:49:11.430 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 10:49:12.189 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(d0085a97) collectionID Test6, to netarkiv-tape-devel-01, destination topic://netarkiv-devel: FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz 10:49:12.191 DEBUG o.b.commandline.DeleteFileCmd - Received event: d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 10:49:12.560 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(d0085a97) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.) 10:49:12.570 DEBUG o.b.c.c.ConversationEventMonitor - d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01 10:49:12.822 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(d0085a97) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 10:49:12.831 DEBUG o.b.c.c.ConversationEventMonitor - d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01 10:49:13.074 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(d0085a97) collectionID Test6, from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 10:49:13.075 DEBUG o.b.commandline.DeleteFileCmd - Received event: d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01 10:49:13.076 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 10:49:13.076 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: [] 10:49:13.076 DEBUG o.b.commandline.DeleteFileCmd - Received event: d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-tape-devel-01] 10:49:13.077 DEBUG o.b.commandline.DeleteFileCmd - Received event: d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-tape-devel-01], Sending request for deleting file 10:49:13.323 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(d0085a97) collectionID Test6, to netarkiv-tape-devel-01, destination queue://netarkiv-tape-devel-01: FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:11.397+02:00] 10:49:13.874 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(d0085a97) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 10:49:13.875 DEBUG o.b.commandline.DeleteFileCmd - Received event: d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS 10:49:14.134 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(d0085a97) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED) 10:49:14.135 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 10:49:14.135 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-tape-devel-01], components that have not answered: [] 10:49:14.136 DEBUG o.b.commandline.DeleteFileCmd - Complete: d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 10:49:14.136 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 10:49:14.136 DEBUG o.b.commandline.DeleteFileCmd - d0085a97: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 10:49:15.401 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 10:49:15.501 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 10:49:15.786 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 10:49:15.815 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 10:49:16.463 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 10:49:16.480 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 10:49:16.481 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 10:49:16.659 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:49:16.660 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 10:49:17.550 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 10:49:17.628 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:49:17.630 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-6093] 10:49:17.632 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 10:49:17.633 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6093' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 10:49:17.633 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6093' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6093#1297836716'. 10:49:17.633 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6093#1297836716'. 10:49:17.649 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 10:49:17.658 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 10:49:17.660 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:17.651+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 10:49:17.674 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 10:49:18.191 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(03ccb09c) collectionID Test6, to netarkiv-disk-devel-01, destination topic://netarkiv-devel: FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz 10:49:18.192 DEBUG o.b.commandline.DeleteFileCmd - Received event: 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 10:49:18.558 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(03ccb09c) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.) 10:49:18.579 DEBUG o.b.c.c.ConversationEventMonitor - 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01 10:49:18.833 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(03ccb09c) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 10:49:18.834 DEBUG o.b.commandline.DeleteFileCmd - Received event: 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01 10:49:18.835 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 10:49:18.835 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: [] 10:49:18.839 DEBUG o.b.commandline.DeleteFileCmd - Received event: 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-disk-devel-01] 10:49:18.840 DEBUG o.b.commandline.DeleteFileCmd - Received event: 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-disk-devel-01], Sending request for deleting file 10:49:19.345 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(03ccb09c) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 10:49:19.418 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(03ccb09c) collectionID Test6, to netarkiv-disk-devel-01, destination queue://netarkiv-disk-devel-01: FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:17.651+02:00] 10:49:19.419 DEBUG o.b.c.c.ConversationEventMonitor - 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01 10:49:19.973 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(03ccb09c) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 10:49:19.976 DEBUG o.b.commandline.DeleteFileCmd - Received event: 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS 10:49:20.223 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(03ccb09c) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED) 10:49:20.224 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 10:49:20.224 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-01], components that have not answered: [] 10:49:20.224 DEBUG o.b.commandline.DeleteFileCmd - Complete: 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 10:49:20.225 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 10:49:20.225 DEBUG o.b.commandline.DeleteFileCmd - 03ccb09c: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 10:49:21.500 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 10:49:21.610 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 10:49:21.985 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 10:49:22.035 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 10:49:22.842 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 10:49:22.859 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 10:49:22.860 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 10:49:23.022 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:49:23.022 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 10:49:23.868 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 10:49:23.959 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:49:23.962 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-6133] 10:49:23.965 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 10:49:23.966 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6133' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 10:49:23.966 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6133' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6133#1297836716'. 10:49:23.966 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6133#1297836716'. 10:49:23.987 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 10:49:23.999 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 10:49:24.001 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-checksum-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:23.990+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 10:49:24.021 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 10:49:24.748 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(a3aa95c4) collectionID Test6, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel: FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz 10:49:24.748 DEBUG o.b.commandline.DeleteFileCmd - Received event: a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 10:49:25.092 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(a3aa95c4) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.) 10:49:25.108 DEBUG o.b.c.c.ConversationEventMonitor - a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-kbh-disk-devel-01 10:49:25.454 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(a3aa95c4) collectionID Test6, from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.) 10:49:25.459 DEBUG o.b.commandline.DeleteFileCmd - Received event: a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01 10:49:25.460 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 10:49:25.460 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: [] 10:49:25.461 DEBUG o.b.commandline.DeleteFileCmd - Received event: a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-checksum-devel-01] 10:49:25.461 DEBUG o.b.commandline.DeleteFileCmd - Received event: a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01], Sending request for deleting file 10:49:25.986 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(a3aa95c4) collectionID Test6, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 10:49:26.136 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(a3aa95c4) collectionID Test6, to netarkiv-checksum-devel-01, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@156b88f5[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@3bf9ce3e[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:23.990+02:00] 10:49:26.136 DEBUG o.b.c.c.ConversationEventMonitor - a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01 10:49:26.359 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(a3aa95c4) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 10:49:26.370 DEBUG o.b.c.c.ConversationEventMonitor - a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01 10:49:26.621 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(a3aa95c4) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS 10:49:26.628 DEBUG o.b.commandline.DeleteFileCmd - Received event: a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-checksum-devel-01 10:49:26.906 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(a3aa95c4) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_COMPLETED 10:49:26.907 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 10:49:26.907 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01], components that have not answered: [] 10:49:26.908 DEBUG o.b.commandline.DeleteFileCmd - Complete: a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 10:49:26.908 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 10:49:26.908 DEBUG o.b.commandline.DeleteFileCmd - a3aa95c4: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 10:49:28.227 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 10:49:28.307 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 10:49:28.621 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 10:49:28.649 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 10:49:29.406 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 10:49:29.421 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 10:49:29.421 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 10:49:29.607 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:49:29.608 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 10:49:30.533 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 10:49:30.626 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 10:49:30.629 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-6173] 10:49:30.631 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 10:49:30.632 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@73700b80' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6173' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 10:49:30.632 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6173' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@73700b80'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6173#1936722816'. 10:49:30.632 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-6173#1936722816'. 10:49:30.648 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. 10:49:30.657 DEBUG o.b.commandline.DeleteFileCmd - Initiating the DeleteFile conversation. 10:49:30.660 INFO o.b.m.d.ConversationBasedDeleteFileClient - Requesting the deletion of the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz' from the pillar 'netarkiv-kbh-disk-devel-01' with checksum 'org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@4efc180e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@bd4dc25[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:30.650+02:00]', while requested checksum 'null'. And the audit trail information 'null'. 10:49:30.674 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 10:49:31.239 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent IdentifyPillarsForDeleteFileRequest(fde55508) collectionID Test6, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel: FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz 10:49:31.240 DEBUG o.b.commandline.DeleteFileCmd - Received event: fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFY_REQUEST_SENT: , Identifying pillars for delete file 10:49:31.650 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fde55508) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(File 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz is in collection and can be deleted.) 10:49:31.657 DEBUG o.b.commandline.DeleteFileCmd - Received event: fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01 10:49:31.658 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 10:49:31.658 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: [] 10:49:31.658 DEBUG o.b.commandline.DeleteFileCmd - Received event: fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01] 10:49:31.659 DEBUG o.b.commandline.DeleteFileCmd - Received event: fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: REQUEST_SENT: ContributorID [netarkiv-kbh-disk-devel-01], Sending request for deleting file 10:49:32.120 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fde55508) collectionID Test6, from netarkiv-disk-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 10:49:32.534 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Sent DeleteFileRequest(fde55508) collectionID Test6, to netarkiv-kbh-disk-devel-01, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileID=1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz, ChecksumDataForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumDataForFileTYPE@4efc180e[checksumSpec=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@bd4dc25[checksumType=MD5, checksumSalt=(default), otherChecksumType=(default)], checksumValue={-25,6,42,118,58,97,-5,83,125,79,-4,-76,113,-52,-116,-21}, calculationTimestamp=2022-07-11T10:49:30.650+02:00] 10:49:32.535 DEBUG o.b.c.c.ConversationEventMonitor - fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-disk-devel-01 10:49:32.680 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received IdentifyPillarsForDeleteFileResponse(fde55508) collectionID Test6, from netarkiv-tape-devel-01: FILE_NOT_FOUND_FAILURE(Cannot serve request, file not on store) 10:49:32.683 DEBUG o.b.c.c.ConversationEventMonitor - fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz:Ignoring message from irrelevant component netarkiv-tape-devel-01 10:49:32.935 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileProgressResponse(fde55508) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(Deleting..) 10:49:32.937 DEBUG o.b.commandline.DeleteFileCmd - Received event: fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: PROGRESS: ContributorID netarkiv-kbh-disk-devel-01, Deleting.. 10:49:33.280 DEBUG o.b.p.m.l.DeleteFileMessageLogger - Received DeleteFileFinalResponse(fde55508) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz deleted.) 10:49:33.281 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 10:49:33.281 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-kbh-disk-devel-01], components that have not answered: [] 10:49:33.282 DEBUG o.b.commandline.DeleteFileCmd - Complete: fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: 10:49:33.282 INFO o.b.commandline.DeleteFileCmd - Results of the DeleteFile operation for the file '1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz': 10:49:33.282 DEBUG o.b.commandline.DeleteFileCmd - fde55508: DELETE_FILE for file 1-1-20220711081221217-00000-sb-test-har-001.statsbiblioteket.dk.warc.gz: COMPLETE: calling cleanup_hosts running cleanup_hosts Removing installation on sb-test-har-001.statsbiblioteket.dk Removing installation on kb-test-har-003.kb.dk Removing installation on kb-test-har-004.kb.dk Removing installation on kb-test-har-005.kb.dk Removing installation on kb-test-adm-001.kb.dk Removing installation on kb-test-acs-001.kb.dk Removing installation on kb-test-way-001.kb.dk calling cleanup_linuxbarhosts running cleanup_linuxbarhosts Removing installation on sb-test-bar-001.statsbiblioteket.dk Removing bitarchive on sb-test-bar-001.statsbiblioteket.dk Calling cleanup_windowsbarhosts running cleanup_windowsbarhosts Removing C:\bitarkiv\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out Removing E:\bitarchive_1\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out Removing F:\bitarchive_2\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out Removing g:\bitarchive_3\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out Removing C:\Users\ba-devel\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out TESTX=Test6 PORT=8078 MAILRECEIVERS=csr@kb.dk VERSION=CSR DEPLOYCONF=deploy_config_bitmag.xml H3ZIP=CSR BITMAGCONF=/home/devel/bitmag_test_config/client_config Using bundler file /home/devel/nas_versions/bundler/NetarchiveSuite-heritrix3-bundler-CSR.zip Creating distribution files in /home/devel/prepared_software/Test6. Will read source files using encoding 'UTF-8' (defaulted) Branch in settings not found: common.warcRecordService Branch in settings not found: common.arcrepositoryClient.bitrepository.getFileIDsMaxResults Branch in settings not found: common.hadoop.kerberos Branch in settings not found: common.hadoop.username Branch in settings not found: common.hadoop.mapred.hadoopUberJar Branch in settings not found: common.hadoop.mapred.inputFilesParentDir Branch in settings not found: common.hadoop.mapred.cdxJob Branch in settings not found: common.hadoop.mapred.metadataExtractionJob Branch in settings not found: common.hadoop.mapred.metadataCDXExtractionJob Branch in settings not found: common.hadoop.mapred.crawlLogExtractionJob Branch in settings not found: common.fileResolver.class Branch in settings not found: common.fileResolver.baseUrl Branch in settings not found: common.fileResolver.keyfile Branch in settings not found: common.webinterface.metadata_cache_dir Branch in settings not found: harvester.harvesting.heritrix3.bundle Branch in settings not found: harvester.harvesting.heritrix3.certificate Branch in settings not found: harvester.harvesting.heritrix3.bundle Branch in settings not found: harvester.harvesting.heritrix3.certificate Branch in settings not found: harvester.harvesting.umbra Branch in settings not found: harvester.harvesting.heritrix3.bundle Branch in settings not found: harvester.harvesting.heritrix3.certificate Branch in settings not found: harvester.harvesting.umbra Branch in settings not found: harvester.harvesting.heritrix3.bundle Branch in settings not found: harvester.harvesting.heritrix3.bundle Machine 'kb-test-adm-001.kb.dk' configured with encoding 'UTF-8' (defaulted) Machine 'kb-test-har-003.kb.dk' configured with encoding 'UTF-8' (defaulted) NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip /home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks Machine 'kb-test-har-005.kb.dk' configured with encoding 'UTF-8' (defaulted) NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip /home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks Machine 'kb-test-har-004.kb.dk' configured with encoding 'UTF-8' (defaulted) NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip Machine 'kb-test-acs-001.kb.dk' configured with encoding 'UTF-8' (defaulted) Machine 'kb-test-way-001.kb.dk' configured with encoding 'UTF-8' (defaulted) Machine 'sb-test-har-001.statsbiblioteket.dk' configured with encoding 'UTF-8' (defaulted) /home/devel/prepared_software/Test6/NetarchiveSuite-heritrix3-bundler.zip -> /home/netarkdv/Test6/NetarchiveSuite-heritrix3-bundler.zip 10:55:01.239 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 10:55:01.244 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 10:55:01.245 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 10:55:01.245 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 10:55:01.245 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 10:55:01.246 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 10:55:01.246 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 10:55:01.246 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 10:55:01.247 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 10:55:01.247 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 10:55:01.247 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 10:55:01.247 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 10:55:01.315 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 10:55:01.315 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-adm-001.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-adm-001.kb.dk deleting devel@kb-test-adm-001.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-adm-001.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-har-003.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-har-003.kb.dk deleting devel@kb-test-har-003.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-har-003.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-har-005.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-har-005.kb.dk deleting devel@kb-test-har-005.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-har-005.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-har-004.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-har-004.kb.dk deleting devel@kb-test-har-004.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-har-004.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-acs-001.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-acs-001.kb.dk deleting devel@kb-test-acs-001.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-acs-001.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-way-001.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-way-001.kb.dk deleting devel@kb-test-way-001.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-way-001.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- -------------------------------------------- INSTALLING TO MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk copying NetarchiveSuite-CSR.zip to:sb-test-har-001.statsbiblioteket.dk deleting netarkdv@sb-test-har-001.statsbiblioteket.dk:/home/netarkdv/Test6/lib unzipping NetarchiveSuite-CSR.zip at:sb-test-har-001.statsbiblioteket.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- Initializing database for system Test6 + host=devel@kb-test-adm-001 + scp -p /home/devel/devel-config/scripts/db/setup_admindb.sh /home/devel/devel-config/scripts/db/setup_harvestdb.sh /home/devel/devel-config/scripts/db/teardown_admindb.sh /home/devel/devel-config/scripts/db/teardown_harvestdb.sh /home/devel/devel-config/scripts/../resources/harvestdb.testdata.sql /home/devel/devel-config/scripts/../resources/default_orderxml.cxml devel@kb-test-adm-001:bin/ + ssh devel@kb-test-adm-001 Pseudo-terminal will not be allocated because stdin is not a terminal. Dette system må kun tilgås af brugere autoriserede af Det Kgl. Bibliotek. This system is only to be used by users authorized by the Royal Danish Library. Destroying test6_admindb DROP DATABASE Creating empty test6_admindb CREATE DATABASE Initialising test6_admindb CREATE TABLE INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX CREATE INDEX CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE TABLE CREATE SEQUENCE ALTER TABLE Destroying test6_harvestdb DROP DATABASE CREATE DATABASE CREATE TABLE INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE GRANT CREATE TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX CREATE INDEX CREATE INDEX CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE INDEX GRANT CREATE TABLE GRANT CREATE TABLE CREATE INDEX GRANT CREATE TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT GRANT CREATE TABLE CREATE INDEX CREATE INDEX GRANT CREATE TABLE CREATE INDEX GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE INDEX CREATE INDEX CREATE INDEX GRANT CREATE TABLE CREATE INDEX CREATE INDEX GRANT CREATE TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT INSERT 0 1 INSERT 0 1 CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX GRANT GRANT ALTER TABLE ALTER TABLE ALTER TABLE ALTER TABLE CREATE TABLE ALTER TABLE CREATE INDEX CREATE SEQUENCE CREATE TABLE ALTER TABLE CREATE INDEX GRANT GRANT GRANT INSERT 0 1 INSERT 0 1 INSERT 0 1 SET SET SET SET SET SET SET SET SET COPY 16 COPY 16 setval -------- 17 (1 row) COPY 16 setval -------- 17 (1 row) COPY 3 setval -------- 17 (1 row) COPY 2 setval -------- 5 (1 row) COPY 4 setval -------- 4 (1 row) COPY 25 COPY 16 setval -------- 17 (1 row) 10:56:59.699 [MLog-Init-Reporter] INFO com.mchange.v2.log.MLog - MLog clients using slf4j logging. 10:56:59.729 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - Reading VM config for path list /com/mchange/v2/log/default-mchange-log.properties, /mchange-commons.properties, /c3p0.properties, hocon:/reference,/application,/c3p0,/, /mchange-log.properties, / 10:56:59.730 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping. 10:56:59.730 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping. 10:56:59.730 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping. 10:56:59.730 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping. 10:56:59.742 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping. 10:56:59.742 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping. 10:56:59.743 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping. 10:56:59.743 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping. 10:57:00.195 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.5.4 [built 23-March-2019 23:00:48 -0700; debug? true; trace: 10] 10:57:00.285 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ap1tm3dtr1lc8ghk|f4168b8,name=10bdx52ap1tm3dtr1lc8ghk|f4168b8 registered. 10:57:00.357 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ap1tm3dtr1lc8ghk|f4168b8,name=10bdx52ap1tm3dtr1lc8ghk|f4168b8 unregistered, in order to be reregistered after update. 10:57:00.358 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ap1tm3dtr1lc8ghk|f4168b8,name=10bdx52ap1tm3dtr1lc8ghk|f4168b8 registered. 10:57:00.377 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values: - minPoolSize=5 - maxPoolSize=20 - acquireIncrement=5 - maxStatements=0 - maxStatementsPerConnection=0 - idleConnTestPeriod=0 - idleConnTestQuery='null' - idleConnTestOnCheckin=false 10:57:00.460 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, dataSourceName -> 10bdx52ap1tm3dtr1lc8ghk|f4168b8, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, extensions -> {}, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, forceUseNamedDriverClass -> false, identityToken -> 10bdx52ap1tm3dtr1lc8ghk|f4168b8, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost:5432/test6_harvestdb, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 3600, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, preferredTestQuery -> null, privilegeSpawnedThreads -> false, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ] 10:57:00.510 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping. 10:57:00.511 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping. 10:57:00.511 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping. 10:57:00.511 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping. 10:57:00.511 [main] WARN com.mchange.v2.resourcepool.BasicResourcePool - Bad pool size config, start 3 < min 5. Using 5 as start. 10:57:00.536 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@5be6e01c config: [start -> 5; min -> 5; max -> 20; inc -> 5; num_acq_attempts -> 30; acq_attempt_delay -> 1000; check_idle_resources_delay -> 0; max_resource_age -> 3600000; max_idle_time -> 0; excess_max_idle_time -> 0; destroy_unreturned_resc_time -> 0; expiration_enforcement_delay -> 900000; break_on_acquisition_failure -> false; debug_store_checkout_exceptions -> false; force_synchronous_checkins -> false] 10:57:00.536 [main] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPoolManager - Created new pool for auth, username (masked): 'de******'. 10:57:00.536 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - acquire test -- pool size: 0; target_pool_size: 5; desired target? 1 10:57:00.536 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - awaitAvailable(): [unknown] 10:57:00.836 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@3911c2a7 [wrapping: SELECT version FROM schemaversions WHERE tablename = 'ordertemplates'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@1725dc0f [wrapping: null] 10:57:00.844 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@2145b572 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@15eb5ee5 [wrapping: null] 10:57:00.876 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@35ef1869 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@3c407114 [wrapping: null] The template 'default_orderxml' has now been updated. + set +x -------------------------------------------- STARTING MACHINE: devel@kb-test-adm-001.kb.dk Starting all applications on: kb-test-adm-001.kb.dk Starting linux application: GUIApplication Starting linux application: ArcRepositoryApplication Starting linux application: HarvestJobManagerApplication SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. -------------------------------------------- STARTING MACHINE: devel@kb-test-har-003.kb.dk Starting all applications on: kb-test-har-003.kb.dk Starting linux application: HarvestControllerApplication_kblow001_h3 10:57:08,560 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml] 10:57:08,810 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 10:57:08,813 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 10:57:08,820 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 10:57:08,833 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:08,892 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 10:57:08,899 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 10:57:08,928 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - No compression will be used 10:57:08,929 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - Will use the pattern ./log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log for the active file 10:57:08,932 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log'. 10:57:08,932 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Roll-over at midnight. 10:57:08,936 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Setting initial period to Mon Jul 11 10:57:08 CEST 2022 10:57:08,936 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 10:57:08,937 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 10:57:08,939 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:08,941 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow001_h3.log 10:57:08,941 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow001_h3.log] 10:57:08,942 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 10:57:09,444 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 10:57:09,446 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 10:57:09,447 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 10:57:09,447 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 10:57:09,447 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 10:57:09,448 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 10:57:09,448 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 10:57:09,450 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@40ef3420 - Registering current configuration as safe fallback point 2022-07-11 10:57:09.462 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 10:57:09.469 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_332 2022-07-11 10:57:09.470 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre 2022-07-11 10:57:09.470 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-07-11 10:57:09.470 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 10:57:09.475 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow001_h3.xml' 2022-07-11 10:57:09.611 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-003.kb.dk' and JMX/RMI ports 8170/8270 2022-07-11 10:57:09.612 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-003.kb.dk:8270/jndi/rmi://kb-test-har-003.kb.dk:8170/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 10:57:09.618 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 10:57:09.621 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:09.622 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:09.622 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 10:57:09.634 INFO d.n.h.h.HarvestControllerServer. - Starting HarvestControllerServer. 2022-07-11 10:57:09.635 INFO d.n.h.h.HarvestControllerServer. - Bound to harvest channel 'LOWPRIORITY' 2022-07-11 10:57:09.635 INFO d.n.h.h.HarvestControllerServer. - Serverdir: 'harvester_low' 2022-07-11 10:57:09.636 INFO d.n.h.h.HarvestControllerServer. - Harvesting requires at least 400000000 bytes free. 2022-07-11 10:57:09.756 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:09.757 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:09.771 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-003.kb.dk 2022-07-11 10:57:11.193 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-07-11 10:57:11.194 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@5c3b6c6e as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3 2022-07-11 10:57:11.206 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3']' 2022-07-11 10:57:11.207 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-07-11 10:57:11.207 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Using 'Test6' as default collectionID 2022-07-11 10:57:11.212 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Storing tempfiles in folder 'arcrepositoryTemp' 2022-07-11 10:57:11.221 INFO d.n.common.utils.HttpsClientBuilder. - Creating Aggressive retry handler for https queries. 2022-07-11 10:57:11.272 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist! 2022-07-11 10:57:11.299 DEBUG d.n.h.h.HarvestControllerServer. - Obtained JMS connection. 2022-07-11 10:57:11.301 INFO d.n.h.h.HarvestControllerServer. - SEND_READY_DELAY used by HarvestControllerServer is 300 2022-07-11 10:57:11.301 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_low' 2022-07-11 10:57:11.302 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7c56e013 as listener to Test6_COMMON_HCHAN_VAL_RESP 2022-07-11 10:57:11.335 INFO d.n.h.h.HarvestControllerServer. - Requested to check the validity of harvest channel 'LOWPRIORITY' 2022-07-11 10:57:11.348 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'LOWPRIORITY' is valid. 2022-07-11 10:57:11.350 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY']' 2022-07-11 10:57:11.350 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7c56e013 as listener to Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY -------------------------------------------- STARTING MACHINE: devel@kb-test-har-005.kb.dk Starting all applications on: kb-test-har-005.kb.dk Starting linux application: HarvestControllerApplication_browser_1 Starting linux application: HarvestControllerApplication_browser_2 10:57:14,089 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml] 10:57:14,471 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 10:57:14,475 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 10:57:14,496 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 10:57:14,526 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:14,657 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 10:57:14,661 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 10:57:14,693 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - No compression will be used 10:57:14,694 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - Will use the pattern ./log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log for the active file 10:57:14,709 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log'. 10:57:14,709 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Roll-over at midnight. 10:57:14,715 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Setting initial period to Mon Jul 11 10:57:14 CEST 2022 10:57:14,715 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 10:57:14,715 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 10:57:14,717 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:14,731 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_1.log 10:57:14,731 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_1.log] 10:57:14,732 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 10:57:15,609 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 10:57:15,611 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 10:57:15,612 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 10:57:15,612 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 10:57:15,612 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 10:57:15,613 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 10:57:15,613 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 10:57:15,613 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@333291e3 - Registering current configuration as safe fallback point 2022-07-11 10:57:15.632 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 10:57:15.638 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_312 2022-07-11 10:57:15.639 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre 2022-07-11 10:57:15.639 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-07-11 10:57:15.639 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 10:57:15.640 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_1.xml' 2022-07-11 10:57:15.906 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8170/8270 2022-07-11 10:57:15.906 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8270/jndi/rmi://kb-test-har-005.kb.dk:8170/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 10:57:15.911 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 10:57:15.922 INFO d.n.h.h.HarvestControllerServer. - Starting HarvestControllerServer. 2022-07-11 10:57:15.923 INFO d.n.h.h.HarvestControllerServer. - Bound to harvest channel 'BROWSER' 2022-07-11 10:57:15.923 INFO d.n.h.h.HarvestControllerServer. - Serverdir: 'harvester_browser_1' 2022-07-11 10:57:15.923 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:15.923 INFO d.n.h.h.HarvestControllerServer. - Harvesting requires at least 400000000 bytes free. 2022-07-11 10:57:15.924 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:15.924 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 10:57:16.119 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:16.120 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:16.148 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk 2022-07-11 10:57:18.318 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-07-11 10:57:18.319 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@26425897 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1 2022-07-11 10:57:18.346 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1']' 2022-07-11 10:57:18.346 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-07-11 10:57:18.347 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Using 'Test6' as default collectionID 2022-07-11 10:57:18.361 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Storing tempfiles in folder 'arcrepositoryTemp' 2022-07-11 10:57:18.372 INFO d.n.common.utils.HttpsClientBuilder. - Creating Aggressive retry handler for https queries. 2022-07-11 10:57:18.434 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist! 2022-07-11 10:57:18.461 DEBUG d.n.h.h.HarvestControllerServer. - Obtained JMS connection. 2022-07-11 10:57:18.463 INFO d.n.h.h.HarvestControllerServer. - SEND_READY_DELAY used by HarvestControllerServer is 300 2022-07-11 10:57:18.463 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_1' 2022-07-11 10:57:18.463 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_HCHAN_VAL_RESP 2022-07-11 10:57:18.492 INFO d.n.h.h.HarvestControllerServer. - Requested to check the validity of harvest channel 'BROWSER' 2022-07-11 10:57:18.500 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'BROWSER' is valid. 2022-07-11 10:57:18.501 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_BROWSER']' 2022-07-11 10:57:18.501 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_JOB_PARTIAL_BROWSER 10:57:14,073 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml] 10:57:14,476 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 10:57:14,492 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 10:57:14,523 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 10:57:14,547 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:14,634 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 10:57:14,648 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 10:57:14,683 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - No compression will be used 10:57:14,684 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - Will use the pattern ./log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log for the active file 10:57:14,687 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log'. 10:57:14,687 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Roll-over at midnight. 10:57:14,693 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Setting initial period to Mon Jul 11 10:57:14 CEST 2022 10:57:14,693 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 10:57:14,693 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 10:57:14,695 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:14,697 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_2.log 10:57:14,697 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_2.log] 10:57:14,698 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 10:57:15,439 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 10:57:15,442 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 10:57:15,442 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 10:57:15,468 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 10:57:15,468 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 10:57:15,468 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 10:57:15,469 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 10:57:15,469 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@333291e3 - Registering current configuration as safe fallback point 2022-07-11 10:57:15.474 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 10:57:15.494 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_312 2022-07-11 10:57:15.495 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre 2022-07-11 10:57:15.495 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-07-11 10:57:15.495 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 10:57:15.500 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_2.xml' 2022-07-11 10:57:15.680 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8175/8275 2022-07-11 10:57:15.680 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8175 communicating on port 8275 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8275/jndi/rmi://kb-test-har-005.kb.dk:8175/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 10:57:15.685 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 10:57:15.694 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:15.695 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:15.695 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 10:57:15.704 INFO d.n.h.h.HarvestControllerServer. - Starting HarvestControllerServer. 2022-07-11 10:57:15.704 INFO d.n.h.h.HarvestControllerServer. - Bound to harvest channel 'BROWSER' 2022-07-11 10:57:15.704 INFO d.n.h.h.HarvestControllerServer. - Serverdir: 'harvester_browser_2' 2022-07-11 10:57:15.705 INFO d.n.h.h.HarvestControllerServer. - Harvesting requires at least 400000000 bytes free. 2022-07-11 10:57:15.838 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:15.839 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:15.853 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk 2022-07-11 10:57:18.041 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-07-11 10:57:18.042 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@26425897 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2 2022-07-11 10:57:18.061 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2']' 2022-07-11 10:57:18.062 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-07-11 10:57:18.062 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Using 'Test6' as default collectionID 2022-07-11 10:57:18.066 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Storing tempfiles in folder 'arcrepositoryTemp' 2022-07-11 10:57:18.088 INFO d.n.common.utils.HttpsClientBuilder. - Creating Aggressive retry handler for https queries. 2022-07-11 10:57:18.200 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist! 2022-07-11 10:57:18.226 DEBUG d.n.h.h.HarvestControllerServer. - Obtained JMS connection. 2022-07-11 10:57:18.228 INFO d.n.h.h.HarvestControllerServer. - SEND_READY_DELAY used by HarvestControllerServer is 300 2022-07-11 10:57:18.228 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_2' 2022-07-11 10:57:18.228 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_HCHAN_VAL_RESP 2022-07-11 10:57:18.246 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'BROWSER' is valid. 2022-07-11 10:57:18.247 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_BROWSER']' 2022-07-11 10:57:18.248 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_JOB_PARTIAL_BROWSER 2022-07-11 10:57:18.249 INFO d.n.h.h.HarvestControllerServer. - Requested to check the validity of harvest channel 'BROWSER' -------------------------------------------- STARTING MACHINE: devel@kb-test-har-004.kb.dk Starting all applications on: kb-test-har-004.kb.dk Starting linux application: HarvestControllerApplication_kblow002_h3 Starting linux application: HarvestControllerApplication_kbhigh_h3 10:57:20,704 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] 10:57:21,621 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 10:57:21,635 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 10:57:21,675 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 10:57:21,743 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:21,912 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 10:57:21,925 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 10:57:22,046 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - No compression will be used 10:57:22,056 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - Will use the pattern ./log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file 10:57:22,069 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log'. 10:57:22,069 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Roll-over at midnight. 10:57:22,088 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Setting initial period to Mon Jul 11 10:57:22 CEST 2022 10:57:22,089 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 10:57:22,089 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 10:57:22,096 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:22,111 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbhigh_h3.log 10:57:22,111 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbhigh_h3.log] 10:57:22,116 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 10:57:23,151 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 10:57:23,159 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 10:57:23,159 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 10:57:23,161 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 10:57:23,161 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 10:57:23,164 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 10:57:23,164 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 10:57:23,166 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2473d930 - Registering current configuration as safe fallback point 2022-07-11 10:57:23.186 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 10:57:23.229 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_25 2022-07-11 10:57:23.232 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25 java.home: /usr/local/java/jdk1.8.0_25_x64/jre 2022-07-11 10:57:23.236 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre Working dir: /home/devel/Test6 2022-07-11 10:57:23.239 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 10:57:23.243 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kbhigh_h3.xml' 2022-07-11 10:57:23.640 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8172/8272 2022-07-11 10:57:23.640 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8172 communicating on port 8272 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8272/jndi/rmi://kb-test-har-004.kb.dk:8172/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 10:57:23.646 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 10:57:23.669 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:23.670 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:23.670 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 10:57:23.693 INFO d.n.h.h.HarvestControllerServer. - Starting HarvestControllerServer. 2022-07-11 10:57:23.694 INFO d.n.h.h.HarvestControllerServer. - Bound to harvest channel 'HIGHPRIORITY' 2022-07-11 10:57:23.694 INFO d.n.h.h.HarvestControllerServer. - Serverdir: 'harvester_high' 2022-07-11 10:57:23.695 INFO d.n.h.h.HarvestControllerServer. - Harvesting requires at least 400000000 bytes free. 2022-07-11 10:57:24.039 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:24.061 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:24.093 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk 10:57:20,570 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml] 10:57:21,472 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 10:57:21,498 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 10:57:21,537 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 10:57:21,599 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:21,792 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 10:57:21,807 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 10:57:21,921 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - No compression will be used 10:57:21,924 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - Will use the pattern ./log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log for the active file 10:57:21,933 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log'. 10:57:21,933 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Roll-over at midnight. 10:57:21,954 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Setting initial period to Mon Jul 11 10:57:21 CEST 2022 10:57:21,955 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 10:57:21,955 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 10:57:21,966 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:21,978 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow002_h3.log 10:57:21,978 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow002_h3.log] 10:57:21,980 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 10:57:23,078 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 10:57:23,097 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 10:57:23,097 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 10:57:23,098 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 10:57:23,098 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 10:57:23,099 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 10:57:23,099 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 10:57:23,100 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2473d930 - Registering current configuration as safe fallback point 2022-07-11 10:57:23.120 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 10:57:23.144 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_25 2022-07-11 10:57:23.145 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25 java.home: /usr/local/java/jdk1.8.0_25_x64/jre 2022-07-11 10:57:23.152 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre Working dir: /home/devel/Test6 2022-07-11 10:57:23.154 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 10:57:23.155 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow002_h3.xml' 2022-07-11 10:57:23.525 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8170/8270 2022-07-11 10:57:23.526 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8270/jndi/rmi://kb-test-har-004.kb.dk:8170/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 10:57:23.549 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 10:57:23.570 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:23.570 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:23.571 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 10:57:23.591 INFO d.n.h.h.HarvestControllerServer. - Starting HarvestControllerServer. 2022-07-11 10:57:23.593 INFO d.n.h.h.HarvestControllerServer. - Bound to harvest channel 'LOWPRIORITY' 2022-07-11 10:57:23.593 INFO d.n.h.h.HarvestControllerServer. - Serverdir: 'harvester_low' 2022-07-11 10:57:23.603 INFO d.n.h.h.HarvestControllerServer. - Harvesting requires at least 400000000 bytes free. 2022-07-11 10:57:23.973 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:24.008 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:24.051 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk -------------------------------------------- STARTING MACHINE: devel@kb-test-acs-001.kb.dk Starting all applications on: kb-test-acs-001.kb.dk Starting linux application: IndexServerApplication Starting linux application: ViewerProxyApplication SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 10:57:25,602 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_IndexServerApplication.xml] at [file:/home/devel/Test6/conf/logback_IndexServerApplication.xml] 10:57:25,864 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 10:57:25,867 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 10:57:25,874 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 10:57:25,886 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:25,987 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 10:57:25,997 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 10:57:26,055 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@29183965 - No compression will be used 10:57:26,057 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@29183965 - Will use the pattern ./log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log for the active file 10:57:26,063 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log'. 10:57:26,063 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - Roll-over at midnight. 10:57:26,071 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - Setting initial period to Mon Jul 11 10:57:26 CEST 2022 10:57:26,072 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 10:57:26,072 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 10:57:26,075 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:26,083 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/IndexServerApplication.log 10:57:26,083 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/IndexServerApplication.log] 10:57:26,085 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 10:57:27,044 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 10:57:27,047 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 10:57:27,047 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 10:57:27,048 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 10:57:27,048 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 10:57:27,048 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 10:57:27,048 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 10:57:27,049 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4f83df68 - Registering current configuration as safe fallback point SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder] 2022-07-11 10:57:27.055 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.indexserver.IndexServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 10:57:27.062 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.indexserver.IndexServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_332 2022-07-11 10:57:27.063 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre 2022-07-11 10:57:27.074 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-07-11 10:57:27.074 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 10:57:27.074 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_IndexServerApplication.xml' 2022-07-11 10:57:27.249 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8371/8471 2022-07-11 10:57:27.250 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8371 communicating on port 8471 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8471/jndi/rmi://kb-test-acs-001.kb.dk:8371/jmxrmi dk.netarkivet.harvester.indexserver.IndexServer Running 2022-07-11 10:57:27.259 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.indexserver.IndexServer Running 2022-07-11 10:57:27.265 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata' 2022-07-11 10:57:27.269 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:27.270 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:27.270 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 10:57:27.293 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:27.293 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:27.298 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk 2022-07-11 10:57:29.305 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-07-11 10:57:29.306 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@4fc5e095 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS 2022-07-11 10:57:29.320 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS']' 2022-07-11 10:57:29.321 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-07-11 10:57:29.321 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Using 'Test6' as default collectionID 2022-07-11 10:57:29.326 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Storing tempfiles in folder 'arcrepositoryTemp' 2022-07-11 10:57:29.338 INFO d.n.common.utils.HttpsClientBuilder. - Creating Aggressive retry handler for https queries. 2022-07-11 10:57:29.390 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found 2022-07-11 10:57:29.392 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found 2022-07-11 10:57:29.428 INFO d.n.h.indexserver.RawMetadataCache. - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled 2022-07-11 10:57:29.428 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'cdxindex' uses directory '/home/devel/Test6/cache/cdxindex' 2022-07-11 10:57:29.431 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'crawllog' uses directory '/home/devel/Test6/cache/crawllog' 2022-07-11 10:57:29.431 INFO d.n.h.indexserver.RawMetadataCache. - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled 2022-07-11 10:57:29.432 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'dedupcrawllogindex' uses directory '/home/devel/Test6/cache/dedupcrawllogindex' 2022-07-11 10:57:29.432 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata' 2022-07-11 10:57:29.433 INFO d.n.h.indexserver.RawMetadataCache. - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled 2022-07-11 10:57:29.434 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'crawllog' uses directory '/home/devel/Test6/cache/crawllog' 2022-07-11 10:57:29.434 INFO d.n.h.indexserver.RawMetadataCache. - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled 2022-07-11 10:57:29.434 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'fullcrawllogindex' uses directory '/home/devel/Test6/cache/fullcrawllogindex' 2022-07-11 10:57:29.435 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata' 2022-07-11 10:57:29.435 INFO d.n.h.indexserver.RawMetadataCache. - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled 2022-07-11 10:57:29.436 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/cdxindex/empty-cache.working 2022-07-11 10:57:29.436 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/cdxindex/empty-cache.working' (thread = main) 2022-07-11 10:57:29.440 DEBUG d.n.common.utils.ProcessUtils.runProcess - Running external program: sort /home/devel/Test6/cache/cdxindex/empty-cache -o /home/devel/Test6/cache/cdxindex/empty-cache.unsorted with environment LANG=C 2022-07-11 10:57:29.469 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@18f20260 2022-07-11 10:57:29.470 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/cdxindex/empty-cache' of id '[]', request was for '[]' 2022-07-11 10:57:29.470 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/dedupcrawllogindex/empty-cache.working 2022-07-11 10:57:29.471 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/dedupcrawllogindex/empty-cache.working' (thread = main) 2022-07-11 10:57:29.471 INFO d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate dedupcrawllogindex for the 0 jobs: [] 2022-07-11 10:57:29.471 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main) 2022-07-11 10:57:29.643 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1) 2022-07-11 10:57:29.653 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)! 2022-07-11 10:57:29.654 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1 2022-07-11 10:57:29.655 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1 2022-07-11 10:57:29.661 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes 2022-07-11 10:57:29.662 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@55e7a35c 2022-07-11 10:57:29.663 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/dedupcrawllogindex/empty-cache' of id '[]', request was for '[]' 2022-07-11 10:57:29.663 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/fullcrawllogindex/empty-cache.working 2022-07-11 10:57:29.663 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/fullcrawllogindex/empty-cache.working' (thread = main) 2022-07-11 10:57:29.664 INFO d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate fullcrawllogindex for the 0 jobs: [] 2022-07-11 10:57:29.664 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main) 2022-07-11 10:57:29.667 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1) 2022-07-11 10:57:29.669 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)! 2022-07-11 10:57:29.670 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1 2022-07-11 10:57:29.671 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1 2022-07-11 10:57:29.672 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes 2022-07-11 10:57:29.673 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@5922ae77 2022-07-11 10:57:29.674 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/fullcrawllogindex/empty-cache' of id '[]', request was for '[]' 2022-07-11 10:57:29.722 INFO d.n.c.utils.hadoop.HadoopJobUtils.doKerberosLogin - Kerberos: /home/devel/extra_configs/kerberos_config/krb5.conf, /home/devel/extra_configs/kerberos_config/nat-nas-devel.keytab, nat-nas-devel@KBHPC.KB.DK 10:57:25,425 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_ViewerProxyApplication.xml] at [file:/home/devel/Test6/conf/logback_ViewerProxyApplication.xml] 10:57:25,797 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 10:57:25,798 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 10:57:25,805 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 10:57:25,843 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:25,984 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 10:57:25,995 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 10:57:26,047 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@117009527 - No compression will be used 10:57:26,048 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@117009527 - Will use the pattern ./log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log for the active file 10:57:26,053 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log'. 10:57:26,053 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - Roll-over at midnight. 10:57:26,064 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - Setting initial period to Mon Jul 11 10:57:26 CEST 2022 10:57:26,064 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 10:57:26,064 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 10:57:26,067 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:26,073 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ViewerProxyApplication.log 10:57:26,073 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ViewerProxyApplication.log] 10:57:26,075 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 10:57:27,017 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 10:57:27,030 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 10:57:27,030 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 10:57:27,031 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 10:57:27,031 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 10:57:27,031 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 10:57:27,031 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 10:57:27,032 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3ba9ad43 - Registering current configuration as safe fallback point 2022-07-11 10:57:27.039 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.viewerproxy.ViewerProxy Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 10:57:27.048 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.viewerproxy.ViewerProxy Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_332 2022-07-11 10:57:27.049 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre 2022-07-11 10:57:27.049 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-07-11 10:57:27.049 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-07-11 10:57:27.050 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_ViewerProxyApplication.xml' 2022-07-11 10:57:27.257 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8370/8470 2022-07-11 10:57:27.259 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8370 communicating on port 8470 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8470/jndi/rmi://kb-test-acs-001.kb.dk:8370/jmxrmi dk.netarkivet.viewerproxy.ViewerProxy Running 2022-07-11 10:57:27.270 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.viewerproxy.ViewerProxy Running 2022-07-11 10:57:27.286 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:27.293 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:27.294 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 10:57:27.292 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:27.300 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-07-11 10:57:27.310 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk 2022-07-11 10:57:29.139 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-07-11 10:57:29.140 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@3543df7d as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP 2022-07-11 10:57:29.148 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP']' 2022-07-11 10:57:29.148 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-07-11 10:57:29.148 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Using 'Test6' as default collectionID 2022-07-11 10:57:29.153 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Storing tempfiles in folder 'arcrepositoryTemp' 2022-07-11 10:57:29.162 INFO d.n.common.utils.HttpsClientBuilder. - Creating Aggressive retry handler for https queries. 2022-07-11 10:57:29.222 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found 2022-07-11 10:57:29.224 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found 2022-07-11 10:57:29.270 INFO d.n.h.indexserver.FileBasedCache. - Metadata cache for 'FULL_CRAWL_LOG' uses directory '/home/devel/Test6/cache/FULL_CRAWL_LOG' 2022-07-11 10:57:29.285 INFO d.n.viewerproxy.ARCArchiveAccess. - Constructed instance of ARCArchiveAccess with TryToLookupUriAsFtp: false 2022-07-11 10:57:29.336 INFO dk.netarkivet.viewerproxy.WebProxy. - Starting viewerproxy jetty on port 8078 -------------------------------------------- STARTING MACHINE: devel@kb-test-way-001.kb.dk Starting all applications on: kb-test-way-001.kb.dk Starting linux application: WaybackIndexerApplication Starting linux application: AggregatorApplication SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. -------------------------------------------- -------------------------------------------- STARTING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk Starting all applications on: sb-test-har-001.statsbiblioteket.dk Starting linux application: HarvestControllerApplication_sbhigh_h3 10:57:35,831 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] at [file:/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] 10:57:35,968 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 10:57:35,970 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 10:57:35,975 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 10:57:35,985 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:36,021 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 10:57:36,024 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 10:57:36,037 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - No compression will be used 10:57:36,038 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - Will use the pattern ./log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file 10:57:36,039 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log'. 10:57:36,039 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Roll-over at midnight. 10:57:36,042 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Setting initial period to Mon Jul 11 10:57:36 CEST 2022 10:57:36,042 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 10:57:36,042 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 10:57:36,043 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 10:57:36,045 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_sbhigh_h3.log 10:57:36,045 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_sbhigh_h3.log] 10:57:36,045 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 10:57:36,290 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 10:57:36,292 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 10:57:36,292 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 10:57:36,292 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 10:57:36,292 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 10:57:36,293 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 10:57:36,293 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 10:57:36,293 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@40ef3420 - Registering current configuration as safe fallback point 2022-07-11 10:57:36.296 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) 2022-07-11 10:57:36.299 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/1ecfd3917eea680d0c84a1809b54b87104643555) Java VM: 1.8.0_332 2022-07-11 10:57:36.300 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-2.el8_6.x86_64/jre 2022-07-11 10:57:36.300 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-2.el8_6.x86_64/jre Working dir: /home/netarkdv/Test6 2022-07-11 10:57:36.300 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/netarkdv/Test6 2022-07-11 10:57:36.300 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/netarkdv/Test6/conf/settings_HarvestControllerApplication_sbhigh_h3.xml' 2022-07-11 10:57:36.385 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'sb-test-har-001.statsbiblioteket.dk' and JMX/RMI ports 8170/8270 2022-07-11 10:57:36.386 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://sb-test-har-001.statsbiblioteket.dk:8270/jndi/rmi://sb-test-har-001.statsbiblioteket.dk:8170/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 10:57:36.389 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-07-11 10:57:36.399 INFO d.n.c.distribute.JMSConnectionSunMQ. - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:36.400 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-07-11 10:57:36.400 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-07-11 10:57:36.402 INFO d.n.h.h.HarvestControllerServer. - Starting HarvestControllerServer. 2022-07-11 10:57:36.402 INFO d.n.h.h.HarvestControllerServer. - Bound to harvest channel 'HIGHPRIORITY' 2022-07-11 10:57:36.402 INFO d.n.h.h.HarvestControllerServer. - Serverdir: 'harvester_high' 2022-07-11 10:57:36.402 INFO d.n.h.h.HarvestControllerServer. - Harvesting requires at least 400000000 bytes free. 2022-07-11 10:57:36.552 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/netarkdv/extra_configs/bitmag_config. 2022-07-11 10:57:36.554 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/netarkdv/extra_configs/bitmag_config. 2022-07-11 10:57:36.557 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): sb-test-har-001.statsbiblioteket.dk 2022-07-11 10:57:37.299 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-07-11 10:57:37.300 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@1c7fd41f as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3 2022-07-11 10:57:37.316 INFO d.n.a.a.d.BitmagArcRepositoryClient. - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3']' 2022-07-11 10:57:37.316 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/netarkdv/extra_configs/bitmag_config 2022-07-11 10:57:37.317 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Using 'Test6' as default collectionID 2022-07-11 10:57:37.319 INFO d.n.a.a.d.BitmagArcRepositoryClient. - Storing tempfiles in folder 'arcrepositoryTemp' 2022-07-11 10:57:37.325 INFO d.n.common.utils.HttpsClientBuilder. - Creating Aggressive retry handler for https queries. 2022-07-11 10:57:37.352 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist! 2022-07-11 10:57:37.369 DEBUG d.n.h.h.HarvestControllerServer. - Obtained JMS connection. 2022-07-11 10:57:37.370 INFO d.n.h.h.HarvestControllerServer. - SEND_READY_DELAY used by HarvestControllerServer is 300 2022-07-11 10:57:37.370 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_high' 2022-07-11 10:57:37.371 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@1de5f0ef as listener to Test6_COMMON_HCHAN_VAL_RESP 2022-07-11 10:57:37.408 INFO d.n.h.h.HarvestControllerServer. - Requested to check the validity of harvest channel 'HIGHPRIORITY' 2022-07-11 10:57:37.482 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'HIGHPRIORITY' is valid. 2022-07-11 10:57:37.483 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY']' 2022-07-11 10:57:37.483 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@1de5f0ef as listener to Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY -------------------------------------------- Completed the script all_test.sh Finished: SUCCESS