Started by user Colin Rosenthal (csr) Building remotely on NetarchiveSuite in workspace /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Done Cloning the remote Git repository Cloning repository https://github.com/netarchivesuite/netarchivesuite.git > git init /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click # timeout=10 Fetching upstream changes from https://github.com/netarchivesuite/netarchivesuite.git > git --version # timeout=10 > git -c core.askpass=true fetch --tags --progress https://github.com/netarchivesuite/netarchivesuite.git +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/netarchivesuite/netarchivesuite.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/netarchivesuite/netarchivesuite.git # timeout=10 Fetching upstream changes from https://github.com/netarchivesuite/netarchivesuite.git > git -c core.askpass=true fetch --tags --progress https://github.com/netarchivesuite/netarchivesuite.git +refs/heads/*:refs/remotes/origin/* > git rev-parse refs/remotes/origin/crawlrss-fix^{commit} # timeout=10 > git rev-parse refs/remotes/origin/origin/crawlrss-fix^{commit} # timeout=10 Checking out Revision 2d37bccb714e8981ceb811b94d904fb3d64234ce (refs/remotes/origin/crawlrss-fix) > git config core.sparsecheckout # timeout=10 > git checkout -f 2d37bccb714e8981ceb811b94d904fb3d64234ce > git rev-list 2d37bccb714e8981ceb811b94d904fb3d64234ce # timeout=10 [NetarchiveSuite-Colin-1-Click] $ /bin/sh -xe /tmp/hudson3698581893855324767.sh + cd /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click + pwd /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click + ls -lart total 136 drwxrwxr-x. 18 cibuild02 cibuild02 4096 May 3 13:11 .. -rw-rw-r--. 1 cibuild02 cibuild02 748 May 3 13:11 .travis.yml drwxrwxr-x. 2 cibuild02 cibuild02 4096 May 3 13:11 .run -rw-rw-r--. 1 cibuild02 cibuild02 4686 May 3 13:11 Narcana.md -rw-rw-r--. 1 cibuild02 cibuild02 816 May 3 13:11 LICENSE.txt -rw-rw-r--. 1 cibuild02 cibuild02 1283 May 3 13:11 .gitignore -rw-rw-r--. 1 cibuild02 cibuild02 2055 May 3 13:11 README.md drwxrwxr-x. 5 cibuild02 cibuild02 4096 May 3 13:11 archive drwxrwxr-x. 3 cibuild02 cibuild02 4096 May 3 13:11 build-tools drwxrwxr-x. 5 cibuild02 cibuild02 4096 May 3 13:11 common drwxrwxr-x. 3 cibuild02 cibuild02 4096 May 3 13:11 hadoop-uber-jar-invoker drwxrwxr-x. 5 cibuild02 cibuild02 4096 May 3 13:11 deploy drwxrwxr-x. 3 cibuild02 cibuild02 4096 May 3 13:11 hadoop-uber-jar drwxrwxr-x. 10 cibuild02 cibuild02 4096 May 3 13:11 harvester drwxrwxr-x. 3 cibuild02 cibuild02 4096 May 3 13:11 integration-test drwxrwxr-x. 5 cibuild02 cibuild02 4096 May 3 13:11 monitor -rwxrwxr-x. 1 cibuild02 cibuild02 429 May 3 13:11 precommit.sh -rw-rw-r--. 1 cibuild02 cibuild02 39975 May 3 13:11 pom.xml drwxrwxr-x. 2 cibuild02 cibuild02 4096 May 3 13:11 quickstart-vagrant-environment -rw-rw-r--. 1 cibuild02 cibuild02 87 May 3 13:11 reset_gitignore_files.sh drwxrwxr-x. 3 cibuild02 cibuild02 4096 May 3 13:11 quickstart drwxrwxr-x. 16 cibuild02 cibuild02 4096 May 3 13:11 . drwxrwxr-x. 5 cibuild02 cibuild02 4096 May 3 13:11 wayback drwxrwxr-x. 8 cibuild02 cibuild02 4096 May 3 13:11 .git + rm -rf './lib/*' + rm -rf './deploy/distribution/target/*' Parsing POMs Established TCP socket on 39794 maven32-agent.jar already up to date maven32-interceptor.jar already up to date maven3-interceptor-commons.jar already up to date [NetarchiveSuite-Colin-1-Click] $ /home/cibuild02/tools/hudson.model.JDK/Java8/bin/java -cp /home/cibuild02/maven32-agent.jar:/home/cibuild02/tools/hudson.tasks.Maven_MavenInstallation/Maven3.2/boot/plexus-classworlds-2.5.2.jar:/home/cibuild02/tools/hudson.tasks.Maven_MavenInstallation/Maven3.2/conf/logging jenkins.maven3.agent.Maven32Main /home/cibuild02/tools/hudson.tasks.Maven_MavenInstallation/Maven3.2 /home/cibuild02/slave.jar /home/cibuild02/maven32-interceptor.jar /home/cibuild02/maven3-interceptor-commons.jar 39794 <===[JENKINS REMOTING CAPACITY]===>channel started Executing Maven: -B -f /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml -U -DskipTests clean package [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:build-tools:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:archive-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:archive-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:bitpreservation-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:archive:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:netarchivesuite-test-utils:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:common-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:common-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:common:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:deploy-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:distribution:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:deploy-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:deploy:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvester-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3-extensions:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3-bundler:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3-controller:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3-monitor:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:heritrix3:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvest-scheduler:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvestchannel-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvestdefinition-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:history-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:qa-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvester-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:harvester:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:monitor-core:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:monitor-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:status-gui:war:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:monitor:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:wayback-indexer:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:wayback-resourcestore:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:wayback-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:wayback:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:system-test:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:integration-test:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:hadoop-uber-jar:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:hadoop-uber-jar-invoker:jar:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ org.netarchivesuite:netarchivesuite:7.4-SNAPSHOT, /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/pom.xml, line 929, column 17 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netarchivesuite:netarchivesuite:pom:7.4-SNAPSHOT [WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ line 929, column 17 [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] ------------------------------------------------------------------------ [INFO] Reactor Build Order: [INFO] [INFO] NetarchiveSuite [INFO] NetarchiveSuite - build-tools [INFO] NetarchiveSuite - common [INFO] NetarchiveSuite - test utils [INFO] NetarchiveSuite - common - core [INFO] NetarchiveSuite - common - test [INFO] NetarchiveSuite - archive [INFO] NetarchiveSuite - archive - core [INFO] NetarchiveSuite - harvester [INFO] NetarchiveSuite - harvester - core [INFO] NetarchiveSuite - archive - test [INFO] NetarchiveSuite - bitpreservation - webapp [INFO] NetarchiveSuite - Harvest Scheduler [INFO] NetarchiveSuite - monitor [INFO] NetarchiveSuite - monitor - core [INFO] NetarchiveSuite - wayback [INFO] NetarchiveSuite - wayback - indexer [INFO] NetarchiveSuite - deploy [INFO] NetarchiveSuite - deploy - core [INFO] NetarchiveSuite - harvester - heritrix3 [INFO] NetarchiveSuite - Heritrix3 Extensions [INFO] NetarchiveSuite - heritrix3 controller [INFO] hadoop-uber-jar [INFO] hadoop-uber-jar-invoker [INFO] NetarchiveSuite - Status - Webapp [INFO] NetarchiveSuite - qa - webapp [INFO] NetarchiveSuite - history - webapp [INFO] NetarchiveSuite - harvestDefinition - webapp [INFO] NetarchiveSuite - harvestChannel - webapp [INFO] NetarchiveSuite - heritrix3 monitor [INFO] NetarchiveSuite - deploy - distribution [INFO] NetarchiveSuite - deploy - test [INFO] NetarchiveSuite - Heritrix3 Bundler [INFO] NetarchiveSuite - harvester - test [INFO] NetarchiveSuite - monitor - test [INFO] NetarchiveSuite - wayback resourceStore [INFO] NetarchiveSuite - wayback - test [INFO] NetarchiveSuite - integration tests [INFO] NetarchiveSuite System test [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ netarchivesuite --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ netarchivesuite --- [INFO] Git info extracted, revision: '2d37bcc', branch: '', tag: '', commitsCount: '4714', buildnumber: 'UNNAMED.4714.2d37bcc' [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ netarchivesuite --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - build-tools 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ build-tools --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ build-tools --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ build-tools --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ build-tools --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/build-tools/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ build-tools --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ build-tools --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ build-tools --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ build-tools --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/build-tools/target/build-tools-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ build-tools --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/build-tools/target/build-tools-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - common 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ common --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ common --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ common --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - test utils 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ netarchivesuite-test-utils --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ netarchivesuite-test-utils --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/../target/jacoco.exec,append=true,excludes=**com.steadystate*:**com.gargoylesoftware* [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ netarchivesuite-test-utils --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ netarchivesuite-test-utils --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 6 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ netarchivesuite-test-utils --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ netarchivesuite-test-utils --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ netarchivesuite-test-utils --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ netarchivesuite-test-utils --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ netarchivesuite-test-utils --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/target/netarchivesuite-test-utils-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ netarchivesuite-test-utils --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/netarchivesuite-test-utils/target/netarchivesuite-test-utils-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - common - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ common-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ common-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ common-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 18 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ common-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 198 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/webinterface/GUIWebServer.java:[49,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[33,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/JMXUtils.java:[50,33] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[54,73] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[59,26] sun.security.krb5.Config is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[68,49] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java:[73,26] sun.security.krb5.Config is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/JMXUtils.java:[105,63] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/dk/netarkivet/common/utils/JMXUtils.java:[107,21] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/is/hi/bok/deduplicator/CommandLineParser.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/src/main/java/is/hi/bok/deduplicator/CommandLineParser.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ common-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ common-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 11 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ common-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ common-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ common-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/target/common-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ common-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-core/target/common-core-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - common - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ common-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ common-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ common-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ common-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 44 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/java/dk/netarkivet/common/webinterface/WebinterfaceTestCase.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/java/dk/netarkivet/common/webinterface/WebinterfaceTestCase.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/java/dk/netarkivet/common/webinterface/WebinterfaceTestCase.java: Some input files use unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/main/java/dk/netarkivet/common/webinterface/WebinterfaceTestCase.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ common-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 386 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ common-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 78 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/test/java/dk/netarkivet/common/utils/StringUtilsTester.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/test/java/dk/netarkivet/common/utils/StringUtilsTester.java uses unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/src/test/java/dk/netarkivet/common/utils/StringUtilsTester.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ common-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ common-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ common-test --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/target/common-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ common-test --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/common/common-test/target/common-test-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - archive 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ archive --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ archive --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ archive --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - archive - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ archive-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ archive-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ archive-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 8 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ archive-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 93 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/main/java/dk/netarkivet/archive/tools/RunBatch.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/main/java/dk/netarkivet/archive/tools/RunBatch.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ archive-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ archive-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 12 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/test/java/dk/netarkivet/archive/arcrepository/distribute/ArcRepositoryServerTester.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/test/java/dk/netarkivet/archive/arcrepository/distribute/ArcRepositoryServerTester.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/src/test/java/dk/netarkivet/archive/arcrepository/distribute/ArcRepositoryServerTester.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ archive-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ archive-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ archive-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/target/archive-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ archive-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-core/target/archive-core-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvester 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvester --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvester --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvester --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvester - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvester-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ harvester-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvester-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 12 resources [INFO] Copying 3 resources to sql-migration/postgresql/ [INFO] Copying 1 resource to sql-migration/mysql/ [INFO] Copying 2 resources to sql-migration/derby/ [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvester-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 237 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/indexserver/distribute/IndexRequestServer.java:[69,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/indexserver/distribute/IndexRequestServer.java:[135,22] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/tools/CreateIndex.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/tools/CreateIndex.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/datamodel/H1HeritrixTemplate.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/datamodel/H1HeritrixTemplate.java uses unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/src/main/java/dk/netarkivet/harvester/datamodel/H1HeritrixTemplate.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvester-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 16 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvester-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 12 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvester-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvester-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvester-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/harvester-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvester-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/harvester-core-7.4-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-jar-plugin:2.4:test-jar (default) @ harvester-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-core/target/harvester-core-7.4-SNAPSHOT-tests.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - archive - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ archive-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ archive-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ archive-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ archive-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ archive-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 280 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ archive-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 78 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/test/java/dk/netarkivet/archive/arcrepository/ArcRepositoryTesterLog.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/test/java/dk/netarkivet/archive/arcrepository/ArcRepositoryTesterLog.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/test/java/dk/netarkivet/archive/webinterface/BatchGUITester.java: Some input files use unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/src/test/java/dk/netarkivet/archive/webinterface/BatchGUITester.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ archive-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ archive-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ archive-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/archive-test/target/archive-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ archive-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - bitpreservation - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ bitpreservation-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ bitpreservation-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ bitpreservation-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ bitpreservation-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ bitpreservation-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ bitpreservation-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ bitpreservation-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ bitpreservation-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [bitpreservation-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/target/BitPreservation] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/src/main/webapp] [INFO] Webapp assembled in [43 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/archive/bitpreservation-gui/target/BitPreservation.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ bitpreservation-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Harvest Scheduler 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvest-scheduler --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ harvest-scheduler --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvest-scheduler --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvest-scheduler --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 14 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvest-scheduler --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvest-scheduler --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 5 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvest-scheduler --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvest-scheduler --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvest-scheduler --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/target/harvest-scheduler-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvest-scheduler --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvest-scheduler/target/harvest-scheduler-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - monitor 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ monitor --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ monitor --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ monitor --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - monitor - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ monitor-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ monitor-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ monitor-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 7 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ monitor-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 23 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/main/java/dk/netarkivet/monitor/webinterface/JMXSummaryUtils.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/main/java/dk/netarkivet/monitor/webinterface/JMXSummaryUtils.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/main/java/dk/netarkivet/monitor/webinterface/JMXSummaryUtils.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ monitor-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ monitor-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 6 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/test/java/dk/netarkivet/monitor/jmx/JMXUtilsTester.java:[30,33] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/test/java/dk/netarkivet/monitor/jmx/JMXUtilsTester.java:[72,63] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/src/test/java/dk/netarkivet/monitor/jmx/JMXUtilsTester.java:[74,23] com.sun.jndi.rmi.registry.RegistryContextFactory is internal proprietary API and may be removed in a future release [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ monitor-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ monitor-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ monitor-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/target/monitor-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ monitor-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-core/target/monitor-core-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - wayback 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - wayback - indexer 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback-indexer --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ wayback-indexer --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-indexer --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-indexer --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 27 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/ArchiveFile.java:[76,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/WaybackIndexer.java:[49,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/ArchiveFile.java:[253,51] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/WaybackIndexer.java:[96,22] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-indexer --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-indexer --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 2 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-indexer --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-indexer --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-indexer --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/target/wayback-indexer-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-indexer --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-indexer/target/wayback-indexer-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - deploy 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ deploy --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ deploy --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ deploy --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - deploy - core 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ deploy-core --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ deploy-core --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ deploy-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ deploy-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 16 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/src/main/java/dk/netarkivet/deploy/DeployApplication.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/src/main/java/dk/netarkivet/deploy/DeployApplication.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/src/main/java/dk/netarkivet/deploy/DeployApplication.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ deploy-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 8 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ deploy-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 3 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ deploy-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ deploy-core --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ deploy-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/target/deploy-core-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ deploy-core --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-core/target/deploy-core-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvester - heritrix3 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3 --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3 --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3 --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Heritrix3 Extensions 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-extensions --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix3-extensions --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix3-extensions --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 16 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/main/java/dk/netarkivet/harvester/harvesting/NasWARCProcessor.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/main/java/dk/netarkivet/harvester/harvesting/NasWARCProcessor.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix3-extensions --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix3-extensions --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 9 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/test/java/dk/netarkivet/harvester/harvesting/extractor/ExtractorOAITest.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/test/java/dk/netarkivet/harvester/harvesting/extractor/ExtractorOAITest.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/src/test/java/dk/netarkivet/harvester/harvesting/extractor/ExtractorOAITest.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ heritrix3-extensions --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-extensions --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix3-extensions --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/target/heritrix3-extensions-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3-extensions --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-extensions/target/heritrix3-extensions-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - heritrix3 controller 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-controller --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix3-controller --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix3-controller --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 23 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/src/main/java/dk/netarkivet/harvester/tools/CreateCDXMetadataFile.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/src/main/java/dk/netarkivet/harvester/tools/CreateCDXMetadataFile.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/src/main/java/dk/netarkivet/harvester/tools/CreateCDXMetadataFile.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix3-controller --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix3-controller --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 3 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ heritrix3-controller --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-controller --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix3-controller --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/target/heritrix3-controller-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3-controller --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-controller/target/heritrix3-controller-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building hadoop-uber-jar 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-uber-jar --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-uber-jar --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-uber-jar --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 1 source file to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/src/main/java/MetadataIndexingApplication.java:[28,25] sun.security.krb5.KrbException is internal proprietary API and may be removed in a future release [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hadoop-uber-jar --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hadoop-uber-jar --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-uber-jar --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ hadoop-uber-jar --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ hadoop-uber-jar --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/target/hadoop-uber-jar-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ hadoop-uber-jar --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar/target/hadoop-uber-jar-7.4-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-shade-plugin:3.2.4:shade (default) @ hadoop-uber-jar --- [INFO] Including commons-cli:commons-cli:jar:1.4 in the shaded jar. [INFO] Including org.apache.commons:commons-math3:jar:3.1.1 in the shaded jar. [INFO] Including org.apache.httpcomponents:httpclient:jar:4.5.12 in the shaded jar. [INFO] Including commons-codec:commons-codec:jar:1.9 in the shaded jar. [INFO] Including commons-io:commons-io:jar:2.4 in the shaded jar. [INFO] Including commons-net:commons-net:jar:3.0.1 in the shaded jar. [INFO] Including commons-collections:commons-collections:jar:3.1 in the shaded jar. [INFO] Including log4j:log4j:jar:1.2.17 in the shaded jar. [INFO] Including javax.xml.bind:jaxb-api:jar:2.2.11 in the shaded jar. [INFO] Including org.apache.commons:commons-compress:jar:1.19 in the shaded jar. [INFO] Including javax.ws.rs:jsr311-api:jar:1.1.1 in the shaded jar. [INFO] Including aopalliance:aopalliance:jar:1.0 in the shaded jar. [INFO] Including org.codehaus.jettison:jettison:jar:1.1 in the shaded jar. [INFO] Including org.slf4j:slf4j-api:jar:1.7.25 in the shaded jar. [INFO] Including dnsjava:dnsjava:jar:3.3.1 in the shaded jar. [INFO] Including com.google.guava:guava:jar:27.0-jre in the shaded jar. [INFO] Including com.google.guava:failureaccess:jar:1.0 in the shaded jar. [INFO] Including com.google.guava:listenablefuture:jar:9999.0-empty-to-avoid-conflict-with-guava in the shaded jar. [INFO] Including com.google.code.findbugs:jsr305:jar:3.0.2 in the shaded jar. [INFO] Including org.checkerframework:checker-qual:jar:2.5.2 in the shaded jar. [INFO] Including com.google.errorprone:error_prone_annotations:jar:2.2.0 in the shaded jar. [INFO] Including com.google.j2objc:j2objc-annotations:jar:1.1 in the shaded jar. [INFO] Including org.codehaus.mojo:animal-sniffer-annotations:jar:1.17 in the shaded jar. [INFO] Including org.netarchivesuite:wayback-indexer:jar:7.4-SNAPSHOT in the shaded jar. [INFO] Including org.netarchivesuite:common-core:jar:7.4-SNAPSHOT in the shaded jar. [INFO] Including org.bitrepository.reference:bitrepository-core:jar:1.9 in the shaded jar. [INFO] Including org.bitrepository.reference:bitrepository-reference-settings:jar:1.9 in the shaded jar. [INFO] Including org.bitrepository.repository-settings:bitrepository-repository-settings-xsd:jar:12 in the shaded jar. [INFO] Including org.bitrepository.repository-settings:bitrepository-repository-settings-java:jar:12 in the shaded jar. [INFO] Including org.bitrepository:bitrepository-message-xml-xsd:jar:30 in the shaded jar. [INFO] Including org.bitrepository:bitrepository-message-xml-java:jar:30 in the shaded jar. [INFO] Including org.apache.activemq:activemq-client:jar:5.13.3 in the shaded jar. [INFO] Including org.apache.geronimo.specs:geronimo-jms_1.1_spec:jar:1.1.1 in the shaded jar. [INFO] Including org.fusesource.hawtbuf:hawtbuf:jar:1.11 in the shaded jar. [INFO] Including org.apache.geronimo.specs:geronimo-j2ee-management_1.1_spec:jar:1.0.1 in the shaded jar. [INFO] Including org.jvnet.jaxb2_commons:jaxb2-basics-runtime:jar:0.11.1 in the shaded jar. [INFO] Including org.bitrepository.reference:bitrepository-client:jar:1.9 in the shaded jar. [INFO] Including org.eclipse.jdt:ecj:jar:3.12.3 in the shaded jar. [INFO] Including org.apache.httpcomponents:httpcore:jar:4.4.1 in the shaded jar. [INFO] Including xalan:xalan:jar:2.7.1 in the shaded jar. [INFO] Including xalan:serializer:jar:2.7.1 in the shaded jar. [INFO] Including xml-apis:xml-apis:jar:1.4.01 in the shaded jar. [INFO] Including ant:ant:jar:1.6.5 in the shaded jar. [INFO] Including commons-fileupload:commons-fileupload:jar:1.3.3 in the shaded jar. [INFO] Including org.eclipse.jdt.core.compiler:ecj:jar:4.4.2 in the shaded jar. [INFO] Including dom4j:dom4j:jar:1.6.1 in the shaded jar. [INFO] Including javax.mail:mail:jar:1.4 in the shaded jar. [INFO] Including javax.activation:activation:jar:1.1 in the shaded jar. [INFO] Including commons-httpclient:commons-httpclient:jar:3.1 in the shaded jar. [INFO] Including org.jwat:jwat-common:jar:1.0.4 in the shaded jar. [INFO] Including org.jwat:jwat-arc:jar:1.0.4 in the shaded jar. [INFO] Including org.jwat:jwat-archive-common:jar:1.0.4 in the shaded jar. [INFO] Including org.jwat:jwat-gzip:jar:1.0.4 in the shaded jar. [INFO] Including org.jwat:jwat-warc:jar:1.0.4 in the shaded jar. [INFO] Including berkeleydb:je:jar:3.2.76 in the shaded jar. [INFO] Including org.archive.heritrix:heritrix-commons:jar:3.4.0-NAS-7.3 in the shaded jar. [INFO] Including org.apache.httpcomponents:httpmime:jar:4.5.13 in the shaded jar. [INFO] Including net.htmlparser.jericho:jericho-html:jar:2.6.1 in the shaded jar. [INFO] Including poi:poi:jar:2.5.1-final-20040804 in the shaded jar. [INFO] Including poi:poi-scratchpad:jar:2.5.1-final-20040804 in the shaded jar. [INFO] Including com.lowagie:itext:jar:1.3 in the shaded jar. [INFO] Including com.anotherbigidea:javaswf:jar:CVS-SNAPSHOT-1 in the shaded jar. [INFO] Including com.esotericsoftware:kryo:jar:1.01 in the shaded jar. [INFO] Including com.esotericsoftware:reflectasm:jar:0.8 in the shaded jar. [INFO] Including com.esotericsoftware:minlog:jar:1.2 in the shaded jar. [INFO] Including net.java.dev.jna:jna:jar:3.2.3 in the shaded jar. [INFO] Including com.jcraft:jsch:jar:0.1.52 in the shaded jar. [INFO] Including org.slf4j:jul-to-slf4j:jar:1.7.25 in the shaded jar. [INFO] Including org.slf4j:jcl-over-slf4j:jar:1.7.25 in the shaded jar. [INFO] Including ch.qos.logback:logback-core:jar:1.2.3 in the shaded jar. [INFO] Including org.gnu.inet:libidn:jar:0.6.5 in the shaded jar. [INFO] Including javassist:javassist:jar:3.9.0.GA in the shaded jar. [INFO] Including org.htmlparser:htmlparser:jar:1.6 in the shaded jar. [INFO] Including org.apache.commons:commons-lang3:jar:3.5 in the shaded jar. [INFO] Including org.netpreserve.openwayback:openwayback-core:jar:2.0.0 in the shaded jar. [INFO] Including org.netpreserve.openwayback:openwayback-cdx-server:jar:classes:2.0.0 in the shaded jar. [INFO] Including org.netpreserve.openwayback:openwayback-access-control-core:jar:1.0.2 in the shaded jar. [INFO] Including com.thoughtworks.xstream:xstream:jar:1.2.2 in the shaded jar. [INFO] Including xpp3:xpp3_min:jar:1.1.3.4.O in the shaded jar. [INFO] Including commons-dbcp:commons-dbcp:jar:1.2.2 in the shaded jar. [INFO] Including com.googlecode.juniversalchardet:juniversalchardet:jar:1.0.3 in the shaded jar. [INFO] Including org.beanshell:bsh:jar:2.0b4 in the shaded jar. [INFO] Including com.flagstone:transform:jar:3.0.2 in the shaded jar. [INFO] Including redis.clients:jedis:jar:2.0.0 in the shaded jar. [INFO] Including org.netpreserve.commons:webarchive-commons:jar:1.1.5 in the shaded jar. [INFO] Including it.unimi.dsi:dsiutils:jar:2.0.12 in the shaded jar. [INFO] Including it.unimi.dsi:fastutil:jar:6.5.2 in the shaded jar. [INFO] Including com.martiansoftware:jsap:jar:2.1 in the shaded jar. [INFO] Including commons-configuration:commons-configuration:jar:1.8 in the shaded jar. [INFO] Including org.netarchivesuite:harvester-core:jar:7.4-SNAPSHOT in the shaded jar. [INFO] Including org.netarchivesuite:heritrix3-wrapper:jar:1.0.4 in the shaded jar. [INFO] Including com.sun.xml.bind:jaxb-impl:jar:2.2.11 in the shaded jar. [INFO] Including com.sun.xml.bind:jaxb-core:jar:2.2.11 in the shaded jar. [INFO] Including com.sun.activation:javax.activation:jar:1.2.0 in the shaded jar. [INFO] Including jaxen:jaxen:jar:1.1.6 in the shaded jar. [INFO] Including commons-pool:commons-pool:jar:1.6 in the shaded jar. [INFO] Including commons-lang:commons-lang:jar:2.3 in the shaded jar. [INFO] Including jfree:jfreechart:jar:1.0.13 in the shaded jar. [INFO] Including jfree:jcommon:jar:1.0.16 in the shaded jar. [INFO] Including com.hp.gagawa:gagawa:jar:1.0.1 in the shaded jar. [INFO] Including javax.inject:javax.inject:jar:1 in the shaded jar. [INFO] Including commons-logging:commons-logging:jar:1.2 in the shaded jar. [INFO] Including org.postgresql:postgresql:jar:42.2.10 in the shaded jar. [INFO] Including com.antiaction:raptor-dbl:jar:0.1.0-RC2 in the shaded jar. [INFO] Including com.antiaction:common-servlet:jar:0.1.0-NAS in the shaded jar. [INFO] Including com.antiaction:common-html:jar:0.1.0-NAS in the shaded jar. [INFO] Including com.antiaction:common-template-engine:jar:0.3.0-NAS in the shaded jar. [INFO] Excluding com.sun.jersey:jersey-core:jar:1.19 from the shaded jar. [INFO] Excluding com.sun.jersey:jersey-server:jar:1.19 from the shaded jar. [INFO] Excluding org.bouncycastle:bcprov-jdk15on:jar:1.54 from the shaded jar. [INFO] Excluding org.bouncycastle:bcmail-jdk15on:jar:1.54 from the shaded jar. [INFO] Excluding org.bouncycastle:bcpkix-jdk15on:jar:1.54 from the shaded jar. [INFO] Excluding org.apache.tomcat.embed:tomcat-embed-core:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-annotations-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat.embed:tomcat-embed-logging-juli:jar:8.5.2 from the shaded jar. [INFO] Excluding org.apache.tomcat.embed:tomcat-embed-jasper:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat.embed:tomcat-embed-el:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-jasper:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-servlet-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-juli:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-el-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-util-scan:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-util:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-jasper-el:jar:8.5.50 from the shaded jar. [INFO] Excluding org.apache.tomcat:tomcat-jsp-api:jar:8.5.50 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jetty-sslengine:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jetty-ajp:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:servlet-api:jar:2.5-20081211 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jsp-2.1-glassfish:jar:2.1.v20091210 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jsp-2.1-jetty:jar:6.1.26 from the shaded jar. [INFO] Excluding org.mortbay.jetty:jsp-api-2.1-glassfish:jar:2.1.v20091210 from the shaded jar. [INFO] Excluding com.sun.messaging.mq:jms:jar:4.4.1 from the shaded jar. [INFO] Excluding com.sun.messaging.mq:imq:jar:4.4.1 from the shaded jar. [INFO] Excluding org.apache.lucene:lucene-core:jar:4.4.0 from the shaded jar. [INFO] Excluding org.apache.lucene:lucene-analyzers-common:jar:4.4.0 from the shaded jar. [INFO] Excluding fastutil:fastutil:jar:5.0.4 from the shaded jar. [INFO] Excluding org.springframework:spring-context:jar:5.3.3 from the shaded jar. [INFO] Excluding org.springframework:spring-aop:jar:5.3.3 from the shaded jar. [INFO] Excluding org.springframework:spring-expression:jar:5.3.3 from the shaded jar. [INFO] Excluding org.slf4j:log4j-over-slf4j:jar:1.7.25 from the shaded jar. [INFO] Excluding ch.qos.logback:logback-classic:jar:1.2.3 from the shaded jar. [INFO] Excluding org.apache.derby:derbyclient:jar:10.12.1.1 from the shaded jar. [INFO] Excluding org.apache.derby:derby:jar:10.12.1.1 from the shaded jar. [INFO] Excluding org.apache.derby:derbytools:jar:10.12.1.1 from the shaded jar. [INFO] Excluding org.springframework:spring-web:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding org.springframework:spring-webmvc:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding org.springframework:spring-context-support:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding javax.servlet:jstl:jar:1.2 from the shaded jar. [INFO] Excluding org.springframework:spring-core:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding org.springframework:spring-asm:jar:3.0.6.RELEASE from the shaded jar. [INFO] Excluding org.springframework:spring-beans:jar:3.0.6.RELEASE from the shaded jar. [WARNING] failureaccess-1.0.jar, guava-27.0-jre.jar define 2 overlapping classes: [WARNING] - com.google.common.util.concurrent.internal.InternalFutureFailureAccess [WARNING] - com.google.common.util.concurrent.internal.InternalFutures [WARNING] ecj-3.12.3.jar, ecj-4.4.2.jar define 600 overlapping classes and resources: [WARNING] - META-INF/eclipse.inf [WARNING] - about.html [WARNING] - ecj.1 [WARNING] - org.eclipse.jdt.core.BuildJarIndex [WARNING] - org.eclipse.jdt.core.CheckDebugAttributes [WARNING] - org.eclipse.jdt.core.JDTCompilerAdapter [WARNING] - org.eclipse.jdt.core.JDTCompilerAdapter$1 [WARNING] - org.eclipse.jdt.core.compiler.CategorizedProblem [WARNING] - org.eclipse.jdt.core.compiler.CharOperation [WARNING] - org.eclipse.jdt.core.compiler.CompilationProgress [WARNING] - 590 more... [WARNING] jaxen-1.1.6.jar, xml-apis-1.4.01.jar define 1 overlapping classes: [WARNING] - org.w3c.dom.UserDataHandler [WARNING] activation-1.1.jar, javax.activation-1.2.0.jar define 40 overlapping classes and resources: [WARNING] - META-INF/mailcap.default [WARNING] - META-INF/mimetypes.default [WARNING] - com.sun.activation.registries.LineTokenizer [WARNING] - com.sun.activation.registries.LogSupport [WARNING] - com.sun.activation.registries.MailcapFile [WARNING] - com.sun.activation.registries.MailcapParseException [WARNING] - com.sun.activation.registries.MailcapTokenizer [WARNING] - com.sun.activation.registries.MimeTypeEntry [WARNING] - com.sun.activation.registries.MimeTypeFile [WARNING] - com.sun.activation.viewers.ImageViewer [WARNING] - 30 more... [WARNING] heritrix-commons-3.4.0-NAS-7.3.jar, webarchive-commons-1.1.5.jar define 1 overlapping classes: [WARNING] - org.archive.util.Base32 [WARNING] commons-logging-1.2.jar, jcl-over-slf4j-1.7.25.jar define 6 overlapping classes: [WARNING] - org.apache.commons.logging.Log [WARNING] - org.apache.commons.logging.LogConfigurationException [WARNING] - org.apache.commons.logging.LogFactory [WARNING] - org.apache.commons.logging.impl.NoOpLog [WARNING] - org.apache.commons.logging.impl.SimpleLog [WARNING] - org.apache.commons.logging.impl.SimpleLog$1 [WARNING] maven-shade-plugin has detected that some class files are [WARNING] present in two or more JARs. When this happens, only one [WARNING] single version of the class is copied to the uber jar. [WARNING] Usually this is not harmful and you can skip these warnings, [WARNING] otherwise try to manually exclude artifacts based on [WARNING] mvn dependency:tree -Ddetail=true and the above output. [WARNING] See http://maven.apache.org/plugins/maven-shade-plugin/ [INFO] Attaching shaded artifact. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building hadoop-uber-jar-invoker 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-uber-jar-invoker --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-uber-jar-invoker --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-uber-jar-invoker --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hadoop-uber-jar-invoker --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hadoop-uber-jar-invoker --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-uber-jar-invoker --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ hadoop-uber-jar-invoker --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ hadoop-uber-jar-invoker --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/target/hadoop-uber-jar-invoker-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ hadoop-uber-jar-invoker --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/target/hadoop-uber-jar-invoker-7.4-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-assembly-plugin:2.4.1:single (default) @ hadoop-uber-jar-invoker --- [INFO] Reading assembly descriptor: src/main/assembly/assembly.xml [INFO] Copying files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/target/hadoop-uber-jar-invoker-7.4-SNAPSHOT [WARNING] Assembly file: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/hadoop-uber-jar-invoker/target/hadoop-uber-jar-invoker-7.4-SNAPSHOT is not a regular file (it may be a directory). It cannot be attached to the project build for installation or deployment. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Status - Webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ status-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ status-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ status-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ status-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ status-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ status-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ status-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ status-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [status-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/target/Status] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/src/main/webapp] [INFO] Webapp assembled in [20 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/status-gui/target/Status.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ status-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - qa - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ qa-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ qa-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ qa-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ qa-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ qa-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ qa-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ qa-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ qa-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [qa-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/target/QA] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/src/main/webapp] [INFO] Webapp assembled in [14 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/qa-gui/target/QA.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ qa-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - history - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ history-gui --- [INFO] [INFO] --- maven-resources-plugin:3.2.0:copy-resources (copy-h3-resources) @ history-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Using 'UTF-8' encoding to copy filtered properties files. [INFO] Copying 16 resources [INFO] [INFO] --- maven-resources-plugin:3.2.0:resources (default-resources) @ history-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Using 'UTF-8' encoding to copy filtered properties files. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ history-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:3.2.0:testResources (default-testResources) @ history-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Using 'UTF-8' encoding to copy filtered properties files. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ history-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ history-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ history-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ history-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [history-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/target/History] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/src/main/webapp] [INFO] Webapp assembled in [89 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/history-gui/target/History.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ history-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvestDefinition - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvestdefinition-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvestdefinition-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvestdefinition-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvestdefinition-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvestdefinition-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvestdefinition-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvestdefinition-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ harvestdefinition-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [harvestdefinition-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/target/HarvestDefinition] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/src/main/webapp] [INFO] Webapp assembled in [64 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestdefinition-gui/target/HarvestDefinition.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvestdefinition-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvestChannel - webapp 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvestchannel-gui --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvestchannel-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvestchannel-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvestchannel-gui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvestchannel-gui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvestchannel-gui --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvestchannel-gui --- [INFO] [INFO] --- maven-war-plugin:2.2:war (default-war) @ harvestchannel-gui --- [INFO] Packaging webapp [INFO] Assembling webapp [harvestchannel-gui] in [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/target/HarvestChannel] [INFO] Processing war project [INFO] Copying webapp resources [/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/src/main/webapp] [INFO] Webapp assembled in [13 msecs] [INFO] Building war: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvestchannel-gui/target/HarvestChannel.war [INFO] WEB-INF/web.xml already added, skipping [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvestchannel-gui --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - heritrix3 monitor 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap-agent-tomcat/0.2.0-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap-agent-tomcat/0.2.0-SNAPSHOT/maven-metadata.xml (3 KB at 6.4 KB/sec) [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap/0.2.0-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap/0.2.0-SNAPSHOT/maven-metadata.xml (600 B at 34.5 KB/sec) [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap-core/0.2.0-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/com/antiaction/bootstrap-core/0.2.0-SNAPSHOT/maven-metadata.xml (2 KB at 90.6 KB/sec) [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-monitor --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix3-monitor --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix3-monitor --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 27 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix3-monitor --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix3-monitor --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 1 source file to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ heritrix3-monitor --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-monitor --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix3-monitor --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/heritrix3-monitor-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3-monitor --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/heritrix3-monitor-7.4-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-assembly-plugin:2.4.1:single (distro-assembly) @ heritrix3-monitor --- [INFO] Reading assembly descriptor: src/main/assembly/assembly.xml [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.eclipse.jetty.orbit:*:jar' o 'org.glassfish:*:jar' o 'org.glassfish.web:*:jar' o 'jdom:jdom:jar' o 'xom:xom:jar' o 'com.ibm.icu:icu4j:jar' o 'commons-configuration:commons-configuration:jar:1.6' o 'org.apache.httpcomponents:httpclient:jar:4.2.5' o 'org.apache.httpcomponents:httpcore:jar:4.2.4' [INFO] Building tar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/NetarchiveSuite-heritrix3-monitor-7.4-SNAPSHOT.tar.gz [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.eclipse.jetty.orbit:*:jar' o 'org.glassfish:*:jar' o 'org.glassfish.web:*:jar' o 'jdom:jdom:jar' o 'xom:xom:jar' o 'com.ibm.icu:icu4j:jar' o 'commons-configuration:commons-configuration:jar:1.6' o 'org.apache.httpcomponents:httpclient:jar:4.2.5' o 'org.apache.httpcomponents:httpcore:jar:4.2.4' [INFO] Building zip: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-monitor/target/NetarchiveSuite-heritrix3-monitor-7.4-SNAPSHOT.zip [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - deploy - distribution 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ distribution --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ distribution --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ distribution --- [INFO] [INFO] --- maven-assembly-plugin:2.4.1:single (distro-assembly) @ distribution --- [INFO] Reading assembly descriptor: src/main/assembly/distribution.xml [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.netarchivesuite:hadoop-uber-jar:*' [INFO] Building zip: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/distribution/target/NetarchiveSuite-7.4-SNAPSHOT.zip [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - deploy - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ deploy-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ deploy-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ deploy-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ deploy-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ deploy-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] Copying 502 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ deploy-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 10 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-test/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ deploy-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ deploy-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ deploy-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/deploy/deploy-test/target/deploy-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ deploy-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - Heritrix3 Bundler 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-bundler --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-bundler --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ heritrix3-bundler --- [INFO] [INFO] --- maven-assembly-plugin:2.4.1:single (distro-assembly) @ heritrix3-bundler --- [INFO] Reading assembly descriptor: src/main/assembly/distribution.xml [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/is/landsbokasafn/crawl-rss/crawl-rss/0.0.2-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/is/landsbokasafn/crawl-rss/crawl-rss/0.0.2-SNAPSHOT/maven-metadata.xml (2 KB at 56.3 KB/sec) [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/is/landsbokasafn/crawl-rss/crawl-rss/0.0.2-SNAPSHOT/crawl-rss-0.0.2-20220503.111045-3.pom [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/is/landsbokasafn/crawl-rss/crawl-rss/0.0.2-SNAPSHOT/crawl-rss-0.0.2-20220503.111045-3.pom (10 KB at 789.3 KB/sec) [INFO] Downloading: https://sbforge.org/nexus/content/groups/public/is/landsbokasafn/crawl-rss/crawl-rss/0.0.2-SNAPSHOT/crawl-rss-0.0.2-20220503.111045-3-dist.zip [INFO] Downloaded: https://sbforge.org/nexus/content/groups/public/is/landsbokasafn/crawl-rss/crawl-rss/0.0.2-SNAPSHOT/crawl-rss-0.0.2-20220503.111045-3-dist.zip (109504 KB at 32707.2 KB/sec) [WARNING] The following patterns were never triggered in this artifact exclusion filter: o 'org.eclipse.jetty.orbit:*:jar' o 'org.glassfish:*:jar' o 'org.glassfish.web:*:jar' o 'org.ow2.asm:*:jar' o 'xom:xom:jar' o 'xerces:*:jar' o 'com.ibm.icu:icu4j:jar' o 'commons-configuration:commons-configuration:jar:1.6' o 'org.apache.httpcomponents:httpclient:jar:4.2.5' o 'org.apache.httpcomponents:httpcomponents-client:jar:4.2.5' o 'org.apache.httpcomponents:httpcore:jar:4.2.4' o '*/lib/httpclient-4.2.5.jar' o 'lib/httpclient-4.2.5.jar' [INFO] Building zip: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/heritrix3/heritrix3-bundler/target/NetarchiveSuite-heritrix3-bundler-7.4-SNAPSHOT.zip [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - harvester - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ harvester-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ harvester-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ harvester-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ harvester-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ harvester-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 14 resources [INFO] Copying 441 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ harvester-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 128 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/viewerproxy/ARCArchiveAccessTester.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/viewerproxy/ARCArchiveAccessTester.java: Recompile with -Xlint:deprecation for details. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/CombiningMultiFileBasedCacheTester.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/CombiningMultiFileBasedCacheTester.java uses unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/CombiningMultiFileBasedCacheTester.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ harvester-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ harvester-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ harvester-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/harvester/harvester-test/target/harvester-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ harvester-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - monitor - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ monitor-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ monitor-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ monitor-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ monitor-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ monitor-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 8 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ monitor-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 4 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ monitor-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ monitor-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ monitor-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/monitor/monitor-test/target/monitor-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ monitor-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - wayback resourceStore 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback-resourcestore --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ wayback-resourcestore --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-resourcestore --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-resourcestore --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 7 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-resourcestore --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-resourcestore --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 4 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-resourcestore --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-resourcestore --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-resourcestore --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/wayback-resourcestore-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-resourcestore --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-resourcestore/target/wayback-resourcestore-7.4-SNAPSHOT-sources.jar [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - wayback - test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ wayback-test --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (agent) @ wayback-test --- [INFO] argLine set to -javaagent:/home/cibuild02/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/../target/jacoco.exec,append=true [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ wayback-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ wayback-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ wayback-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 28 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ wayback-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 17 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/test/java/dk/netarkivet/wayback/hadoop/CDXMapperTester.java: Some input files use or override a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/src/test/java/dk/netarkivet/wayback/hadoop/CDXMapperTester.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ wayback-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ wayback-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ wayback-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/wayback/wayback-test/target/wayback-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ wayback-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite - integration tests 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ integration-test --- [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ integration-test --- [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ integration-test --- [JENKINS] Archiving disabled [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetarchiveSuite System test 7.4-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ system-test --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ system-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ system-test --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ system-test --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 22 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ system-test --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 34 source files to /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java uses unchecked or unsafe operations. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/src/test/java/dk/netarkivet/systemtest/SeleniumSession.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ system-test --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ system-test --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ system-test --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-Colin-1-Click/integration-test/system-test/target/system-test-7.4-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources-no-fork) @ system-test --- [INFO] No sources in project. Archive not created. [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] NetarchiveSuite .................................... SUCCESS [ 1.480 s] [INFO] NetarchiveSuite - build-tools ...................... SUCCESS [ 1.402 s] [INFO] NetarchiveSuite - common ........................... SUCCESS [ 0.146 s] [INFO] NetarchiveSuite - test utils ....................... SUCCESS [ 1.943 s] [INFO] NetarchiveSuite - common - core .................... SUCCESS [ 7.602 s] [INFO] NetarchiveSuite - common - test .................... SUCCESS [ 3.892 s] [INFO] NetarchiveSuite - archive .......................... SUCCESS [ 0.130 s] [INFO] NetarchiveSuite - archive - core ................... SUCCESS [ 3.536 s] [INFO] NetarchiveSuite - harvester ........................ SUCCESS [ 0.120 s] [INFO] NetarchiveSuite - harvester - core ................. SUCCESS [ 4.971 s] [INFO] NetarchiveSuite - archive - test ................... SUCCESS [ 2.855 s] [INFO] NetarchiveSuite - bitpreservation - webapp ......... SUCCESS [ 0.844 s] [INFO] NetarchiveSuite - Harvest Scheduler ................ SUCCESS [ 2.377 s] [INFO] NetarchiveSuite - monitor .......................... SUCCESS [ 0.134 s] [INFO] NetarchiveSuite - monitor - core ................... SUCCESS [ 2.142 s] [INFO] NetarchiveSuite - wayback .......................... SUCCESS [ 0.110 s] [INFO] NetarchiveSuite - wayback - indexer ................ SUCCESS [ 2.220 s] [INFO] NetarchiveSuite - deploy ........................... SUCCESS [ 0.137 s] [INFO] NetarchiveSuite - deploy - core .................... SUCCESS [ 3.078 s] [INFO] NetarchiveSuite - harvester - heritrix3 ............ SUCCESS [ 0.122 s] [INFO] NetarchiveSuite - Heritrix3 Extensions ............. SUCCESS [ 3.554 s] [INFO] NetarchiveSuite - heritrix3 controller ............. SUCCESS [ 2.638 s] [INFO] hadoop-uber-jar .................................... SUCCESS [ 8.656 s] [INFO] hadoop-uber-jar-invoker ............................ SUCCESS [ 8.368 s] [INFO] NetarchiveSuite - Status - Webapp .................. SUCCESS [ 1.017 s] [INFO] NetarchiveSuite - qa - webapp ...................... SUCCESS [ 0.502 s] [INFO] NetarchiveSuite - history - webapp ................. SUCCESS [ 1.535 s] [INFO] NetarchiveSuite - harvestDefinition - webapp ....... SUCCESS [ 1.135 s] [INFO] NetarchiveSuite - harvestChannel - webapp .......... SUCCESS [ 0.474 s] [INFO] NetarchiveSuite - heritrix3 monitor ................ SUCCESS [ 19.732 s] [INFO] NetarchiveSuite - deploy - distribution ............ SUCCESS [ 18.343 s] [INFO] NetarchiveSuite - deploy - test .................... SUCCESS [ 2.398 s] [INFO] NetarchiveSuite - Heritrix3 Bundler ................ SUCCESS [ 19.567 s] [INFO] NetarchiveSuite - harvester - test ................. SUCCESS [ 4.248 s] [INFO] NetarchiveSuite - monitor - test ................... SUCCESS [ 1.411 s] [INFO] NetarchiveSuite - wayback resourceStore ............ SUCCESS [ 1.661 s] [INFO] NetarchiveSuite - wayback - test ................... SUCCESS [ 1.866 s] [INFO] NetarchiveSuite - integration tests ................ SUCCESS [ 0.153 s] [INFO] NetarchiveSuite System test ........................ SUCCESS [ 1.892 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:32 min [INFO] Finished at: 2022-05-03T13:14:09+02:00 [INFO] Final Memory: 137M/329M [INFO] ------------------------------------------------------------------------ channel stopped [NetarchiveSuite-Colin-1-Click] $ /bin/bash /tmp/hudson4396511107520375883.sh Do a total cleanup of system Test6 start tunning cleanup script end part of script -------------------------------------------- KILLING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk Killing all applications on: sb-test-har-001.statsbiblioteket.dk Killing linux application: HarvestControllerApplication_sbhigh_h3 -------------------------------------------- -------------------------------------------- KILLING MACHINE: devel@kb-test-adm-001.kb.dk Killing all applications on: kb-test-adm-001.kb.dk Killing linux application: GUIApplication Killing linux application: ArcRepositoryApplication Killing linux application: HarvestJobManagerApplication -------------------------------------------- KILLING MACHINE: devel@kb-test-har-003.kb.dk Killing all applications on: kb-test-har-003.kb.dk Killing linux application: HarvestControllerApplication_kblow001_h3 -------------------------------------------- KILLING MACHINE: devel@kb-test-har-005.kb.dk Killing all applications on: kb-test-har-005.kb.dk Killing linux application: HarvestControllerApplication_browser_1 Killing linux application: HarvestControllerApplication_browser_2 -------------------------------------------- KILLING MACHINE: devel@kb-test-har-004.kb.dk Killing all applications on: kb-test-har-004.kb.dk Killing linux application: HarvestControllerApplication_kblow002_h3 Killing linux application: HarvestControllerApplication_kbhigh_h3 -------------------------------------------- KILLING MACHINE: devel@kb-test-acs-001.kb.dk Killing all applications on: kb-test-acs-001.kb.dk Killing linux application: IndexServerApplication Killing linux application: ViewerProxyApplication -------------------------------------------- KILLING MACHINE: devel@kb-test-way-001.kb.dk Killing all applications on: kb-test-way-001.kb.dk Killing linux application: WaybackIndexerApplication Killing linux application: AggregatorApplication -------------------------------------------- running cleanup_bitmag Resetting Collection Test6 Delete content in collection=Test6 13:15:32.809 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 13:15:33.155 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 13:15:33.194 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 13:15:34.001 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 13:15:34.020 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 13:15:34.021 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 13:15:34.196 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 13:15:34.198 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 13:15:35.087 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 13:15:35.229 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@2b71e916[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 13:15:35.232 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-26398] 13:15:35.236 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 13:15:35.236 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26398' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 13:15:35.237 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26398' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@10d307f1'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26398#282265585'. 13:15:35.237 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26398#282265585'. Checksum: Count: FileID: 13:15:35.284 INFO o.b.a.g.ConversationBasedGetChecksumsClient - Requesting the checksums for file '' with the specifications 'org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@4d0f2471[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)]null' with query [ContributorQuery{componentID='netarkiv-tape-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-disk-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-disk-devel-02, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-checksum-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}, ContributorQuery{componentID='netarkiv-kbh-disk-devel-01, minTimestamp=Thu Jan 01 01:00:00 CET 1970, maxTimestamp=null, maxNumberOfResults=10000}]. 13:15:35.306 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/versioning/ProtocolVersionDefinition.xsd 13:15:35.928 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent IdentifyPillarsForGetChecksumsRequest(c7342867) collectionID Test6, destination topic://netarkiv-devel: FileIDs=AllFiles 13:15:35.929 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: IDENTIFY_REQUEST_SENT: , Identifying pillars for GetChecksums 13:15:36.302 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(c7342867) collectionID Test6, from netarkiv-kbh-disk-devel-01: IDENTIFICATION_POSITIVE(Checksum operation available.) 13:15:36.305 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-kbh-disk-devel-01 13:15:36.306 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 13:15:36.306 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01] 13:15:36.585 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(c7342867) collectionID Test6, from netarkiv-checksum-devel-01: IDENTIFICATION_POSITIVE(Operation acknowledged and accepted.) 13:15:36.592 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-checksum-devel-01 13:15:36.592 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 13:15:36.592 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-tape-devel-01, netarkiv-disk-devel-01] 13:15:36.828 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(c7342867) collectionID Test6, from netarkiv-tape-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 13:15:36.836 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-tape-devel-01 13:15:36.836 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 13:15:36.836 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02, netarkiv-disk-devel-01] 13:15:37.138 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received IdentifyPillarsForGetChecksumsResponse(c7342867) collectionID Test6, from netarkiv-disk-devel-01: IDENTIFICATION_POSITIVE(IDENTIFICATION_POSITIVE) 13:15:37.139 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: COMPONENT_IDENTIFIED: ContributorID netarkiv-disk-devel-01 13:15:37.140 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 13:15:37.140 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-disk-devel-02, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-disk-devel-02] 13:15:45.304 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: IDENTIFY_TIMEOUT: , Time has run out for looking up contributors The following contributors didn't respond: [netarkiv-disk-devel-02] 13:15:45.305 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: COMPONENT_FAILED: ContributorID netarkiv-disk-devel-02 ResponseCode: null, Timeout for identifying contributor 13:15:45.306 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: IDENTIFICATION_COMPLETE: Contributors: [netarkiv-kbh-disk-devel-01, netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01] 13:15:45.308 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: REQUEST_SENT: ContributorID [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], Sending GetFileIDsRequest's 13:15:45.730 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(c7342867) collectionID Test6, destination queue://netarkiv-tape-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@4d0f2471[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00 13:15:46.127 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(c7342867) collectionID Test6, destination queue://netarkiv-disk-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@4d0f2471[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00 13:15:46.604 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(c7342867) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 13:15:46.607 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-tape-devel-01, OPERATION_ACCEPTED_PROGRESS 13:15:46.654 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(c7342867) collectionID Test6, destination topic://netarkiv-devel-netarkiv-checksum-devel-01-contributor: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@4d0f2471[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00 13:15:47.124 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(c7342867) collectionID Test6, from netarkiv-tape-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@689a7f6f[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false 13:15:47.131 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-tape-devel-01 13:15:47.132 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01] 13:15:47.238 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Sent GetChecksumsRequest(c7342867) collectionID Test6, destination topic://netarkiv-devel.netarkiv-kbh-disk-devel-01: FileIDs=AllFiles, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@4d0f2471[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], MaxNumberOfResults=10000, MinTimestamp=1970-01-01T01:00:00.000+01:00 13:15:47.458 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(c7342867) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_ACCEPTED_PROGRESS(OPERATION_ACCEPTED_PROGRESS) 13:15:47.465 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-disk-devel-01, OPERATION_ACCEPTED_PROGRESS 13:15:47.723 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(c7342867) collectionID Test6, from netarkiv-disk-devel-01: OPERATION_COMPLETED(OPERATION_COMPLETED), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@39aa9c4b[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false 13:15:47.730 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-disk-devel-01 13:15:47.731 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-checksum-devel-01, netarkiv-kbh-disk-devel-01] 13:15:47.939 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsProgressResponse(c7342867) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_ACCEPTED_PROGRESS(Starting to calculate checksums.) 13:15:47.946 DEBUG o.b.commandline.GetChecksumsCmd - Received event: c7342867: GET_CHECKSUMS: PROGRESS: ContributorID netarkiv-checksum-devel-01, Starting to calculate checksums. 13:15:48.191 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(c7342867) collectionID Test6, from netarkiv-checksum-devel-01: OPERATION_COMPLETED, NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@6f59bf3b[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false 13:15:48.203 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-checksum-devel-01 13:15:48.203 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [netarkiv-kbh-disk-devel-01] 13:15:48.441 DEBUG o.b.p.m.l.GetChecksumsMessageLogger - Received GetChecksumsFinalResponse(c7342867) collectionID Test6, from netarkiv-kbh-disk-devel-01: OPERATION_COMPLETED(Completed checksum retrieval.), NumberOfChecksums=0, ChecksumRequestForExistingFile=org.bitrepository.bitrepositoryelements.ChecksumSpecTYPE@6575e598[checksumType=MD5, checksumSalt=<null>(default), otherChecksumType=<null>(default)], PartialResult=false 13:15:48.442 DEBUG o.b.c.c.s.ContributorResponseStatus - Received response from: netarkiv-kbh-disk-devel-01 13:15:48.442 DEBUG o.b.c.c.s.ContributorResponseStatus - Expected contributors: [netarkiv-checksum-devel-01, netarkiv-tape-devel-01, netarkiv-disk-devel-01, netarkiv-kbh-disk-devel-01], components that have not answered: [] Deleting file FileID: with checksum Checksum: in collection Test6 from pillars netarkiv-tape-devel-01 netarkiv-disk-devel-01 netarkiv-checksum-devel-01 netarkiv-kbh-disk-devel-01 13:15:49.775 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-repository-settings-xsd-12.jar!/xsd/RepositorySettings.xsd 13:15:49.917 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/RepositorySettings.xml'. 13:15:50.227 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-reference-settings-1.9.0.1.jar!/xsd/ReferenceSettings.xsd 13:15:50.254 DEBUG o.b.c.settings.XMLFileSettingsLoader - Loading the settings file '/home/devel/ResetCollection/bitrepository-client/bin/../conf/ReferenceSettings.xml'. 13:15:51.006 DEBUG o.b.p.security.BasicSecurityManager - X509CertificateHolder found 13:15:51.025 DEBUG o.b.p.security.BasicSecurityManager - Got something, that we don't (yet) recognize. Class: PEMKeyPair 13:15:51.025 DEBUG o.b.p.security.BasicSecurityManager - PrivateKeyInfo found 13:15:51.264 INFO o.b.p.activemq.ActiveMQMessageBus - Initializing ActiveMQMessageBus:'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 13:15:51.265 DEBUG org.bitrepository.common.JaxbHelper - Creating JAXBHelper based on schema from: jar:file:/home/devel/ResetCollection/bitrepository-client/lib/bitrepository-message-xml-xsd-30.jar!/xsd/BitRepositoryMessages.xsd 13:15:52.246 INFO o.a.a.t.failover.FailoverTransport - Successfully connected to ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true 13:15:52.384 DEBUG o.b.p.activemq.ActiveMQMessageBus - ActiveMQConnection initialized for 'org.bitrepository.settings.repositorysettings.MessageBusConfiguration@13c9d689[name=netarkiv-aar-bit-master-devel-01 broker, url=failover:(ssl://netarkiv-aar-bit-master-devel-01.statsbiblioteket.dk:61612?keepAlive=true)]'. 13:15:52.387 INFO o.b.p.activemq.ActiveMQMessageBus - Settings component filter to: [kb-test-har-003.kb.dk-devel-26430] 13:15:52.391 DEBUG o.b.c.c.m.CollectionBasedConversationMediator - Initializing the CollectionBasedConversationMediator 13:15:52.391 DEBUG o.b.p.activemq.ActiveMQMessageBus - Adding listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac' to destination: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26430' on message-bus 'netarkiv-aar-bit-master-devel-01 broker'. 13:15:52.392 DEBUG o.b.p.activemq.ActiveMQMessageBus - Retrieving message consumer on destination 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26430' for listener 'org.bitrepository.client.conversation.mediator.CollectionBasedConversationMediator@4d5b6aac'. Key: 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26430#1297836716'. 13:15:52.392 DEBUG o.b.p.activemq.ActiveMQMessageBus - No consumer known. Creating new for key 'topic://netarkiv-devel-kb-test-har-003.kb.dk-devel-26430#1297836716'. 13:15:52.412 DEBUG o.b.commandline.DeleteFileCmd - Performing the DeleteFile operation. java.lang.IllegalArgumentException: String hexString, 'Checksum:', must be an even number of characters. at org.bitrepository.common.ArgumentValidator.checkTrue(ArgumentValidator.java:160) at org.bitrepository.common.utils.Base16Utils.encodeBase16(Base16Utils.java:64) at org.bitrepository.commandline.CommandLineClient.getChecksumDataForDeleteValidation(CommandLineClient.java:302) at org.bitrepository.commandline.DeleteFileCmd.deleteTheFile(DeleteFileCmd.java:125) at org.bitrepository.commandline.DeleteFileCmd.performOperation(DeleteFileCmd.java:107) at org.bitrepository.commandline.CommandLineClient.runCommand(CommandLineClient.java:68) at org.bitrepository.commandline.DeleteFileCmd.main(DeleteFileCmd.java:47) xargs: ssh: exited with status 255; aborting calling cleanup_hosts running cleanup_hosts Removing installation on sb-test-har-001.statsbiblioteket.dk Removing installation on kb-test-har-003.kb.dk Removing installation on kb-test-har-004.kb.dk Removing installation on kb-test-har-005.kb.dk Removing installation on kb-test-adm-001.kb.dk Removing installation on kb-test-acs-001.kb.dk Removing installation on kb-test-way-001.kb.dk calling cleanup_linuxbarhosts running cleanup_linuxbarhosts Removing installation on sb-test-bar-001.statsbiblioteket.dk Removing bitarchive on sb-test-bar-001.statsbiblioteket.dk Calling cleanup_windowsbarhosts running cleanup_windowsbarhosts Removing C:\bitarkiv\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out Removing E:\bitarchive_1\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out Removing F:\bitarchive_2\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out Removing g:\bitarchive_3\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out Removing C:\Users\ba-devel\Test6 on kb-test-bar-01.bitarkiv.kb.dk ssh: connect to host kb-test-bar-01.bitarkiv.kb.dk port 22: Connection timed out TESTX=Test6 PORT=8078 MAILRECEIVERS=csr@kb.dk VERSION=CSR DEPLOYCONF=deploy_config_bitmag.xml H3ZIP=CSR BITMAGCONF=/home/devel/bitmag_test_config/client_config Using bundler file /home/devel/nas_versions/bundler/NetarchiveSuite-heritrix3-bundler-CSR.zip Creating distribution files in /home/devel/prepared_software/Test6. Will read source files using encoding 'UTF-8' (defaulted) Branch in settings not found: common.warcRecordService Branch in settings not found: common.arcrepositoryClient.bitrepository.getFileIDsMaxResults Branch in settings not found: common.hadoop.kerberos Branch in settings not found: common.hadoop.username Branch in settings not found: common.hadoop.mapred.hadoopUberJar Branch in settings not found: common.hadoop.mapred.inputFilesParentDir Branch in settings not found: common.hadoop.mapred.cdxJob Branch in settings not found: common.hadoop.mapred.metadataExtractionJob Branch in settings not found: common.hadoop.mapred.metadataCDXExtractionJob Branch in settings not found: common.hadoop.mapred.crawlLogExtractionJob Branch in settings not found: common.fileResolver.class Branch in settings not found: common.fileResolver.baseUrl Branch in settings not found: common.fileResolver.keyfile Branch in settings not found: common.webinterface.metadata_cache_dir Branch in settings not found: harvester.harvesting.heritrix3.bundle Branch in settings not found: harvester.harvesting.heritrix3.certificate Branch in settings not found: harvester.harvesting.heritrix3.bundle Branch in settings not found: harvester.harvesting.heritrix3.certificate Branch in settings not found: harvester.harvesting.umbra Branch in settings not found: harvester.harvesting.heritrix3.bundle Branch in settings not found: harvester.harvesting.heritrix3.certificate Branch in settings not found: harvester.harvesting.umbra Branch in settings not found: harvester.harvesting.heritrix3.bundle Branch in settings not found: harvester.harvesting.heritrix3.bundle Machine 'kb-test-adm-001.kb.dk' configured with encoding 'UTF-8' (defaulted) Machine 'kb-test-har-003.kb.dk' configured with encoding 'UTF-8' (defaulted) NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip /home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks Machine 'kb-test-har-005.kb.dk' configured with encoding 'UTF-8' (defaulted) NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip /home/devel/quickstart-nas-5.0-h3/h3server.jks -> /home/devel/Test6/h3server.jks Machine 'kb-test-har-004.kb.dk' configured with encoding 'UTF-8' (defaulted) NetarchiveSuite-heritrix3-bundler.zip -> /home/devel/Test6/NetarchiveSuite-heritrix3-bundler.zip Machine 'kb-test-acs-001.kb.dk' configured with encoding 'UTF-8' (defaulted) Machine 'kb-test-way-001.kb.dk' configured with encoding 'UTF-8' (defaulted) Machine 'sb-test-har-001.statsbiblioteket.dk' configured with encoding 'UTF-8' (defaulted) /home/devel/prepared_software/Test6/NetarchiveSuite-heritrix3-bundler.zip -> /home/netarkdv/Test6/NetarchiveSuite-heritrix3-bundler.zip 13:21:25.954 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 13:21:25.959 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 13:21:25.960 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 13:21:25.960 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 13:21:25.960 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 13:21:25.960 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 13:21:25.961 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 13:21:25.961 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 13:21:25.961 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 13:21:25.961 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 13:21:25.962 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 13:21:25.962 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive 13:21:26.025 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element baseDir is not a branch in the tree [archive, bitpreservation, baseDir]. Null returned 13:21:26.026 [main] DEBUG dk.netarkivet.deploy.XmlStructure - Element is not text. Null returned. Path given to getLeafValue archive -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-adm-001.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-adm-001.kb.dk deleting devel@kb-test-adm-001.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-adm-001.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-har-003.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-har-003.kb.dk deleting devel@kb-test-har-003.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-har-003.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-har-005.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-har-005.kb.dk deleting devel@kb-test-har-005.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-har-005.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-har-004.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-har-004.kb.dk deleting devel@kb-test-har-004.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-har-004.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-acs-001.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-acs-001.kb.dk deleting devel@kb-test-acs-001.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-acs-001.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- INSTALLING TO MACHINE: devel@kb-test-way-001.kb.dk copying NetarchiveSuite-CSR.zip to:kb-test-way-001.kb.dk deleting devel@kb-test-way-001.kb.dk:/home/devel/Test6/lib unzipping NetarchiveSuite-CSR.zip at:kb-test-way-001.kb.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- -------------------------------------------- INSTALLING TO MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk copying NetarchiveSuite-CSR.zip to:sb-test-har-001.statsbiblioteket.dk deleting netarkdv@sb-test-har-001.statsbiblioteket.dk:/home/netarkdv/Test6/lib unzipping NetarchiveSuite-CSR.zip at:sb-test-har-001.statsbiblioteket.dk Creating directories. preparing for copying of settings and scripts copying settings and scripts make scripts executable make password and access files readonly -------------------------------------------- Initializing database for system Test6 + host=devel@kb-test-adm-001 + scp -p /home/devel/devel-config/scripts/db/setup_admindb.sh /home/devel/devel-config/scripts/db/setup_harvestdb.sh /home/devel/devel-config/scripts/db/teardown_admindb.sh /home/devel/devel-config/scripts/db/teardown_harvestdb.sh /home/devel/devel-config/scripts/../resources/harvestdb.testdata.sql /home/devel/devel-config/scripts/../resources/default_orderxml.cxml devel@kb-test-adm-001:bin/ + ssh devel@kb-test-adm-001 Pseudo-terminal will not be allocated because stdin is not a terminal. Dette system må kun tilgås af brugere autoriserede af Det Kgl. Bibliotek. This system is only to be used by users authorized by the Royal Danish Library. Destroying test6_admindb DROP DATABASE Creating empty test6_admindb CREATE DATABASE Initialising test6_admindb CREATE TABLE INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX CREATE INDEX CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE TABLE CREATE SEQUENCE ALTER TABLE Destroying test6_harvestdb DROP DATABASE CREATE DATABASE CREATE TABLE INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 INSERT 0 1 GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE GRANT CREATE TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX CREATE INDEX CREATE INDEX CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE INDEX GRANT CREATE TABLE GRANT CREATE TABLE CREATE INDEX GRANT CREATE TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT GRANT CREATE TABLE CREATE INDEX CREATE INDEX GRANT CREATE TABLE CREATE INDEX GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX GRANT GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX CREATE INDEX GRANT GRANT CREATE TABLE CREATE INDEX CREATE INDEX CREATE INDEX GRANT CREATE TABLE CREATE INDEX CREATE INDEX GRANT CREATE TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT CREATE TABLE CREATE SEQUENCE ALTER TABLE GRANT INSERT 0 1 INSERT 0 1 CREATE TABLE CREATE SEQUENCE ALTER TABLE CREATE INDEX GRANT GRANT ALTER TABLE ALTER TABLE ALTER TABLE ALTER TABLE CREATE TABLE ALTER TABLE CREATE INDEX CREATE SEQUENCE CREATE TABLE ALTER TABLE CREATE INDEX GRANT GRANT GRANT INSERT 0 1 INSERT 0 1 INSERT 0 1 SET SET SET SET SET SET SET SET SET COPY 16 COPY 16 setval -------- 17 (1 row) COPY 16 setval -------- 17 (1 row) COPY 3 setval -------- 17 (1 row) COPY 2 setval -------- 5 (1 row) COPY 4 setval -------- 4 (1 row) COPY 25 COPY 16 setval -------- 17 (1 row) 13:23:50.614 [MLog-Init-Reporter] INFO com.mchange.v2.log.MLog - MLog clients using slf4j logging. 13:23:50.652 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - Reading VM config for path list /com/mchange/v2/log/default-mchange-log.properties, /mchange-commons.properties, /c3p0.properties, hocon:/reference,/application,/c3p0,/, /mchange-log.properties, / 13:23:50.652 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping. 13:23:50.652 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping. 13:23:50.652 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping. 13:23:50.653 [MLog-Init-Reporter] DEBUG com.mchange.v2.log.MLog - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping. 13:23:50.667 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping. 13:23:50.667 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping. 13:23:50.667 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping. 13:23:50.668 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping. 13:23:51.217 [main] INFO com.mchange.v2.c3p0.C3P0Registry - Initializing c3p0-0.9.5.4 [built 23-March-2019 23:00:48 -0700; debug? true; trace: 10] 13:23:51.418 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ao1272id61iltg8p|f4168b8,name=10bdx52ao1272id61iltg8p|f4168b8 registered. 13:23:51.554 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ao1272id61iltg8p|f4168b8,name=10bdx52ao1272id61iltg8p|f4168b8 unregistered, in order to be reregistered after update. 13:23:51.554 [main] DEBUG com.mchange.v2.c3p0.management.DynamicPooledDataSourceManagerMBean - MBean: com.mchange.v2.c3p0:type=PooledDataSource,identityToken=10bdx52ao1272id61iltg8p|f4168b8,name=10bdx52ao1272id61iltg8p|f4168b8 registered. 13:23:51.618 [main] INFO dk.netarkivet.harvester.datamodel.HarvestDBConnection - Connection pool initialized with the following values: - minPoolSize=5 - maxPoolSize=20 - acquireIncrement=5 - maxStatements=0 - maxStatementsPerConnection=0 - idleConnTestPeriod=0 - idleConnTestQuery='null' - idleConnTestOnCheckin=false 13:23:51.719 [main] INFO com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource - Initializing c3p0 pool... com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 5, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, dataSourceName -> 10bdx52ao1272id61iltg8p|f4168b8, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, extensions -> {}, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, forceUseNamedDriverClass -> false, identityToken -> 10bdx52ao1272id61iltg8p|f4168b8, idleConnectionTestPeriod -> 0, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://localhost:5432/test6_harvestdb, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 3600, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, numHelperThreads -> 3, preferredTestQuery -> null, privilegeSpawnedThreads -> false, properties -> {user=******, password=******}, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, userOverrides -> {}, usesTraditionalReflectiveProxies -> false ] 13:23:51.763 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-commons.properties' could not be found. Skipping. 13:23:51.764 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/mchange-log.properties' could not be found. Skipping. 13:23:51.764 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier '/c3p0.properties' could not be found. Skipping. 13:23:51.764 [main] DEBUG com.mchange.v2.cfg.MConfig - The configuration file for resource identifier 'hocon:/reference,/application,/c3p0,/' could not be found. Skipping. 13:23:51.765 [main] WARN com.mchange.v2.resourcepool.BasicResourcePool - Bad pool size config, start 3 < min 5. Using 5 as start. 13:23:51.769 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - com.mchange.v2.resourcepool.BasicResourcePool@5be6e01c config: [start -> 5; min -> 5; max -> 20; inc -> 5; num_acq_attempts -> 30; acq_attempt_delay -> 1000; check_idle_resources_delay -> 0; max_resource_age -> 3600000; max_idle_time -> 0; excess_max_idle_time -> 0; destroy_unreturned_resc_time -> 0; expiration_enforcement_delay -> 900000; break_on_acquisition_failure -> false; debug_store_checkout_exceptions -> false; force_synchronous_checkins -> false] 13:23:51.769 [main] DEBUG com.mchange.v2.c3p0.impl.C3P0PooledConnectionPoolManager - Created new pool for auth, username (masked): 'de******'. 13:23:51.770 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - acquire test -- pool size: 0; target_pool_size: 5; desired target? 1 13:23:51.770 [main] DEBUG com.mchange.v2.resourcepool.BasicResourcePool - awaitAvailable(): [unknown] 13:23:52.173 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@3911c2a7 [wrapping: SELECT version FROM schemaversions WHERE tablename = 'ordertemplates'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@1725dc0f [wrapping: null] 13:23:52.199 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@2145b572 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@15eb5ee5 [wrapping: null] 13:23:52.240 [main] DEBUG com.mchange.v2.c3p0.impl.NewProxyPreparedStatement - com.mchange.v2.c3p0.impl.NewProxyPreparedStatement@35ef1869 [wrapping: SELECT COUNT(*) FROM ordertemplates WHERE name = 'default_orderxml'] closed orphaned ResultSet: com.mchange.v2.c3p0.impl.NewProxyResultSet@3c407114 [wrapping: null] The template 'default_orderxml' has now been updated. + set +x -------------------------------------------- STARTING MACHINE: devel@kb-test-adm-001.kb.dk Starting all applications on: kb-test-adm-001.kb.dk Starting linux application: GUIApplication Starting linux application: ArcRepositoryApplication Starting linux application: HarvestJobManagerApplication SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. -------------------------------------------- STARTING MACHINE: devel@kb-test-har-003.kb.dk Starting all applications on: kb-test-har-003.kb.dk Starting linux application: HarvestControllerApplication_kblow001_h3 13:24:00,372 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow001_h3.xml] 13:24:00,679 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 13:24:00,683 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:24:00,692 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:24:00,705 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:00,768 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:24:00,775 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 13:24:00,804 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - No compression will be used 13:24:00,806 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@858952163 - Will use the pattern ./log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log for the active file 13:24:00,810 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow001_h3.%d{yyyy-MM-dd}.%i.log'. 13:24:00,810 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Roll-over at midnight. 13:24:00,815 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - Setting initial period to Tue May 03 13:24:00 CEST 2022 13:24:00,815 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 13:24:00,815 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@479d31f3 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 13:24:00,818 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:00,821 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow001_h3.log 13:24:00,821 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow001_h3.log] 13:24:00,822 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 13:24:01,395 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 13:24:01,397 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 13:24:01,398 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 13:24:01,398 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 13:24:01,398 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 13:24:01,399 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 13:24:01,399 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:24:01,400 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@40ef3420 - Registering current configuration as safe fallback point 2022-05-03 13:24:01.410 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) 2022-05-03 13:24:01.419 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) Java VM: 1.8.0_332 2022-05-03 13:24:01.420 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre 2022-05-03 13:24:01.420 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-05-03 13:24:01.420 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-05-03 13:24:01.425 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow001_h3.xml' 2022-05-03 13:24:01.573 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-003.kb.dk' and JMX/RMI ports 8170/8270 2022-05-03 13:24:01.574 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-003.kb.dk:8270/jndi/rmi://kb-test-har-003.kb.dk:8170/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-05-03 13:24:01.580 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-05-03 13:24:01.592 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:01.592 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:01.593 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-05-03 13:24:01.597 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer. 2022-05-03 13:24:01.598 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY' 2022-05-03 13:24:01.598 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low' 2022-05-03 13:24:01.598 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free. 2022-05-03 13:24:01.752 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:01.752 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:01.763 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-003.kb.dk 2022-05-03 13:24:03.475 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-05-03 13:24:03.476 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@5c3b6c6e as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3 2022-05-03 13:24:03.491 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_9_HCS_KBLOW001_H3']' 2022-05-03 13:24:03.492 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-05-03 13:24:03.493 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID 2022-05-03 13:24:03.503 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp' 2022-05-03 13:24:03.522 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries. 2022-05-03 13:24:03.629 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist! 2022-05-03 13:24:03.655 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection. 2022-05-03 13:24:03.657 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300 2022-05-03 13:24:03.657 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_low' 2022-05-03 13:24:03.658 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7c56e013 as listener to Test6_COMMON_HCHAN_VAL_RESP 2022-05-03 13:24:03.674 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'LOWPRIORITY' 2022-05-03 13:24:03.686 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'LOWPRIORITY' is valid. 2022-05-03 13:24:03.687 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY']' 2022-05-03 13:24:03.688 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7c56e013 as listener to Test6_COMMON_JOB_SNAPSHOT_LOWPRIORITY -------------------------------------------- STARTING MACHINE: devel@kb-test-har-005.kb.dk Starting all applications on: kb-test-har-005.kb.dk Starting linux application: HarvestControllerApplication_browser_1 Starting linux application: HarvestControllerApplication_browser_2 13:24:05,859 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_1.xml] 13:24:06,333 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 13:24:06,336 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:24:06,342 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:24:06,368 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:06,462 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:24:06,471 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 13:24:06,504 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - No compression will be used 13:24:06,505 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - Will use the pattern ./log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log for the active file 13:24:06,507 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_1.%d{yyyy-MM-dd}.%i.log'. 13:24:06,507 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Roll-over at midnight. 13:24:06,511 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Setting initial period to Tue May 03 13:24:06 CEST 2022 13:24:06,511 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 13:24:06,511 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 13:24:06,517 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:06,519 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_1.log 13:24:06,519 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_1.log] 13:24:06,520 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 13:24:07,154 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 13:24:07,155 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 13:24:07,155 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 13:24:07,156 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 13:24:07,156 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 13:24:07,156 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 13:24:07,156 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:24:07,157 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@333291e3 - Registering current configuration as safe fallback point 2022-05-03 13:24:07.191 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) 2022-05-03 13:24:07.207 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) Java VM: 1.8.0_312 2022-05-03 13:24:07.208 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre 2022-05-03 13:24:07.208 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-05-03 13:24:07.208 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-05-03 13:24:07.212 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_1.xml' 2022-05-03 13:24:07.423 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8170/8270 2022-05-03 13:24:07.424 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8270/jndi/rmi://kb-test-har-005.kb.dk:8170/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-05-03 13:24:07.429 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-05-03 13:24:07.437 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer. 2022-05-03 13:24:07.437 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'BROWSER' 2022-05-03 13:24:07.437 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_browser_1' 2022-05-03 13:24:07.438 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free. 2022-05-03 13:24:07.465 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:07.465 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:07.466 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-05-03 13:24:07.696 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:07.696 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:07.720 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk 2022-05-03 13:24:10.070 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-05-03 13:24:10.071 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@1ce61929 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1 2022-05-03 13:24:10.096 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_1']' 2022-05-03 13:24:10.096 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-05-03 13:24:10.097 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID 2022-05-03 13:24:10.101 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp' 2022-05-03 13:24:10.111 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries. 2022-05-03 13:24:10.166 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist! 2022-05-03 13:24:10.207 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection. 2022-05-03 13:24:10.208 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300 2022-05-03 13:24:10.208 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_1' 2022-05-03 13:24:10.208 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@674c583e as listener to Test6_COMMON_HCHAN_VAL_RESP 2022-05-03 13:24:10.235 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'BROWSER' 2022-05-03 13:24:10.241 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'BROWSER' is valid. 2022-05-03 13:24:10.242 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_BROWSER']' 2022-05-03 13:24:10.242 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@674c583e as listener to Test6_COMMON_JOB_PARTIAL_BROWSER 13:24:05,815 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_browser_2.xml] 13:24:06,273 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 13:24:06,276 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:24:06,282 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:24:06,306 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:06,380 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:24:06,384 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 13:24:06,414 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - No compression will be used 13:24:06,415 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@447981768 - Will use the pattern ./log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log for the active file 13:24:06,418 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_browser_2.%d{yyyy-MM-dd}.%i.log'. 13:24:06,418 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Roll-over at midnight. 13:24:06,421 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - Setting initial period to Tue May 03 13:24:06 CEST 2022 13:24:06,421 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 13:24:06,421 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@43195e57 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 13:24:06,425 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:06,427 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_browser_2.log 13:24:06,427 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_browser_2.log] 13:24:06,428 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 13:24:07,280 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 13:24:07,281 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 13:24:07,284 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 13:24:07,284 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 13:24:07,284 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 13:24:07,285 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 13:24:07,285 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:24:07,286 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@333291e3 - Registering current configuration as safe fallback point 2022-05-03 13:24:07.296 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) 2022-05-03 13:24:07.302 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) Java VM: 1.8.0_312 2022-05-03 13:24:07.303 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_312 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre 2022-05-03 13:24:07.303 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-05-03 13:24:07.303 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-05-03 13:24:07.303 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_browser_2.xml' 2022-05-03 13:24:07.543 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-005.kb.dk' and JMX/RMI ports 8175/8275 2022-05-03 13:24:07.543 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8175 communicating on port 8275 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-005.kb.dk:8275/jndi/rmi://kb-test-har-005.kb.dk:8175/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-05-03 13:24:07.548 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-05-03 13:24:07.558 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:07.558 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:07.558 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-05-03 13:24:07.570 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer. 2022-05-03 13:24:07.570 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'BROWSER' 2022-05-03 13:24:07.571 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_browser_2' 2022-05-03 13:24:07.571 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free. 2022-05-03 13:24:07.702 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:07.702 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:07.711 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-005.kb.dk 2022-05-03 13:24:09.191 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-05-03 13:24:09.192 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@26425897 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2 2022-05-03 13:24:09.236 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_16_HCS_BROWSER_2']' 2022-05-03 13:24:09.237 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-05-03 13:24:09.237 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID 2022-05-03 13:24:09.241 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp' 2022-05-03 13:24:09.254 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries. 2022-05-03 13:24:09.369 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist! 2022-05-03 13:24:09.434 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection. 2022-05-03 13:24:09.435 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300 2022-05-03 13:24:09.435 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_browser_2' 2022-05-03 13:24:09.436 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_HCHAN_VAL_RESP 2022-05-03 13:24:09.463 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'BROWSER' is valid. 2022-05-03 13:24:09.465 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_BROWSER']' 2022-05-03 13:24:09.465 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@7bc10d84 as listener to Test6_COMMON_JOB_PARTIAL_BROWSER 2022-05-03 13:24:09.466 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'BROWSER' -------------------------------------------- STARTING MACHINE: devel@kb-test-har-004.kb.dk Starting all applications on: kb-test-har-004.kb.dk Starting linux application: HarvestControllerApplication_kblow002_h3 Starting linux application: HarvestControllerApplication_kbhigh_h3 13:24:11,682 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kbhigh_h3.xml] 13:24:12,159 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 13:24:12,171 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:24:12,183 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:24:12,205 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:12,259 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:24:12,263 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 13:24:12,296 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - No compression will be used 13:24:12,298 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - Will use the pattern ./log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file 13:24:12,300 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kbhigh_h3.%d{yyyy-MM-dd}.%i.log'. 13:24:12,300 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Roll-over at midnight. 13:24:12,306 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Setting initial period to Tue May 03 13:24:12 CEST 2022 13:24:12,307 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 13:24:12,307 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 13:24:12,308 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:12,313 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kbhigh_h3.log 13:24:12,313 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kbhigh_h3.log] 13:24:12,314 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 13:24:12,859 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 13:24:12,863 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 13:24:12,863 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 13:24:12,864 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 13:24:12,864 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 13:24:12,864 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 13:24:12,864 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:24:12,866 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2473d930 - Registering current configuration as safe fallback point 2022-05-03 13:24:12.877 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) 2022-05-03 13:24:12.895 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) Java VM: 1.8.0_25 2022-05-03 13:24:12.896 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25 java.home: /usr/local/java/jdk1.8.0_25_x64/jre 2022-05-03 13:24:12.896 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre Working dir: /home/devel/Test6 2022-05-03 13:24:12.896 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-05-03 13:24:12.897 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kbhigh_h3.xml' 2022-05-03 13:24:13.102 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8172/8272 2022-05-03 13:24:13.102 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8172 communicating on port 8272 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8272/jndi/rmi://kb-test-har-004.kb.dk:8172/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-05-03 13:24:13.122 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-05-03 13:24:13.145 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:13.149 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:13.153 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-05-03 13:24:13.157 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer. 2022-05-03 13:24:13.157 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY' 2022-05-03 13:24:13.157 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high' 2022-05-03 13:24:13.158 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free. 2022-05-03 13:24:13.365 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:13.390 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:13.395 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk 13:24:11,807 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml] at [file:/home/devel/Test6/conf/logback_HarvestControllerApplication_kblow002_h3.xml] 13:24:12,515 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 13:24:12,526 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:24:12,556 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:24:12,599 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:12,713 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:24:12,726 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 13:24:12,808 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - No compression will be used 13:24:12,813 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1704629915 - Will use the pattern ./log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log for the active file 13:24:12,817 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_kblow002_h3.%d{yyyy-MM-dd}.%i.log'. 13:24:12,817 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Roll-over at midnight. 13:24:12,833 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - Setting initial period to Tue May 03 13:24:12 CEST 2022 13:24:12,834 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 13:24:12,834 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@76908cc0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 13:24:12,839 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:12,854 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_kblow002_h3.log 13:24:12,854 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_kblow002_h3.log] 13:24:12,856 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 13:24:13,788 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 13:24:13,795 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 13:24:13,797 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 13:24:13,799 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 13:24:13,799 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 13:24:13,801 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 13:24:13,801 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:24:13,806 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2473d930 - Registering current configuration as safe fallback point 2022-05-03 13:24:13.823 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) 2022-05-03 13:24:13.848 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) Java VM: 1.8.0_25 2022-05-03 13:24:13.860 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25 java.home: /usr/local/java/jdk1.8.0_25_x64/jre 2022-05-03 13:24:13.863 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java/jdk1.8.0_25_x64/jre Working dir: /home/devel/Test6 2022-05-03 13:24:13.865 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-05-03 13:24:13.867 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_HarvestControllerApplication_kblow002_h3.xml' 2022-05-03 13:24:14.167 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-har-004.kb.dk' and JMX/RMI ports 8170/8270 2022-05-03 13:24:14.168 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-har-004.kb.dk:8270/jndi/rmi://kb-test-har-004.kb.dk:8170/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-05-03 13:24:14.191 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-05-03 13:24:14.227 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:14.227 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:14.228 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-05-03 13:24:14.259 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer. 2022-05-03 13:24:14.263 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'LOWPRIORITY' 2022-05-03 13:24:14.265 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_low' 2022-05-03 13:24:14.269 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free. 2022-05-03 13:24:14.600 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:14.623 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:14.645 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-har-004.kb.dk -------------------------------------------- STARTING MACHINE: devel@kb-test-acs-001.kb.dk Starting all applications on: kb-test-acs-001.kb.dk Starting linux application: IndexServerApplication Starting linux application: ViewerProxyApplication SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 13:24:18,337 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_IndexServerApplication.xml] at [file:/home/devel/Test6/conf/logback_IndexServerApplication.xml] 13:24:18,665 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 13:24:18,671 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:24:18,685 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:24:18,711 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:18,789 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:24:18,794 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 13:24:18,833 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@29183965 - No compression will be used 13:24:18,835 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@29183965 - Will use the pattern ./log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log for the active file 13:24:18,838 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/IndexServerApplication.%d{yyyy-MM-dd}.%i.log'. 13:24:18,838 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - Roll-over at midnight. 13:24:18,842 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - Setting initial period to Tue May 03 13:24:18 CEST 2022 13:24:18,842 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 13:24:18,842 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@55183b20 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 13:24:18,845 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:18,848 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/IndexServerApplication.log 13:24:18,848 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/IndexServerApplication.log] 13:24:18,849 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 13:24:19,514 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 13:24:19,517 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 13:24:19,517 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 13:24:19,518 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 13:24:19,518 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 13:24:19,518 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 13:24:19,518 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:24:19,519 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@4f83df68 - Registering current configuration as safe fallback point SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder] 2022-05-03 13:24:19.526 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.indexserver.IndexServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) 2022-05-03 13:24:19.533 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.indexserver.IndexServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) Java VM: 1.8.0_332 2022-05-03 13:24:19.544 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre 2022-05-03 13:24:19.545 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-05-03 13:24:19.545 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-05-03 13:24:19.545 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_IndexServerApplication.xml' 2022-05-03 13:24:19.748 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8371/8471 2022-05-03 13:24:19.748 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8371 communicating on port 8471 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8471/jndi/rmi://kb-test-acs-001.kb.dk:8371/jmxrmi dk.netarkivet.harvester.indexserver.IndexServer Running 2022-05-03 13:24:19.753 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.indexserver.IndexServer Running 2022-05-03 13:24:19.770 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata' 2022-05-03 13:24:19.789 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:19.790 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:19.791 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:19.791 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-05-03 13:24:19.791 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:19.806 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk 2022-05-03 13:24:21.536 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-05-03 13:24:21.537 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@4fc5e095 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS 2022-05-03 13:24:21.558 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_IS']' 2022-05-03 13:24:21.559 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-05-03 13:24:21.560 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID 2022-05-03 13:24:21.566 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp' 2022-05-03 13:24:21.574 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries. 2022-05-03 13:24:21.623 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found 2022-05-03 13:24:21.625 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found 2022-05-03 13:24:21.661 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled 2022-05-03 13:24:21.661 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxindex' uses directory '/home/devel/Test6/cache/cdxindex' 2022-05-03 13:24:21.664 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'crawllog' uses directory '/home/devel/Test6/cache/crawllog' 2022-05-03 13:24:21.664 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled 2022-05-03 13:24:21.665 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'dedupcrawllogindex' uses directory '/home/devel/Test6/cache/dedupcrawllogindex' 2022-05-03 13:24:21.665 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata' 2022-05-03 13:24:21.666 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled 2022-05-03 13:24:21.667 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'crawllog' uses directory '/home/devel/Test6/cache/crawllog' 2022-05-03 13:24:21.667 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'crawllog' is fetching metadata with urls matching 'metadata://[^/]*/crawl/logs/crawl\.log.*' and mimetype matching 'text/plain'. Migration of duplicate records is disabled 2022-05-03 13:24:21.668 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'fullcrawllogindex' uses directory '/home/devel/Test6/cache/fullcrawllogindex' 2022-05-03 13:24:21.668 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'cdxdata' uses directory '/home/devel/Test6/cache/cdxdata' 2022-05-03 13:24:21.669 INFO d.n.h.indexserver.RawMetadataCache.<init> - Metadata cache for 'cdxdata' is fetching metadata with urls matching 'metadata://[^/]*/crawl/index/cdx.*' and mimetype matching 'application/x-cdx'. Migration of duplicate records is disabled 2022-05-03 13:24:21.669 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/cdxindex/empty-cache.working 2022-05-03 13:24:21.669 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/cdxindex/empty-cache.working' (thread = main) 2022-05-03 13:24:21.672 DEBUG d.n.common.utils.ProcessUtils.runProcess - Running external program: sort /home/devel/Test6/cache/cdxindex/empty-cache -o /home/devel/Test6/cache/cdxindex/empty-cache.unsorted with environment LANG=C 2022-05-03 13:24:21.684 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@18f20260 2022-05-03 13:24:21.684 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/cdxindex/empty-cache' of id '[]', request was for '[]' 2022-05-03 13:24:21.685 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/dedupcrawllogindex/empty-cache.working 2022-05-03 13:24:21.685 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/dedupcrawllogindex/empty-cache.working' (thread = main) 2022-05-03 13:24:21.685 INFO d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate dedupcrawllogindex for the 0 jobs: [] 2022-05-03 13:24:21.685 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main) 2022-05-03 13:24:21.794 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1) 2022-05-03 13:24:21.801 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)! 2022-05-03 13:24:21.802 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1 2022-05-03 13:24:21.803 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1 2022-05-03 13:24:21.808 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes 2022-05-03 13:24:21.809 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@55e7a35c 2022-05-03 13:24:21.809 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/dedupcrawllogindex/empty-cache' of id '[]', request was for '[]' 2022-05-03 13:24:21.809 DEBUG d.n.h.indexserver.FileBasedCache.cache - Waiting to enter synchronization on /home/devel/Test6/cache/fullcrawllogindex/empty-cache.working 2022-05-03 13:24:21.810 DEBUG d.n.h.indexserver.FileBasedCache.cache - locking filechannel for file '/home/devel/Test6/cache/fullcrawllogindex/empty-cache.working' (thread = main) 2022-05-03 13:24:21.810 INFO d.n.h.indexserver.CrawlLogIndexCache.prepareCombine - Starting to generate fullcrawllogindex for the 0 jobs: [] 2022-05-03 13:24:21.810 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Starting combine task #1. This combines a dataset with 0 crawl logs (thread = main) 2022-05-03 13:24:21.812 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding the final 0 subindices to main index. Forcing index to contain max 42 files (related to combine task #1) 2022-05-03 13:24:21.814 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Adding operation completed (combine task #1)! 2022-05-03 13:24:21.815 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Closed index (related to combine task #1 2022-05-03 13:24:21.815 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Gzip-compressing the individual 2 index files of combine task # 1 2022-05-03 13:24:21.816 INFO d.n.h.indexserver.CrawlLogIndexCache.combine - Completed combine task #1 that combined a dataset with 0 crawl logs (entries in combined index: 0) - compressed index has size 72 bytes 2022-05-03 13:24:21.816 DEBUG d.n.h.indexserver.FileBasedCache.cache - release lock on filechannel sun.nio.ch.FileChannelImpl@5922ae77 2022-05-03 13:24:21.817 INFO d.n.h.indexserver.FileBasedCache.getIndex - Generated index '/home/devel/Test6/cache/fullcrawllogindex/empty-cache' of id '[]', request was for '[]' 2022-05-03 13:24:21.846 INFO d.n.c.utils.hadoop.HadoopJobUtils.doKerberosLogin - Kerberos: /home/devel/extra_configs/kerberos_config/krb5.conf, /home/devel/extra_configs/kerberos_config/nat-nas-devel.keytab, nat-nas-devel@KBHPC.KB.DK 2022-05-03 13:24:22.057 WARN o.a.hadoop.util.NativeCodeLoader.<clinit> - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2022-05-03 13:24:22.275 INFO d.n.h.i.d.IndexRequestServer.setHandler - Setting handler for RequestType: CDX 2022-05-03 13:24:22.276 INFO d.n.h.i.d.IndexRequestServer.setHandler - Setting handler for RequestType: DEDUP_CRAWL_LOG 2022-05-03 13:24:22.277 INFO d.n.h.i.d.IndexRequestServer.setHandler - Setting handler for RequestType: FULL_CRAWL_LOG 2022-05-03 13:24:22.277 INFO d.n.h.i.d.IndexRequestServer.restoreRequestsfromRequestDir - requestdir not found: creating request dir 2022-05-03 13:24:22.278 INFO d.n.h.i.d.IndexRequestServer.start - 0 indexing jobs in progress that was stored in requestdir: /home/devel/Test6/requests 2022-05-03 13:24:22.279 INFO d.n.h.i.d.IndexRequestServer.run - Enabling listening to the indexserver channel '[Queue 'Test6_COMMON_INDEX_SERVER']' 2022-05-03 13:24:22.280 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.indexserver.distribute.IndexRequestServer@e5554fc as listener to Test6_COMMON_INDEX_SERVER 13:24:18,178 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_ViewerProxyApplication.xml] at [file:/home/devel/Test6/conf/logback_ViewerProxyApplication.xml] 13:24:18,549 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 13:24:18,550 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:24:18,574 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:24:18,600 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:18,684 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:24:18,693 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 13:24:18,726 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@117009527 - No compression will be used 13:24:18,728 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@117009527 - Will use the pattern ./log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log for the active file 13:24:18,734 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/ViewerProxyApplication.%d{yyyy-MM-dd}.%i.log'. 13:24:18,734 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - Roll-over at midnight. 13:24:18,739 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - Setting initial period to Tue May 03 13:24:18 CEST 2022 13:24:18,740 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 13:24:18,740 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@be64738 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 13:24:18,743 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:18,746 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/ViewerProxyApplication.log 13:24:18,746 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/ViewerProxyApplication.log] 13:24:18,747 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 13:24:19,443 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 13:24:19,454 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 13:24:19,454 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 13:24:19,455 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 13:24:19,455 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 13:24:19,456 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 13:24:19,456 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:24:19,457 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3ba9ad43 - Registering current configuration as safe fallback point 2022-05-03 13:24:19.468 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.viewerproxy.ViewerProxy Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) 2022-05-03 13:24:19.482 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.viewerproxy.ViewerProxy Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) Java VM: 1.8.0_332 2022-05-03 13:24:19.483 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_332 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre 2022-05-03 13:24:19.483 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.332.b09-1.el7_9.x86_64/jre Working dir: /home/devel/Test6 2022-05-03 13:24:19.484 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-05-03 13:24:19.484 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_ViewerProxyApplication.xml' 2022-05-03 13:24:19.656 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'kb-test-acs-001.kb.dk' and JMX/RMI ports 8370/8470 2022-05-03 13:24:19.657 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8370 communicating on port 8470 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://kb-test-acs-001.kb.dk:8470/jndi/rmi://kb-test-acs-001.kb.dk:8370/jmxrmi dk.netarkivet.viewerproxy.ViewerProxy Running 2022-05-03 13:24:19.659 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.viewerproxy.ViewerProxy Running 2022-05-03 13:24:19.669 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:19.670 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/devel/extra_configs/bitmag_config. 2022-05-03 13:24:19.675 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:19.676 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:19.677 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-05-03 13:24:19.677 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): kb-test-acs-001.kb.dk 2022-05-03 13:24:21.378 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-05-03 13:24:21.379 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@b6b1987 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP 2022-05-03 13:24:21.398 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_226_228_5_VP']' 2022-05-03 13:24:21.398 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/devel/extra_configs/bitmag_config 2022-05-03 13:24:21.399 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID 2022-05-03 13:24:21.403 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp' 2022-05-03 13:24:21.419 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries. 2022-05-03 13:24:21.497 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - X509CertificateHolder found 2022-05-03 13:24:21.498 DEBUG d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - PrivateKeyInfo found 2022-05-03 13:24:21.542 INFO d.n.h.indexserver.FileBasedCache.<init> - Metadata cache for 'FULL_CRAWL_LOG' uses directory '/home/devel/Test6/cache/FULL_CRAWL_LOG' 2022-05-03 13:24:21.557 INFO d.n.viewerproxy.ARCArchiveAccess.<init> - Constructed instance of ARCArchiveAccess with TryToLookupUriAsFtp: false 2022-05-03 13:24:21.587 INFO dk.netarkivet.viewerproxy.WebProxy.<init> - Starting viewerproxy jetty on port 8078 -------------------------------------------- STARTING MACHINE: devel@kb-test-way-001.kb.dk Starting all applications on: kb-test-way-001.kb.dk Starting linux application: WaybackIndexerApplication Starting linux application: AggregatorApplication 13:24:25,828 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/devel/Test6/conf/logback_AggregatorApplication.xml] at [file:/home/devel/Test6/conf/logback_AggregatorApplication.xml] 13:24:26,137 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 13:24:26,141 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:24:26,151 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:24:26,184 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:26,353 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:24:26,405 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 13:24:26,557 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@477289012 - No compression will be used 13:24:26,568 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@477289012 - Will use the pattern ./log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log for the active file 13:24:26,588 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/AggregatorApplication.%d{yyyy-MM-dd}.%i.log'. 13:24:26,588 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - Roll-over at midnight. 13:24:26,632 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - Setting initial period to Tue May 03 13:24:26 CEST 2022 13:24:26,636 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 13:24:26,636 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6b0c2d26 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 13:24:26,639 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:26,669 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/AggregatorApplication.log 13:24:26,669 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/AggregatorApplication.log] 13:24:26,677 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 13:24:28,049 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 13:24:28,053 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 13:24:28,053 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 13:24:28,064 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 13:24:28,064 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 13:24:28,064 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 13:24:28,064 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:24:28,065 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3d3fcdb0 - Registering current configuration as safe fallback point 2022-05-03 13:24:28.098 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.wayback.aggregator.AggregationWorker Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) 2022-05-03 13:24:28.136 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.wayback.aggregator.AggregationWorker Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) Java VM: 1.8.0_25 2022-05-03 13:24:28.137 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_25 java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre 2022-05-03 13:24:28.138 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/local/java.old/jdk1.8.0_25_x64/jre Working dir: /home/devel/Test6 2022-05-03 13:24:28.139 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/devel/Test6 2022-05-03 13:24:28.141 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/devel/Test6/conf/settings_AggregatorApplication.xml' SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/devel/Test6/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. -------------------------------------------- -------------------------------------------- STARTING MACHINE: netarkdv@sb-test-har-001.statsbiblioteket.dk Starting all applications on: sb-test-har-001.statsbiblioteket.dk Starting linux application: HarvestControllerApplication_sbhigh_h3 13:24:29,324 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] at [file:/home/netarkdv/Test6/conf/logback_HarvestControllerApplication_sbhigh_h3.xml] 13:24:29,484 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 13:24:29,487 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:24:29,493 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:24:29,504 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:29,547 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:24:29,549 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] 13:24:29,569 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@251210093 - No compression will be used 13:24:29,571 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@251210093 - Will use the pattern ./log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log for the active file 13:24:29,573 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@36c88a32 - The date pattern is 'yyyy-MM-dd' from file name pattern './log/HarvestControllerApplication_sbhigh_h3.%d{yyyy-MM-dd}.%i.log'. 13:24:29,573 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@36c88a32 - Roll-over at midnight. 13:24:29,578 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@36c88a32 - Setting initial period to Tue May 03 13:24:29 CEST 2022 13:24:29,578 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@36c88a32 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead 13:24:29,578 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@36c88a32 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy 13:24:29,582 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:24:29,584 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: ./log/HarvestControllerApplication_sbhigh_h3.log 13:24:29,584 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [./log/HarvestControllerApplication_sbhigh_h3.log] 13:24:29,588 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [dk.netarkivet.monitor.logging.CachingSLF4JAppender] 13:24:29,868 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [MONITOR] 13:24:29,870 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN 13:24:29,870 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 13:24:29,875 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT] 13:24:29,875 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [MONITOR] to Logger[ROOT] 13:24:29,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [dk.netarkivet] to DEBUG 13:24:29,875 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:24:29,876 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@7880cdf3 - Registering current configuration as safe fallback point 2022-05-03 13:24:29.879 DEBUG dk.netarkivet.common.utils.Settings.invoke0 - Value found in loaded data: SB,KB SLF4J: A number (1) of logging calls during the initialization phase have been intercepted and are SLF4J: now being replayed. These are subject to the filtering rules of the underlying logging system. SLF4J: See also http://www.slf4j.org/codes.html#replay Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) 2022-05-03 13:24:29.886 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Starting dk.netarkivet.harvester.heritrix3.HarvestControllerServer Version: 7.4-SNAPSHOT (https://github.com/netarchivesuite/netarchivesuite/commit/2d37bccb714e8981ceb811b94d904fb3d64234ce) Java VM: 1.8.0_232 2022-05-03 13:24:29.887 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Java VM: 1.8.0_232 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre 2022-05-03 13:24:29.887 INFO d.n.common.utils.ApplicationUtils.logAndPrint - java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-0.el7_7.x86_64/jre Working dir: /home/netarkdv/Test6 2022-05-03 13:24:29.887 INFO d.n.common.utils.ApplicationUtils.logAndPrint - Working dir: /home/netarkdv/Test6 2022-05-03 13:24:29.887 INFO d.n.common.utils.ApplicationUtils.startApp - Using settings files '/home/netarkdv/Test6/conf/settings_HarvestControllerApplication_sbhigh_h3.xml' 2022-05-03 13:24:30.063 INFO d.n.m.d.JMSMonitorRegistryClient.register - Registering this client for monitoring every 1 minutes, using hostname 'sb-test-har-001.statsbiblioteket.dk' and JMX/RMI ports 8170/8270 2022-05-03 13:24:30.064 INFO d.n.c.m.MBeanConnectorCreator.exposeJMXMBeanServer - Registered mbean server in registry on port 8170 communicating on port 8270 using password file 'conf/jmxremote.password'. Service URL is service:jmx:rmi://sb-test-har-001.statsbiblioteket.dk:8270/jndi/rmi://sb-test-har-001.statsbiblioteket.dk:8170/jmxrmi dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-05-03 13:24:30.072 INFO d.n.common.utils.ApplicationUtils.logAndPrint - dk.netarkivet.harvester.heritrix3.HarvestControllerServer Running 2022-05-03 13:24:30.079 INFO d.n.c.distribute.JMSConnectionSunMQ.<init> - Creating instance of dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:30.080 DEBUG d.n.common.distribute.JMSConnection.initConnection - Initializing a JMS connection dk.netarkivet.common.distribute.JMSConnectionSunMQ 2022-05-03 13:24:30.086 INFO d.n.c.distribute.JMSConnectionSunMQ.getConnectionFactory - Establishing SunMQ JMS Connection to 'kb-test-adm-001.kb.dk:7676' 2022-05-03 13:24:30.093 INFO d.n.h.h.HarvestControllerServer.<init> - Starting HarvestControllerServer. 2022-05-03 13:24:30.099 INFO d.n.h.h.HarvestControllerServer.<init> - Bound to harvest channel 'HIGHPRIORITY' 2022-05-03 13:24:30.105 INFO d.n.h.h.HarvestControllerServer.<init> - Serverdir: 'harvester_high' 2022-05-03 13:24:30.105 INFO d.n.h.h.HarvestControllerServer.<init> - Harvesting requires at least 400000000 bytes free. 2022-05-03 13:24:30.274 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Bitrepository settings will be loaded from /home/netarkdv/extra_configs/bitmag_config. 2022-05-03 13:24:30.275 DEBUG d.n.c.d.bitrepository.BitmagUtils.initialize - Path to Bitrepository settings is /home/netarkdv/extra_configs/bitmag_config. 2022-05-03 13:24:30.279 INFO d.n.c.d.bitrepository.HostNameUtils.getHostName - Local hostname (provided by getCanonicalHostName): sb-test-har-001.statsbiblioteket.dk 2022-05-03 13:24:31.420 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient will timeout on each get request after 300000 milliseconds. 2022-05-03 13:24:31.422 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.archive.arcrepository.distribute.BitmagArcRepositoryClient@4504d271 as listener to Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3 2022-05-03 13:24:31.462 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - BitmagArcRepositoryClient listens for replies on channel '[Queue 'Test6_COMMON_THIS_REPOS_CLIENT_130_225_27_140_HCS_SBHIGH_H3']' 2022-05-03 13:24:31.462 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Getting bitmag config from settings.common.arcrepositoryClient.bitrepository.settingsDir=/home/netarkdv/extra_configs/bitmag_config 2022-05-03 13:24:31.463 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Using 'Test6' as default collectionID 2022-05-03 13:24:31.493 INFO d.n.a.a.d.BitmagArcRepositoryClient.<init> - Storing tempfiles in folder 'arcrepositoryTemp' 2022-05-03 13:24:31.503 INFO d.n.common.utils.HttpsClientBuilder.<init> - Creating Aggressive retry handler for https queries. 2022-05-03 13:24:31.533 INFO d.n.c.utils.BasicTwoWaySSLProvider.loadPrivateKey - Key file '/home/devel/extra_configs/https_config/https_key.pem' with private key and certificate does not exist! 2022-05-03 13:24:31.552 DEBUG d.n.h.h.HarvestControllerServer.<init> - Obtained JMS connection. 2022-05-03 13:24:31.553 INFO d.n.h.h.HarvestControllerServer.<init> - SEND_READY_DELAY used by HarvestControllerServer is 300 2022-05-03 13:24:31.553 INFO d.n.h.heritrix3.PostProcessing.processOldJobs - Looking for unprocessed crawldata in 'harvester_high' 2022-05-03 13:24:31.554 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@31e75d13 as listener to Test6_COMMON_HCHAN_VAL_RESP 2022-05-03 13:24:31.647 INFO d.n.h.h.HarvestControllerServer.<init> - Requested to check the validity of harvest channel 'HIGHPRIORITY' 2022-05-03 13:24:31.834 INFO d.n.h.h.HarvestControllerServer.visit - Received message stating that channel 'HIGHPRIORITY' is valid. 2022-05-03 13:24:31.838 INFO d.n.h.h.HarvestControllerServer.beginListeningIfSpaceAvailable - Starts to listen to new jobs on queue '[Queue 'Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY']' 2022-05-03 13:24:31.838 DEBUG d.n.common.distribute.JMSConnection.setListener - Adding dk.netarkivet.harvester.heritrix3.HarvestControllerServer@31e75d13 as listener to Test6_COMMON_JOB_PARTIAL_HIGHPRIORITY -------------------------------------------- Completed the script all_test.sh Finished: SUCCESS