[INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Netarchivesuite - Heritrix3 Extensions 5.3-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix3-extensions --- [INFO] Deleting /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix3-extensions --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix3-extensions --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 14 source files to /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/target/classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/src/main/java/org/archive/crawler/framework/ToeThread.java: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/src/main/java/org/archive/crawler/framework/ToeThread.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/src/main/java/org/archive/crawler/framework/ToeThread.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix3-extensions --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix3-extensions --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 8 source files to /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/target/test-classes [WARNING] /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/src/test/java/dk/netarkivet/harvester/harvesting/extractor/ExtractorOAITest.java: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/src/test/java/dk/netarkivet/harvester/harvesting/extractor/ExtractorOAITest.java uses or overrides a deprecated API. [WARNING] /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/src/test/java/dk/netarkivet/harvester/harvesting/extractor/ExtractorOAITest.java: Recompile with -Xlint:deprecation for details. [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ heritrix3-extensions --- [INFO] Surefire report directory: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/target/surefire-reports ------------------------------------------------------- T E S T S ------------------------------------------------------- Running is.hi.bok.deduplicator.DeDuplicatorTester Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.101 sec - in is.hi.bok.deduplicator.DeDuplicatorTester Running dk.netarkivet.harvester.harvesting.DomainnameQueueAssignmentPolicyTester SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/cibuild02/.m2/repository/ch/qos/logback/logback-classic/1.0.13/logback-classic-1.0.13.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/cibuild02/.m2/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder] 00:12:00.589 [main] INFO dk.netarkivet.common.utils.TLD - Did not found external public suffix list at '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/conf/public_suffix_list.dat'! Reading instead the public suffixes list from embedded file 'dk/netarkivet/common/utils/public_suffix_list.dat' in common-core.jar-VERSION.jar. 00:12:00.651 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.bd', ignoring 00:12:00.656 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.bn', ignoring 00:12:00.659 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.nom.br', ignoring 00:12:00.661 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ck', ignoring 00:12:00.661 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!www.ck', ignoring 00:12:00.714 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.er', ignoring 00:12:00.714 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.fj', ignoring 00:12:00.715 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.fk', ignoring 00:12:00.725 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.gu', ignoring 00:12:00.823 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.jm', ignoring 00:12:00.838 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kawasaki.jp', ignoring 00:12:00.838 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kitakyushu.jp', ignoring 00:12:00.838 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kobe.jp', ignoring 00:12:00.838 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.nagoya.jp', ignoring 00:12:00.839 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sapporo.jp', ignoring 00:12:00.839 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sendai.jp', ignoring 00:12:00.839 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.yokohama.jp', ignoring 00:12:00.839 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kawasaki.jp', ignoring 00:12:00.840 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kitakyushu.jp', ignoring 00:12:00.840 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kobe.jp', ignoring 00:12:00.840 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.nagoya.jp', ignoring 00:12:00.841 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.sapporo.jp', ignoring 00:12:00.841 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.sendai.jp', ignoring 00:12:00.841 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.yokohama.jp', ignoring 00:12:00.969 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ke', ignoring 00:12:00.969 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kh', ignoring 00:12:00.970 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kw', ignoring 00:12:00.970 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.mm', ignoring 00:12:00.974 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.mz', ignoring 00:12:00.975 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!teledata.mz', ignoring 00:12:00.986 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.np', ignoring 00:12:00.987 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.pg', ignoring 00:12:01.071 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sch.uk', ignoring 00:12:01.107 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ye', ignoring 00:12:01.107 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.zw', ignoring 00:12:01.113 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.compute.estate', ignoring 00:12:01.115 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.alces.network', ignoring 00:12:01.115 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.platform.sh', ignoring 00:12:01.115 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.cryptonomic.net', ignoring 00:12:01.117 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.api.githubcloud.com', ignoring 00:12:01.118 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ext.githubcloud.com', ignoring 00:12:01.118 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.githubcloudusercontent.com', ignoring 00:12:01.118 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.0emm.com', ignoring 00:12:01.119 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.magentosite.cloud', ignoring The list of loaded data settings is empty. Is this OK?00:12:01.411 [main] DEBUG dk.netarkivet.common.utils.TLD - No tlds found in settingsfiles 00:12:01.412 [main] INFO dk.netarkivet.common.utils.TLD - Did not found external public suffix list at '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/conf/public_suffix_list.dat'! Reading instead the public suffixes list from embedded file 'dk/netarkivet/common/utils/public_suffix_list.dat' in common-core.jar-VERSION.jar. 00:12:01.413 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.bd', ignoring 00:12:01.414 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.bn', ignoring 00:12:01.415 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.nom.br', ignoring 00:12:01.416 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ck', ignoring 00:12:01.416 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!www.ck', ignoring 00:12:01.417 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.er', ignoring 00:12:01.417 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.fj', ignoring 00:12:01.417 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.fk', ignoring 00:12:01.419 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.gu', ignoring 00:12:01.421 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.jm', ignoring 00:12:01.422 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kawasaki.jp', ignoring 00:12:01.422 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kitakyushu.jp', ignoring 00:12:01.422 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kobe.jp', ignoring 00:12:01.422 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.nagoya.jp', ignoring 00:12:01.423 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sapporo.jp', ignoring 00:12:01.423 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sendai.jp', ignoring 00:12:01.423 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.yokohama.jp', ignoring 00:12:01.424 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kawasaki.jp', ignoring 00:12:01.425 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kitakyushu.jp', ignoring 00:12:01.425 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kobe.jp', ignoring 00:12:01.425 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.nagoya.jp', ignoring 00:12:01.426 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.sapporo.jp', ignoring 00:12:01.426 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.sendai.jp', ignoring 00:12:01.426 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.yokohama.jp', ignoring 00:12:01.432 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ke', ignoring 00:12:01.432 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kh', ignoring 00:12:01.433 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kw', ignoring 00:12:01.434 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.mm', ignoring 00:12:01.437 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.mz', ignoring 00:12:01.437 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!teledata.mz', ignoring 00:12:01.440 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.np', ignoring 00:12:01.441 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.pg', ignoring 00:12:01.445 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sch.uk', ignoring 00:12:01.447 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ye', ignoring 00:12:01.447 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.zw', ignoring 00:12:01.456 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.compute.estate', ignoring 00:12:01.457 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.alces.network', ignoring 00:12:01.458 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.platform.sh', ignoring 00:12:01.459 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.cryptonomic.net', ignoring 00:12:01.461 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.api.githubcloud.com', ignoring 00:12:01.461 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ext.githubcloud.com', ignoring 00:12:01.463 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.githubcloudusercontent.com', ignoring 00:12:01.463 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.0emm.com', ignoring 00:12:01.464 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.magentosite.cloud', ignoring The list of loaded data settings is empty. Is this OK?00:12:01.466 [main] DEBUG dk.netarkivet.common.utils.TLD - No tlds found in settingsfiles 00:12:01.584 [main] DEBUG d.n.h.h.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'x.fnord.barbar' for 'http://x.fnord.barbar/' 00:12:01.584 [main] WARN d.n.h.h.DomainnameQueueAssignmentPolicy - The url is a dns-url 'dns:bar.foo.dk'. Returning: default... 00:12:01.585 [main] WARN d.n.h.h.DomainnameQueueAssignmentPolicy - The url is not a dns-url 'about:blank'. Returning: default... Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.381 sec - in dk.netarkivet.harvester.harvesting.DomainnameQueueAssignmentPolicyTester Running dk.netarkivet.harvester.harvesting.NASFetchDNSTester Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.088 sec - in dk.netarkivet.harvester.harvesting.NASFetchDNSTester Running dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRuleTester Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Feb 20, 2017 12:12:01 AM dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRule addedSeedImpl WARNING: originalUri not available Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.252 sec - in dk.netarkivet.harvester.harvesting.NASSurtPrefixedDecideRuleTester Running dk.netarkivet.harvester.harvesting.OnNSDomainsDecideRuleTester Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in dk.netarkivet.harvester.harvesting.OnNSDomainsDecideRuleTester Results : Tests run: 16, Failures: 0, Errors: 0, Skipped: 0 [JENKINS] Recording test results [INFO] [INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix3-extensions --- [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix3-extensions --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/target/heritrix3-extensions-5.3-SNAPSHOT.jar [INFO] [INFO] >>> maven-source-plugin:2.2.1:jar (attach-sources) @ heritrix3-extensions >>> [WARNING] Failed to getClass for org.apache.maven.plugin.source.SourceJarMojo [INFO] [INFO] <<< maven-source-plugin:2.2.1:jar (attach-sources) @ heritrix3-extensions <<< [INFO] [INFO] --- maven-source-plugin:2.2.1:jar (attach-sources) @ heritrix3-extensions --- [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/target/heritrix3-extensions-5.3-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-javadoc-plugin:2.10.3:jar (attach-javadocs) @ heritrix3-extensions --- [INFO] 1 warning [WARNING] Javadoc Warnings [WARNING] /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/src/main/java/dk/netarkivet/harvester/harvesting/extractor/IcelandicExtractorJS.java:66: warning - @contributor is an unknown tag. [INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/target/heritrix3-extensions-5.3-SNAPSHOT-javadoc.jar [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ heritrix3-extensions --- [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/target/heritrix3-extensions-5.3-SNAPSHOT.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/heritrix3-extensions/5.3-SNAPSHOT/heritrix3-extensions-5.3-SNAPSHOT.jar [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/pom.xml to /home/cibuild02/.m2/repository/org/netarchivesuite/heritrix3-extensions/5.3-SNAPSHOT/heritrix3-extensions-5.3-SNAPSHOT.pom [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/target/heritrix3-extensions-5.3-SNAPSHOT-sources.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/heritrix3-extensions/5.3-SNAPSHOT/heritrix3-extensions-5.3-SNAPSHOT-sources.jar [INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix3/heritrix3-extensions/target/heritrix3-extensions-5.3-SNAPSHOT-javadoc.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/heritrix3-extensions/5.3-SNAPSHOT/heritrix3-extensions-5.3-SNAPSHOT-javadoc.jar [JENKINS] Archiving disabled