Console Output
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building NetarchiveSuite - heritrix1 extensions 5.3-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ heritrix1-extensions ---
[INFO] Deleting /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/target
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix1-extensions ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ heritrix1-extensions ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 10 source files to /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/target/classes
[WARNING] /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/src/main/java/dk/netarkivet/harvester/tools/TwitterDecidingScope.java: Some input files use unchecked or unsafe operations.
[WARNING] /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/src/main/java/dk/netarkivet/harvester/tools/TwitterDecidingScope.java: Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix1-extensions ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ heritrix1-extensions ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 7 source files to /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/target/test-classes
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ heritrix1-extensions ---
[INFO] Surefire report directory: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/target/surefire-reports
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running dk.netarkivet.harvester.harvesting.WARCWriterProcessorTester
Feb 04, 2017 12:06:30 AM dk.netarkivet.harvester.harvesting.WARCWriterProcessor getFirstrecordBody
SEVERE: Error missing metadata
Feb 04, 2017 12:06:30 AM dk.netarkivet.harvester.harvesting.WARCWriterProcessor getFirstrecordBody
SEVERE: Error missing metadata
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.623 sec - in dk.netarkivet.harvester.harvesting.WARCWriterProcessorTester
Running dk.netarkivet.harvester.harvesting.extractor.ExtractorOAITest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.047 sec - in dk.netarkivet.harvester.harvesting.extractor.ExtractorOAITest
Running dk.netarkivet.harvester.harvesting.DomainnameQueueAssignmentPolicyTester
00:06:30.329 [main] DEBUG d.n.h.h.DomainnameQueueAssignmentPolicy - Heritrix broke getting class key candidate for
00:06:30.333 [main] INFO dk.netarkivet.common.utils.TLD - Did not found external public suffix list at '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/conf/public_suffix_list.dat'! Reading instead the public suffixes list from embedded file 'dk/netarkivet/common/utils/public_suffix_list.dat' in common-core.jar-VERSION.jar.
00:06:30.370 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.bd', ignoring
00:06:30.378 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.bn', ignoring
00:06:30.382 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.nom.br', ignoring
00:06:30.383 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ck', ignoring
00:06:30.384 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!www.ck', ignoring
00:06:30.386 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.er', ignoring
00:06:30.387 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.fj', ignoring
00:06:30.387 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.fk', ignoring
00:06:30.389 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.gu', ignoring
00:06:30.398 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.jm', ignoring
00:06:30.399 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kawasaki.jp', ignoring
00:06:30.400 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kitakyushu.jp', ignoring
00:06:30.400 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kobe.jp', ignoring
00:06:30.400 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.nagoya.jp', ignoring
00:06:30.400 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sapporo.jp', ignoring
00:06:30.401 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sendai.jp', ignoring
00:06:30.401 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.yokohama.jp', ignoring
00:06:30.402 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kawasaki.jp', ignoring
00:06:30.402 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kitakyushu.jp', ignoring
00:06:30.402 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kobe.jp', ignoring
00:06:30.402 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.nagoya.jp', ignoring
00:06:30.402 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.sapporo.jp', ignoring
00:06:30.402 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.sendai.jp', ignoring
00:06:30.403 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.yokohama.jp', ignoring
00:06:30.544 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ke', ignoring
00:06:30.545 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kh', ignoring
00:06:30.545 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kw', ignoring
00:06:30.546 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.mm', ignoring
00:06:30.561 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.mz', ignoring
00:06:30.564 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!teledata.mz', ignoring
00:06:30.577 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.np', ignoring
00:06:30.578 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.pg', ignoring
00:06:30.587 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sch.uk', ignoring
00:06:30.591 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ye', ignoring
00:06:30.591 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.zw', ignoring
00:06:30.604 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.compute.estate', ignoring
00:06:30.604 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.alces.network', ignoring
00:06:30.606 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.platform.sh', ignoring
00:06:30.606 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.cryptonomic.net', ignoring
00:06:30.610 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.api.githubcloud.com', ignoring
00:06:30.610 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ext.githubcloud.com', ignoring
00:06:30.610 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.githubcloudusercontent.com', ignoring
00:06:30.611 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.0emm.com', ignoring
00:06:30.612 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.magentosite.cloud', ignoring
The list of loaded data settings is empty. Is this OK?00:06:30.641 [main] DEBUG dk.netarkivet.common.utils.TLD - No tlds found in settingsfiles
00:06:30.642 [main] INFO dk.netarkivet.common.utils.TLD - Did not found external public suffix list at '/home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/conf/public_suffix_list.dat'! Reading instead the public suffixes list from embedded file 'dk/netarkivet/common/utils/public_suffix_list.dat' in common-core.jar-VERSION.jar.
00:06:30.647 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.bd', ignoring
00:06:30.647 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.bn', ignoring
00:06:30.648 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.nom.br', ignoring
00:06:30.649 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ck', ignoring
00:06:30.649 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!www.ck', ignoring
00:06:30.652 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.er', ignoring
00:06:30.653 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.fj', ignoring
00:06:30.653 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.fk', ignoring
00:06:30.653 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.gu', ignoring
00:06:30.658 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.jm', ignoring
00:06:30.659 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kawasaki.jp', ignoring
00:06:30.660 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kitakyushu.jp', ignoring
00:06:30.660 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kobe.jp', ignoring
00:06:30.660 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.nagoya.jp', ignoring
00:06:30.660 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sapporo.jp', ignoring
00:06:30.660 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sendai.jp', ignoring
00:06:30.662 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.yokohama.jp', ignoring
00:06:30.662 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kawasaki.jp', ignoring
00:06:30.662 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kitakyushu.jp', ignoring
00:06:30.662 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.kobe.jp', ignoring
00:06:30.662 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.nagoya.jp', ignoring
00:06:30.663 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.sapporo.jp', ignoring
00:06:30.663 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.sendai.jp', ignoring
00:06:30.663 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!city.yokohama.jp', ignoring
00:06:30.683 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ke', ignoring
00:06:30.683 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kh', ignoring
00:06:30.684 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.kw', ignoring
00:06:30.685 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.mm', ignoring
00:06:30.692 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.mz', ignoring
00:06:30.693 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '!teledata.mz', ignoring
00:06:30.760 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.np', ignoring
00:06:30.761 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.pg', ignoring
00:06:30.767 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.sch.uk', ignoring
00:06:30.770 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ye', ignoring
00:06:30.770 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.zw', ignoring
00:06:30.781 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.compute.estate', ignoring
00:06:30.781 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.alces.network', ignoring
00:06:30.782 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.platform.sh', ignoring
00:06:30.783 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.cryptonomic.net', ignoring
00:06:30.786 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.api.githubcloud.com', ignoring
00:06:30.786 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.ext.githubcloud.com', ignoring
00:06:30.786 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.githubcloudusercontent.com', ignoring
00:06:30.786 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.0emm.com', ignoring
00:06:30.788 [main] WARN dk.netarkivet.common.utils.TLD - Invalid tld '*.magentosite.cloud', ignoring
The list of loaded data settings is empty. Is this OK?00:06:30.790 [main] DEBUG dk.netarkivet.common.utils.TLD - No tlds found in settingsfiles
00:06:30.926 [main] DEBUG d.n.h.h.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'default...' for ''
00:06:30.927 [main] DEBUG d.n.h.h.DomainnameQueueAssignmentPolicy - Heritrix broke getting class key candidate for
00:06:30.927 [main] DEBUG d.n.h.h.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'default...' for ''
00:06:30.928 [main] DEBUG d.n.h.h.DomainnameQueueAssignmentPolicy - Heritrix broke getting class key candidate for null
00:06:30.928 [main] DEBUG d.n.h.h.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'default...' for 'null'
00:06:30.929 [main] DEBUG d.n.h.h.DomainnameQueueAssignmentPolicy - Heritrix broke getting class key candidate for
00:06:30.930 [main] DEBUG d.n.h.h.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'default...' for ''
00:06:30.936 [main] DEBUG d.n.h.h.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'x.fnord.barbar' for 'http://x.fnord.barbar/'
00:06:30.938 [main] DEBUG d.n.h.h.DomainnameQueueAssignmentPolicy - Illegal class key candidate 'default...' for 'about:blank'
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.623 sec - in dk.netarkivet.harvester.harvesting.DomainnameQueueAssignmentPolicyTester
Running dk.netarkivet.harvester.harvesting.PersistentJobDataTester
harvestInfo.xml
harvestInfo-0.4.xml
00:06:31.202 [main] DEBUG d.n.h.datamodel.H1HeritrixTemplate - WARC format selected to be used by Heritrix
00:06:31.231 [main] WARN d.n.h.datamodel.H1HeritrixTemplate - No attribute insertion is done for H1 templates
00:06:31.232 [main] DEBUG d.n.h.datamodel.H1HeritrixTemplate - In H1 templates we don't enable/disable deduplication.
00:06:31.242 [main] WARN d.netarkivet.harvester.datamodel.Job - HarvestnamePrefix not yet set for job 1. Set it by using the naming scheme. This should only happen for old jobs being read
00:06:31.246 [main] DEBUG d.netarkivet.harvester.datamodel.Job - Applying the default ArchiveFileNaming class 'dk.netarkivet.harvester.harvesting.LegacyNamingConvention'.
00:06:31.246 [main] DEBUG d.netarkivet.harvester.datamodel.Job - The harvestPrefix of this job is: 1-1
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.311 sec - in dk.netarkivet.harvester.harvesting.PersistentJobDataTester
Running dk.netarkivet.harvester.harvesting.OnNSDomainsDecideRuleTester
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec - in dk.netarkivet.harvester.harvesting.OnNSDomainsDecideRuleTester
Results :
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0
[JENKINS] Recording test results
[INFO]
[INFO] --- maven-jgit-buildnumber-plugin:1.2.9:extract-buildnumber (git-buildnumber) @ heritrix1-extensions ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix1-extensions ---
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/target/heritrix1-extensions-5.3-SNAPSHOT.jar
[INFO]
[INFO] >>> maven-source-plugin:2.2.1:jar (attach-sources) @ heritrix1-extensions >>>
[WARNING] Failed to getClass for org.apache.maven.plugin.source.SourceJarMojo
[INFO]
[INFO] <<< maven-source-plugin:2.2.1:jar (attach-sources) @ heritrix1-extensions <<<
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar (attach-sources) @ heritrix1-extensions ---
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/target/heritrix1-extensions-5.3-SNAPSHOT-sources.jar
[INFO]
[INFO] --- maven-javadoc-plugin:2.10.3:jar (attach-javadocs) @ heritrix1-extensions ---
[INFO] Building jar: /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/target/heritrix1-extensions-5.3-SNAPSHOT-javadoc.jar
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ heritrix1-extensions ---
[INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/target/heritrix1-extensions-5.3-SNAPSHOT.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/heritrix1-extensions/5.3-SNAPSHOT/heritrix1-extensions-5.3-SNAPSHOT.jar
[INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/pom.xml to /home/cibuild02/.m2/repository/org/netarchivesuite/heritrix1-extensions/5.3-SNAPSHOT/heritrix1-extensions-5.3-SNAPSHOT.pom
[INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/target/heritrix1-extensions-5.3-SNAPSHOT-sources.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/heritrix1-extensions/5.3-SNAPSHOT/heritrix1-extensions-5.3-SNAPSHOT-sources.jar
[INFO] Installing /home/cibuild02/workspace/NetarchiveSuite-sonar/harvester/heritrix1/heritrix1-extensions/target/heritrix1-extensions-5.3-SNAPSHOT-javadoc.jar to /home/cibuild02/.m2/repository/org/netarchivesuite/heritrix1-extensions/5.3-SNAPSHOT/heritrix1-extensions-5.3-SNAPSHOT-javadoc.jar
[JENKINS] Archiving disabled
Help us localize this page