NetarchiveSuite-Github

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Work on NAS-2683 - now works with seeds coming from a form

Max number of running h3 instances. So 80 or so now?

Max number of running h3 instances. So 80 or so now?

Is it possible to define the configuration and executions tags in pluginManagement so they don't need to be repeated in each module?

Is it possible to define the configuration and executions tags in pluginManagement so they don't need to be repeated in each module?

Not an easy one to review, but should be easy to test. If it builds and harvests then you haven't removed anything vital.

Not an easy one to review, but should be easy to test. If it builds and harvests then you haven't removed anything vital.

Since these are useful tools they should be documented with example usage in https://sbforge.org/display/NASDOC/Tools+in+the+Common+Module .

Since these are useful tools they should be documented with example usage in https://sbforge.org/display/NASDOC/Tools+in+the+Common+Module .

NAS-2685 Simultaneous processing of HD
NAS-2685 Simultaneous processing of HD
This may not fix the bug, but should make diagnosis easier.

This may not fix the bug, but should make diagnosis easier.

More logging.

Added a lot of logging and renamed one method to make its functionality clearer.

Added a sanity test that harvest ids returned are unique.

Fixed bug in crawllog caching. Work on optimizing frontier queue viewery. Removed useless auto refresh from most pages.

The class ./harvester/harvester-core/src/main/java/dk/netarkivet/harvester/harvesting/report/Heritrix1Constants.java should also be removed

The class ./harvester/harvester-core/src/main/java/dk/netarkivet/harvester/harvesting/report/Heritrix1Constants.java
should also be removed

NAS-2673 - more work

Changes have been merged in with NAS-2638 branch. Frontier groovy function was 0 paged while the GUI was 1 paged. Besides the performance issues the solution works.

Changes have been merged in with NAS-2638 branch.

Frontier groovy function was 0 paged while the GUI was 1 paged.

Besides the performance issues the solution works.

Det pattern, jeg har rettet, drejer sig kun om for metadata filer. Det andet pattern er uændret. Hvorfor skulle 2-1... iøvrigt være et ugyldigt filenavn?

Det pattern, jeg har rettet, drejer sig kun om for metadata filer.
Det andet pattern er uændret.
Hvorfor skulle 2-1... iøvrigt være et ugyldigt filenavn?

Er det her et gyldigt fil navn? Jeg går ud fra det fejler med det nye pattern.

Er det her et gyldigt fil navn?
Jeg går ud fra det fejler med det nye pattern.

Det er mere om det er ikke burde være en option til deploy at den tjekker alle definerede ftp serveren in deploy.xml og sender et test email også under deploy.

Det er mere om det er ikke burde være en option til deploy at den tjekker alle definerede ftp serveren in deploy.xml og sender et test email også under deploy.

Modified test to assume domains file is already present locally.

Modified test to assume domains file is already present locally.

NAS-2672: Add tool for verifying if ftp server setup is NetarchiveSuite compliant
NAS-2672: Add tool for verifying if ftp server setup is NetarchiveSuite compliant