All Activity

SNAPSHOT: Ingester - 1) hasParts-bug, 2) Be much more robust using Either+IdValue.

DPA-123: HasPart relations not created if any error happened earlier in ingest.

ABR found (default) IP-number of host as seen from docker instance.

Work on NAS-2683 - now works with seeds coming from a form

Max number of running h3 instances. So 80 or so now?

Max number of running h3 instances. So 80 or so now?

Is it possible to define the configuration and executions tags in pluginManagement so they don't need to be repeated in each module?

Is it possible to define the configuration and executions tags in pluginManagement so they don't need to be repeated in each module?

Not an easy one to review, but should be easy to test. If it builds and harvests then you haven't removed anything vital.

Not an easy one to review, but should be easy to test. If it builds and harvests then you haven't removed anything vital.

Since these are useful tools they should be documented with example usage in https://sbforge.org/display/NASDOC/Tools+in+the+Common+Module .

Since these are useful tools they should be documented with example usage in https://sbforge.org/display/NASDOC/Tools+in+the+Common+Module .

NAS-2685 Simultaneous processing of HD
NAS-2685 Simultaneous processing of HD
This may not fix the bug, but should make diagnosis easier.

This may not fix the bug, but should make diagnosis easier.

More logging.

Added a lot of logging and renamed one method to make its functionality clearer.

Added a sanity test that harvest ids returned are unique.

PDFAValidator must be closed after being used.

DPA-124: Create VeraPDF validate web service in docker.

Merge branch 'DPA-122' (which needed a _lot_ of work before it was ready)

DPA-122 was about VeraPDF not being robust. This boiled down to

recognizing the worth of first Either to hold one of two possible

situations, and then the need to create IdValue (with DomsValue) to

be able to emulate returning tuples from functions. Also

some initial docker-compose work (with ABR) is included. Initial

Java 9 support (Vaadin missing).

Made ValidateXMLMain and VeraPDFInvokeMain more robust against errors.

Fixed bug in crawllog caching. Work on optimizing frontier queue viewery. Removed useless auto refresh from most pages.

The class ./harvester/harvester-core/src/main/java/dk/netarkivet/harvester/harvesting/report/Heritrix1Constants.java should also be removed

The class ./harvester/harvester-core/src/main/java/dk/netarkivet/harvester/harvesting/report/Heritrix1Constants.java
should also be removed

Made a /usr/bin/zip which satisfies the only usage in package.sh.

Dockerized Fedora answers with default basic objects.

We now have Fedora answering to web interface. Next step will be

to ingest base objects the first time DOMS starts. Next next step will be to

set SBOI up correctly. Two things may have to be fixed:

1) package.sh needs zip which is not in the image.

2) log4j configuration files send error messages to example.com - should be disabled instead.

Initial DOMS dockerization (TRA+ABR). Postgres image most likely finished.

    • -0
    • +24
    /bitrepository/Dockerfile
    • -0
    • +51
    /docker-settings.xml
    • -0
    • +60
    /doms-postgres/10-create-databases.sql
    • -0
    • +22
    /doms-postgres/20-populate-xmltapes.sh
    • -0
    • +8
    /doms-postgres/Dockerfile
    • -0
    • +51
    /doms/docker-settings.xml
    • -0
    • +290
    /doms/doms-installer-contents.txt
    • -0
    • +758
    /doms/package-result.txt