Release Test Information
- Previous 5.3.1 Release Test
- The Netarkivet devel system is now documented at https://sbprojects.statsbiblioteket.dk/pages/viewpage.action?pageId=37597440 (DK developers only)
- Release test status: Started
- NetarchiveSuite 5.4 Release Notes: NetarchiveSuite 5.4.x Release Notes
- Prepare Release Test Process
Run the tests (with proper definitions of TESTX, PORT and MAILRECEIVERS) as follows:
Version Commit Reason for Rejection 5.4-RC1 https://github.com/netarchivesuite/netarchivesuite/commit/54d12da51c8cf3d1f544d6936f1a004f252eac02
Run right after code freeze to verify the system integrity prior to the main release test.
Run through the Quick Start Manual
|TEST0 - with vagrant|
Run through the Quickstart with Vagrant
|TEST0 - with postgresql||Run through the quickstart where we test the procedure for using NAS with postgresql (see page Choose an Installation Scenario )||OK||SVC|
createscripts and documentation has been updated
A quickstart deploy for postgresql has been added
|Complete with errors.||CSR|
Danish ADM GUI Access, indexing and caching
|OK||SVC||Made some changes to the test during the test. E.g. the multi-domain harvest only generates 4 jobs, not 5. Previously we used kb-test-bar-014.bitarkiv.kb.dk and kb-test-bar-015.bitarkiv.kb.dk for windows bitarchive servers. Now we use kb-test-bar-016.bitarkiv.kb.dk and kb-test-bar-01.bitarkiv.kb.dk instead|
After which I will take a look at as many of the bug-fixes/new-functionality issues as possible.
|OK with errors||JRG|
Step "Verify the restarted system. On devel@kb-test-adm-001" part 1 gives a:
"Attempting to store file '23-metadata-1.warc.gz' with a different checksum than before". Needs follow-up.
Have made JIRA-issues of the remaining errors.
Production load job schedule database, adminDB and CS
|OK with errors|
One part of the test uses /home/devel/devel-config/deployment-configs/default_deploy_config_harvester.xml
We need to
1) Remove Bitpreservation sitesection from the GUI used;
2) Avoid using obsolete h3-zip (NetarchiveSuite-heritrix3-bundler-5.0-SNAPSHOT.zip) when deploying
3) Update the 1-cache.tar.bz2. It is created with Lucene 2.X. NAS now only supports indices with Lucene 3.X (workaround: use empty cache created when IndexServer starts)
4) Change the Viewerproxy test to use a freshly made index of a netarkivet.dk harvest
using a standard NAS installation. (we used kb-test-acs-001.kb.dk:12-data instead of the kb-prod-udv-001.kb.dk:test-data, and a fresh index, that indexes the harvestdata in the 12-data dir)
We had to go kb-test-acs-001 to perform the two wget operations, otherwise the firewall blocked us
|OK with errors||SVC|
The last step: Run UrlAndMimeSearch with argument 'image/.*' for mimetype and '.*kb\.dk/.*' for url. Verify that only images from the kb domain is listed.
failed to find any images at all. It could be because warcs are not supported by UrlAndMimeSearch batchjob
Batchjobprocessing stress test with external program
because of issue 3
Updated deploy_config_TEST11B.xml to use data from kb-test-bar-01.bitarkiv.kb.dk instead of machine kb-test-bar-012.bitarkiv.kb.dk which no longer exists.
baseFileDir's E:\bitarkiv, F:\bitarkiv, G:\bitarkiv, H:\bitarkiv, I:\bitarkiv, J:\bitarkiv
are replaced with baseFileDir's E:\bitarchive_1, F:\bitarchive_2, G:\bitarchive_3, H:\bitarchive_4, I:\bitarchive_5, J:\bitarchive_6
Issue 1: (FIXED in test-description)
Default installation does not work with TEST11B.
We want the test to use existing data in bitarchive_X/filedir
But prepare_test.sh modifies the scripts to use bitarchive_X/TEST11B/filedir
where there is no data.
Issue 2: Description of Step "Update Checksum and FileStatus" doesn't make much sense
(this issue has been ignored for this test.)
Have found the compiled scripts in
but we need to have the sourcecode for these
Rewriting to use the latest OpenWayback with https support
Same as French UI test?
German UI test
Test new functionality
(H3 Scripting features do not need to be tested as part of the NAS release test.)
Review of Documentation
|NetarchiveSuite Overview||SVC||Done||No mention of H3 Remote Access module|
|Quick Start Manual||KAAH||Done|
Heritrix Control and GUI-console Access (All Running Jobs page picture needs to be updated)
|Installation Manual||CSR||Done||I don't really like the state of this manual. It's very confusing and contains a considerable amount of material which should really be elsewhere. I don't how we can find time to give it the rewrite it needs.|
The manual now assumes that this link works: https://sbforge.org/maven/netarchivesuite/apidocs/5.4/dk/netarkivet/common/utils/Settings.html
Pages on JSP is no longer correct, as we now have two competing standards for how to make server-pages
All links to javadoc was previously wrong: https://sbforge.org/maven/netarchivesuite/apidocs/release/dk/netarkivet/common/utils/Notifications.html
The apidocs/release folder doesn't exist
All javadoc links now refer to https://sbforge.org/maven/netarchivesuite/apidocs/5.4
Harvester design page contained many factual errors, which are now fixed
|KAAH||Done||FTPValidator and MailValidator are now added.|
|Migrating H1 templates to H3 to use with NetarchiveSuite 5.1+||SVC||Done|