Page tree
Skip to end of metadata
Go to start of metadata

 

Release Test Information

Precondition

Check that the Full Test Suite (Master) and System Test are both green.

Sanity test

Run right after code freeze to verify the system integrity prior to the main release test.

Test

Status

Tester

Revision

Comments

TEST1

DONEColin Rosenthal5.4-RC1

NAS-2719 - Getting issue details... STATUS NAS-2720 - Getting issue details... STATUS The test description requires some cleanup of i) the expected results of the various harvests and ii) use of H3 Monitor where appropriate e.g. to terminate harvests. 


Regression tests

 

Test

Summary

Status

Tester

Comments

TEST0

Run through the Quick Start Manual

OK?SVC

NAS-2723 - Getting issue details... STATUS     NAS-2724 - Getting issue details... STATUS NAS-2725 - Getting issue details... STATUS NAS-2726 - Getting issue details... STATUS

NAS-2727 - Getting issue details... STATUS

The vagrant part of the Quickstart has not been tested

TEST0 - with vagrant

Run through the Quickstart with Vagrant




TEST0 - with postgresqlRun through the quickstart where we test the procedure for using NAS with postgresql (see page      Choose an Installation Scenario )StartedSVC

TEST2

Allround test

Complete with errors.CSR

Started then abandoned by JRG after recommendation from SVC. CSR takes over.

NAS-2729 - Getting issue details... STATUS

NAS-2730 - Getting issue details... STATUS

TEST 3A

Database Bitpreservation

OKSVC

  NAS-2728 - Getting issue details... STATUS

Fixed old issue:  NAS-2078 - Getting issue details... STATUS

TEST4

Danish ADM GUI Access, indexing and caching

OKSVC Made some changes to the test during the test. E.g. the multi-domain harvest only generates 4 jobs, not 5. Previously we used kb-test-bar-014.bitarkiv.kb.dk and kb-test-bar-015.bitarkiv.kb.dk for windows bitarchive servers. Now we use kb-test-bar-016.bitarkiv.kb.dk and kb-test-bar-01.bitarkiv.kb.dk instead

TEST5A

Infrastructure

OKSVC 

TEST5B

Infrastructure

OK CSR

 After which I will take a look at as many of the bug-fixes/new-functionality issues as possible.

TEST6

Errorhandling

Started JRG

 Null pointer exception when doing the search in step 3 of "Stop the Test Automatically During Upload". A stack trace is available if you perform the test.


NAS-2741 - Getting issue details... STATUS


Step "Verify the restarted system. On devel@kb-test-adm-001" part 1 gives a:

"Attempting to store file '23-metadata-1.warc.gz' with a different checksum than before". Needs follow-up.


Step "Verify the restarted system. On devel@kb-test-adm-001" part 2 gives a:

Remote JMX bean generated exception:
javax.management.InstanceNotFoundException: dk.netarkivet.common.logging:applicationinstanceid=,name
=error_host_kb-test-har-004.kb.dk_8150,httpport=8076,machine=kb-test-adm-001.kb.dk,applicationname=d
k.netarkivet.common.webinterface.GUIWebServer,index=0,channel=,replicaname=KBN,hostname=kb-test-har-
004.kb.dk,location=K


TEST7

Production load job schedule database, adminDB and CS

 Automatic

 

 

TEST9

Opensource modules

OK with errors

 SVC

One part of the test uses /home/devel/devel-config/deployment-configs/default_deploy_config_harvester.xml

We need to

   1) Remove Bitpreservation sitesection from the GUI used;

   2) Avoid using obsolete h3-zip (NetarchiveSuite-heritrix3-bundler-5.0-SNAPSHOT.zip) when deploying

  3) Update the 1-cache.tar.bz2. It is created with Lucene 2.X. NAS now only supports indices with Lucene 3.X (workaround: use empty cache created when IndexServer starts)

 4) Change the Viewerproxy test to use a freshly made index of a netarkivet.dk harvest

using a standard NAS installation. (we used kb-test-acs-001.kb.dk:12-data instead of the kb-prod-udv-001.kb.dk:test-data, and a fresh index, that indexes the harvestdata in the 12-data dir)

Note:

We had to go kb-test-acs-001 to perform the two wget operations, otherwise the firewall blocked us

NAS-2734 - Getting issue details... STATUS NAS-2737 - Getting issue details... STATUS

TEST11A

Batchjobprocessing

OK with errors SVC

NAS-2738 - Getting issue details... STATUS NAS-2739 - Getting issue details... STATUS

The last step: Run UrlAndMimeSearch with argument 'image/.*' for mimetype and '.*kb\.dk/.*' for url. Verify that only images from the kb domain is listed.

failed to find any images at all. It could be because warcs are not supported by UrlAndMimeSearch batchjob

TEST11B

Batchjobprocessing stress test with external program

Stalled

because of issue 3

 SVC

Updated deploy_config_TEST11B.xml to use data from kb-test-bar-01.bitarkiv.kb.dk instead of machine kb-test-bar-012.bitarkiv.kb.dk which no longer exists.

baseFileDir's E:\bitarkiv, F:\bitarkiv, G:\bitarkiv, H:\bitarkiv, I:\bitarkiv, J:\bitarkiv  

are replaced with baseFileDir's E:\bitarchive_1, F:\bitarchive_2, G:\bitarchive_3, H:\bitarchive_4, I:\bitarchive_5, J:\bitarchive_6

Issue 1: (FIXED in test-description)

Default installation does not work with TEST11B.

We want the test to use existing data in bitarchive_X/filedir

But prepare_test.sh modifies the scripts to use bitarchive_X/TEST11B/filedir

where there is no data.

Issue 2: Description of Step "Update Checksum and FileStatus" doesn't make much sense

(this issue has been ignored for this test.)

Issue 3: path test@kb-prod-udv-001.kb.dk:/home/test/test-batch/* does not exist

Have found the compiled scripts in test@kb-test-adm-001.kb.dk:/home/test/TEST11B

but we need to have the sourcecode for these

TEST12

Wayback test


 CSR

Rewriting to use the latest OpenWayback with https support 

 

BNF sanity test

Same as French UI test?



NAS-2731 - Getting issue details... STATUS NAS-2732 - Getting issue details... STATUS NAS-2733 - Getting issue details... STATUS

ONB Sanity test

German UI test

 

 

Test new functionality

(H3 Scripting features do not need to be tested as part of the NAS release test.)

Key Summary Assignee Component/s Status
Loading...
Refresh

Review of Documentation


Comments

  • No labels