Changes

NAS-2642: Initial refactoring by making a new method
generatePageInformation, which creates a part of the HTML-script.

NAS-2642: Further refactoring by making a new method
generateJobInformation

NAS-2642: Refactored a bit more, so it is more clear what actually
happens in the methods crawllog_list and frontier_list

NAS-2642: An error occured during the refactoring, so a change has been
applied that hopefully will fix it

NAS-2642: Starting to transfer parameters from crawlog_list to
frontier_list

NAS-2642: Introducing solution from crawllog

NAS-2642: Inserted test in content

NAS-2642: Inserted test in content

NAS-2642: The pagenumber gets printed as a test

NAS-2642: Attempt to only show the specified number of URI's in a first
attempt to make it paginated

NAS-2642: Inform about the pagenumber and pagesize

NAS-2642: Another try to print the pageinformation

NAS-2642: Another step towards pagination

NAS-2642: Removed adding the pagination to the content variable

NAS-2642: Further test regarding pagination

NAS-2642: Itemnumber gets printed as test

NAS-2642: Another attempt in the pagination process - this time going
back to code that should work

NAS-2642: Another attempt to reestablish the normal state

NAS-2642: Another try to reestablish working code

NAS-2642: Another attempt

NAS-2642: The first page * 50 items are skipped

NAS-2642: Implemented two further parameters in listFrontier

NAS-2642: Extracted pagination method variables to class variables so
groovy can access them

NAS-2642: Reduced the pagesize to 100

NAS-2642: Reversed extraction

NAS-2642: The first 25 URIs get skipped

NAS-2642: Another content is displayed, so the number of pages differs
from the number of crawllog pages

NAS-2642: Generate frontier paged lines

NAS-2642: Refactored

NAS-2642: Frontier site divides the number of pending URIs up in pages

NAS-2642: Information about page and number of pages  is displayed

NAS-2642: More information

NAS-2642: Changed displayed order of information

NAS-2642: Page is set to 2

NAS-2642: Further information displayed

NAS-2642: Further information displayed

NAS-2642:  Deleted check on linesPerPage

NAS-2642:  Back to the old method

NAS-2642:  Displaying test information

NAS-2642:  totalCachedSize and totalCachedLines are now set to correct
value

NAS-2642: The number of the pending URIs is put in the html-string

NAS-2642: The number of lines is now determined by pending uris matching
the regular expression instead of all pending uris

NAS-2642: Since it is necessary to walk through all pending URIs to find
out the lines that should be displayed it is also necessary to close the
database and then open it again before displaying the actual lines on
the page.

NAS-2642: Display  testinformation

NAS-2642: More testinformation

NAS-2642: More testinformation

NAS-2642: Variable transformation

NAS-2642: Testinformation

NAS-2642: Testinformation

NAS-2642: Now the string is split by #

NAS-2642: Now the string is split by ½ instead

NAS-2642: Testinformation

NAS-2642: Delimiter is now 'Matching count:'

NAS-2642: The number of lines is now found in the result of listFrontier
in the groovy script

NAS-2642: Variable introduced for test purposes

NAS-2642: Regular expression is used to find the number of lines that
should be paginated

NAS-2642: Introducing another test variable

NAS-2642: The total number of lines are found in the groovy script and
then the number of lines are first extracted and then removed from the
html result

NAS-2642: Parselong used rather than getlong

NAS-2642: Testvariable

NAS-2642: Introduced exception

NAS-2642: Changed page number extraction and removed the first while
loop since we now have to find all lines that match the regular
expression

NAS-2642: Changed the extraction back again

NAS-2642: Changed page number extraction to use pattern matching instead

NAS-2642: Default page value is "1" instead of null

NAS-2642: listFrontier in nas.groovy is now called with the page number

NAS-2642: totalCachedLines is extracted from the start fo scriptResult
instead of being set in listFrontier in the groovy script

NAS-2642: Back to the version which call listFrontier where the page
number is included in the regular expression

NAS-2642: Inserted code from master in crawllog to get the correct
result

NAS-2642: Refactored a bit again

NAS-2642: Refactored a bit

NAS-2642: Pagestring replaces regexstring

NAS-2642: Crawllog gave an excep so going back to the old code

NAS-2642: Default pagesize of 100 is no longer assigned every time a
differnet page is selected

NAS-2642: Pagesize will now no longer change to default when another
page is selected

NAS-2642: Both frontier and crawllog now uses same method to find the
number of lines which the user has typed that a page can contain

NAS-2642: Changed the groovy script to accept three parameters

NAS-2642: Ready for review

Work on NAS-2646 . Trying to merge jacoco reports into one single report

Fix NAS-2648 - support for crawllogs with old duplicate annotations
(also NARK-1338)

NARK-1388 NAS-2648 - forgot to change the pattern itself :(

H3 monitor review follow-up and cleanup.

Added a TODO!

Adding LICENSELICENSE.txt as requested by Mick Hucka

NAS-2641: Pagination now supports additional parameters in the page
links.

Disabling very slow test:
archive/archive-test/src/test/java/dk/netarkivet/archive/tools/RunBatchTester.java
and resetting version to 5.4-SNAPSHOT

Added pom.xml.versionsBackup to .gitignore

Ignoring pom.xml.versionsBackup

Work on NAS-2646 - also moved some tests from archive-test module to
archive-core and made the Channels.reset() method public

Work on NAS-2646 - removed a lot @Ignore clauses in the archive-test
package

Work on NAS-2646 - more enabling of disabled tests

Work on NAS-2646 - some cleanup in the monitor modules. moved most tests
from monitor-test to monitor-core

Work on NAS-2646 - some cleanup in the common-test module

Work on NAS-2646 - ignored test failing in travis

A script to redeply NAS from either inside or outside vagrant

Less verbose on redeploy

Fixed $USER

NAS-2674 - add a notification, in case of channel mismatch

Changed bitarkiv 015 to 01 in test setup

Fixed case-sensitive hostname!!!

Removed duplicate dependency 'javax.inject' in pom.xml

NAS-2673 - Added postgresql create script for default schedules, and
moved scripts away from scripts/sql

NAS-2673 - Added updated versions of mq.sh and RunNetarchiveSuite.sh

NAS-2673 -  more work

Made 'final' all warnings of "Synchronization on a non-final field" that
Intellij Idea would allow me to do. The remaining 15 occurrences of
"Synchronization on a non-final field" will be more interesting...

Fixed 13 occurrences of "Synchronization on a non-final field", now only
2 are left.

Changed the fix of "Synchronization on a non-final field" in this class
to the cleaner solution now also used elsewhere.

NAS-2680: Fixed the error that made the Jenkins build fail

Work on NAS-2733 - now searching for the domain in the cached logs. Only
does lookup, if the crawlog is cached. If no caching, the job will not
be shown on the result.page

Fixed trivial issue NAS-2741. It wrote out useless warnings to the log

Made fix for NAS-2735. Work on NAS-2733 - Enabled filtering in running
jobs using previously used FindRunningJobQuery class

NAS-2733 - Forgot to update the complete_settings.xml file. Added the
default value for tempPath to HarvesterSettings class

NAS-2733 -  lacked some imports in the jsp page

NAS-2733 - don't search in database if chosen filteringMethod is
'database'

Work on NAS-2673. Updates on scripts RunNetarchiveSuite.sh and mq.sh.
Removed sql-scripts from sql folder to folders mysql,postgresql, an
derby respectedly

Fix NAS-2673. Fix incorrect creation of tables 'harvestdefinitions' and
'harvestchannel'. Include creation of SNAPSHOT and FOCUSED channels used
by Quickstart

Update copyright date on OnB-provided code. (NAS-2696)

Fixed NAS-2744 - changed HERITRIX3_VERSION to '3.3.0-BDB-5.0.x'

NAS-2673 - fixed createHarvestDB.pgsql script and added documentation to
the scripts. Added a deploy_standalone_example_postgresql.xml deploy
script

Follow-up on NAS-2677 -  removed H1 templates in
deploy/distribution/src/main/resources/order_templates_dist/

Updated placing of sql init file.

[maven-release-plugin] prepare release netarchivesuite-5.4

[maven-release-plugin] prepare for next development iteration

NAS-2719 Fixed misplaced header in all 7 css-files

NAS-2751 - fixed memory-leak in JMS QueueBrowser functionality

NAS-2751 - Trying to reset the jmsconnection after a number of
getCount() calls.

NAS-2751 - we evaluated the limit for resetting jms wrong

NAS-2751 - now reuses the same QueueSession for every getCount() call.
And the QueueSession is reinitialized in the case of a JMSException

NAS-2751 - minor follow-ups after codereview

NAS-2751 - minor follow-up after codereview

Fixed NAS-2752 - disabled by default the search for duplicationmigration
records

Bumped the version to 5.4.1

NAS-2752 -  added the SendDedupIndexRequestToIndexserver program
required to test indexing from the commandline

NAS-2750 - added new DNSFetcher class that fails bad URIs early, ie.
before DNS lookup is tried

NAS-2750 - added usage for the new DNS fetcher, and disabled the new
feature by default

Fixed at least one bug in how groovy script matches regexes.

Modified text in GUI to make clear that filtering is limited by
page-size.

Enabled ".*" search and delete.

NAS-2750 - logging level changed

Fixed NAS-2712 - changed the regexp used for metadata-retrieval to the
one in the Reporting class. NAS-2752 - added more logging to verify if
duplicationmigration lookup is turned on/off

NAS-2752 - final corrections

Changed version to 5.4.1-SNAPSHOT

[maven-release-plugin] prepare release netarchivesuite-5.4.1

[maven-release-plugin] prepare for next development iteration

Experimental quota enforcer that always allows prerequisites

Experimental quota enforcer that always allows prerequisites

Bumped version to 5.4.2-SNAPSHOT

Made queuing behaviour of dns: lookups in heritrix configurable.

Improved a log message with extra information.

[maven-release-plugin] prepare release netarchivesuite-5.4.2

[maven-release-plugin] prepare for next development iteration

Fixed NAS-2760 - and added additional logging to the class
dk.netarkivet.deploy.XmlStructure

Fixed NAS-2760 - and added additional logging to the class
dk.netarkivet.deploy.XmlStructure

NAS-2673 - correct headers for postgresql scripts

Give QueueBrowserPatch branch the same version as master to enable
merging

NAS-2793 When a harvest dispatches a job the jobs channel name is
examined and if its name is UMBRA umbrabean information is put in the
cxml-file replacing the four placeholders

NAS-2793 Edited a comment

NAS-2793 Made two new parameters instead of hardcoding the rabbitmq url
and the regular expression to limit search pages

Modified umbra integration to read from settings.

Changed logic to enable umbra harvesting for any job channel with
"umbra" in name in lower/upper/mixed case.

Made clientId for umbra jobs thoroughly unique.

Fixed bug in substituting placeholders.

Added necessary new.lines to the spring overrides.

Added todo for moving umbra-inserts to HarvestController.

Refactor to put umbra config in HarvestControllers.

bugfix

typo

Tidied up logic and removed superfluous after-check.

Added validity checks on settings + logging.

Fix to NAS-2794 - correct queue assignment when url scheme is missing

Rebuilt complete settings.

Rebuilt complete settings. (again)

Escaped string values in xml attributes.

Code Review follow-ups