Clone
 

csrster <csr@statsbiblioteket.dk> in NetarchiveSuite-Github

Merge remote-tracking branch 'origin/bitmag' into warc-record-api

# Conflicts:

# common/common-core/src/main/java/dk/netarkivet/common/CommonSettings.java

A few final edits.

Added a conf flag to switch between standard indexing and dedup indexing for metadata files.

Changed test to use paths relative to module root

Added pattern-matching method to file-resolver

Merge remote-tracking branch 'origin/NARK-1882-hadoop-indexing' into NARK-1882-hadoop-indexing

# Conflicts:

# wayback/wayback-indexer/src/test/java/dk/netarkivet/wayback/hadoop/CDXJobTest.java

Initial work on FileResolver

Merge branch 'NARK-1882-hadoop-indexing' into NARK-1941-dedup-indexing

Now returns correct record.

Now passes integration test.

Attempt to avoid double-indexing

Code-maturation for cdx-indexing

Dedup indexing

Added a hdfs setting that seems relevant

Updated version for h3 and snapshot version number for NAS

  1. … 22 more files in changeset.
Refactored Bitrepository to a singleton.

H3 upstreams from IIPC including BnF data-src fixes

Merge pull request #79 from aponb/master

fix for https://sbforge.org/jira/browse/NAS-2790 (domain list with duplicate names)

Merge pull request #80 from netarchivesuite/NAS-2853

fix HarvestController when BindingException occurs

Fully implemented distribution of client configuration with rest of software.

Reimplemented the mixed client using the split interfaces. Ready for testing I think.

Refactored to separate out different sub-interfaces from ArcRepository

  1. … 14 more files in changeset.
Added a bunch of logging.

Added a bunch of logging.

    • -86
    • +31
    /quickstart/deploy_standalone_bitmag.xml
Added a bitmagasin client configuration for quickstart.

    • -0
    • +399
    /quickstart/deploy_standalone_bitmag.xml
Merge remote-tracking branch 'origin/bitmag' into bitmag

Added a bitmagasin client configuration for quickstart.

    • -0
    • +24
    /quickstart/bitmagclientconfig/logback.xml
Removed surplus print statements in StressTest.

Reenabled snapshot generation test.