Package dk.netarkivet.wayback

Class WaybackSettings

  • public class WaybackSettings
extends Object
    Settings specific to the wayback module of NetarchiveSuite.

    • Field Detail

      • URL_CANONICALIZER_CLASSNAME

        public static String URL_CANONICALIZER_CLASSNAME
        Setting specifying the name of the class used to canonicalize urls. This class must implement the interface org.archive.wayback.UrlCanonicalizer .

      • C3P0_ACQUIRE_INCREMENT

        public static String C3P0_ACQUIRE_INCREMENT
        c3p0 is the database connection manager used by hibernate. See c3p0 documentation for their meaning.

      • C3P0_IDLE_PERIOD

        public static String C3P0_IDLE_PERIOD

      • C3P0_MAX_SIZE

        public static String C3P0_MAX_SIZE

      • C3P0_MAX_STATEMENTS

        public static String C3P0_MAX_STATEMENTS

      • C3P0_MIN_SIZE

        public static String C3P0_MIN_SIZE

      • C3P0_TIMEOUT

        public static String C3P0_TIMEOUT

      • HIBERNATE_DB_URL

        public static String HIBERNATE_DB_URL
        These are the hibernate specific properties. See hibernate documentation for their meaning.

      • HIBERNATE_DB_DRIVER

        public static String HIBERNATE_DB_DRIVER

      • HIBERNATE_REFLECTION_OPTIMIZER

        public static String HIBERNATE_REFLECTION_OPTIMIZER

      • HIBERNATE_TRANSACTION_FACTORY

        public static String HIBERNATE_TRANSACTION_FACTORY

      • HIBERNATE_DIALECT

        public static String HIBERNATE_DIALECT

      • HIBERNATE_SHOW_SQL

        public static String HIBERNATE_SHOW_SQL

      • HIBERNATE_FORMAT_SQL

        public static String HIBERNATE_FORMAT_SQL

      • HIBERNATE_HBM2DDL_AUTO

        public static String HIBERNATE_HBM2DDL_AUTO

      • HIBERNATE_USERNAME

        public static String HIBERNATE_USERNAME

      • HIBERNATE_PASSWORD

        public static String HIBERNATE_PASSWORD

      • WAYBACK_REPLICA

        public static String WAYBACK_REPLICA
        The replica to be used by the wayback indexer.

      • WAYBACK_INDEX_TEMPDIR

        public static String WAYBACK_INDEX_TEMPDIR
        The directory to which batch output is written during indexing.

      • WAYBACK_BATCH_OUTPUTDIR

        public static String WAYBACK_BATCH_OUTPUTDIR
        The directory to which batch output is moved after a batch indexing job is successfully completed, and from which the output is read by the aggregator.

      • WAYBACK_INDEXER_MAXFAILEDATTEMPTS

        public static String WAYBACK_INDEXER_MAXFAILEDATTEMPTS
        The maximum number of times an archive file may generate a batch error during indexing before we give up on it.

      • WAYBACK_INDEXER_PRODUCER_DELAY

        public static String WAYBACK_INDEXER_PRODUCER_DELAY
        The delay in milliseconds before the producer thread is started.

      • WAYBACK_INDEXER_PRODUCER_INTERVAL

        public static String WAYBACK_INDEXER_PRODUCER_INTERVAL
        The interval, in milliseconds, between successive fecthes of the complete file list from the archive.

      • WAYBACK_INDEXER_RECENT_PRODUCER_SINCE

        public static final String WAYBACK_INDEXER_RECENT_PRODUCER_SINCE
        How long ago to fetch newer files from the archive for indexing, measured in milliseconds since now. Default values is one day (86400000)
        See Also:
        Constant Field Values

      • WAYBACK_INDEXER_RECENT_PRODUCER_INTERVAL

        public static final String WAYBACK_INDEXER_RECENT_PRODUCER_INTERVAL
        How often to fetch recent files from the archive (milliseconds). Default values is a half hour (1800000).
        See Also:
        Constant Field Values

      • WAYBACK_INDEXER_CONSUMER_THREADS

        public static String WAYBACK_INDEXER_CONSUMER_THREADS
        The number of consumer threads to run.

      • WAYBACK_INDEXER_INITIAL_FILES

        public static String WAYBACK_INDEXER_INITIAL_FILES
        A file containing a list of files which have been archived and therefore do not need to be archived again. This key may be unset.

      • WAYBACK_AGGREGATOR_OUTPUT_DIR

        public static String WAYBACK_AGGREGATOR_OUTPUT_DIR
        The directory the Aggregator places the Aggregated and sorted files into.

      • WAYBACK_AGGREGATOR_TEMP_DIR

        public static String WAYBACK_AGGREGATOR_TEMP_DIR
        The directory used by the aggregator to store temporary files.

      • WAYBACK_AGGREGATOR_AGGREGATION_INTERVAL

        public static String WAYBACK_AGGREGATOR_AGGREGATION_INTERVAL
        The time to between each scheduled aggregation run (in milliseconds).

      • WAYBACK_AGGREGATOR_MAX_INTERMEDIATE_INDEX_FILE_SIZE

        public static String WAYBACK_AGGREGATOR_MAX_INTERMEDIATE_INDEX_FILE_SIZE
        The maximum size of the Intermediate index file in MB. When this limit is reached a new index file is created and new indexes are added to this file. In the case of a 0 value, the intermediate index file will always be merged into the main index file.

      • WAYBACK_AGGREGATOR_MAX_MAIN_INDEX_FILE_SIZE

        public static String WAYBACK_AGGREGATOR_MAX_MAIN_INDEX_FILE_SIZE
        The maximum size of the main wayback index file in MB. When this limit is reached a new index file is created and new indexes are added to this file. The old index file will be rename to ${finalIndexFileSizeLimit}.

      • WAYBACK_RESOURCESTORE_CACHE_MAXFILES

        public static String WAYBACK_RESOURCESTORE_CACHE_MAXFILES
        The maximum number of files in the resourcestore cache. The default is 100.

      • WAYBACK_RESOURCESTORE_CACHE_DIR

        public static String WAYBACK_RESOURCESTORE_CACHE_DIR
        The cachedirectory.

    • Constructor Detail

      • WaybackSettings

        public WaybackSettings()