Package dk.netarkivet.harvester.indexserver

Class DedupCrawlLogIndexCache

java.lang.Object

dk.netarkivet.harvester.indexserver.FileBasedCache<Set<T>>

dk.netarkivet.harvester.indexserver.MultiFileBasedCache<T>

dk.netarkivet.harvester.indexserver.CombiningMultiFileBasedCache<Long>

dk.netarkivet.harvester.indexserver.CrawlLogIndexCache

dk.netarkivet.harvester.indexserver.DedupCrawlLogIndexCache

All Implemented Interfaces:

JobIndexCache

public class DedupCrawlLogIndexCache
extends CrawlLogIndexCache

A cache of crawl log indices appropriate for the Icelandic deduplicator code, excluding all text entries.

See Also:

CrawlLogIndexCache

Field Summary

Fields inherited from class dk.netarkivet.harvester.indexserver.CombiningMultiFileBasedCache

rawcache

Fields inherited from class dk.netarkivet.harvester.indexserver.FileBasedCache

cacheDir

Constructor Summary

Constructors

Constructor	Description
DedupCrawlLogIndexCache()	Constructor.

Method Summary

Modifier and Type	Method	Description
void	requestIndex(Set<Long> jobSet, Long harvestId)	Request an index from the indexserver.

Methods inherited from class dk.netarkivet.harvester.indexserver.CrawlLogIndexCache

combine, createStandardIndexer, getSortedCDX, getSortedCrawlLog, indexFile, prepareCombine

Methods inherited from class dk.netarkivet.harvester.indexserver.CombiningMultiFileBasedCache

cacheData

Methods inherited from class dk.netarkivet.harvester.indexserver.MultiFileBasedCache

getCacheFile

Methods inherited from class dk.netarkivet.harvester.indexserver.FileBasedCache

cache, get, getCacheDir, getIndex

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dk.netarkivet.common.distribute.indexserver.JobIndexCache

getIndex

Constructor Detail

DedupCrawlLogIndexCache

public DedupCrawlLogIndexCache()

Constructor. Calls the constructor of the inherited class with the correct values.

Method Detail

requestIndex

public void requestIndex(Set<Long> jobSet,
                         Long harvestId)

Description copied from interface: JobIndexCache

Request an index from the indexserver. Prepare the index but don't give it to me.

Parameters:

jobSet - Set of job IDs to generate index for.

harvestId - Harvestdefinition associated with this set of jobs