Package | Description |
---|---|
dk.netarkivet.archive.arcrepositoryadmin | |
dk.netarkivet.archive.bitarchive | |
dk.netarkivet.archive.bitarchive.distribute | |
dk.netarkivet.archive.webinterface | |
dk.netarkivet.common.distribute | |
dk.netarkivet.common.utils | |
dk.netarkivet.harvester.datamodel | |
dk.netarkivet.harvester.datamodel.extendedfield | |
dk.netarkivet.harvester.harvesting.distribute | |
dk.netarkivet.harvester.harvesting.metadata | |
dk.netarkivet.harvester.heritrix3 |
This module handles defining, scheduling, and execution of harvests.
|
Modifier and Type | Method and Description |
---|---|
void |
ReplicaCacheDatabase.addFileListInformation(File filelistFile,
Replica replica)
Method for adding the results from a list of filenames on a replica.
|
String |
AdminData.getCheckSum(String arcfileName)
Deprecated.
Get Checksum for a given arcfile.
|
ReplicaStoreState |
AdminData.getState(String arcfileName,
String replicaChannelName)
Deprecated.
Retrieves the storage state of a file for a specific replica.
|
StoreMessage |
UpdateableAdminData.removeReplyInfo(String fileName)
Deprecated.
Removes the replyInfo associated with arcfileName.
|
void |
UpdateableAdminData.setCheckSum(String fileName,
String checkSum)
Deprecated.
Set/update the checksum for a given arcfileName in the admindata.
|
void |
UpdateableAdminData.setReplyInfo(String fileName,
StoreMessage replyInfo)
Deprecated.
Records the replyInfo (StoreMessage object) so that it can be retrieved using the given file name.
|
void |
UpdateableAdminData.setState(String fileName,
String replicaID,
ReplicaStoreState state)
Deprecated.
Sets the store state for the given file on the given bitarchive.
|
Modifier and Type | Method and Description |
---|---|
BitarchiveRecord |
Bitarchive.get(String arcfile,
long index)
Get an ARC or WARC record out of the archive.
|
void |
BitarchiveAdmin.updateFileList(File basedir)
Method for updating the filelist for a given basedir.
|
Modifier and Type | Method and Description |
---|---|
static BitarchiveServer |
BitarchiveServer.getInstance()
Returns the unique instance of this class The server creates an instance of the bitarchive it provides access to
and starts to listen to JMS messages on the incomming jms queue
|
Modifier and Type | Method and Description |
---|---|
static void |
BatchGUI.getPageForClass(javax.servlet.jsp.PageContext context)
Method for creating the page for a batchjob.
|
Modifier and Type | Method and Description |
---|---|
static ChannelID |
Channels.retrieveReplicaChannelFromReplicaId(String replicaId)
The method for retrieving the identification channel for a replica based on the Id of this replica.
|
static String |
Channels.retrieveReplicaChannelNameFromReplicaId(String replicaId)
The method for retrieving the name of the identification channel for a replica based on the Id of this replica.
|
static Replica |
Channels.retrieveReplicaFromIdentifierChannel(String channelName)
Method for extracting the replica from the name of the identifier channel.
|
Modifier and Type | Method and Description |
---|---|
static String |
Settings.get(String key)
Gets a setting.
|
static String[] |
Settings.getAll(String key)
Gets a list of settings.
|
static boolean |
Settings.getBoolean(String key)
Gets a setting as a boolean.
|
static double |
Settings.getDouble(String key)
Gets a setting as a double.
|
static int |
Settings.getInt(String key)
Gets a setting as an int.
|
static long |
Settings.getLong(String key)
Gets a setting as a long.
|
Modifier and Type | Method and Description |
---|---|
abstract void |
GlobalCrawlerTrapListDAO.delete(int id)
Deletes a crawler trap list from the database.
|
HarvestChannel |
HarvestChannelDBDAO.getById(long id) |
abstract HarvestChannel |
HarvestChannelDAO.getById(long id)
Retrieves a
HarvestChannel by its UID. |
HarvestChannel |
HarvestChannelDBDAO.getByName(String name) |
abstract HarvestChannel |
HarvestChannelDAO.getByName(String name)
Retrieves a
HarvestChannel by its unique name. |
List<Long> |
JobDBDAO.getJobIDsForDuplicateReduction(long jobID)
Calculate all jobIDs to use for duplication reduction.
|
abstract List<Long> |
JobDAO.getJobIDsForDuplicateReduction(long jobID)
Calculate all jobIDs to use for duplication reduction.
|
abstract GlobalCrawlerTrapList |
GlobalCrawlerTrapListDAO.read(int id)
Get a traplist from the database.
|
abstract Job |
JobDAO.read(long jobID)
Reads a job from persistent storage.
|
HarvestDefinition |
HarvestDefinitionDBDAO.read(Long harvestDefinitionID)
Read the stored harvest definition for the given ID.
|
abstract HarvestDefinition |
HarvestDefinitionDAO.read(Long harvestDefinitionID)
Read the stored harvest definition for the given ID.
|
abstract void |
GlobalCrawlerTrapListDAO.update(GlobalCrawlerTrapList trapList)
Updates a given global crawler trap list.
|
Modifier and Type | Method and Description |
---|---|
abstract ExtendedField |
ExtendedFieldDAO.read(Long aExtendedFieldID)
Reads an ExtendedField from persistent storage.
|
Modifier and Type | Method and Description |
---|---|
void |
HarvestControllerServer.visit(DoOneCrawlMessage msg)
Receives a DoOneCrawlMessage and call onDoOneCrawl.
|
Modifier and Type | Method and Description |
---|---|
static URI |
MetadataFileWriter.getAlternateCDXURI(long jobID,
String filename)
Generates a URI identifying CDX info for one harvested ARC file.
|
static URI |
MetadataFileWriter.getCDXURI(String harvestID,
String jobID,
String filename)
Generates a URI identifying CDX info for one harvested (W)ARC file.
|
Modifier and Type | Method and Description |
---|---|
void |
HarvestControllerServer.visit(DoOneCrawlMessage msg)
Checks that we're available to do a crawl, and if so, marks us as unavailable, checks that the job message is
well-formed, and starts the thread that the crawl happens in.
|
Copyright © 2005–2015 The Royal Danish Library, the Danish State and University Library, the National Library of France and the Austrian National Library.. All rights reserved.