Modifier and Type | Method and Description |
---|---|
ReplicaClient |
ArcRepository.getReplicaClientFromReplicaId(String replicaId)
Returns a replica client based on a replica id.
|
void |
ArcRepository.store(RemoteFile rf,
StoreMessage replyInfo)
Stores a file in all known replicas.
|
Modifier and Type | Method and Description |
---|---|
void |
FileBasedActiveBitPreservation.addMissingFilesToAdminData(String... filenames)
Deprecated.
Reestablish admin data to match bitarchive states for files.
|
void |
DatabaseBasedActiveBitPreservation.addMissingFilesToAdminData(String... filenames)
Old method, which refers to the checksum replica part of admin data.
|
void |
FileBasedActiveBitPreservation.changeStateForAdminData(String filename)
Deprecated.
Reestablish admin data to match replica states for file.
|
void |
DatabaseBasedActiveBitPreservation.changeStateForAdminData(String filename)
This should reestablish the state for the file.
|
boolean |
DatabasePreservationState.fileIsMissing(Replica replica)
Check if the file is missing from a replica.
|
void |
FileBasedActiveBitPreservation.findChangedFiles(Replica replica)
Deprecated.
This method finds out which files in a given bitarchive are misrepresented in the admin data: Either having the
wrong checksum or not being marked as uploaded when it actually is.
|
void |
DatabaseBasedActiveBitPreservation.findChangedFiles(Replica replica)
The method is used to update the checksum for all the files in a replica.
|
void |
FileBasedActiveBitPreservation.findMissingFiles(Replica replica)
Deprecated.
This method takes as input the name of a replica for which we wish to retrieve the list of files, either through
a FileListJob or a GetAllFilenamesMessage.
|
void |
DatabaseBasedActiveBitPreservation.findMissingFiles(Replica replica)
This method retrieves the filelist for the replica, and then it updates the database with this list of filenames.
|
String |
DatabasePreservationState.getAdminReplicaState(Replica replica)
Get the status of the file in a replica, according to the admin data.
|
Iterable<String> |
DatabaseBasedActiveBitPreservation.getChangedFiles(Replica replica)
This method retrieves the name of all the files which has a wrong checksum for the replica.
|
Date |
FileBasedActiveBitPreservation.getDateForChangedFiles(Replica replica)
Deprecated.
Get the date for last time the checksum information was updated for this replica.
|
Date |
DatabaseBasedActiveBitPreservation.getDateForChangedFiles(Replica replica)
This method retrieves the date for the latest checksum update was performed for the replica.
|
Date |
FileBasedActiveBitPreservation.getDateForMissingFiles(Replica replica)
Deprecated.
Get the date for last time the missing files information was updated for this replica.
|
Date |
DatabaseBasedActiveBitPreservation.getDateForMissingFiles(Replica replica)
This method retrieves the date for the latest filelist update was performed for the replica.
|
Iterable<String> |
FileBasedActiveBitPreservation.getMissingFiles(Replica replica)
Deprecated.
Get a list of missing files in a given replica.
|
Iterable<String> |
DatabaseBasedActiveBitPreservation.getMissingFiles(Replica replica)
This method retrieves the name of all the files which are missing for the given replica.
|
long |
FileBasedActiveBitPreservation.getNumberOfChangedFiles(Replica replica)
Deprecated.
Get the number of wrong files for a replica.
|
long |
DatabaseBasedActiveBitPreservation.getNumberOfChangedFiles(Replica replica)
The method calculates the number of files which has a wrong checksum for the replica.
|
long |
FileBasedActiveBitPreservation.getNumberOfFiles(Replica replica)
Deprecated.
Return the number of files found in the replica.
|
long |
DatabaseBasedActiveBitPreservation.getNumberOfFiles(Replica replica)
This method finds the number of files which are known to be in the archive of a specific replica.
|
long |
FileBasedActiveBitPreservation.getNumberOfMissingFiles(Replica replica)
Deprecated.
Get the number of missing files in a given replica.
|
long |
DatabaseBasedActiveBitPreservation.getNumberOfMissingFiles(Replica replica)
This method calculates the number of files which are not found in the given replica.
|
PreservationState |
DatabaseBasedActiveBitPreservation.getPreservationState(String filename)
Method for retrieving the FilePreservationState for a specific file.
|
Map<String,PreservationState> |
FileBasedActiveBitPreservation.getPreservationStateMap(String... filenames)
Deprecated.
Retrieve the preservation status for the files with the given filenames.
|
Map<String,PreservationState> |
DatabaseBasedActiveBitPreservation.getPreservationStateMap(String... filenames)
Method for retrieving the FilePreservationState for a list of files.
|
List<String> |
DatabasePreservationState.getReplicaChecksum(Replica replica)
Get the checksum of this file in a specific replica.
|
String |
DatabasePreservationState.getUniqueChecksum(Replica replica)
Get a checksum that the whole replica agrees upon, or else "".
|
void |
FileBasedActiveBitPreservation.replaceChangedFile(Replica replica,
String filename,
String credentials,
String checksum)
Deprecated.
Check that file checksum is indeed different to admin data and reference replica.
|
void |
DatabaseBasedActiveBitPreservation.replaceChangedFile(Replica replica,
String filename,
String credentials,
String checksum)
Check that the checksum of the file is indeed different to the value in admin data and reference replica.
|
void |
FileBasedActiveBitPreservation.uploadMissingFiles(Replica replica,
String... filenames)
Deprecated.
Check that the files we want to restore are indeed missing on the replica, and present in admin data and the
reference bitarchive.
|
void |
DatabaseBasedActiveBitPreservation.uploadMissingFiles(Replica replica,
String... filenames)
This method is used to upload missing files to a replica.
|
Constructor and Description |
---|
DatabasePreservationState(String fileName,
List<ReplicaFileInfo> rfis)
Constructor.
|
Modifier and Type | Method and Description |
---|---|
BatchStatus |
JMSArcRepositoryClient.batch(FileBatchJob job,
String replicaId,
String batchId,
String... args)
Runs a batch job on each file in the ArcRepository.
|
File |
JMSArcRepositoryClient.correct(String replicaId,
String checksum,
File file,
String credentials)
Method for correcting an entry in a replica.
|
BitarchiveRecord |
JMSArcRepositoryClient.get(String arcfile,
long index)
Sends a GetMessage on the "TheArcrepos" queue and waits for a reply.
|
File |
JMSArcRepositoryClient.getAllChecksums(String replicaId)
Retrieves all the checksum from the replica through a GetAllChecksumMessage.
|
File |
JMSArcRepositoryClient.getAllFilenames(String replicaId)
Retrieves the names of all the files in the replica through a GetAllFilenamesMessage.
|
String |
JMSArcRepositoryClient.getChecksum(String replicaId,
String filename)
Retrieves the checksum of a specific file.
|
void |
JMSArcRepositoryClient.getFile(String arcfilename,
Replica replica,
File toFile)
Synchronously retrieves a file from a bitarchive and places it in a local file.
|
File |
JMSArcRepositoryClient.removeAndGetFile(String fileName,
String bitarchiveId,
String checksum,
String credentials)
Removes a file from the bitarchives, if given credentials and checksum are correct.
|
void |
JMSArcRepositoryClient.store(File file)
Sends a StoreMessage via the synchronized JMS connection method sendAndWaitForOneReply().
|
void |
JMSArcRepositoryClient.updateAdminData(String fileName,
String replicaId,
ReplicaStoreState newval)
Request update of admin data to specific state.
|
void |
ArcRepositoryServer.visit(BatchMessage msg)
Resends a batch message to the requested bitarchive.
|
void |
ArcRepositoryServer.visit(BatchReplyMessage msg)
Forwards the handling of batch replies to the arc repository.
|
void |
ArcRepositoryServer.visit(CorrectMessage msg)
Method for handling CorrectMessages.
|
void |
ArcRepositoryServer.visit(GetAllChecksumsMessage msg)
Method for retrieving all the checksums from a replica.
|
void |
ArcRepositoryServer.visit(GetAllFilenamesMessage msg)
For retrieving all the filenames from a replica.
|
void |
ArcRepositoryServer.visit(GetFileMessage msg)
Forwards a getfile message to requested bitarchive replica.
|
void |
ArcRepositoryServer.visit(GetMessage msg)
Forwards a get message to the local bitarchive.
|
void |
ArcRepositoryServer.visit(UploadMessage msg)
Forwards the handling of upload replies to the arc repository.
|
Modifier and Type | Method and Description |
---|---|
void |
DatabaseAdmin.addEntry(String filename,
StoreMessage msg,
String checksum)
Method for adding an entry for administration.
|
void |
ReplicaCacheDatabase.addFileListInformation(File filelistFile,
Replica replica)
Method for adding the results from a list of filenames on a replica.
|
void |
DerbyEmbeddedSpecifics.backupDatabase(Connection c,
File backupDir)
Backup the database.
|
void |
DerbyServerSpecifics.backupDatabase(Connection c,
File backupDir)
Backup the database.
|
void |
ReplicaCacheDatabase.changeStateOfReplicafileinfo(String filename,
Replica replica,
ReplicaStoreState state)
Method for inserting an entry into the database about a file upload has begun for a specific replica.
|
void |
ReplicaCacheDatabase.changeStateOfReplicafileinfo(String filename,
String checksum,
Replica replica,
ReplicaStoreState state)
Method for inserting an entry into the database about a file upload has begun for a specific replica.
|
static FileListStatus |
FileListStatus.fromOrdinal(int status)
Method to retrieve the FileListStatus based on an integer.
|
static ChecksumStatus |
ChecksumStatus.fromOrdinal(int status)
Method to retrieve the FileListStatus based on an integer.
|
Set<String> |
DatabaseAdmin.getAllFileNames(Replica rep,
ReplicaStoreState state)
Retrieves a set with the name of the files with a specific ReplicaStoreState in a specific replica.
|
Replica |
ReplicaCacheDatabase.getBitarchiveWithGoodFile(String filename)
Method for finding a replica with a valid version of a file.
|
Replica |
ReplicaCacheDatabase.getBitarchiveWithGoodFile(String filename,
Replica badReplica)
Method for finding a replica with a valid version of a file.
|
String |
ReplicaCacheDatabase.getChecksum(String filename)
Method for retrieving the checksum for a specific file.
|
String |
DatabaseAdmin.getCheckSum(String filename)
Retrieves the checksum of a given file.
|
String |
AdminData.getCheckSum(String arcfileName)
Deprecated.
Get Checksum for a given arcfile.
|
Date |
ReplicaCacheDatabase.getDateOfLastMissingFilesUpdate(Replica replica)
Get the date for the last file list job.
|
Date |
ReplicaCacheDatabase.getDateOfLastWrongFilesUpdate(Replica replica)
Method for retrieving the date for the last update for corrupted files.
|
Iterable<String> |
ReplicaCacheDatabase.getMissingFilesInLastUpdate(Replica replica)
Method for retrieving the list of the names of the files which was missing for the replica in the last filelist
update.
|
long |
ReplicaCacheDatabase.getNumberOfFiles(Replica replica)
Method for retrieving the number of files within a replica.
|
long |
ReplicaCacheDatabase.getNumberOfMissingFilesInLastUpdate(Replica replica)
Method for retrieving the number of files missing from a specific replica.
|
long |
ReplicaCacheDatabase.getNumberOfWrongFilesInLastUpdate(Replica replica)
Method for retrieving the amount of files with a incorrect checksum within a replica.
|
ReplicaFileInfo |
ReplicaCacheDatabase.getReplicaFileInfo(String filename,
Replica replica)
Method for retrieving the entry in the replicafileinfo table for a given file and replica.
|
ReplicaStoreState |
ReplicaCacheDatabase.getReplicaStoreState(String filename,
String replicaId)
Retrieves the ReplicaStoreState for the entry in the replicafileinfo table, which refers to the given file and
replica.
|
ReplicaStoreState |
DatabaseAdmin.getState(String filename,
String replicaChannelName)
Returns the ReplicaStoreState of a given file in a specific replica.
|
Iterable<String> |
ReplicaCacheDatabase.getWrongFilesInLastUpdate(Replica replica)
Method for retrieving the list of the files in the replica which have a incorrect checksum.
|
boolean |
DatabaseAdmin.hasEntry(String filename)
Method for telling whether a file entry exists.
|
boolean |
DatabaseAdmin.hasReplyInfo(String filename)
Determines whether the StoreMessage of a given file exists.
|
boolean |
DatabaseAdmin.hasState(String filename,
String repChannelId)
Determines whether a given file in a specific replica has a valid replica store state.
|
boolean |
ReplicaCacheDatabase.insertAdminEntry(String line)
Method for inserting a line of Admin.Data into the database.
|
void |
ReplicaCacheDatabase.insertNewFileForUpload(String filename,
String checksum)
Creates a new entry for the filename for each replica, and give it the given checksum and set the upload_status =
UNKNOWN_UPLOAD_STATUS.
|
StoreMessage |
DatabaseAdmin.removeReplyInfo(String filename)
Retrieves the StoreMessage of a specific file.
|
FileListStatus |
ReplicaCacheDatabase.retrieveFileListStatus(String filename,
Replica replica)
Method for retrieving the filelist_status for a replicafileinfo entry.
|
Collection<String> |
ReplicaCacheDatabase.retrieveFilenamesForReplicaEntries(String replicaId,
ReplicaStoreState state)
Retrieves the names of all the files in the given replica which has the specified UploadStatus.
|
void |
ReplicaCacheDatabase.setAdminDate(Date date)
Method for setting a specific value for the filelistdate and the checksumlistdate for all the replicas.
|
void |
DatabaseAdmin.setCheckSum(String filename,
String checksum)
Sets the checksum of a given file.
|
void |
UpdateableAdminData.setCheckSum(String fileName,
String checkSum)
Deprecated.
Set/update the checksum for a given arcfileName in the admindata.
|
void |
ReplicaCacheDatabase.setReplicaStoreState(String filename,
String replicaId,
ReplicaStoreState state)
Sets the ReplicaStoreState for the entry in the replicafileinfo table.
|
void |
DatabaseAdmin.setReplyInfo(String filename,
StoreMessage msg)
Assign a StoreMessage to a specific filename.
|
void |
ArchiveStoreState.setState(ReplicaStoreState state)
Sets the current ReplicaStoreState.
|
void |
ArchiveStoreState.setState(ReplicaStoreState state,
Date lastDate)
Sets the current ReplicaStoreState.
|
void |
DatabaseAdmin.setState(String filename,
String repChannelId,
ReplicaStoreState state)
Sets the store state of an entry to a specific value.
|
void |
UpdateableAdminData.setState(String fileName,
String replicaID,
ReplicaStoreState state)
Deprecated.
Sets the store state for the given file on the given bitarchive.
|
void |
ReplicaCacheDatabase.updateChecksumInformationForFileOnReplica(String filename,
String checksum,
Replica replica)
Method for updating a specific entry in the replicafileinfo table.
|
void |
ReplicaCacheDatabase.updateChecksumStatus(String filename)
Method for updating the status for a specific file for all the replicas.
|
Constructor and Description |
---|
ReplicaFileInfo(long gId,
String rId,
long fId,
long sId,
String cs,
int us,
int fs,
int css,
Date fDate,
Date cDate)
Constructor.
|
Modifier and Type | Method and Description |
---|---|
BatchStatus |
Bitarchive.batch(String bitarchiveAppId,
FileBatchJob job)
Run a batch job on all ARC entries in the archive.
|
void |
BitarchiveMonitor.bitarchiveReply(String bitarchiveBatchID,
String bitarchiveID,
int noOfFilesProcessed,
Collection<File> filesFailed,
RemoteFile remoteFile,
String errMsg,
List<FileBatchJob.ExceptionOccurrence> exceptions)
Handle a reply received from a bitarchive.
|
BitarchiveRecord |
Bitarchive.get(String arcfile,
long index)
Get an ARC or WARC record out of the archive.
|
File |
Bitarchive.getFile(String arcFileID)
Get a file for a given arcFileID.
|
File |
BitarchiveAdmin.getTemporaryPath(String arcFileName,
long requestedSize)
Returns a temporary place for the the file to be stored.
|
protected boolean |
BitarchiveAdmin.isBitarchiveDirectory(File theDir)
Checks whether a directory is one of the known bitarchive directories.
|
File |
BitarchiveAdmin.moveToStorage(File tempLocation)
Moves a file from temporary storage to file storage.
|
void |
BitarchiveMonitor.registerBatch(String requestID,
ChannelID requestReplyTo,
String bitarchiveBatchID,
long timeout)
Register a new batch sent to the bitarchives.
|
void |
BitarchiveAdmin.updateFileList(File basedir)
Method for updating the filelist for a given basedir.
|
void |
Bitarchive.upload(RemoteFile arcfile,
String fileName)
Upload an ARC file to this archive.
|
Constructor and Description |
---|
BitarchiveARCFile(String fn,
File fp)
Create a new representation of a file in the archive.
|
Modifier and Type | Method and Description |
---|---|
void |
GetFileMessage.getData(File toFile)
Writes the the content of the retrieved file into a local file.
|
static BitarchiveServer |
BitarchiveServer.getInstance()
Returns the unique instance of this class The server creates an instance of the bitarchive it provides access to
and starts to listen to JMS messages on the incomming jms queue
|
static AccessBitarchiveServer |
AccessBitarchiveServer.getInstance()
Returns the unique instance of this class The server creates an instance of the bitarchive it provides access to
and starts to listen to JMS messages on the incomming jms queue
|
BatchMessage |
BitarchiveClient.sendBatchJob(BatchMessage bMsg)
Submit an already constructed get message to the archive.
|
BatchMessage |
BitarchiveClient.sendBatchJob(ChannelID replyChannel,
FileBatchJob job)
Submit a batch job to the archive.
|
void |
BitarchiveClient.sendBatchTerminationMessage(String batchID)
Sends a message to terminate a running batchjob.
|
void |
BitarchiveClient.sendCorrectMessage(CorrectMessage msg)
For correcting an erroneous entry in the archive.
|
void |
BitarchiveClient.sendGetAllChecksumsMessage(GetAllChecksumsMessage msg)
Method for sending the GetAllChecksumMessage to the ChecksumReplica.
|
void |
BitarchiveClient.sendGetAllFilenamesMessage(GetAllFilenamesMessage msg)
Method for sending a GetAllFilenamesMessage to a checksum archive.
|
GetChecksumMessage |
BitarchiveClient.sendGetChecksumMessage(ChannelID replyChannel,
String filename)
Method for retrieving the checksum of a specific arcfile within the archive.
|
void |
BitarchiveClient.sendGetChecksumMessage(GetChecksumMessage msg)
Method for retrieving the checksum of a specific arcfile within the archive.
|
void |
BitarchiveClient.sendUploadMessage(RemoteFile rf,
String precomputedChecksum)
Submit an upload request to the bitarchive.
|
void |
RemoveAndGetFileMessage.setFile(File data)
Set the file this message should remove and return.
|
void |
BitarchiveMonitorServer.visit(BatchEndedMessage beMsg)
This is the message handling method for BatchEndedMessages.
|
void |
BitarchiveServer.visit(BatchMessage msg)
Process a batch job and send the result back to the client.
|
void |
BitarchiveMonitorServer.visit(BatchMessage inbMsg)
This is the message handling method for BatchMessages.
|
void |
BitarchiveServer.visit(BatchTerminationMessage msg) |
void |
BitarchiveMonitorServer.visit(CorrectMessage cm)
This is the first step in correcting a bad entry.
|
void |
BitarchiveMonitorServer.visit(GetAllChecksumsMessage msg)
Method for handling the GetAllChecksumsMessage.
|
void |
BitarchiveMonitorServer.visit(GetAllFilenamesMessage msg)
Method for handling the GetAllFilenamesMessage.
|
void |
BitarchiveMonitorServer.visit(GetChecksumMessage msg)
Method for handling the GetChecksumMessage.
|
void |
BitarchiveServer.visit(GetFileMessage msg)
Process a getFile request and send the result back to the client.
|
void |
BitarchiveServer.visit(GetMessage msg)
Process a get request and send the result back to the client.
|
void |
BitarchiveMonitorServer.visit(HeartBeatMessage hbMsg)
This is the message handling method for HeartBeatMessages.
|
void |
BitarchiveServer.visit(RemoveAndGetFileMessage msg)
Removes an arcfile from the bitarchive and returns the removed file as an remotefile.
|
void |
AccessBitarchiveServer.visit(RemoveAndGetFileMessage msg) |
void |
BitarchiveMonitorServer.visit(RemoveAndGetFileMessage msg)
This is the second step in correcting a bad entry.
|
void |
BitarchiveServer.visit(UploadMessage msg)
Process a upload request and send the result back to the client.
|
void |
AccessBitarchiveServer.visit(UploadMessage msg) |
void |
BitarchiveMonitorServer.visit(UploadMessage msg)
This is the third step in correcting a bad entry.
|
Constructor and Description |
---|
BatchEndedMessage(ChannelID to,
String baAppId,
String originatingBatchMsgId,
RemoteFile rf)
Message to signal from a BitarchiveServer to the BitarchiveMonitorServer that the Bit Archive Application
identified by BA_ApplicationId has completed its part of the batch job.
|
BatchMessage(ChannelID to,
ChannelID replyTo,
FileBatchJob job,
String replicaId,
String batchId,
String... arguments)
Creates a BatchMessage object which can be used to initiate a batch job.
|
BatchReplyMessage(ChannelID to,
ChannelID replyTo,
String originatingBatchMsgId,
int filesProcessed,
Collection<File> failedFiles,
RemoteFile resultFile)
Message to signal from BitarchiveMonitorServer that the batch job identified by originatingBatchMsgId is
completed.
|
BatchTerminationMessage(ChannelID to,
ChannelID replyTo,
String batchID)
Constructor.
|
BatchTerminationMessage(ChannelID to,
String batchID)
Constructor.
|
HeartBeatSender(ChannelID inReceiver,
BitarchiveServer inBaServer)
Constructs a HearBeatSender that sends heartbeats.
|
Modifier and Type | Method and Description |
---|---|
File |
DatabaseChecksumArchive.correct(String filename,
File correctFile) |
File |
ChecksumArchive.correct(String filename,
File correctFile)
Method for removing a bad entry from the archive.
|
File |
FileChecksumArchive.correct(String filename,
File correctFile)
Method for correcting a bad entry from the archive.
|
String |
FileChecksumArchive.getChecksum(String filename)
Method for retrieving the checksum of a record, based on the filename.
|
void |
FileChecksumArchive.upload(RemoteFile file,
String filename)
The method for uploading a file to the archive.
|
void |
FileChecksumArchive.upload(String checksum,
String filename) |
Modifier and Type | Method and Description |
---|---|
void |
CorrectMessage.getData(File toFile)
Retrieves the content of the remoteFile and writes it into the local file.
|
void |
GetAllChecksumsMessage.getData(File toFile)
Method for retrieving the resulting file.
|
static ChecksumClient |
ChecksumClient.getInstance(ChannelID theCRin)
The method for invoking an instance of this class.
|
BatchMessage |
ChecksumClient.sendBatchJob(BatchMessage msg)
Method for sending batch job messages to the replica.
|
BatchMessage |
ChecksumClient.sendBatchJob(ChannelID replyChannel,
FileBatchJob job)
Method for sending batch job messages to the replica.
|
void |
ChecksumClient.sendCorrectMessage(CorrectMessage msg)
Method for sending correct messages to the replica.
|
void |
ChecksumClient.sendGetAllChecksumsMessage(GetAllChecksumsMessage msg)
Method for sending the GetAllChecksumMessage to the ChecksumReplica.
|
void |
ChecksumClient.sendGetAllFilenamesMessage(GetAllFilenamesMessage msg)
Method for sending a GetAllFilenamesMessage to a checksum archive.
|
GetChecksumMessage |
ChecksumClient.sendGetChecksumMessage(ChannelID replyChannel,
String filename)
Method for retrieving the checksum of a specific arcfile within the archive.
|
void |
ChecksumClient.sendGetFileMessage(GetFileMessage gfm)
This method is intended to retrieve an arc-file from the archive.
|
void |
ChecksumClient.sendGetMessage(GetMessage msg)
This method is intended to retrieve a record from an arc-file within the archive.
|
void |
ChecksumClient.sendRemoveAndGetFileMessage(RemoveAndGetFileMessage msg)
This method is intended to retrieve an arc-file from the archive.
|
void |
ChecksumClient.sendUploadMessage(RemoteFile rf,
String precomputedChecksum)
Method for uploading a file to the archive.
|
void |
GetChecksumMessage.setChecksum(String cs)
Method for returning the result of the checksum.
|
void |
GetAllChecksumsMessage.setFile(File file)
Method for setting the resulting file.
|
void |
CorrectMessage.setRemovedFile(RemoteFile rf)
Sets the removed file.
|
void |
ChecksumFileServer.visit(CorrectMessage msg)
Method for correcting an entry in the archive.
|
void |
ChecksumFileServer.visit(GetAllChecksumsMessage msg)
Method for retrieving a map containing all the checksums and their corresponding filenames within the archive.
|
void |
ChecksumFileServer.visit(GetAllFilenamesMessage msg)
Method for retrieving all the filenames within the archive.
|
void |
ChecksumFileServer.visit(GetChecksumMessage msg)
Method for retrieving the checksum of a record.
|
void |
ChecksumFileServer.visit(UploadMessage msg)
The method for uploading arc files.
|
Constructor and Description |
---|
CorrectMessage(ChannelID to,
ChannelID replyTo,
String badChecksum,
RemoteFile rf,
String repId,
String cred)
Constructor.
|
Constructor and Description |
---|
ArchiveMessage(ChannelID to,
ChannelID replyTo)
Creates a new ArchiveMessage.
|
Modifier and Type | Method and Description |
---|---|
static void |
BatchGUI.getBatchOverviewPage(javax.servlet.jsp.PageContext context)
Method for creating the batchjob overview page.
|
static File |
BatchGUI.getJarFile(String classPath)
Method for retrieving and validating the arc-file for a given DOOM!
|
static String |
BatchGUI.getJobName(String classPath)
Method for extracting the name of the batchjob from the batchjob path.
|
static void |
BatchGUI.getPageForClass(javax.servlet.jsp.PageContext context)
Method for creating the page for a batchjob.
|
static PreservationState |
BitpreserveFileState.processChecksumRequest(StringBuilder res,
javax.servlet.jsp.PageContext context)
Processes a checksum request.
|
static Map<String,PreservationState> |
BitpreserveFileState.processMissingRequest(javax.servlet.jsp.PageContext context,
StringBuilder res)
Processes a missingFiles request.
|
static String |
BitpreserveFileState.processUpdateRequest(javax.servlet.jsp.PageContext context)
Extract the name of the replica (parameter Constants.BITARCHIVE_NAME_PARAM) and the type of update requested
(parameter Constants.UPDATE_TYPE_PARAM).
|
Constructor and Description |
---|
BatchExecuter(FileBatchJob job,
String pattern,
Replica replica)
The constructor.
|
BitpreservationUpdateThread(Replica replica,
BitpreservationUpdateType updateType)
Constructor for the BitpreservationUpdateThread.
|
Modifier and Type | Method and Description |
---|---|
BitarchiveRecord |
TrivialArcRepositoryClient.get(String arcfile,
long index)
Gets a single ARC record out of the ArcRepository.
|
BitarchiveRecord |
TestArcRepositoryClient.get(String arcfile,
long index) |
void |
TrivialArcRepositoryClient.store(File file)
Store the given file in the ArcRepository.
|
Modifier and Type | Method and Description |
---|---|
static ChannelID |
Channels.getBaMonForReplica(String replicaId)
Given an replica, returns the BAMON queue to which batch jobs must be sent in order to run them on that
bitarchive.
|
static ChannelID |
Channels.retrieveReplicaChannelFromReplicaId(String replicaId)
The method for retrieving the identification channel for a replica based on the Id of this replica.
|
static String |
Channels.retrieveReplicaChannelNameFromReplicaId(String replicaId)
The method for retrieving the name of the identification channel for a replica based on the Id of this replica.
|
static Replica |
Channels.retrieveReplicaFromIdentifierChannel(String channelName)
Method for extracting the replica from the name of the identifier channel.
|
static NetarkivetMessage |
JMSConnection.unpack(javax.jms.Message msg)
Unwraps a NetarkivetMessage from an ObjectMessage.
|
Modifier and Type | Method and Description |
---|---|
BatchStatus |
LocalArcRepositoryClient.batch(FileBatchJob job,
String replicaId,
String... args)
Runs a batch job on each file in the ArcRepository.
|
File |
LocalArcRepositoryClient.correct(String replicaId,
String checksum,
File file,
String credentials)
Method for correcting a bad entry.
|
BitarchiveRecord |
LocalArcRepositoryClient.get(String arcfile,
long index)
Gets a single ARC record out of the ArcRepository.
|
BitarchiveRecord |
PreservationArcRepositoryClient.get(String arcfile,
long index)
Gets a single ARC record out of the ArcRepository.
|
BitarchiveRecord |
ViewerArcRepositoryClient.get(String arcfile,
long index)
Gets a single ARC record out of the ArcRepository.
|
BitarchiveRecord |
ArcRepositoryClient.get(String arcfile,
long index)
Gets a single ARC record out of the ArcRepository.
|
File |
LocalArcRepositoryClient.getAllChecksums(String replicaId)
Method for retrieving the checksums of all the files of the replica.
|
File |
LocalArcRepositoryClient.getAllFilenames(String replicaId)
Method for retrieving all the filenames of the replica.
|
String |
LocalArcRepositoryClient.getChecksum(String replicaId,
String filename)
Method for finding the checksum of a file.
|
void |
LocalArcRepositoryClient.store(File file)
Store the given file in the ArcRepository.
|
void |
PreservationArcRepositoryClient.store(File file)
Store the given file in the ArcRepository.
|
void |
ArcRepositoryClient.store(File file)
Store the given file in the ArcRepository.
|
void |
HarvesterArcRepositoryClient.store(File file)
Store the given file in the ArcRepository.
|
Modifier and Type | Method and Description |
---|---|
static <T> String |
StringUtils.conjoin(String separator,
Collection<T> objects,
int max)
Concatenate the string representation of a maximum number of objects in a collection with a given separator
between them.
|
static String |
Settings.get(String key)
Gets a setting.
|
static String[] |
Settings.getAll(String key)
Gets a list of settings.
|
static boolean |
Settings.getBoolean(String key)
Gets a setting as a boolean.
|
static double |
Settings.getDouble(String key)
Gets a setting as a double.
|
static String |
StreamUtils.getInputStreamAsString(InputStream in)
Reads an input stream and returns it as a string.
|
static int |
Settings.getInt(String key)
Gets a setting as an int.
|
static long |
Settings.getLong(String key)
Gets a setting as a long.
|
static String |
DomainUtils.reduceHostname(String hostname)
Reduce a hostname to a more readable form.
|
Modifier and Type | Method and Description |
---|---|
void |
ARCBatchJob.handleException(Exception e,
File arcfile,
long index)
When the org.archive.io.arc classes throw IOExceptions while reading, this is where they go.
|
boolean |
ARCBatchJob.processFile(File arcFile,
OutputStream os)
Accepts only ARC and ARCGZ files.
|
Modifier and Type | Method and Description |
---|---|
void |
ArchiveBatchJobBase.handleException(Exception e,
File archiveFile,
long index)
When the org.archive.io.arc classes throw IOExceptions while reading, this is where they go.
|
boolean |
ArchiveBatchJob.processFile(File archiveFile,
OutputStream os)
Accepts only arc(.gz) and warc(.gz) files.
|
Modifier and Type | Method and Description |
---|---|
static KeyValuePair<String,String> |
ChecksumJob.parseLine(String line)
Parse a line of output into a key-value pair.
|
Constructor and Description |
---|
BatchLocalFiles(File[] incomingFiles)
Given an array of files, constructs a BatchLocalFiles instance to be used in running a batch job over those
files.
|
LoadableFileBatchJob(File classFile,
List<String> arguments)
Create a new batch job that runs the loaded class.
|
LoadableJarBatchJob(String jobClass,
List<String> arguments,
File... jarFiles)
Load a given class from a jar file.
|
Modifier and Type | Method and Description |
---|---|
void |
CDXReader.addCDXRecordFilter(CDXRecordFilter cdxrecfilter)
Add another CDXRecordFilter to the list of filters to use when searching.
|
static void |
CDXUtils.generateCDX(ArchiveProfile archiveProfile,
File archiveFileDirectory,
File cdxFileDirectory)
Applies createCDXRecord() to all ARC/WARC files in a directory, creating one CDX file per ARC/WARC file.
|
Constructor and Description |
---|
ARCFilenameCDXRecordFilter(String arcfilenamepattern,
String filtername)
Class constructor.
|
SimpleCDXRecordFilter(String filtername) |
Modifier and Type | Method and Description |
---|---|
void |
WARCBatchJob.handleException(Exception e,
File warcfile,
long index)
When the org.archive.io.arc classes throw IOExceptions while reading, this is where they go.
|
boolean |
WARCBatchJob.processFile(File warcFile,
OutputStream os)
Accepts only WARC and WARCGZ files.
|
Modifier and Type | Method and Description |
---|---|
static String |
Constants.changeToXMLBeginScope(String scope)
Create the beginning of a scope in XML (e.g.
|
static String |
Constants.changeToXMLEndScope(String scope)
Create the ending of a scope in XML (e.g.
|
static String |
ScriptConstants.doubleBackslashes(String path)
Changes a string into correct formatted style.
|
static String |
ScriptConstants.getLinuxPIDS(String totalName,
String path,
String id)
Creates the script for extracting the processes of a specific application, depending on the name of the
application and the settings file.
|
void |
Parameters.newParameters(org.dom4j.Element root)
Overwrites the inherited parameters, if the root has new specified.
|
static String |
ScriptConstants.replaceWindowsDirSeparators(String path)
Changes a string into correct formatted style.
|
static boolean |
Constants.validEnvironmentName(String name)
Checks whether a string is valid for environment name.
|
void |
PhysicalLocation.write(File directory)
Initiate the creation of global scripts and machine scripts.
|
void |
Machine.write(File parentDirectory)
Create the directory for the specific configurations of this machine and call the functions for creating all the
scripts in this directory.
|
static String |
ScriptConstants.writeInstallMachineHeader(String login)
The header for the install all script for the machine.
|
static String |
ScriptConstants.writeKillMachineHeader(String login)
The header for the kill all script for the machine.
|
static String |
ScriptConstants.writeSecurityPolicyDirPermission(String dir)
For giving readonly permission to a directory in the security policy.
|
static String |
ScriptConstants.writeStartMachineHeader(String login)
The header for the start all script for the machine.
|
Constructor and Description |
---|
DeployConfiguration(File deployConfigFileName,
File netarchiveSuiteFileName,
File secPolicyFileName,
File slf4jConfigFileName,
String outputDirName,
File dbFileName,
File arcdbFileName,
boolean resetDir,
File externalJarFolder,
String sourceEncoding,
File defaultBundlerZip)
Constructor.
|
Machine(org.dom4j.Element subTreeRoot,
XmlStructure parentSettings,
Parameters param,
String netarchiveSuiteSource,
File slf4JConfig,
File securityPolicy,
File dbFileName,
File archiveDbFileName,
boolean resetDir,
File externalJarFolder)
A machine is referring to an actual computer at a physical location, which can have independent applications from
the other machines at the same location.
|
Parameters(Parameters parent)
Constructor.
|
Parameters(XmlStructure root)
Constructor.
|
PhysicalLocation(org.dom4j.Element subTreeRoot,
XmlStructure parentSettings,
Parameters param,
String netarchiveSuiteSource,
File slf4JConfig,
File securityPolicy,
File dbFile,
File arcdbFile,
boolean resetDir,
File externalJarFolder,
DeployConfiguration deployConfiguration)
The physical locations is referring to the position in the real world where the computers are located.
|
Modifier and Type | Method and Description |
---|---|
abstract int |
GlobalCrawlerTrapListDAO.create(GlobalCrawlerTrapList trapList)
This method creates the object in the database and has the side effect of setting the trapLists id field to the
auto-generated id in the database.
|
HarvestChannel |
HarvestChannelDBDAO.getById(long id) |
abstract HarvestChannel |
HarvestChannelDAO.getById(long id)
Retrieves a
HarvestChannel by its UID. |
HarvestChannel |
HarvestChannelDBDAO.getByName(String name) |
abstract HarvestChannel |
HarvestChannelDAO.getByName(String name)
Retrieves a
HarvestChannel by its unique name. |
abstract Job |
JobDAO.read(long jobID)
Reads a job from persistent storage.
|
void |
Job.setActualStop(Date actualStop)
Set the actual time when this job was stopped/completed.
|
void |
GlobalCrawlerTrapList.setTrapsFromInputStream(InputStream is,
String listName)
A utility method to read the list of traps from an InputStream, line-by-line.
|
void |
H1HeritrixTemplate.writeTemplate(OutputStream os) |
abstract void |
HeritrixTemplate.writeTemplate(OutputStream os) |
Constructor and Description |
---|
AliasInfo(String domain,
String aliasOf,
Date lastChange)
Constructor for the AliasInfo class.
|
GlobalCrawlerTrapList(InputStream is,
String name,
String description,
boolean isActive)
Construct a new GlobalCrawlerTrapList from an input stream consisting of newline-separated regular expressions.
|
GlobalCrawlerTrapList(int id,
List<String> traps,
String name,
String description,
boolean isActive)
Protected constructor used by the DAO to create instances of this class.
|
Job(Long harvestID,
DomainConfiguration cfg,
HeritrixTemplate orderXMLdoc,
HarvestChannel channel,
long forceMaxObjectsPerDomain,
long forceMaxBytesPerDomain,
long forceMaxJobRunningTime,
int harvestNum)
Package private constructor for common initialisation.
|
Modifier and Type | Method and Description |
---|---|
abstract ExtendedField |
ExtendedFieldDAO.read(Long aExtendedFieldID)
Reads an ExtendedField from persistent storage.
|
Modifier and Type | Method and Description |
---|---|
static HeritrixLauncher |
HeritrixLauncherFactory.getInstance(Object... args)
Returns an instance of the default
HeritrixLauncher implementation defined by the setting
dk.netarkivet.harvester.harvesting.heritrixLauncher.class . |
static ArchiveFileNaming |
ArchiveFileNamingFactory.getInstance(Object... args)
Returns an instance of the default
ArchiveFileNaming implementation defined by the setting
settings.harvester.harvesting.heritrix.archiveNaming.class . |
void |
HarvestController.runHarvest(HeritrixFiles files)
Creates the actual HeritrixLauncher instance and runs it, after the various setup files have been written.
|
HarvestReport |
HarvestController.storeFiles(HeritrixFiles files,
StringBuilder errorMessage,
List<File> failedFiles)
Controls storing all files involved in a job.
|
Constructor and Description |
---|
HeritrixLauncher(HeritrixFiles files)
Private HeritrixLauncher constructor.
|
Modifier and Type | Method and Description |
---|---|
static HeritrixController |
HeritrixControllerFactory.getDefaultHeritrixController(Object... args)
Returns an instance of the default HeritrixController implementation defined by the setting
dk.netarkivet.harvester.harvesting.heritrixController.class .
|
static DefaultHeritrixLauncher |
DefaultHeritrixLauncher.getInstance(HeritrixFiles files)
Get instance of this class.
|
static BnfHeritrixLauncher |
BnfHeritrixLauncher.getInstance(HeritrixFiles files)
Get instance of this class.
|
Modifier and Type | Method and Description |
---|---|
void |
HarvestControllerServer.visit(DoOneCrawlMessage msg)
Receives a DoOneCrawlMessage and call onDoOneCrawl.
|
Constructor and Description |
---|
DoOneCrawlMessage(Job submittedJob,
ChannelID to,
HarvestDefinitionInfo harvestInfo,
List<MetadataEntry> metadata)
A NetarkivetMessage that contains a Job for Heritrix.
|
Modifier and Type | Method and Description |
---|---|
static URI |
MetadataFileWriter.getAlternateCDXURI(long jobID,
String filename)
Generates a URI identifying CDX info for one harvested ARC file.
|
static URI |
MetadataFileWriter.getCDXURI(String harvestID,
String jobID,
String filename)
Generates a URI identifying CDX info for one harvested (W)ARC file.
|
static String |
MetadataFileWriter.getMetadataArchiveFileName(String jobID,
Long harvestID)
Generates a name for an archive(ARC/WARC) file containing metadata regarding a given job.
|
Modifier and Type | Method and Description |
---|---|
static HarvestReport |
HarvestReportFactory.generateHarvestReport(Object... args)
Returns an instance of the default
HarvestReport implementation defined by the setting
HarvesterSettings.HARVEST_REPORT_CLASS . |
Long |
HarvestReport.getByteCount(String domainName)
Get the number of bytes downloaded for the given domain.
|
Long |
HarvestReport.getObjectCount(String domainName)
Get the number of objects found for the given domain.
|
StopReason |
HarvestReport.getStopReason(String domainName)
Get the StopReason for the given domain.
|
Modifier and Type | Method and Description |
---|---|
static HeritrixLauncherAbstract |
HeritrixLauncherFactory.getInstance(Object... args)
Returns an instance of the default
HeritrixLauncherAbstract implementation defined by the setting
dk.netarkivet.harvester.harvesting.heritrixLauncher.class . |
void |
HarvestJob.runHarvest()
Creates the actual HeritrixLauncher instance and runs it, after the various setup files have been written.
|
void |
HarvestControllerServer.visit(DoOneCrawlMessage msg)
Checks that we're available to do a crawl, and if so, marks us as unavailable, checks that the job message is
well-formed, and starts the thread that the crawl happens in.
|
Constructor and Description |
---|
HeritrixLauncherAbstract(Heritrix3Files files)
Private HeritrixLauncher constructor.
|
Modifier and Type | Method and Description |
---|---|
static IHeritrixController |
HeritrixControllerFactory.getDefaultHeritrixController(Object... args)
Returns an instance of the default HeritrixController implementation defined by the setting
dk.netarkivet.harvester.harvesting.heritrixController.class .
|
static HeritrixLauncher |
HeritrixLauncher.getInstance(Heritrix3Files files,
String jobName)
Get instance of this class.
|
Modifier and Type | Method and Description |
---|---|
static HarvestReport |
HarvestReportFactory.generateHarvestReport(Object... args)
Returns an instance of the default
HarvestReport implementation defined by the setting
HarvesterSettings.HARVEST_REPORT_CLASS . |
Modifier and Type | Method and Description |
---|---|
static IndexRequestServerInterface |
IndexRequestServerFactory.getInstance()
Returns an instance of the chosen IndexRequestServerInterface implementation defined by the setting
settings.archive.indexserver.indexrequestserver.class .
|
Modifier and Type | Method and Description |
---|---|
protected Set<Long> |
IndexRequestClient.cacheData(Set<Long> jobSet)
This method makes sure the actual caching of underlying data is done using the index server.
|
static IndexRequestClient |
IndexRequestClient.getInstance(RequestType type)
Factory method returning an IndexRequestClient for the given type of index cache.
|
void |
IndexRequestClient.requestIndex(Set<Long> jobSet,
Long harvestId)
Method to request an Index without having the result sent right away.
|
void |
IndexRequestMessage.setFoundJobs(Set<Long> foundJobs)
On reply, set the set of jobs for which an index is found.
|
void |
IndexRequestMessage.setResultFile(RemoteFile resultFile)
On reply, set remote file containing index of requested jobs.
|
void |
IndexRequestMessage.setResultFiles(List<RemoteFile> resultFiles)
Set several result files making up an index of requested jobs.
|
void |
IndexRequestServer.visit(IndexRequestMessage irMsg)
Given a request for an index over a set of job ids, use a cache to try to create the index, Then reply result.
|
void |
TestIndexRequestServer.visit(IndexRequestMessage irMsg)
Given a request for an index over a set of job ids, use a cache to try to create the index, Then reply result.
|
Constructor and Description |
---|
IndexRequestMessage(RequestType requestType,
Set<Long> jobSet,
RemoteFileSettings ftpconnectionInfo)
Generate an index request message.
|
Modifier and Type | Method and Description |
---|---|
void |
JobDispatcher.doOneCrawl(Job job,
String origHarvestName,
String origHarvestDesc,
String origHarvestSchedule,
HarvestChannel channel,
String origHarvestAudience,
List<MetadataEntry> metadata)
Submit an doOneCrawl request to a HarvestControllerServer.
|
Modifier and Type | Method and Description |
---|---|
static JobGenerator |
JobGeneratorFactory.getInstance(Object... args)
Returns an instance of the configured
JobGenerator implementation defined by the setting
HarvesterSettings.JOBGEN_CLASS . |
Modifier and Type | Method and Description |
---|---|
static void |
DomainDefinition.CreateDomainDefinitionListInRequest(javax.servlet.http.HttpServletRequest request,
javax.servlet.http.HttpServletResponse response,
javax.servlet.jsp.PageContext pageContext,
I18n I18N)
Create the domain definition list for the jsp page.
|
void |
HarvestStatusJobDetails.PrintPageContent(javax.servlet.jsp.JspWriter out,
I18n I18N,
Locale locale) |
Constructor and Description |
---|
HarvestStatusJobDetails(javax.servlet.http.HttpServletResponse response,
javax.servlet.jsp.PageContext pageContext,
I18n I18N)
Constuctor for jsp Harveststatus-jobdetails.jsp.
|
Modifier and Type | Method and Description |
---|---|
static String |
JMXSummaryUtils.createJMXQuery(String[] parameters,
JMXSummaryUtils.StarredRequest starredRequest)
Build a JMX query string (ObjectName) from a request and a list of parameters to query for.
|
static String |
JMXSummaryUtils.generateLink(JMXSummaryUtils.StarredRequest request,
String setPart,
String setValue,
String linkText)
Generate an HTML link to the JMX summary page with one part of the URL parameters set to a specific value.
|
static String |
JMXSummaryUtils.generateMessage(String logMessage,
Locale l)
Make an HTML fragment that shows a log message preformatted.
|
static String |
JMXSummaryUtils.generateShowAllLink(JMXSummaryUtils.StarredRequest starredRequest,
String parameter,
Locale l)
Generate HTML to show at the top of the table, containing a "show all" link if the parameter is currently
restricted.
|
static String |
JMXSummaryUtils.generateShowColumn(JMXSummaryUtils.StarredRequest starredRequest,
Locale l)
Creates the show links for showing columns again.
|
static String |
JMXSummaryUtils.generateShowLink(JMXSummaryUtils.StarredRequest starredRequest,
String parameter,
Locale l)
Generate HTML to show at the top of the table, containing a "show all" and a "off" links if the parameter is
currently restricted.
|
String |
JMXSummaryUtils.StarredRequest.getParameter(String paramName)
Gets a parameter from the original request, except if the parameter is unset, return the following.
|
static List<StatusEntry> |
JMXSummaryUtils.queryJMXFromRequest(String[] parameters,
JMXSummaryUtils.StarredRequest request,
javax.servlet.jsp.PageContext context)
Get status entries from JMX based on a request and some parameters.
|
static String |
JMXSummaryUtils.reduceApplicationName(String applicationName)
Reduce the class name of an application to the essentials.
|
static void |
JMXSummaryUtils.RemoveApplication(javax.servlet.http.HttpServletRequest request,
javax.servlet.http.HttpServletResponse response,
javax.servlet.jsp.PageContext pageContext)
Remove an application.
|
static boolean |
JMXSummaryUtils.showColumn(JMXSummaryUtils.StarredRequest starredRequest,
String parameter)
Tests if a parameter in the request is "-" (thus off).
|
static void |
JMXSummaryUtils.unregisterJMXInstance(String[] parameters,
JMXSummaryUtils.StarredRequest request,
javax.servlet.jsp.PageContext context)
Select zero or more beans from JMX and unregister these.
|
Constructor and Description |
---|
StarredRequest(javax.servlet.http.HttpServletRequest req)
Makes the request reusable for this class.
|
Copyright © 2005–2016 The Royal Danish Library, the Danish State and University Library, the National Library of France and the Austrian National Library.. All rights reserved.