public class DomainnameQueueAssignmentPolicy extends org.archive.crawler.frontier.HostnameQueueAssignmentPolicy
Constructor and Description |
---|
DomainnameQueueAssignmentPolicy() |
Modifier and Type | Method and Description |
---|---|
protected String |
getCoreKey(org.archive.net.UURI basis)
Return a key for queue names based on domain names (last two parts of
host name) or IP address.
|
bucketBasis, getClassKey, getDeferToPrevious, getParallelQueues, getSubqueue, setDeferToPrevious, setParallelQueues
getForceQueueAssignment, getKeyedProperties, maximumNumberOfKeys, setForceQueueAssignment
public DomainnameQueueAssignmentPolicy()
protected String getCoreKey(org.archive.net.UURI basis)
getCoreKey
in class org.archive.crawler.frontier.HostnameQueueAssignmentPolicy
basis
- A potential URI.URIAuthorityBasedQueueAssignmentPolicy.getClassKey(org.archive.modules.CrawlURI)
Copyright © 2005–2018 The Royal Danish Library, the National Library of France and the Austrian National Library.. All rights reserved.