Loading...

XML

Word

Printable

Details

Type: New Feature
Resolution: Fixed
Priority: Major
Fix Version/s: 3.18.0, I49
Affects Version/s: 3.14.0, 3.16.1
Component/s: None
Labels:
None

Organization:

SB/KB
Accuracy of estimate:
Confident

Verification:

Hide

Install NetarchiveSuite on a single machine.
Get 100-200 metadata-arc files from your production environment
Store them on the machine where the IndexserverApplication is installed.
Change the settings of the Indexserverapplication to use the LocalArcrepositoryClient
Start the IndexserverApplication. Ignore the other apps.
Send a message to the Indexserver asking for a dedup index for the 100-200 jobs
This shouldn't be sent back to the sender

Show
Install NetarchiveSuite on a single machine. Get 100-200 metadata-arc files from your production environment Store them on the machine where the IndexserverApplication is installed. Change the settings of the Indexserverapplication to use the LocalArcrepositoryClient Start the IndexserverApplication. Ignore the other apps. Send a message to the Indexserver asking for a dedup index for the 100-200 jobs This shouldn't be sent back to the sender

Description

The generation of the deduplication indices is very timeconsuming, and inefficient.
One should maybe to parallelize some of the processing done in the dk.netarkivet.archive.indexserver-CrawlLogIndexCache

Attachments

Activity

People

Assignee:: Søren Vejrup Carlsen (Inactive)

Reporter:: Søren Vejrup Carlsen (Inactive)

Inspector:: Colin Rosenthal

Watchers:: 0 Start watching this issue

Dates

Created:: 31/May/11 2:19 PM

Updated:: 15/Nov/11 2:22 PM

Resolved:: 15/Nov/11 2:22 PM

Time Tracking

Estimated:

35h

Remaining:

Logged:

13h