Export - CSV (All fields)
Export - CSV (Current fields)
NAS-2758
Multiple Metadatacache objects started by the IndexServerApplication
We always look for duplicationmigration records during indexingNAS-2736
Making indexes for jobs with very large migration records can cause OOM
Incomplete lines in the duplicationMigration are not caught in RawMetadataCache.migrateDuplicates()
Indexserver fails during indexing to substitute properly duplicate-records in old metadata files with the old duplicate annotation
Even when the preemptive indexing operation fails the HarvestJobManager still starts generating jobs
Let it be a setting whether to clear the requests directory or not
When asking for the same index twice, the indexserver fails to find data for a small number of jobs
The Index generating batchjob RawMetadataCache fails after having added warc-info record to the metadata file
The dedup indices contains more segments (72 files) than the max limit set by the settings ( 42 segments)
Generation of deduplication indices for snapshot harvesting index produces more than one index for the same set of JOB-IDS.
Restrictions on how many external sort processes are run simultaneously
Only one indexing operation allowed at a time
The indexes generated by the Indexserver has too big a memory demandNAS-2045
Roll back of multi threaded indexing - while examining how to reduce the memory demands of lucene in Heritrix
IDs in messages sent to the Indexserver are not unique!
Change the way the Indexserver names the indices constructed
indexserver tries to generate deduplication indexes based on unfinished selective harvestsNAS-1998
Indexing statistics measures the wrong size in CrawlLogIndexCache.combine
It is difficult to see which data the indexserver cannot retrieve when generating the deduplication index
Indexes with no objects in them should at least give a warning of some kind
.working filer bliver ikke slettet
{"searchers":{"groups":[{"searchers":[{"name":"Project","id":"project","key":"issue.field.project","isShown":true,"lastViewed":1685686204446},{"name":"Summary","id":"summary","key":"issue.field.summary","isShown":true},{"name":"Type","id":"issuetype","key":"issue.field.issuetype","isShown":true,"lastViewed":1685686204447},{"name":"Status","id":"status","key":"issue.field.status","isShown":true,"lastViewed":1685686204452},{"name":"Priority","id":"priority","key":"issue.field.priority","isShown":true},{"name":"Resolution","id":"resolution","key":"issue.field.resolution","isShown":true},{"name":"Creator","id":"creator","key":"issue.field.creator","isShown":true},{"name":"Affects Version","id":"version","key":"issue.field.affectsversions","isShown":true},{"name":"Fix Version","id":"fixfor","key":"issue.field.fixversions","isShown":true},{"name":"Component","id":"component","key":"issue.field.components","isShown":true,"lastViewed":1685686204454},{"name":"% Limits","id":"workratio","key":"issue.field.workratio","isShown":true},{"name":"Link types","id":"issue_link_type","key":"issue.field.issuelinks","isShown":true},{"name":"Description","id":"description","key":"issue.field.description","isShown":true},{"name":"Comment","id":"comment","key":"issue.field.comment","isShown":true},{"name":"Label","id":"labels","key":"issue.field.labels","isShown":true},{"name":"Query","id":"text","key":"text","isShown":true},{"name":"Accuracy of estimate","id":"customfield_10057","key":"com.atlassian.jira.plugin.system.customfieldtypes:select","isShown":true},{"name":"Business Value","id":"customfield_10003","key":"com.atlassian.jira.plugin.system.customfieldtypes:float","isShown":false},{"name":"Development","id":"customfield_10470","key":"com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary","isShown":true},{"name":"Epic Colour","id":"customfield_10273","key":"com.pyxis.greenhopper.jira:gh-epic-color","isShown":false},{"name":"Epic Link","id":"customfield_10270","key":"com.pyxis.greenhopper.jira:gh-epic-link","isShown":true},{"name":"Epic Name","id":"customfield_10271","key":"com.pyxis.greenhopper.jira:gh-epic-label","isShown":true},{"name":"Epic Status","id":"customfield_10272","key":"com.pyxis.greenhopper.jira:gh-epic-status","isShown":false},{"name":"Epic/Theme","id":"customfield_10030","key":"com.atlassian.jira.plugin.system.customfieldtypes:labels","isShown":true},{"name":"External reference","id":"customfield_10010","key":"com.atlassian.jira.plugin.system.customfieldtypes:textfield","isShown":true},{"name":"Flagged","id":"customfield_10000","key":"com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes","isShown":true},{"name":"GforgeID","id":"customfield_10052","key":"com.atlassian.jira.plugin.system.customfieldtypes:textfield","isShown":true},{"name":"Global Rank","id":"customfield_10070","key":"com.pyxis.greenhopper.jira:gh-global-rank","isShown":true},{"name":"Organization","id":"customfield_10058","key":"com.atlassian.jira.plugin.system.customfieldtypes:multiselect","isShown":true},{"name":"Original story points","id":"customfield_10573","key":"com.atlassian.jpo:jpo-custom-field-original-story-points","isShown":true},{"name":"Parent Link","id":"customfield_10570","key":"com.atlassian.jpo:jpo-custom-field-parent","isShown":false},{"name":"Rank","id":"customfield_10370","key":"com.pyxis.greenhopper.jira:gh-lexo-rank","isShown":true},{"name":"Rank (Obsolete)","id":"customfield_10001","key":"com.atlassian.jira.plugin.system.customfieldtypes:float","isShown":false},{"name":"Rank (Obsolete)","id":"customfield_10170","key":"com.pyxis.greenhopper.jira:gh-global-rank","isShown":true},{"name":"Release Version History","id":"customfield_10012","key":"com.pyxis.greenhopper.jira:greenhopper-releasedmultiversionhistory","isShown":true},{"name":"Sprint","id":"customfield_10171","key":"com.pyxis.greenhopper.jira:gh-sprint","isShown":true},{"name":"Story Points","id":"customfield_10002","key":"com.atlassian.jira.plugin.system.customfieldtypes:float","isShown":false},{"name":"Team","id":"customfield_10574","key":"com.atlassian.teams:rm-teams-custom-field-team","isShown":true},{"name":"Verification","id":"customfield_10060","key":"com.atlassian.jira.plugin.system.customfieldtypes:textarea","isShown":true}],"type":"DETAILS","title":"Details"},{"searchers":[{"name":"Created Date","id":"created","key":"issue.field.created","isShown":true},{"name":"Updated Date","id":"updated","key":"issue.field.updated","isShown":true},{"name":"Resolution Date","id":"resolutiondate","key":"issue.field.resolution.date","isShown":true},{"name":"Due Date","id":"duedate","key":"issue.field.duedate","isShown":true},{"name":"Target end","id":"customfield_10572","key":"com.atlassian.jpo:jpo-custom-field-baseline-end","isShown":true},{"name":"Target start","id":"customfield_10571","key":"com.atlassian.jpo:jpo-custom-field-baseline-start","isShown":true}],"type":"DATES","title":"Dates"},{"searchers":[{"name":"Assignee","id":"assignee","key":"issue.field.assignee","isShown":true,"lastViewed":1685686204453},{"name":"Reporter","id":"reporter","key":"issue.field.reporter","isShown":true},{"name":"Inspector","id":"customfield_10011","key":"com.atlassian.jira.plugin.system.customfieldtypes:userpicker","isShown":true}],"type":"PEOPLE","title":"People"}]},"values":{"issuetype":{"name":"Type","editHtml":"\n\n\n\n <div class=\"field-group aui-field-issuetype\" >\n <label for=\"searcher-type\">Type</label> <select class=\"select js-default-checkboxmultiselect\" id=\"searcher-type\" multiple=\"multiple\" name=\"type\"\n data-placeholder-text=\"Find Issue Types...\" size=\"5\">\n <optgroup>\n \n <option class=\" \"\n id=\"type_-2\"\n title=\"All Standard Issue Types\"\n value=\"-2\">All Standard Issue Types</option>\n \n <option class=\" \"\n id=\"type_-3\"\n title=\"All Sub-Task Issue Types\"\n value=\"-3\">All Sub-Task Issue Types</option>\n </optgroup>\n\n <optgroup label=\"Standard Issue Types\">\n \n <option class=\" imagebacked 10000 \"\n data-icon=\"/jira/secure/viewavatar?size=xsmall&avatarId=11103&avatarType=issuetype\"\n data-fallback-icon=\"/jira/images/icons/issuetypes/blank.png\"\n id=\"type_1\"\n title=\"Bug\"\n value=\"1\">Bug</option>\n \n <option class=\" imagebacked 10000 \"\n data-icon=\"/jira/secure/viewavatar?size=xsmall&avatarId=11107&avatarType=issuetype\"\n data-fallback-icon=\"/jira/images/icons/issuetypes/blank.png\"\n id=\"type_6\"\n title=\"Epic\"\n value=\"6\">Epic</option>\n \n <option class=\" imagebacked 10000 \"\n data-icon=\"/jira/secure/viewavatar?size=xsmall&avatarId=11110&avatarType=issuetype\"\n data-fallback-icon=\"/jira/images/icons/issuetypes/blank.png\"\n id=\"type_4\"\n title=\"Improvement\"\n value=\"4\">Improvement</option>\n \n <option class=\" imagebacked 10000 \"\n data-icon=\"/jira/secure/viewavatar?size=xsmall&avatarId=11111&avatarType=issuetype\"\n data-fallback-icon=\"/jira/images/icons/issuetypes/blank.png\"\n id=\"type_2\"\n title=\"New Feature\"\n value=\"2\">New Feature</option>\n \n <option class=\" imagebacked 10000 \"\n data-icon=\"/jira/secure/viewavatar?size=xsmall&avatarId=11115&avatarType=issuetype\"\n data-fallback-icon=\"/jira/images/icons/issuetypes/blank.png\"\n id=\"type_7\"\n title=\"Story\"\n value=\"7\">Story</option>\n \n <option class=\" imagebacked 10000 \"\n data-icon=\"/jira/secure/viewavatar?size=xsmall&avatarId=11118&avatarType=issuetype\"\n data-fallback-icon=\"/jira/images/icons/issuetypes/blank.png\"\n id=\"type_3\"\n title=\"Task\"\n value=\"3\">Task</option>\n </optgroup>\n\n <optgroup label=\"Sub-Task Issue Types\">\n \n <option class=\" imagebacked 10000 \"\n data-icon=\"/jira/secure/viewavatar?size=xsmall&avatarId=11116&avatarType=issuetype\"\n data-fallback-icon=\"/jira/images/icons/issuetypes/blank.png\"\n id=\"type_9\"\n title=\"Specification\"\n value=\"9\">Specification</option>\n \n <option class=\" imagebacked 10000 \"\n data-icon=\"/jira/secure/viewavatar?size=xsmall&avatarId=11116&avatarType=issuetype\"\n data-fallback-icon=\"/jira/images/icons/issuetypes/blank.png\"\n id=\"type_5\"\n title=\"Sub-task\"\n value=\"5\">Sub-task</option>\n \n <option class=\" imagebacked 10000 \"\n data-icon=\"/jira/download/resources/com.pyxis.greenhopper.jira:greenhopper-webactions/images/ico_task.png\"\n data-fallback-icon=\"/jira/images/icons/issuetypes/blank.png\"\n id=\"type_8\"\n title=\"Technical task\"\n value=\"8\">Technical task</option>\n \n <option class=\" imagebacked 10000 \"\n data-icon=\"/jira/secure/viewavatar?size=xsmall&avatarId=11116&avatarType=issuetype\"\n data-fallback-icon=\"/jira/images/icons/issuetypes/blank.png\"\n id=\"type_10\"\n title=\"Test\"\n value=\"10\">Test</option>\n </optgroup>\n </select>\n </div>\n ","validSearcher":true,"isShown":true},"component":{"name":"Component","viewHtml":" <div class=\"searcherValue\">\n \n <label class=\"fieldLabel\" for=\"fieldcomponent\">Component:</label><span id=\"fieldcomponent\" class=\"fieldValue\">\n \n IndexServer </span></div>\n","editHtml":"\n <div class=\"field-group aui-field-projectconstant\" >\n <label for=\"searcher-component\">Component</label> <select class=\"select js-default-checkboxmultiselect\" id=\"searcher-component\" multiple=\"multiple\" name=\"component\" size=\"2\" aria-label=\"Search for components\">\n <optgroup label=\"\">\n <option value=\"-1\" title=\"No Component\">No Component</option>\n </optgroup>\n <optgroup label=\"\">\n <option value=\"id:Archive\" title=\"Archive\">Archive</option>\n <option value=\"id:Batch\" title=\"Batch\">Batch</option>\n <option value=\"id:Bitpreservation\" title=\"Bitpreservation\">Bitpreservation</option>\n <option value=\"id:Build managment\" title=\"Build managment\">Build managment</option>\n <option value=\"id:Common\" title=\"Common\">Common</option>\n <option value=\"id:compression-workflow\" title=\"compression-workflow\">compression-workflow</option>\n <option value=\"id:deduplication\" title=\"deduplication\">deduplication</option>\n <option value=\"id:Deploy\" title=\"Deploy\">Deploy</option>\n <option value=\"id:Derby\" title=\"Derby\">Derby</option>\n <option value=\"id:Documentation\" title=\"Documentation\">Documentation</option>\n <option value=\"id:GUI\" title=\"GUI\">GUI</option>\n <option value=\"id:H3 Scripting\" title=\"H3 Scripting\">H3 Scripting</option>\n <option value=\"id:H3-extensions\" title=\"H3-extensions\">H3-extensions</option>\n <option value=\"id:Harvest Definition\" title=\"Harvest Definition\">Harvest Definition</option>\n <option value=\"id:Harvest Monitor\" title=\"Harvest Monitor\">Harvest Monitor</option>\n <option value=\"id:Harvester Controller Server\" title=\"Harvester Controller Server\">Harvester Controller Server</option>\n <option value=\"id:HarvestJobManager\" title=\"HarvestJobManager\">HarvestJobManager</option>\n <option value=\"id:Heritrix 1\" title=\"Heritrix 1\">Heritrix 1</option>\n <option value=\"id:Heritrix 3\" title=\"Heritrix 3\">Heritrix 3</option>\n <option value=\"id:heritrix3-remote-access\" title=\"heritrix3-remote-access\">heritrix3-remote-access</option>\n <option selected=\"selected\" value=\"id:IndexServer\" title=\"IndexServer\">IndexServer</option>\n <option value=\"id:Language\" title=\"Language\">Language</option>\n <option value=\"id:Monitor\" title=\"Monitor\">Monitor</option>\n <option value=\"id:MySQL\" title=\"MySQL\">MySQL</option>\n <option value=\"id:Netarkiv\" title=\"Netarkiv\">Netarkiv</option>\n <option value=\"id:OpenWayback Fork\" title=\"OpenWayback Fork\">OpenWayback Fork</option>\n <option value=\"id:OpenWayback Overlay\" title=\"OpenWayback Overlay\">OpenWayback Overlay</option>\n <option value=\"id:PostgreSQL\" title=\"PostgreSQL\">PostgreSQL</option>\n <option value=\"id:Project management\" title=\"Project management\">Project management</option>\n <option value=\"id:quickstart\" title=\"quickstart\">quickstart</option>\n <option value=\"id:SBForge Migration\" title=\"SBForge Migration\">SBForge Migration</option>\n <option value=\"id:SystemTest\" title=\"SystemTest\">SystemTest</option>\n <option value=\"id:Test\" title=\"Test\">Test</option>\n <option value=\"id:Umbra\" title=\"Umbra\">Umbra</option>\n <option value=\"id:Vienna 2017\" title=\"Vienna 2017\">Vienna 2017</option>\n <option value=\"id:Viewerproxy\" title=\"Viewerproxy\">Viewerproxy</option>\n <option value=\"id:WARC\" title=\"WARC\">WARC</option>\n <option value=\"id:Wayback\" title=\"Wayback\">Wayback</option>\n <option value=\"id:windows\" title=\"windows\">windows</option>\n </optgroup>\n </select>\n </div>\n ","jql":"component = IndexServer","validSearcher":true,"isShown":true},"project":{"name":"Project","viewHtml":" <div class=\"searcherValue\">\n \n <label class=\"fieldLabel\" for=\"fieldpid\">Project:</label><span id=\"fieldpid\" class=\"fieldValue\">\n \n <a href=\"/jira/browse/NAS\" title=\"Browse NetarchiveSuite project\">NetarchiveSuite</a> </span></div>\n","editHtml":"\n <div class=\"field-group aui-field-project\" >\n <label for=\"searcher-pid\">Project</label> \n\n <select class=\"select js-default-checkboxmultiselect\" data-placeholder-text=\"Find Projects...\" id=\"searcher-pid\" multiple=\"multiple\" name=\"pid\" size=\"5\">\n <optgroup label=\"All Projects\">\n \n <option data-icon=\"/jira/secure/projectavatar?pid=10061&size=small\"\n title=\"Bitrepository\"\n value=\"10061\">\n Bitrepository (BITMAG)\n </option>\n \n <option data-icon=\"/jira/secure/projectavatar?pid=10051&size=small\"\n title=\"DOMS\"\n value=\"10051\">\n DOMS (DOMS)\n </option>\n \n <option data-icon=\"/jira/secure/projectavatar?pid=10092&size=small\"\n title=\"Java Web Archive Toolkit\"\n value=\"10092\">\n Java Web Archive Toolkit (JWAT)\n </option>\n \n <option data-icon=\"/jira/secure/projectavatar?pid=10090&size=small\"\n title=\"LARM-CHAOS-platform\"\n value=\"10090\">\n LARM-CHAOS-platform (CHAOS)\n </option>\n \n <option data-icon=\"/jira/secure/projectavatar?pid=10072&size=small\"\n selected=\"selected\" title=\"NetarchiveSuite\"\n value=\"10072\">\n NetarchiveSuite (NAS)\n </option>\n \n <option data-icon=\"/jira/secure/projectavatar?pid=10091&size=small\"\n title=\"NetarchiveSuite Curator\"\n value=\"10091\">\n NetarchiveSuite Curator (NASC)\n </option>\n \n <option data-icon=\"/jira/secure/projectavatar?pid=10042&size=small\"\n title=\"Sandbox\"\n value=\"10042\">\n Sandbox (SANDBOX)\n </option>\n \n <option data-icon=\"/jira/secure/projectavatar?pid=10010&size=small\"\n title=\"Tools\"\n value=\"10010\">\n Tools (TOOL)\n </option>\n \n <option data-icon=\"/jira/secure/projectavatar?pid=10290&size=small\"\n title=\"WebDanica\"\n value=\"10290\">\n WebDanica (WEBDAN)\n </option>\n </optgroup>\n </select>\n </div>\n \n","jql":"project = NAS","validSearcher":true,"isShown":true},"assignee":{"name":"Assignee","editHtml":"\n \n <div class=\"field-group aui-field-userlist\" >\n <label for=\"searcher-assigneeSelect\">Assignee</label> <fieldset rel=\"assignee\" class=\"hidden user-group-searcher-params\">\n </fieldset>\n <select class=\"js-usergroup-checkboxmultiselect\" multiple=\"multiple\" id=\"assignee\" name=\"assignee\" data-placeholder-text=\"Enter username or group\">\n <optgroup>\n <option class=\"headerOption\" data-icon=\"https://sbforge.org/jira/secure/useravatar?size=xsmall&avatarId=10123\" value=\"empty\" title=\"Unassigned\">Unassigned</option>\n </optgroup>\n <optgroup>\n </optgroup>\n </select>\n <input type=\"hidden\" name=\"check_prev_assignee\" value=\"true\">\n </div>\n \n","validSearcher":true,"isShown":true},"status":{"name":"Status","editHtml":"\n <div class=\"field-group aui-field-constants\" >\n <label for=\"searcher-status\">Status</label> \n <select class=\"select js-default-checkboxmultiselectstatuslozenge\" data-placeholder-text=\"Find Statuses...\" id=\"searcher-status\" multiple=\"multiple\" name=\"status\" size=\"4\" data-status-lozenge=\"true\">\n <option class=\"imagebacked\" data-icon=\"/jira/images/icons/statuses/open.png\" value=\"1\" title=\"Open\" data-simple-status=\"{"id":"1","name":"Open","description":"The issue is open and ready for the assignee to start work on it.","iconUrl":"/jira/images/icons/statuses/open.png","statusCategory":{"id":2,"key":"new","colorName":"blue-gray"}}\">Open</option>\n <option class=\"imagebacked\" data-icon=\"/jira/images/icons/statuses/inprogress.png\" value=\"3\" title=\"In Progress\" data-simple-status=\"{"id":"3","name":"In Progress","description":"This issue is being actively worked on at the moment by the assignee.","iconUrl":"/jira/images/icons/statuses/inprogress.png","statusCategory":{"id":4,"key":"indeterminate","colorName":"yellow"}}\">In Progress</option>\n <option class=\"imagebacked\" data-icon=\"/jira/images/icons/statuses/reopened.png\" value=\"4\" title=\"Reopened\" data-simple-status=\"{"id":"4","name":"Reopened","description":"This issue was once resolved, but the resolution was deemed incorrect. From here issues are either marked assigned or resolved.","iconUrl":"/jira/images/icons/statuses/reopened.png","statusCategory":{"id":2,"key":"new","colorName":"blue-gray"}}\">Reopened</option>\n <option class=\"imagebacked\" data-icon=\"/jira/images/icons/statuses/resolved.png\" value=\"5\" title=\"Resolved\" data-simple-status=\"{"id":"5","name":"Resolved","description":"A resolution has been taken, and it is awaiting verification by reporter. From here issues are either reopened, or are closed.","iconUrl":"/jira/images/icons/statuses/resolved.png","statusCategory":{"id":3,"key":"done","colorName":"green"}}\">Resolved</option>\n <option class=\"imagebacked\" data-icon=\"/jira/images/icons/statuses/closed.png\" value=\"6\" title=\"Closed\" data-simple-status=\"{"id":"6","name":"Closed","description":"The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.","iconUrl":"/jira/images/icons/statuses/closed.png","statusCategory":{"id":3,"key":"done","colorName":"green"}}\">Closed</option>\n <option class=\"imagebacked\" data-icon=\"/jira/images/icons/statuses/visible.png\" value=\"10000\" title=\"Ready for release test\" data-simple-status=\"{"id":"10000","name":"Ready for release test","description":"The issue solution is ready for release test","iconUrl":"/jira/images/icons/statuses/visible.png","statusCategory":{"id":4,"key":"indeterminate","colorName":"yellow"}}\">Ready for release test</option>\n <option class=\"imagebacked\" data-icon=\"/jira/images/icons/statuses/visible.png\" value=\"10001\" title=\"Ready for review\" data-simple-status=\"{"id":"10001","name":"Ready for review","description":"The issue is ready for review","iconUrl":"/jira/images/icons/statuses/visible.png","statusCategory":{"id":4,"key":"indeterminate","colorName":"yellow"}}\">Ready for review</option>\n <option class=\"imagebacked\" data-icon=\"/jira/images/icons/statuses/information.png\" value=\"10003\" title=\"Triage\" data-simple-status=\"{"id":"10003","name":"Triage","description":"The needs to be triage, before it can accepted into the project","iconUrl":"/jira/images/icons/statuses/information.png","statusCategory":{"id":2,"key":"new","colorName":"blue-gray"}}\">Triage</option>\n </select>\n </div>\n \n","validSearcher":true,"isShown":true}}}
[{"id":-1,"name":"My open issues","jql":"assignee = currentUser() AND resolution = Unresolved order by updated DESC","isSystem":true,"sharePermissions":[],"requiresLogin":true},{"id":-2,"name":"Reported by me","jql":"reporter = currentUser() order by created DESC","isSystem":true,"sharePermissions":[],"requiresLogin":true},{"id":-4,"name":"All issues","jql":"order by created DESC","isSystem":true,"sharePermissions":[],"requiresLogin":false},{"id":-5,"name":"Open issues","jql":"resolution = Unresolved order by priority DESC,updated DESC","isSystem":true,"sharePermissions":[],"requiresLogin":false},{"id":-9,"name":"Done issues","jql":"statusCategory = Done order by updated DESC","isSystem":true,"sharePermissions":[],"requiresLogin":false},{"id":-3,"name":"Viewed recently","jql":"issuekey in issueHistory() order by lastViewed DESC","isSystem":true,"sharePermissions":[],"requiresLogin":false},{"id":-6,"name":"Created recently","jql":"created >= -1w order by created DESC","isSystem":true,"sharePermissions":[],"requiresLogin":false},{"id":-7,"name":"Resolved recently","jql":"resolutiondate >= -1w order by updated DESC","isSystem":true,"sharePermissions":[],"requiresLogin":false},{"id":-8,"name":"Updated recently","jql":"updated >= -1w order by updated DESC","isSystem":true,"sharePermissions":[],"requiresLogin":false}]
0.3
0