Dashboard

Welcome Message

Welcome to Atlassian Crucible with Fisheye .

To report a bug or suggest a feature please raise an issue in our public JIRA.

Customize this welcome note.

Support

You are running Crucible 4.7.0 with Fisheye 4.7.0 (20190214100246 2019-02-14)

If you are experiencing any issues, please contact your administrator. You may also want to browse the documentation or search the support forums. Still stuck? You can start a support ticket at support.atlassian.com or raise a bug or feature request at jira.atlassian.com.

Customize the support message.

Today
29 mins ago

Rasmus Bohl Kristensen

31 mins ago

Rasmus Bohl Kristensen

Ah, didn't notice that index() and indexFile() of course takes different parameters, but I guess the file could still be retrieved to make line 65 go something like indexer.indexFile(warcFile);

Ah, didn't notice that index() and indexFile() of course takes different parameters, but I guess the file could still be retrieved to make line 65 go something like indexer.indexFile(warcFile);

38 mins ago

Rasmus Bohl Kristensen

The indexer is dynamically assigned here based on the file type, but the indexer variable is not dynamically assigned in the part at line 65 - any reason for this? https://sbforge.org/fisheye/stati...

The indexer is dynamically assigned here based on the file type, but the indexer variable is not dynamically assigned in the part at line 65 - any reason for this?
If using dynamic assignment the indexer-fields at line 29-30 can be replaced by just one Indexer-class, no?

Thursday 17 Sep
9:15 am

Kim Christensen

Cleanup repository: remove unused docker stuff, rewrite README to reflect changes

Options
    • -17
    • +0
    /Dockerfile
    • -60
    • +5
    /README.md
    • -38
    • +0
    /configuration-map/pom.xml
    • -11
    • +0
    /configuration-map/src/main/java/dk/statsbiblioteket/configurationmap/ConfigurationKeyNotSetException.java
    • -95
    • +0
    /configuration-map/src/main/java/dk/statsbiblioteket/configurationmap/ConfigurationMap.java
    • -84
    • +0
    /configuration-map/src/main/java/dk/statsbiblioteket/configurationmap/ConfigurationMapHelper.java
    • -141
    • +0
    /configuration-map/src/main/java/dk/statsbiblioteket/configurationmap/MainExecutor.java
    • -64
    • +0
    /docker-compose.yml
    • -58
    • +0
    /docker-settings.xml
    • -71
    • +0
    /docker/cgi-bin/1.pl
    • -1
    • +0
    /docker/empty.conf
    • -361
    • +0
    /docker/httpd.conf
    • -7
    • +0
    /docker/newspaper-fcgi.conf
    • -4
    • +0
    /docker/newspaper-statistics.conf
    • -3
    • +0
    /docker/newspaper_statistics.py.cfg
  16. … 43 more files in changeset.
Tuesday 15 Sep
1:07 pm

Rasmus Bohl Kristensen

Integration of Hadoop dedup indexing with GetMetadataArchiveMapper now works - still needs few tweaks though

Options
    • -145
    • +0
    /common/common-core/src/main/java/dk/netarkivet/common/utils/HadoopUtils.java
    • -5
    • +10
    /common/common-core/src/main/java/dk/netarkivet/common/utils/SimpleFileResolver.java
    • -0
    • +102
    /common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopFileUtils.java
    • -0
    • +104
    /common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/HadoopJobUtils.java
    • -12
    • +11
    /harvester/harvester-core/src/main/java/dk/netarkivet/harvester/indexserver/RawMetadataCache.java
    • -7
    • +6
    /wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/ArchiveFile.java
    • -6
    • +3
    /wayback/wayback-indexer/src/test/java/dk/netarkivet/wayback/hadoop/CDXJobTest.java
Monday 14 Sep
3:46 pm

Colin Rosenthal

Dedup Indexing of Metadata Files
Dedup Indexing of Metadata Files
3:39 pm

Colin Rosenthal

Enable indexing of deduplication records in metadata files. This is done in the same hadoop-class as "ordinary" indexing but with an alternative execution path based on the filename. Also the exist...

Enable indexing of deduplication records in metadata files. This is done in the same hadoop-class as "ordinary" indexing but with an alternative execution path based on the filename. Also the existing (batch job) indexing class is just reused.

Friday 11 Sep
2:30 pm

Kim Christensen

Remember to include ServiceUrl.class in list of service classes

Options
    • -1
    • +1
    /bitrepository-webclient/src/main/java/org/bitrepository/webservice/ReposerviceRestApplication.java
11:07 am

Rasmus Bohl Kristensen

Tiny settings change for NARK-1882 review

Options
    • -1
    • +1
    /common/common-core/src/main/java/dk/netarkivet/common/CommonSettings.java
9:41 am

Rasmus Bohl Kristensen

'Start' of https://sbprojects.statsbiblioteket.dk/jira/browse/NARK-1970

Options
    • -1
    • +7
    /common/common-core/src/main/java/dk/netarkivet/common/CommonSettings.java
    • -0
    • +24
    /common/common-core/src/main/java/dk/netarkivet/common/utils/FileResolver.java
    • -0
    • +91
    /common/common-core/src/main/java/dk/netarkivet/common/utils/HadoopUtils.java
    • -0
    • +43
    /common/common-core/src/main/java/dk/netarkivet/common/utils/SimpleFileResolver.java
    • -88
    • +213
    /harvester/harvester-core/src/main/java/dk/netarkivet/harvester/indexserver/RawMetadataCache.java
    • -0
    • +1
    /harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/GetMetadataArchiveBatchJobTester.java
    • -8
    • +7
    /harvester/harvester-test/src/test/java/dk/netarkivet/harvester/indexserver/hadoop/GetMetadataArchiveMapperTester.java
    • -0
    • +7
    /wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/hadoop/CDXMap.java
    • -11
    • +14
    /wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/ArchiveFile.java
    • -24
    • +0
    /wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/FileResolver.java
    • -22
    • +0
    /wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/SimpleFileResolver.java
    • -11
    • +4
    /wayback/wayback-indexer/src/test/java/dk/netarkivet/wayback/hadoop/CDXJobTest.java
Thursday 10 Sep
3:41 pm

csrster <csr@statsbiblioteket.dk>

Added a conf flag to switch between standard indexing and dedup indexing for metadata files.

Options
    • -1
    • +4
    /wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/hadoop/CDXMap.java
    • -0
    • +1
    /wayback/wayback-indexer/src/test/java/dk/netarkivet/wayback/hadoop/CDXJobTest.java
Wednesday 09 Sep
2:50 pm

Peter Christiansen

test corrections excludes .gz

Options
    • -8
    • +20
    /common/common-core/src/test/java/dk/netarkivet/common/utils/warc/WarcRecordClientTester.java
10:23 am

Kåre Fiedler Christiansen <kfc@statsbiblioteket.dk>

Fix inverted check for existing file (stupid bug introduced in review followup)

Options
    • -1
    • +1
    /src/main/scripts/record-extract.sh
8:48 am

Peter Christiansen

Added tests

Options
    • -11
    • +79
    /common/common-core/src/test/java/dk/netarkivet/common/utils/warc/WarcRecordClientTester.java
Tuesday 08 Sep
3:17 pm

csrster <csr@statsbiblioteket.dk>

Changed test to use paths relative to module root

Options
    • -7
    • +3
    /wayback/wayback-indexer/src/test/java/dk/netarkivet/wayback/hadoop/CDXJobTest.java
11:20 am

Kim Christensen

11:18 am

Rasmus Bohl Kristensen

Monday 07 Sep
12:08 pm

Kim Christensen

Make it configurable which operation timeout is used in pillar-acceptence tests
Make it configurable which operation timeout is used in pillar-acceptence tests
12:01 pm

Kim Christensen

Make it configurable which operation timeout is used in pillar-acceptence tests

Options
    • -0
    • +4
    /bitrepository-reference-pillar/src/test/java/org/bitrepository/pillar/integration/PillarIntegrationTest.java
    • -0
    • +4
    /bitrepository-reference-pillar/src/test/java/org/bitrepository/pillar/integration/PillarIntegrationTestConfiguration.java
    • -5
    • +9
    /bitrepository-reference-pillar/src/test/java/org/bitrepository/pillar/integration/func/deletefile/DeleteFileRequestIT.java
    • -4
    • +6
    /bitrepository-reference-pillar/src/test/java/org/bitrepository/pillar/integration/func/getfile/GetFileRequestIT.java
    • -7
    • +10
    /bitrepository-reference-pillar/src/test/java/org/bitrepository/pillar/integration/func/getfileids/GetFileIDsTest.java
    • -4
    • +7
    /bitrepository-reference-pillar/src/test/java/org/bitrepository/pillar/integration/func/putfile/PutFileRequestIT.java
    • -3
    • +6
    /bitrepository-reference-pillar/src/test/java/org/bitrepository/pillar/integration/func/replacefile/ReplaceFileRequestIT.java
    • -0
    • +1
    /bitrepository-reference-pillar/src/test/resources/testprops/pillar-integration-test.properties
Sunday 06 Sep
11:48 pm

Peter Christiansen

added test methods for archive files and negative testing

Options
    • -1
    • +40
    /common/common-core/src/test/java/dk/netarkivet/common/utils/warc/WarcRecordClientTester.java
Friday 04 Sep
10:14 am

Kim Christensen

Bump message-xml version to 31-SNAPSHOT

Options
    • -1
    • +1
    /pom.xml
10:09 am

Kim Christensen

10:07 am

Kim Christensen

Merge branch 'getFileIT' of github.com:bitrepository/reference into getFileIT

Options
10:07 am

Kim Christensen

Bump message-xml version to 31-SNAPSHOT

Options
    • -1
    • +1
    /pom.xml
9:48 am

Kim Christensen

Update versioning in examples

Options
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/data/FileIDsParameter.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/data/GetAuditTrailsResults.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/data/GetChecksumsResults.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/data/GetFileIDsResults.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/data/GetStatusResults.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/messages/AlarmMessage.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/messages/DeleteFileFinalResponse.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/messages/DeleteFileProgressResponse.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/messages/DeleteFileRequest.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/messages/GetAuditTrailsFinalResponse.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/messages/GetAuditTrailsProgressResponse.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/messages/GetAuditTrailsRequest.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/messages/GetChecksumsFinalResponse.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/messages/GetChecksumsProgressResponse.xml
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/examples/messages/GetChecksumsRequest.xml
  16. … 32 more files in changeset.
9:45 am

Kim Christensen

Update definition of AllFileIDs to match the actual use of the protocol. This retains backwards compability while updating the specification, but should however be rectified as a contentless element. However as it would be a breaking change, it will be grouped with other breaking changes.

Options
    • -1
    • +1
    /bitrepository-message-xml-xsd/src/main/resources/xsd/BitRepositoryElements.xsd
Thursday 03 Sep
2:04 pm

Kåre Fiedler Christiansen

Followup after review

Options
    • -3
    • +4
    /src/main/scripts/record-extract.sh
2:04 pm

Kåre Fiedler Christiansen

Followup after review

Options
    • -3
    • +4
    /src/main/scripts/record-extract.sh
1:37 pm

Rasmus Bohl Kristensen

Merge branch 'NARK-1882-hadoop-indexing' of https://github.com/netarchivesuite/netarchivesuite into NARK-1882-hadoop-indexing

Options
    • -4
    • +9
    /wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/ArchiveFile.java
1:37 pm

Rasmus Bohl Kristensen

Small refactor of ArchiveFile/HadoopUtils, few touch ups and started on metadata job

Options
    • -4
    • +14
    /common/common-core/src/main/java/dk/netarkivet/common/CommonSettings.java
    • -0
    • +26
    /common/common-core/src/main/java/dk/netarkivet/common/utils/HadoopUtils.java
    • -2
    • +2
    /common/common-core/src/main/java/dk/netarkivet/common/utils/hadoop/GetMetadataArchiveMapper.java
    • -9
    • +89
    /harvester/harvester-core/src/main/java/dk/netarkivet/harvester/indexserver/RawMetadataCache.java
    • -46
    • +22
    /wayback/wayback-indexer/src/main/java/dk/netarkivet/wayback/indexer/ArchiveFile.java