Dashboard

Welcome Message

Welcome to Atlassian Crucible with FishEye .

To report a bug or suggest a feature please raise an issue in our public JIRA.

Customize this welcome note.

Support

You are running Crucible 4.5.3 with FishEye 4.5.3 (20180321104931 2018-03-21)

If you are experiencing any issues, please contact your administrator. You may also want to browse the documentation or search the support forums. Still stuck? You can start a support ticket at support.atlassian.com or raise a bug or feature request at jira.atlassian.com.

Customize the support message.

Today
3 hrs ago

Jonas Lindberg Frellesen

Added issue link to javadoc.

Options
    • -0
    • +1
    /bitrepository-reference-pillar/src/main/java/org/bitrepository/pillar/store/hadooparchive/CollectionHdfsManager.java
4 hrs ago

Jonas Lindberg Frellesen

The method is used quite rarely, but when it is called, then it is mostly called several times in a row. How about caching them the first time this method is called?

The method is used quite rarely, but when it is called, then it is mostly called several times in a row.
How about caching them the first time this method is called?

4 hrs ago

Jonas Lindberg Frellesen

Agreed, and added it with the default value, along with a couple of other missing settings.

Agreed, and added it with the default value, along with a couple of other missing settings.

4 hrs ago

Asger Askov Blekinge

4 hrs ago

Jonas Lindberg Frellesen

Added default value for the missing ReferenceSettings.

Options
    • -1
    • +3
    /bitrepository-core/src/test/resources/settings/xml/bitrepository-devel/ReferenceSettings.xml
Thursday 21 Mar
3:53 pm

Asger Askov Blekinge

3:53 pm

Asger Askov Blekinge

3:45 pm

Asger Askov Blekinge

Javadoc about possible error-situations for FileInfo

Options
    • -0
    • +5
    /bitrepository-core/src/main/java/org/bitrepository/common/filestore/FileInfo.java
    • -0
    • +1
    /bitrepository-reference-pillar/src/main/java/org/bitrepository/pillar/store/checksumdatabase/ExtractedFileIDsResultSet.java
3:44 pm

Asger Askov Blekinge

Apache IOUtils and Better stream closing with try-with-resources

Options
    • -6
    • +5
    /bitrepository-core/src/main/java/org/bitrepository/common/utils/ChecksumUtils.java
    • -1
    • +2
    /bitrepository-core/src/main/java/org/bitrepository/protocol/LocalFileExchange.java
    • -2
    • +4
    /bitrepository-core/src/main/java/org/bitrepository/protocol/http/HttpFileExchange.java
    • -5
    • +12
    /bitrepository-core/src/test/java/org/bitrepository/common/utils/StreamUtilsTest.java
    • -12
    • +9
    /bitrepository-reference-pillar/src/main/java/org/bitrepository/pillar/messagehandler/GetFileRequestHandler.java
    • -3
    • +3
    /bitrepository-reference-pillar/src/main/java/org/bitrepository/pillar/store/FileStorageModel.java
    • -10
    • +4
    /bitrepository-reference-pillar/src/main/java/org/bitrepository/pillar/store/filearchive/ReferenceArchive.java
    • -1
    • +2
    /bitrepository-reference-pillar/src/main/java/org/bitrepository/pillar/store/hadooparchive/HdfsArchive.java
3:10 pm

Asger Askov Blekinge

Should we get these info dynamically, or should we cache them when the HadoopFileInfo object is made?

Should we get these info dynamically, or should we cache them when the HadoopFileInfo object is made?

3:07 pm

Asger Askov Blekinge

This should probably also list a implementing class for the pillar

This should probably also list a implementing class for the pillar

3:06 pm

Asger Askov Blekinge

Probably. These files let's the pillar connect to the narcana cluster.

Probably. These files let's the pillar connect to the narcana cluster.

3:02 pm

Kim Christensen

3:01 pm

Asger Askov Blekinge

Done

Done

3:00 pm

Asger Askov Blekinge

Hortonworks maven repo proxied by sbforge nexus, so removing from pom

Options
    • -7
    • +0
    /pom.xml
Wednesday 20 Mar
3:00 pm

Colin Rosenthal

This is the client implementation used in the mixed-mode prototype.

This is the client implementation used in the mixed-mode prototype.

10:15 am

Asger Askov Blekinge

Shut up in tests

Options
    • -1
    • +17
    /archive/archive-core/src/test/resources/logback-test.xml
10:15 am

Asger Askov Blekinge

HadoopProcessorRepo Work In Progress

Options
    • -38
    • +89
    /archive/archive-core/pom.xml
    • -96
    • +141
    /archive/archive-core/src/main/java/dk/netarkivet/archive/arcrepository/distribute/HadoopProcessorRepository.java
    • -0
    • +90
    /archive/archive-core/src/test/java/dk/netarkivet/archive/arcrepository/distribute/HadoopProcessorRepositoryTest.java
    • -0
    • +119
    /archive/archive-core/src/test/resources/core-site.xml
    • -0
    • +333
    /archive/archive-core/src/test/resources/hdfs-site.xml
    • -0
    • +253
    /archive/archive-core/src/test/resources/mapred-site.xml
    • -0
    • +663
    /archive/archive-core/src/test/resources/yarn-site.xml
10:14 am

Asger Askov Blekinge

hadoop test job

Options
    • -0
    • +60
    /archive/test-hadoop-job/pom.xml
    • -0
    • +67
    /archive/test-hadoop-job/src/main/java/dk/netarkivet/archive/arcrepository/distribute/MockupHadoopBatchJob.java
    • -0
    • +21
    /archive/test-hadoop-job/src/main/java/dk/netarkivet/archive/arcrepository/distribute/TestMapper.java
    • -0
    • +13
    /archive/test-hadoop-job/src/main/java/dk/netarkivet/archive/arcrepository/distribute/TestReducer.java
10:13 am

Asger Askov Blekinge

HadoopBatchJob work in progress

Options
    • -0
    • +1
    /archive/pom.xml
    • -8
    • +44
    /common/common-core/src/main/java/dk/netarkivet/common/distribute/hadoop/HadoopBatchJob.java
    • -7
    • +7
    /common/common-core/src/main/java/dk/netarkivet/common/distribute/hadoop/HadoopBatchStatus.java
    • -3
    • +7
    /common/common-core/src/main/java/dk/netarkivet/common/distribute/hadoop/WholeFileInputFormat.java
9:12 am

Kim Christensen

Jeg er ret sikker på at Asger Askov Blekinge kan sætte det op (vil tro det kræver administrator adgang til nexus)

Jeg er ret sikker på at Asger Askov Blekinge kan sætte det op (vil tro det kræver administrator adgang til nexus)

Tuesday 19 Mar
1:24 pm

Jonas Lindberg Frellesen

Partly followup on review CR-BITMAG-384. Still needs test-configuration changes for hdfs and using the SBForge to mirror site with the hadoop dependencies.

Options
    • -2
    • +21
    /bitrepository-reference-pillar/src/main/java/org/bitrepository/pillar/store/hadooparchive/CollectionHdfsManager.java
    • -0
    • +5
    /bitrepository-reference-pillar/src/main/java/org/bitrepository/pillar/store/hadooparchive/HadoopFileInfo.java
    • -4
    • +2
    /bitrepository-reference-pillar/src/test/java/org/bitrepository/pillar/store/FullHadoopPillarModelTest.java
11:22 am

Jonas Lindberg Frellesen

The public methods need argument validations

The public methods need argument validations

11:21 am

Jonas Lindberg Frellesen

needs argument validation

needs argument validation

11:18 am

Jonas Lindberg Frellesen

Yeah, that would be better. How can it be done?

Yeah, that would be better. How can it be done?

Monday 18 Mar
2:53 pm

Kim Christensen

Is it not possible to have this mirrored through sbforge repo?

Is it not possible to have this mirrored through sbforge repo?

2:52 pm

Kim Christensen

I suppose the file is not actually used to connect to a hadoop cluster, but rather to verify that it can be properly loaded. In such case this file along with the corresponding hdfs-site.xml file s...

I suppose the file is not actually used to connect to a hadoop cluster, but rather to verify that it can be properly loaded.
In such case this file along with the corresponding hdfs-site.xml file should have hosts changed to dummy content (just like RepositorySettings.xml which lies next to this file)

2:44 pm

Kim Christensen

Typo in constant name, SHA385 should be SHA384?

Typo in constant name, SHA385 should be SHA384?

2:06 pm

Jonas Lindberg Frellesen

Created HDFS based file-store for the HadoopReferencePillar
Created HDFS based file-store for the HadoopReferencePillar
1:55 pm

Jonas Lindberg Frellesen

Bumped C3P0 patch version to fix github alert.

Options
    • -1
    • +1
    /bitrepository-service/pom.xml