|
Changes
- Added a bunch of logging. (commit: 0050b0b4e64137e3744cf5404e128fdc0b529511)
(detail)
- Added a bunch of logging. (commit: 40657dd874dafab228544e408aa6c094f6eb7215)
(detail)
- Follow ups to https://sbforge.org/fisheye/cru/CR-NAS-370 (commit: 0e15e313cc0ffc98e75f5856fafb9c74acc4e44d)
(detail)
- Most of the followup to https://sbforge.org/fisheye/cru/CR-NAS-372 (commit: f3a1ba688da30792c7846d519fc99bc6c448c30d)
(detail)
- Most of the followup nr 2 to https://sbforge.org/fisheye/cru/CR-NAS-372 (commit: 4cc7008f4620754fa82ca22dd2ae81bbe88625f1)
(detail)
- Partial followup on CR-NAS-372. (commit: 1197c122a2491839b401dc97122d644b31da1bf5)
(detail)
- Fixed method call (commit: d79ad774301a18f159cfa257a9f61c1f322c9d3d)
(detail)
- Further followup on CR-NAS-372. (commit: 8d4ebfd77f7f61844663c86e18df4668d4dc2534)
(detail)
- Merge branch 'bitmag' of /home/csr/projects/netarchivesuite with (commit: 1767d415911495676652ecf7ee9050cfda9a43a9)
(detail)
- Most of the followup nr 3 to https://sbforge.org/fisheye/cru/CR-NAS-372 (commit: b3cd9fcee1116c7eb651328059ef0bc1e7ba1797)
(detail)
- Some trivial documentation followups to (commit: f86fec56c346c383f94f3f5111be69d97143252e)
(detail)
- Followup on TestBitrepository stuff (commit: 374be4d1731ec21db2ccc30da2c6d12fe9285c86)
(detail)
- Fixes according to CR-NAS-373 (commit: 08c5a0110ef55abdbc806e49969199c8a3b007a4)
(detail)
- Fixed issue that -D params should not include dk.netarkivet (commit: 52c8672d5d12c60a7c087eed1dc54f0cd80535e9)
(detail)
- fix HarvestController when BindingException occurs (commit: 01b2292e383f418f40372de37f01a461ff177e6d)
(detail)
- UI fixes (commit: 69c20c76dbe8ca697cb623d14596552c03cd676b)
(detail)
- Updated to new matching Heritrix version (commit: dd7bf4369a7a0fb262a9ba00359b7684540c8fe4)
(detail)
- [maven-release-plugin] prepare release netarchivesuite-5.6 (commit: 7b15d7abf1ed8a11f000177058f3acbea23ab29f)
(detail)
- [maven-release-plugin] prepare for next development iteration (commit: 97ebda03303de3f69cd2656ced3de95af6226083)
(detail)
- Updated version to a unique name (commit: e3b328a3cca883f6396a2955ef28bb0e2c7d2300)
(detail)
- poms updated with Hadoop and basic settings for it added in (commit: 1360e402889d881aee7e6a964c7847f2a96de0b5)
(detail)
- Small changes to settings (commit: a85a3ad520234cf8cedeeef058911ad47c304474)
(detail)
- Can now at least work with local bitmag, it seems (commit: 91bdce496fa2ebe20ee0eeb8ce97528a868505f1)
(detail)
- Indexing through hadoop instead of batch should now work for WARC files (commit: 982056795b045ed339987660c2d13dd7f41d1073)
(detail)
- Changes from review (commit: a4871eadd0dcfd71fe3bda54170c5f911ae3da88)
(detail)
- Refactored Bitrepository to a singleton. (commit: e494e8d0482fde2bc44ee840b4e675dac00a43d5)
(detail)
- Bitrepository class changes (commit: 9a39a4b2aacdc9283f4c34b080693ca5a1ddfe92)
(detail)
- Dependency fix to avoid logging loop and small logging changes (commit: a709b310c9f6af51c6312e3ed3fec73a912e2622)
(detail)
- WarcRecordClient.java andApacheClientReaderFactory.java in (commit: d71da3e20c6df7f04c793f8b55f0fc6a028286d1)
(detail)
- WarcRecordClient get and getFile changed (commit: 2b5e8b16b240a009f9ae1ee456350d70aaa821ac)
(detail)
- Mulig del-løsning (commit: c81836a89060b2194e91860f82947d17a27fe8dc)
(detail)
- Fixed datafil og tilføjet lidt dokumentation (commit: 26339a4799be4c7ecff361b2be29861d8af2e2f8)
(detail)
- Added an integration test for WarcRecordClient (commit: 64ac9178de086347e9335ba4b98316370ab699b8)
(detail)
- WarcRecord fixes for WarcRecordClientTest and Tester (commit: 961cff06f0e4c6241fc550d476add1739b142f7f)
(detail)
- Error fix (commit: 3cce599a2ccae8aa6ba1c26c75a33cd893ca6220)
(detail)
- Made method for indexing with Hadoop that assumes direct access to input (commit: b227515615b8ca0bd8c8fe2fd34be189679549c8)
(detail)
- latest from pc (commit: 9cb0209af9f385e3527307c1dd08c4a78b588c4a)
(detail)
- Moved getWarc from constructor to get (commit: 4e00feebd87d28c227a323907ab83cdaca0e143d)
(detail)
- Code-maturation for cdx-indexing (commit: c87a69b57c851c9d90e12982a344da40f614bc74)
(detail)
- URI corrected to include filename Not yet robust for files not in gzip (commit: 3148c07477ae875b0e29021e146090e7487312f7)
(detail)
- Hardcoded finName for testing (commit: dda3889ee6740e4306cf84f8e0b7bbee557ee8ee)
(detail)
- Hardcoded finName for testing (commit: dee3eaab03e37446ffd1be94b1783193a68bba4d)
(detail)
- Now passes integration test. (commit: 65fd5e068a37d7040f4ef741dd35347d00136ce5)
(detail)
- Now returns correct record. (commit: 671d7f64ec0db29802bba897eddfdce56d026b49)
(detail)
- Efter lidt cleanup (commit: dd9de321b98a8635ba8dd1948152469046b3985f)
(detail)
- Efter endnu lidt cleanup, men før logs (commit: e7504646b6f369f362a96d9ddcf01e4df7266323)
(detail)
- Added hadoop job for getting metadata lines from archive files and an (commit: 553e20659df3bb62c6d121d50c6effa3fc8947e9)
(detail)
- latest update (commit: 5763a813e2ec0f0eb1e8ad50cefcafc4767f0455)
(detail)
- Added filehandling for GetMetadataArchiveMapper and small touch ups (commit: 24aaecbc74299fa9fda9191dfe510977aa027b8f)
(detail)
- added null response if http statuscode is not 200 (commit: 4804a0787d97a2a9c3802edb716d3d3c78753259)
(detail)
- removed printlns and added logging for http exception (commit: db425bdcd25a943fdf3c59f741fb5eeb04da82b1)
(detail)
- Small refactor of ArchiveFile/HadoopUtils, few touch ups and started on (commit: 0d880c6017572102b4bf24e60d87ea35a84e2470)
(detail)
- added test methods for archive files and negative testing (commit: 085be39423a4881b64793f1328a73ba0286a3f3f)
(detail)
- Added tests (commit: ec684feb1b69f99952e68dd4e366289b45710ed6)
(detail)
- test corrections excludes .gz (commit: aca94d36b025e95458e0f718bfd83b9d6876545a)
(detail)
- 'Start' of https://sbprojects.statsbiblioteket.dk/jira/browse/NARK-1970 (commit: d52a6bfda1ed72ad4fc125356ae274f18e0de8c6)
(detail)
- Tiny settings change for NARK-1882 review (commit: 27a3d95258902008eda3d450c7261e3d694a4c10)
(detail)
- Integration of Hadoop dedup indexing with GetMetadataArchiveMapper now (commit: ca2c62d474caf14d80e8e1e8f3970a4582e84672)
(detail)
- Cleaned up a few things in RawMetadataCache and refactored HadoopUtils (commit: d10211a994d936309d076e87f0ae9699d99f385e)
(detail)
- Squashed commit of the following: (commit: 8d9adc2b50d996dfaa544528b34a7b6b96947d1e)
(detail)
- Added pattern configuration constants in GetMetadataMapper (commit: 9c130776d86bffa43170028cad724353348ec8dc)
(detail)
- Cleanup aaording review (commit: 5b3c5fbb6202b4be581afacd06be50dbe3e0deb2)
(detail)
- latest changes i getFile etc. (commit: 2c586ca6fd4c5b62a1df805f10f8bd1ac451b323)
(detail)
- corrected (commit: 216184c3737c5b895f1eba74be84f5e4beab244e)
(detail)
- A few final edits. (commit: e7fbf863417a855376671d375fbe0e4332b9f0ca)
(detail)
- 'Initial' commit (commit: c4553748c54d383e3f082fc10cf29b2ca4688ab3)
(detail)
- First commit on arc_record branch (commit: d27f60647703e6333b0baa83ece150e2b1c238a5)
(detail)
- Review https://sbforge.org/fisheye/cru/CR-NAS-385 changes (commit: 553c4afcb7ddf654b26cc4c9afa3c4cdc7c79197)
(detail)
- Added testing (commit: 779f5a0dc37edfd41a0dd30d1dc4dd2167c8e13b)
(detail)
- added .arc test-files (commit: dfffbac038e84ceb95a38d42024b6eb2fd557fdf)
(detail)
- Fixed dependency problem and added simple application class to run (commit: 016eb5f4073e02288b2acd38f940e0002db0642f)
(detail)
- Fixed get .arc-record with positive offset (commit: 66c495b026566a13658e39cf40e28120e91a31b8)
(detail)
- Javadoc added to few files https://sbforge.org/fisheye/cru/CR-NAS-387 (commit: 18336a02e91749175a3a19b4a9fafaa181af053c)
(detail)
- More review changes https://sbforge.org/fisheye/cru/CR-NAS-387 (commit: 274b0fb8819d98558b17b3fae93c4885ebb6200c)
(detail)
- minor changes tests (commit: fc4184449c23c26d5a014544479b6673b024164c)
(detail)
- Initial functioning FileResolverRESTClient (commit: c60029793838e1421e0eb97c3ca8aee8d2b32149)
(detail)
- Removed some old bitmag classes (commit: 4674413716dbf6fc8e322c47ab8c2fb89c259664)
(detail)
- Improved handling of try/catch logic (commit: 7a7cda6012b1ba4c6e7d0a1832e5c22b5133bb65)
(detail)
- Added some new tests and matured code ready for review (commit: b005ce2942cfab8a18e1389da311c32f2e5ac1ee)
(detail)
- Removed more old bitmag classes, refactored parts of some classes for (commit: dbf8703610bf19bfe044cf7f6f59a10710fdf7b4)
(detail)
- Fixed some old imports that made the compiler angry (commit: 48d011475ef9dc0480986dbab35e8266e3207f4f)
(detail)
- Fixed up FileResolverRESTClient for review and refactored code to enable (commit: 0a31340c22213cb7707a5188ec83ded5143c22ce)
(detail)
- Latest bug fixes on loop testing (commit: f41a6bc3cf46940f48d0dbfca3121cd68679342a)
(detail)
- Undo of file-change permissions. (commit: 0019993d36df0e7d3be07594ded1edfe0c2e101b)
(detail)
- Fixed handling of returning used client to pool (commit: cba38820408a11fa56fe247f7b1c9eab668c6ba2)
(detail)
- Added cdx indexing for metadata files in CDXIndexer and proper testing (commit: 7000ae16f8936955299227260d601c5db7005b81)
(detail)
- Got Hadoop replacement for ArchiveExtractCDXJob ready, refactored some (commit: 52c718231cc4eb4ba13f6161ace4f701aeb4b738)
(detail)
- Added setting for new job input/output dirs and more logging (commit: 629996d5c70f12e916878cb48e1c234b932eedcd)
(detail)
- Setting fix from review https://sbforge.org/jira/browse/NARK-1954 (commit: 5cb2bc46120e35bc9e1074ec1f135efd672d4b2a)
(detail)
- Tidied up logic in client and tests (commit: 6996761e42e6f09685269eee0b656c2686cbc2d6)
(detail)
- Review changes https://sbforge.org/fisheye/cru/CR-NAS-393, changes to (commit: bf5e943440e3760f4e25662ffcf603c3a78c0b2e)
(detail)
- FileResolverRESTClient now sends collectionId as an extra query (commit: 4327720c7867c82e5f3533a23657a5cd16149eba)
(detail)
- Fixed SimpleFileResolver, refactored how Hadoop jobs can be started, and (commit: 987c230dc013d45aaac9554df0392043965e56a0)
(detail)
- Added collectionId parameter to WarcRecordClient (commit: 7aadc2501609e5b0ee956af0928ef4793af85ccb)
(detail)
- Added exactfilename parameter to FileResolverRESTClient. (commit: c8272eac493023dd1aaa9ebef671a1e3a42c3742)
(detail)
- Added settings for new job and finished last refactoring parts (commit: dcee3b48afde25b3ab1ac42fa65adc64f672d91e)
(detail)
- Squashed commit of the following: (commit: ab9b8860ca1f5323ca20cabf8a23c7ee01009bc8)
(detail)
- Small changes from review https://sbforge.org/fisheye/cru/CR-NAS-395 (commit: 3d6bc39bc70440065a715acfe11a76e0575c5ea3)
(detail)
- Added a default value for setting useBitmagHadoopBackend (commit: d4d44145f82d3a6d425472d62eed5dd070672e8f)
(detail)
- Squashed commit of the following: (commit: 9687194f6e849461945a3f75bdd3906f128d71c8)
(detail)
- Bit of refactoring and made SSL provider to work with https (commit: 8f03956481c07a5c8639a847a6a51a30a8827882)
(detail)
- First attempt at a command-line metadata extraction job. (commit: 8183749da409edb2229dabb86b9e2fbaca8a182d)
(detail)
- Changed how the SSLContext is built to avoid trusting self-signed certs (commit: 18e8f959abf99005115a5e2521286242e98db82f)
(detail)
- Fixed the error with closed hadoop file system (commit: 87397cff475747f2efdba4befe07276742918bc7)
(detail)
- Created an invoker-module to prevent the job from including all the (commit: fffd21b9e21b9572899722516c0c6e10a16db15c)
(detail)
- Create FileSystem with newInstance and close it afterwards. DO NOT CLOSE (commit: b006660cc04ac3f6c2442dc0d09b74b6c017c9c9)
(detail)
- Improved logging (commit: 6486dd243255f8bbf407a34207a76e5a4a27d331)
(detail)
- Modified to support dynamic identification of the correct file-system (commit: dd68c05afd42a7a8beb6c10dde0a134b2a9b47a4)
(detail)
- Few clarification fixes to java doc (commit: 44da8bb849b06dc55392c01eaf7475563bc75313)
(detail)
- Refactoring to make MetadataIndexingApplication closer to a reusable (commit: 48366f7a72262d6f1442b635b466a2b929b9bcd3)
(detail)
- Refactored to use login mechanism instead of doAs. (commit: dc8b3564c4d580f0a8078d58514296c11b01dbce)
(detail)
- Removed all unnecessary configuration overrides. (commit: e1c9cc6202e4f7da4fa340f9d9d84ab4f94ea957)
(detail)
- Added default truststore settings (commit: d3522cfe5d45e6eeafeaf740119b5ef9bc7604d1)
(detail)
- Squashed commit of the following: (commit: 73e016f0e681e23ea9b50428fed236cbba4b706c)
(detail)
- ny pom.xmm a intergaces og annotations (commit: 1fd4d1d17ef45ac49b8f1d91504b390ecb47a70e)
(detail)
- Fixed circular dependency (commit: b9239bc6e51ea9fafa652287c25a3a1a76306c30)
(detail)
|