Asger Askov-Blekinge

Everything should use slf4j in system test now

    • -6
    • +33
    /integration-test/system-test/pom.xml
[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release ingesters-1.9

tar also includes stagetest.md

    • -0
    • +1
    /radio-tv/src/main/assembly/assembly.xml
Stagetest updated with info about how to deploy on devel

If the identically test throws exception, assume not-identical, but do not break the ingest

Moved statetest.md

    • -0
    • +114
    /radio-tv/StageTest.md
Updated changelog

Better logging

Removed unnused commented code

Label på posten er titlen. Men der er ikke nogen metode i domsClienten til at få labellen ud. getLabel er en beskidt løgn. Derfor jeg er nød til det workaround nedenfor

Label på posten er titlen. Men der er ikke nogen metode i domsClienten til at få labellen ud. getLabel er en beskidt løgn. Derfor jeg er nød til det workaround nedenfor

Det bliver slettet

Det bliver slettet

Correctly compared object titles
Correctly compared object titles
Correctly compared object titles

Reworked to use enhancedFedora instead of webservice client.

    • -1
    • +2
    /radio-tv/src/main/config/ingest_config.sh
1.8 Stage test

Remember the new params in ingest.sh and ingest_config.sh. And remember the log config in ingest.sh

    • -0
    • +6
    /radio-tv/src/main/config/ingest_config.sh
    • -6
    • +37
    /radio-tv/src/main/scripts/ingest.sh
[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release ingesters-1.8

updated changelog

No. This is how the log will look 2017-04-11 13:29:12,725 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.r.RadioTVFolderWatcherClient - Creating xml parser 2017-04-11 13:29:12,726 [Worker3-...

No.
This is how the log will look

2017-04-11 13:29:12,725 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.r.RadioTVFolderWatcherClient - Creating xml parser
2017-04-11 13:29:12,726 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.r.RadioTVFolderWatcherClient - Parsing xml file
2017-04-11 13:29:12,728 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.r.RadioTVFolderWatcherClient - Creating doms record
2017-04-11 13:29:12,728 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.r.RadioTVFolderWatcherClient - Starting to create doms record for file
2017-04-11 13:29:12,729 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.radiotv.RecordCreator - Found file url http://bitfinder.statsbiblioteket.dk/bart/tv2oj_yousee.1490565600-2017-03-27-00.00.00_1490569200-2017-03-27-01.00.00_yousee.ts from metadata
2017-04-11 13:29:13,168 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.radiotv.RecordCreator - Found file object pid uuid:d60a50fd-7f12-44ea-9352-49cbe0307351 for file url http://bitfinder.statsbiblioteket.dk/bart/tv2oj_yousee.1490565600-2017-03-27-00.00.00_1490569200-2017-03-27-01.00.00_yousee.ts
2017-04-11 13:29:13,168 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.radiotv.RecordCreator - Found pids [uuid:d60a50fd-7f12-44ea-9352-49cbe0307351] of referenced files
2017-04-11 13:29:13,169 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.radiotv.RecordCreator - Found these old identifiers [23877070RitzauProgram] in the program to ingest
2017-04-11 13:29:13,185 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.radiotv.RecordCreator - Old identifiers [23877070RitzauProgram] did not find a program object in doms
2017-04-11 13:29:13,869 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.radiotv.RecordCreator - Created new program object with pid uuid:4394d333-3345-4a84-8301-e5e6d4366ca8
2017-04-11 13:29:13,870 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.radiotv.RecordCreator - Found program title 'Sådanmark', setting this as label on uuid:4394d333-3345-4a84-8301-e5e6d4366ca8
2017-04-11 13:29:14,041 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.radiotv.RecordCreator - Adding/Updating PBCORE datastream
2017-04-11 13:29:14,273 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.radiotv.RecordCreator - Adding/Updating RITZAU_ORIGINAL datastream
2017-04-11 13:29:14,448 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.radiotv.RecordCreator - Adding/Updating GALLUP_ORIGINAL datastream
2017-04-11 13:29:14,635 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.radiotv.RecordCreator - Adding/Updating PROGRAM_BROADCAST datastream
2017-04-11 13:29:15,343 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.radiotv.RecordCreator - Adding relation uuid:4394d333-3345-4a84-8301-e5e6d4366ca8,'http://doms.statsbiblioteket.dk/relations/default/0/1/#hasFile',uuid:d60a50fd-7f12-44ea-9352-49cbe0307351
2017-04-11 13:29:16,380 [Worker3-2017-03-27_00-15-00_tv2oj.xml] DEBUG d.s.d.i.r.RadioTVFolderWatcherClient - Ingest complete


I encode the filename in the threadname, to be sure that I have it no matter what people write in their log statements

Review followup and Successfully ingested file {} is different from file {} in failedFolder={}
Review followup and Successfully ingested file {} is different from file {} in failedFolder={}
When succesful ingest, check if an equivalent file exist. If yes, delete the file.

Review followup. Better logging of the new flags and max checks

Good catch. Done

Good catch. Done

Good catch. Done

Good catch. Done