Uploaded image for project: 'Bitrepository'
  1. Bitrepository
  2. BITMAG-890 SB pillar should produce more informative audit events
  3. BITMAG-926

A put operation failing in layer2 will cause a delete log to be created

    XMLWordPrintable

Details

    • Technical task
    • Resolution: Fixed
    • Minor
    • 0.27
    • None
    • Audit trail, SB pillar
    • None

    Description

      This is because of the triggered 'remove temp file' call: 

      2013-06-13 10:07:40.955 [pool-1-thread-1] DEBUG d.s.s.c.ActiveMQMessageBus - Sending PutFileProgressResponse related to 32aa0424-0b63-426f-b1fb-70e1e93efc0a to destination = topic://integrationtest1-PutFileClient
2013-06-13 10:07:40.964 [pool-1-thread-1] DEBUG d.s.sbpillar.filestore.DiskFileStore - Caught a null checksum, not supported!
2013-06-13 10:07:40.964 [pool-1-thread-1] DEBUG d.s.sbpillar.filestore.DiskFileStore - External command: [layer2.sh, put, http://int-bitmag-01.kb.dk:80/dav/AarhusAmtstidende-0000000001-01-0043.jp2.md5, AarhusAmtstidende-0000000001-01-00
43.jp2.md5, --collectionid=avis, --length=652000, --message={"auditTrailInfo":"Putting the file '/home/lfm/Documents/bitmagasin/avis/AarhusAmtstidende-0000000001-01-0043.jp2.md5' with the file id 'AarhusAmtstidende-0000000001-01-0043.jp
2.md5' from commandLine.","actor":"PutFileClient","info":"Protocol initiated","version":"2"}]
2013-06-13 10:07:41.480 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04: Traceback (most recent call last):
2013-06-13 10:07:41.481 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:   File "/home/integ3/L2/bitmag-layer2/command.py"
, line 508, in <module>
2013-06-13 10:07:41.483 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:     Disk_pillar().run()
2013-06-13 10:07:41.483 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:   File "/home/integ3/L2/bitmag-layer2/pillar.py",
 line 19, in run
2013-06-13 10:07:41.484 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:     return command(sys.argv[2:])
2013-06-13 10:07:41.485 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:   File "/home/integ3/L2/bitmag-layer2/command.py"
, line 101, in put_command
2013-06-13 10:07:41.485 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:     lock.unlock('reserve files')
2013-06-13 10:07:41.485 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:   File "/home/integ3/L2/bitmag-layer2/lock.py", l
ine 39, in unlock
2013-06-13 10:07:41.486 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:     os.remove(filename)
2013-06-13 10:07:41.487 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04: OSError: [Errno 2] No such file or directory: '/home/integ3/L2/disk-pillar/locks/166d19aeded7c32d0f182e32f41187ea79540767'
2013-06-13 10:07:41.495 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04: Error in atexit._run_exitfuncs:
2013-06-13 10:07:41.496 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04: Traceback (most recent call last):
2013-06-13 10:07:41.496 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:   File "/usr/lib64/python2.6/atexit.py", line 24, in _run_exitfuncs
2013-06-13 10:07:41.497 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:     func(*targs, **kargs)
2013-06-13 10:07:41.498 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:   File "/home/integ3/L2/bitmag-layer2/lock.py", line 51, in cleanup
2013-06-13 10:07:41.498 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:     unlock(name)
2013-06-13 10:07:41.499 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:   File "/home/integ3/L2/bitmag-layer2/lock.py", line 39, in unlock
2013-06-13 10:07:41.499 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:     os.remove(filename)
2013-06-13 10:07:41.499 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04: OSError: [Errno 2] No such file or directory: '/home/integ3/L2/disk-pillar/locks/166d19aeded7c32d0f182e32f41187ea79540767'
2013-06-13 10:07:41.500 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04: Error in sys.exitfunc:
2013-06-13 10:07:41.500 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04: Traceback (most recent call last):
2013-06-13 10:07:41.501 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:   File "/usr/lib64/python2.6/atexit.py", line 24, in _run_exitfuncs
2013-06-13 10:07:41.502 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:     func(*targs, **kargs)
2013-06-13 10:07:41.502 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:   File "/home/integ3/L2/bitmag-layer2/lock.py", line 51, in cleanup
2013-06-13 10:07:41.502 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:     unlock(name)
2013-06-13 10:07:41.503 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:   File "/home/integ3/L2/bitmag-layer2/lock.py", line 39, in unlock
2013-06-13 10:07:41.503 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04:     os.remove(filename)
2013-06-13 10:07:41.504 [Process 'java.lang.UNIXProcess@2aed9b04' error stream logger] WARN  d.s.s.utils.ExternalProcessRunner - Error output from process java.lang.UNIXProcess@2aed9b04: OSError: [Errno 2] No such file or directory: '/home/integ3/L2/disk-pillar/locks/166d19aeded7c32d0f182e32f41187ea79540767'
2013-06-13 10:07:41.516 [Process 'java.lang.UNIXProcess@2aed9b04' exit code logger] WARN  d.s.s.utils.ExternalProcessRunner - Non-zero exit code from process java.lang.UNIXProcess@2aed9b04: 1
2013-06-13 10:07:41.520 [pool-1-thread-1] WARN  d.s.sbpillar.filestore.DiskFileStore - Got unexpected exitcode from layer2: 1
2013-06-13 10:07:41.522 [pool-1-thread-1] WARN  d.s.sbpillar.pillartask.PutFileTask - Failed to put file AarhusAmtstidende-0000000001-01-0043.jp2.md5, attempting to remove temp file
2013-06-13 10:07:41.523 [pool-1-thread-1] DEBUG d.s.sbpillar.filestore.DiskFileStore - External command: [layer2.sh, delete, AarhusAmtstidende-0000000001-01-0043.jp2.md5, --message=Attempting to remove temp file for failed put, --collectionid=avis]
2013-06-13 10:07:42.169 [pool-1-thread-1] WARN  d.s.sbpillar.pillartask.PutFileTask - Runtime problem with put call
2013-06-13 10:07:42.367 [pool-1-thread-1] INFO  d.s.s.c.BasicResponseDispatcher - Sending message: [Type: PutFileFinalResponse, CorrelationID: 32aa0424-0b63-426f-b1fb-70e1e93efc0a, From: sbdisk1, To: topic://integrationtest1-PutFileClient, FileID: AarhusAmtstidende-0000000001-01-0043.jp2.md5, ResponseCode: FAILURE, ResponseText: Unspecified error]
2013-06-13 10:07:42.377 [pool-1-thread-1] DEBUG d.s.s.c.ActiveMQMessageBus - Sending PutFileFinalResponse related to 32aa0424-0b63-426f-b1fb-70e1e93efc0a to destination = topic://integrationtest1-PutFileClient
2013-06-13 10:07:42.379 [pool-1-thread-3] DEBUG d.s.sbpillar.filestore.DiskFileStore - External command: [layer2.sh, approve, b01tc01272009_20050315_Andelsbanken_V1_14.mpg, --checksum-type=md5, --collectionid=reklamefilm, --checksum=2ce810605c5ba538323eaf303c852890, --message={"auditTrailInfo":"Standard approve","actor":"PutFileClient","info":"Protocol initiated","version":"2"}]
2013-06-13 10:07:42.388 [pool-1-thread-1] DEBUG d.s.s.pillartask.PillarTaskProcessor - Finished PutFileTask task (32aa0424-0b63-426f-b1fb-70e1e93efc0a)

      it is confusing for the user to see a delete event suddenly appearing, as no delete operation has been performed.

      Attachments

        Activity

          People

            ktc Kim Christensen (Inactive)
            mss Mikis Seth Sørensen (Inactive)
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: