IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 1 and Version 2 of Nebulous_Issues


Ignore:
Timestamp:
Apr 29, 2011, 12:19:10 PM (15 years ago)
Author:
watersc1
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Nebulous_Issues

    v1 v2  
    44
    55We currently do not have a validation system in place.  It would be useful to have a neb-fsck program that could do the following things:
    6  1) Scan the instance table, and confirm that the files exist on disk.
    7  1) Confirm that the md5sum matches for all instances of a given storage object.
    8  1) Scan the nebulous directory trees and identify files that do not have a matching entry in the instance table.  These files could be reinserted, as the full disk path describes the ins_id and the ext_id for a given file.  It could be reassociated with the storage_object (if it exists), or simply deleted.
     6 1. Scan the instance table, and confirm that the files exist on disk.
     7 1. Confirm that the md5sum matches for all instances of a given storage object.
     8 1. Scan the nebulous directory trees and identify files that do not have a matching entry in the instance table.  These files could be reinserted, as the full disk path describes the ins_id and the ext_id for a given file.  It could be reassociated with the storage_object (if it exists), or simply deleted.
    99
    1010In addition, all nebulous tasks that create a file or copy a file should validate that the files agree before the function completes successfully.  Not doing this can introduce errors if we silently replicate a broken copy of the file.