| | 30 | * 11:02 CZW: ipp050 going down last night resulted in a number of stuck runs that would not revert cleanly due to nebulous having storage_objects for some files (generally the logs), but no instance. This likely means that the storage_object was created, ipp050 crashed, and then the script terminated when it couldn't get a filehandle. To resolve this, I identified all the storage_objects for these runs (neb-ls $path_base%$class_id), and used neb-mv to rename them to $key.bak. This seems to have unstuck things. |