| | 34 | This progress report covers the past two weeks |
| | 35 | * Most of time spent monitoring the progress and debugging the LAP static sky processing. |
| | 36 | * Regions completed |
| | 37 | * 267 < RA < 303 DEC > 10 |
| | 38 | * RA < 225 DEC < 10 |
| | 39 | * Debugged and fixed a couple of assertion failures in psphot. |
| | 40 | * Changed scripts to collect statistics on number of detections and added them to the staticskyResult table' |
| | 41 | * removed "singlefilter" mode of staticsky. For consistency it now always uses psphotStack even if there is only a single filter |
| | 42 | * investigated instances of large numbers of forced detections caused by run away y band stacks. Created a method to identify the problem and in those cases turn off matching of all y band detections. Affects about ~2% of skycells. Made a mistake in the implementation and so had to re-run 3 days worth of skycells. |
| | 43 | * spent seemingly vast amounts of time choosing the right balance of nodes to use for staticsky. 3 x compute 3 works well at high galactic latitudes but must dedicate an entire machine near the plane. Near the galactic center the footprint analysis is very inefficient. There are so many sources that they get merged into just a few and it takes hours for the code to figure that out. |
| | 44 | * Enhanced cleanup process |
| | 45 | * log progress to a proper log file. This will aid debugging of problems and help reduce the disk space usage in ~ipp/cleanup/pantasks_logs |
| | 46 | * added mode to cleanup where it will go back and insure that previously cleaned components are all cleaned up. This will be used to go back and delete the unneeded chip and warp stage cmf files which are using considerable space on the cluster |
| | 47 | * handle several error conditions due to lost files. Re-institute setting of error_cleaned. Combined with log files this will allow us to better identify data that has been lost due to disk failures. |
| | 48 | * debugged some problems with dvo at MPIA. Turned out to be an incomplete copy of the dvo catalog. |
| | 49 | * fixed setting of Object.xStackDetectID in ippToPsps again |
