| | 7 | |
| | 8 | We had a planned power outage at MHPCC on Wednesday this week. The outage went smoothly, though it took somewhat more time than we expected. I took the opportunity to re-organize our chip->host and skycell->host relationships in an attempt to make the storage usage more evenly balanced. We had not been using all of the wave 1 nodes for storage in several of the stages, with the result that those machines were nearly 10% emptier than the wave 2 and 3 nodes. It will probably take some time to get the balance back even after the adjustments. |
| | 9 | |
| | 10 | I spent an inordinate amount of time attempting to clean up the many terabytes of test data sets taking up space on ipp004. As discussed by Heather, the disk was full, making the dvomerge have trouble. The cleanup is still not complete, but I freed up 25% of the partition. We are getting ready to receive our first set of replacement 2TB disks, just in time, as the cluster has been pushing the limits lately. This is partly driven by a number of non-standard processing batches and large sets of data not currently automatically deleted: the MD04 stack data, all diffs from 3pi and Sweetspot for Paul's photometry reprocessing, all Sweetspot images for the stacking. In the coming days, some of these big datasets can be deleted to clear up more space. The new disks will get us 90TB more free space (30TB extra per wave 1 node). Assuming this process goes well, we will schedule upgrades for another set of 3 nodes towards the end of the summer. |
| | 11 | |
| | 12 | The plan for the MD04 deep stack was to produce an example with the standard pixel scale (0.2 arcsec), and then make an additional example in r-band with the GPC1 native scale (0.258 arcsec) for sensitivity comparison tests by Mark Huber. It turned out that the MD04 deep stack was made with the 0.258 arcsec pixel scale, so I launched the comparison in r-band using the 0.2 arcsec pixel scale. I also started the last lunation's sweetspot stack and warp-stack diff run. |
| | 13 | |
| | 14 | I've been working this week on the extended source analysis. I added Kron magnitudes to the standard data products for PSF sources as requested by folks at Durham. I've also been testing the non-linear fitting, and attempting to use information from the Kron analysis to improve the initial parameter guesses. |