IPP Progress Report for the week 2011-10-31 - 2011-11-06

(Up to IPP Progress Reports)

Eugene Magnier

Serge Chastel

• Sick Tue+Wed
• ippdb02 replication is back
• diff non-unique diff_skyfile_id 162937 investigation
• ganglia temperature monitoring

Heather Flewelling

Roy Henderson

• vacation Mon/Tues/Wed

• monitored loading
• some tedious work reloading 1500-odd batches that were placed on hold in the ODM. had to be very carefull
• updated IN batch with 'w' filter in Filter table
• looked into missing extended properties tables in SAS data
• caught up with LAP loading after DVO merging was restarted
• continued to load old 3PI.Now have 9 - 15 hours RA
• updated PSPS news page with plots of both old and new 3PI.
• usual mailing list admin
• created wiki page to bring together all the suggested schema changes
• added 'deepstacks' server to czartool

Mark Huber

• MD04-r very deep stack release. MD07 exposures finished running through warp, MD07-y refstack and test samples made.
• continued working through ppStack and ppSub testing
• Out sick Tuesday, Czar Friday

Bill Sweeney

• Modified database schema for diff stage to handle case where difftool -definewarpwarp selects two exposures but for differencing but they actually don't have any skycells in common. This was trickier than we expected but in the end we solved the problem.
• In the process of testing this feature we discovered an inconsistency between the production gpc1 database and the replicated version. An extra row exists in the replicants. Spent several hours with Serge attempting to determine how this might have happened. No conclusions as yet
• Gathered some M31 warp exposures to demonstrate the severe false streak detection problem that we are having with M31 this year. This involved reprocessing some exposures and writing scripts to copy the data to a directory on one of the stare nodes and run the ppSkycell program to generate binned jpegs.
• Started working on adding a new feature to the postage stamp server to allow users to select images that have the background correction restored. This has been requested by users looking at large sources. Something that is different here is that we are going to do processing which has not been run before. That is we won't require that a chipBackgroundRun exist for the exposure. This is something new for the postage stamp server, but in this case it appears to be something that we can implement with reasonable effort.

Chris Waters

• Diskspace: Further work getting diskspace scripts organized to be more descriptive.
• Sky background: Began comparison of science images and linearity data, to determine why we are not fully correcting the cell-to-cell variations in the background level. Confirmed that stacking the footprint data in two halves yields the same pattern in the final stacks.
• Storage: organized nebulous commands to add stare nodes into nebulous and target the first copies of stare data to those nodes.
• LAP: helped unstick LAP processing a few times during the week. Also checked the astrometry failure rate for LAP region H, which is located near the pole. This region has a 6% failure rate, compared with 1-2% for the rest of the sky. This shows that we do have problems solving the astrometry there, but it is not catastrophic.
• asinh: Updated the header values for asinh scaling to be more descriptive of the actual process to reverse the scaling.