PSNSC_MOPS requirements and notes (draft) --

Processing products -- czar needs to make sure all faults and issues are cleared daily (early morning) for OSS, MSS, ESS, ThreePi? products

• chip-cam-warp -- nightly
• warp-stack diffims -- nightly
• datastore of WS diffim catalogs -- nightly
• stamps -- chip only from pstamp, MOPS has own stamp server that requires uncompressed image access

• MOPS looking at using visit 1-2, 2-3 when visit 4 lost due to weather/faults to increase just a pair to triple for tracklets -- currently by request
  • sometime seem to be auto-made and other times not? need update on both when known --
  • appears to be at least partially due to the .multi nightly science task (which is not right and shouldn't be happening..) -- .multi look to be made internight when the camera stage quality faults on visit 2 & 3 and then makes a visit 1-4 diffim since neither 1 nor 4 is used to make a diffim -- expect other combinations to then be possible as well
  • lost visit mapping to be done -- typical losses from fault at camera due to FWHM cut

    v1 missing: v2-v3
    v2 missing: v1-v3
    v3 missing: v2-v4
    v4 missing: v2-v3
    

NEO targeted observations -- FSS.nightlyscience, FSS.WS -- also needs to be finished by early morning

• obs_mode FSS (new 201608) -- 6 exposure, MD-like dither (rotation) plus small offsets -- so WSdiff only and published to normal MOPS datastore location
• chip->warp normal stdscience pantasks as with xSS
• WSdiff currently runs in ~ippmops/stdscience_ws to make uncompressed WSdiffs

Cleanup --

• chip -- 1 days
• warp -- ? days (no specific requirement)
• WW, WSdiff -- 1 days -- if disk space issue, can reduce this to 2 days as long as warps uncleaned the update time is minimal
  • maybe longer for the FSS WSdiff since special follow-up field
• datastore WSdiff catalog bundles -- Bill has script doing?
• pstamp -- manual cleanup like other ps_ud_%

Tasks to do --

• WS diffims for MOPS
  • image files uncompressed -- either in processing or a copy on ipp032 -- ~10TB/night extra space used (20TB since data kept for 36hrs), processing seems ok (network i/o, dtime, faults were all acceptable)
  • publishing -- TBD
• .mops catalog format update/revision
  • evaluate contents again, remove/add new columns as needed (skycell_id in addition to chip XY and position?)
  • merge WW and WSdiff catalog publishing to single product if possible
• w-band stack update for WSdiff
• daily MOPS test quad -- label MOPS.dailytestset -- MOPS.dailytestset still in development
• ops tag test chunk -- MOPS.testchunk.OSSR.R15S2.0.Q.w.20140603
  • necessary comparison set for WW and WS diff for any development/modifications to ops tag
• more automated checking for missing visit WWdiffs -- create by exposure status table in czardb for a night reset @initday?