IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links
wiki:PSST_QUB

Version 13 (modified by Mark Huber, 9 years ago) ( diff )

--

PSST QUB requirements and notes (draft) --

Processing products -- like for MOPS, czar needs to make sure all faults are cleared daily for OSS, MSS, ESS, ThreePi products

  • chip-cam-warp -- nightly
  • warp-stack diffims -- nightly
  • datastore of WS diffim catalogs -- nightly
  • PSS and rapid updates for historical stamps (warp+stack+diff) --

QUB targeted observations (QUB.nightlyscience, QUB.WS/SS) should only be managed by Mark Huber.

Processing timescale -- ideal and last cutoff times for diffim catalogs to be available for QUB ingestion and processing (TBD)

  • chip-cam-warp -- nightly
  • warp-stack diffims -- nightly

Cleanup --

  • chip -- 2 days (same as MOPS)
  • warp -- 4 days (so weekends covered)
  • WSdiff -- 4 days (so weekends covered) -- if disk space issue, can reduce this to 2 days as long as warps uncleaned the update time is minimal
  • datastore WSdiff catalog bundles -- 1 month (manually done)
  • ps_ud_QUB -- manual, only Mark Huber should do
  • QUB.nightlyscience, QUB.WS/SS -- manual, only Mark Huber should do

Tasks to do -- in order of possible accomplishment

  • only really need image+mask (compressed so ~ok) -- like MOPS could switch off weight image for less disk use in processing
  • gpc2 import of PV3 stack products -- requires new ops tag and then export/import of gpc1 stack rows to gpc2
  • WSdiff daily test set --
  • PV3 w-band stacks -- some done at LANL, likely a good amount of reorganization work to be done as well as compute and disk space required -- some exist as of 20160201, have asked QUB if they wish to partially switch over but suspect not with all the other work going on
  • gri synthetic w-band stacks for all sky -- much development work, nodes and disk space required.
  • PSS should have option to turn up power for updates when large number of historical stamps are required (method to do so is unclear/undocumented..)
  • cleanup timescales -- 3PI(7d)+OSS(2d)+SNIa(?) are all various times..
  • gpc1 on ipp0012 restored for access to what diffims should be available --
  • switch to PV3 stacks for grizy (done 201xxxx) -- requires new ops tag, still some bugs in it -- ~ippqub running modified old tag to use 20141024 since ipp-20170121 broken for WSdiff
  • s/n cut in diffphot -- MOPS will use WSdiff in future at lower cut ~3.5-4, will the be useful for QUB (or at least able to filter to their desired s/n cut?)
  • good_frac limit 0.2 reduce to 0 (remove constraint) to match MOPS WWdiff if possible
  • gpc1 replication to ipp003 (tcs mysql) for QUB+ use -- will be retiring machines soon so need to work in that time frame

Attachments (2)

Download all attachments as: .zip

Note: See TracWiki for help on using the wiki.