Changes between Version 22 and Version 23 of PSNSC_MOPS

Timestamp:

Dec 5, 2017, 1:08:18 PM (9 years ago)

Author:

Mark Huber

Comment:

--

PSNSC_MOPS

@@ -44 +44 @@
 == Tasks/Improvements/Enhancements needed == 
 Nightly products -- only really need image+mask (uncompressed) so could make normal use of no weight file to save disk use during nightly
- * currently hacked to not produce mask+weight in ippitc due to overuse of itc datanodes with non-nightly products...
+ * currently hacked to not produce mask+weight in ippitc due to overuse of itc datanodes with non-nightly products... 
+ * compression and hack removed ~201709xx once MOPS installed new node -- 
 
 WW diffims for MOPS --
- * excess detections causing full rejection of OTA -- typically edges full of junk, unclear if could be improved with other cuts
+ * excess detections causing full rejection of OTA -- typically edges full of junk, unclear if could be improved with other cuts, need real sources on edges as it can still be useful
 
 centroids poor causing large GCR -- factor of 2 larger..
@@ -64 +65 @@
  * evaluate contents again, remove/add new columns as needed -- must add skycell_id, chip XY and position
  * merge WW and WSdiff catalog publishing to single product if possible -- conflict with timing possibly
- * add warp xy pixels and skycell_id to output catalog
+ * -- likely best to just wait for MOPS to switch to directly using the diff CMF files for both -- 
 
 w-band stack update for WSdiff -- 
@@ -81 +82 @@
  * more automated checking for missing visit WWdiffs -- create by exposure status table in czardb for a night reset @initday?
  
-MOPS stamp server @ITC -- MOPS using own node for this now 8/2017 -- node crash 20170917 unclear -- 
+MOPS stamp server @ITC -- MOPS using own node for this now 08/2017 -- node crash 20170917 unclear -- 
  * needs some raid1 disk (minimum few 100 GB, more in future for other work), modest RAM and cores -- more RAM+cores, more stamps can be made
  * must be a reliable node and close to the data nodes on the network (and out to neo cluster) -- unclear which is to be used
@@ -87 +88 @@
  * scp/nfs/rcp debate for overheads -- is it possible to use less intensive encryption in ssh?
 
-pstamp server backlog -- particularly w/ QUB stamps, in future may want to split pantasks so MOPS doesn't get behind large numbers of uploaded parse jobs
- * can bump up the parse limit (in pstamp.pro) from 10->20 and should help for short term
+pstamp server 
+ * backlog -- particularly w/ QUB stamps, in future may want to split pantasks so MOPS doesn't get behind large numbers of uploaded parse jobs
+  * can bump up the parse limit (in pstamp.pro) from 10->20 and should help for short term -- added as config in ipp-20170121r40242 update (see below)
+ * unclear which refcat used in returned stamps (ie for astrometry in MOPS recovery work 2MASS/GAIAv1) -- really useful for warps->diffs to also have but PSREFCAT isn't propagated...
+
+
+== Ops tag notes ==  
+
+ipp-20170121 -- r40242 starting 20171205 -- key change/update refcat using GAIAv1 astrometry and CMF_DV5 format
+ * new refcat for astronomy with GAIAv1 but photometry still PV3 ubercal (PSREFCAT PS1.REF.20170919, catdir.refcat.20170919.v0)
+ * cleared bugs to update difference catalog CMF to DV5 version (additional columns in CMF but none added to ppmops file), will allow for adding any new diff params in future as needed
+ * adjusted config allowing for more detections along edges to more closely match the prior tag (PSF_FIT_MODEL_SUM_FRAC_CUT,PSF_FIT_MASKED_SUM_FRAC_CUT)
+ * pstamp config options to change parse and number of faults limits to reduce backlog in getting stamps
+ * various bug fixes that were stuck in the xxxxx-stack diff processing when processing changed to the ipp-20170121  
+ * WSdiff configuration for a lower signal-to-noise cut similar to WWdiffs (SWEETSPOT_WS)
+
+
+ipp-20170121 -- rX starting 201702xx -- key changes/updates on WCS but also many modifications throughout code for PV3 (with bugs for nightly processing..)
+ * problem in WCS changes between tags and updates of pixels -- night of 20170214 issue?
+ * full use of tag started on 
+
+ipp-20141024 -- rX starting -- setup for post-ps1sc processing, many revisions
+ * using refcat  PSREFCAT PS1.REF.20140713, catdir.refcat.20140713.v0
+
+
+
+