IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Initial Version and Version 1 of PS1_IPP_Czarlog_20180129


Ignore:
Timestamp:
Feb 1, 2018, 1:44:15 PM (8 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PS1_IPP_Czarlog_20180129

    v1 v1  
     1== PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD ==
     2[[PageOutline]]
     3
     4(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])
     5
     6=== Monday : YYYY.MM.DD ===
     7 
     8=== Tuesday : YYYY.MM.DD ===
     9
     10=== Wednesday : 2018.01.31 ===
     11 * MEH: chip repeat fault 2 failure -- blocking automatic alt-diffs v2-v3 at end of night.. -- manually set quality 42 and fault 0, if happens again should be looked into
     12{{{
     13        o8149g0350o     XY27    1371055         2050838         new     OSS.nightlyscience      OSS.20180131    SweetSpot       2
     14gpc1/OSS.nt/2018/01/31/o8149g0350o.1371055/o8149g0350o.1371055.ch.2050838.XY27.log
     15
     16    Failed to calculate the min/max of the input vector.
     17        Auxiliary mask not enabled.
     18          Cell 0: 1 1
     19      PHOTCODE is GPC1.i.XY27
     20      --- psphot Model Background ---
     21        Unable to measure image background: too few data points (0) (0 failures)
     22        Unable to measure image background: too few data points (0) (1 failures)
     23        Unable to measure image background: too few data points (0) (2 failures)
     24    Failed to estimate background using ROBUST_MEDIAN for (434x423, (row0,col0) = (0,0)
     25    Failed to estimate background using ROBUST_MEDIAN for (434x800, (row0,col0) = (0,23)
     26    Failed to estimate background using ROBUST_MEDIAN for (434x800, (row0,col0) = (0,423)
     27        Unable to measure image background: too few data points (0) (100 failures)
     28                Unable to measure image background: too few data points (0) (200 failures)
     29Unable to measure image background: too few data points (0) (200 failures)
     30    Failed to estimate background using ROBUST_MEDIAN for (800x800, (row0,col0) = (2434,3223)
     31                Unable to measure image background: too few data points (0) (300 failures)
     32Unable to measure image background: too few data points (0) (300 failures)
     33    Failed to estimate background for 169 of 169 subimages
     34Error in the psphot readout analysis
     35 -> psphotModelBackgroundReadout (psphotModelBackground.c:275): invalid data
     36     failed to build background image
     37 -> psphotModelBackgroundReadoutFileIndex (psphotModelBackground.c:394): invalid data
     38     Unable to generate background model
     39 -> psphotModelBackground (psphotModelBackground.c:413): invalid data
     40     failed to model background for PSPHOT.INPUT entry 0
     41    In ppImageMaskStats: 0 483835616
     42    In ppImageMaskStats: 23590328 0.675939 0.324061 0.000000 0.000000
     43
     44....
     45
     46Number of leaks to display: 500
     47Running [/data/ippc64.1/ippitc/psconfig/ipp-20170121.lin64/bin/ppStatsFromMetadata /data/ipp118.1/nebulous/46/80/10454753075.gpc1:OSS.nt:2018:01:31:o8149g0350o.1371055:o8149g0350o.1371055.ch.2050838.XY27.stats - CHIP_IMFILE]...
     48    All data points have the same value: 20631.320312.
     49    All data points have the same value: 20631.320312.
     50-bg 20631.320312 -bg_mean_stdev 0.000000 -bg_stdev 70.661133 -dtime_detrend 13.332060 -dtime_photom 1.159112 -dtime_total 118.431503 -n_stars 0.000000 -n_extended 0.000000 -n_cr 0.000000 -quality 0 -ver_pslib '40242' -ver_psmodules '40242' -ver_psphot '40242' -ver_psastro '40242' -ver_ppstats '40242' -ver_ppimage '40242' -maskfrac_npix 23590328 -maskfrac_static 0.675938 -maskfrac_dynamic 0.324062 -maskfrac_magic 0.000000 -maskfrac_advisory 0.000000
     51Running [/data/ippc64.1/ippitc/psconfig/ipp-20170121.lin64/bin/funpack -S /data/ipp118.1/nebulous/ff/52/10454753063.gpc1:OSS.nt:2018:01:31:o8149g0350o.1371055:o8149g0350o.1371055.ch.2050838.XY27.ch.fits > /dev/null]...
     52Running [/data/ippc64.1/ippitc/psconfig/ipp-20170121.lin64/bin/funpack -S /data/ipp118.1/nebulous/94/2c/10454753064.gpc1:OSS.nt:2018:01:31:o8149g0350o.1371055:o8149g0350o.1371055.ch.2050838.XY27.ch.mk.fits > /dev/null]...
     53Running [/data/ippc64.1/ippitc/psconfig/ipp-20170121.lin64/bin/funpack -S /data/ipp118.1/nebulous/d5/cb/10454753065.gpc1:OSS.nt:2018:01:31:o8149g0350o.1371055:o8149g0350o.1371055.ch.2050838.XY27.ch.wt.fits > /dev/null]...
     54Running [/data/ippc64.1/ippitc/psconfig/ipp-20170121.lin64/bin/funpack -S /data/ipp118.1/nebulous/c7/30/10454753067.gpc1:OSS.nt:2018:01:31:o8149g0350o.1371055:o8149g0350o.1371055.ch.2050838.XY27.b1.fits > /dev/null]...
     55Running [/data/ippc64.1/ippitc/psconfig/ipp-20170121.lin64/bin/funpack -S /data/ipp118.1/nebulous/e7/fa/10454753068.gpc1:OSS.nt:2018:01:31:o8149g0350o.1371055:o8149g0350o.1371055.ch.2050838.XY27.b2.fits > /dev/null]...
     56Running [/data/ippc64.1/ippitc/psconfig/ipp-20170121.lin64/bin/funpack -S /data/ipp118.1/nebulous/af/8c/10454753066.gpc1:OSS.nt:2018:01:31:o8149g0350o.1371055:o8149g0350o.1371055.ch.2050838.XY27.mdl.fits > /dev/null]...
     57Couldn't find expected output file: neb://ipp118.1/gpc1/OSS.nt/2018/01/31//o8149g0350o.1371055/o8149g0350o.1371055.ch.2050838.XY27.cmf at /data/ippc64.1/ippitc/psconfig/ipp-20170121.lin64/bin/chip_imfile.pl line 830
     58        main::my_die('Couldn\'t find expected output file: neb://ipp118.1/gpc1/OSS....', 1371055, 2050838, 'XY27', 2) called at /data/ippc64.1/ippitc/psconfig/ipp-20170121.lin64/bin/chip_imfile.pl line 799
     59        main::check_output('neb://ipp118.1/gpc1/OSS.nt/2018/01/31//o8149g0350o.1371055/o8...', 1) called at /data/ippc64.1/ippitc/psconfig/ipp-20170121.lin64/bin/chip_imfile.pl line 554
     60
     61}}}
     62
     63 * MEH: regular cleanup of active distribution datastores of old products
     64 * MEH: regular bzip of pantask logs and mirror of ippitc account
     65 * MEH: had to manually reset state of 2 diffs for QUB stamps, caught in cleanup but not cleaned
     66 * MEH: neb-host adjustments --
     67  * ipp032 repair -- getting full, MOPS may need for gpc2 stamps until can update disk space
     68  * ipp105.0 up -- has space again (not red)
     69  * ipp115.0+1 -- red for while,  put into repair to preserve space
     70
     71
     72=== Thursday : 2018.02.01 ===
     73 * MEH: moving ippqub:stdscience_ws (and other pantasks as needed) to run primarily on ippc65 since ippitc nightly pantasks running on ippc66,c67,c69 (not clear why c69 is used rather than c68...) in order to free up ippc106 for full compute node processing
     74
     75=== Friday : YYYY.MM.DD ===
     76
     77=== Saturday : YYYY.MM.DD ===
     78
     79=== Sunday : YYYY.MM.DD ===