== PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2018.05.28 ===
 * MEH: continue working on cleaning up broken issues for MOPS getting warp stamps -- make no changes to system without discussing with me first 
  * re-queue MOPS request as mehtest to run under WEB.BIG and look at other failure issues -- FIXNS/RINGS.V0 older data not reprocessed due to FWHM cut about <12 pixels in ecliptic.rp and will need a new config to do so now, this may be silently not giving data to MOPS reporting PSTAMP_NO_OVERLAP
  * oddly broken .psf file o6864g0429o.770967/o6864g0429o.770967.ch.1329113.XY60.psf -- had to manuall neb-mv to .bad for it to update with the recent code mods 
  * additional reprocessing of old, broken ecliptic.rp under label/data_group PSNSC.wfix.20180525/PSNSC.wfix.20180525.<orig data_group>, moving broken update files to label ps_ud_MOPSeclip
  * additional reprocessing of broken LAP.PV3 files under label/data_group mopsfix/mops.fixbrokenLAP.20180323
  * continue re-queue MOPS pstamp requests looking at missing/broken file update fault cases from the stsci shuffle and clearing as needed -- will only continue to re-queue the remaining MOPS requests, will not be fixing any more broken files after today 
  * MOPS request names that seem to have all requested exposures based on the re-queue test -- ~60 exposures to fix/reprocess and complete the remaining 23 requests in the _120-_179 set in the ps_ud_WEB.UP label
{{{
web_639232.fits weryk_5B063D9F_00
web_639233.fits weryk_5B063D9F_179
web_639234.fits weryk_5B063D9F_178 
web_639237.fits weryk_5B063D9F_175 
web_639238.fits weryk_5B063D9F_174
web_639240.fits weryk_5B063D9F_173
web_639241.fits weryk_5B063D9F_172
web_639244.fits weryk_5B063D9F_169 
web_639245.fits weryk_5B063D9F_168
web_639247.fits weryk_5B063D9F_166 
web_639248.fits weryk_5B063D9F_165
web_639250.fits weryk_5B063D9F_163
web_639251.fits weryk_5B063D9F_162
web_639252.fits weryk_5B063D9F_161
web_639253.fits weryk_5B063D9F_160
web_639254.fits weryk_5B063D9F_159
web_639255.fits weryk_5B063D9F_158
web_639258.fits weryk_5B063D9F_155
web_639259.fits weryk_5B063D9F_154 
web_639260.fits weryk_5B063D9F_153
web_639261.fits weryk_5B063D9F_152
web_639263.fits weryk_5B063D9F_150 
web_639266.fits weryk_5B063D9F_147 
web_639267.fits weryk_5B063D9F_146
web_639268.fits weryk_5B063D9F_145
web_639269.fits weryk_5B063D9F_144
web_639270.fits weryk_5B063D9F_143
web_639271.fits weryk_5B063D9F_142
web_639272.fits weryk_5B063D9F_141
web_639273.fits weryk_5B063D9F_140
web_639275.fits weryk_5B063D9F_138 
web_639278.fits weryk_5B063D9F_135 
web_639280.fits weryk_5B063D9F_133 
web_639281.fits weryk_5B063D9F_132 
web_639282.fits weryk_5B063D9F_131
web_639285.fits weryk_5B063D9F_128 
web_639286.fits weryk_5B063D9F_127
}}}
=== Tuesday : 2018.05.29 ===
 * MEH: running PS2-WSdiff for MOPS in ~ippps2/stscience
=== Wednesday : YYYY.MM.DD ===

=== Thursday : YYYY.MM.DD ===
 * 08:45 EAM : one exposure was stuck at cam.  psastro was hung waiting for a reply from nebulous for an input file.  the input file exists (manual requests for the file succeeded).  checking the psastro stack, the code was waiting for a response from nebclient via soap.  My best guess: a hiccup in the apache server.  psastro stack trace:
{{{
#0  0x00007f9b09e37bd5 in recv () from /lib/libpthread.so.0
#1  0x00007f9b0dd6885d in frecv (soap=0x484ea70, s=0x4854b98 "POST /nebulous HTTP/1.1\r\nHost: ippc75\r\nUser-Agent: gSOAP/2.7\r\nContent-Type: text/xml; charset=utf-8\r\nContent-Length: 605\r\nConnection: close\r\nSOAPAction: \"urn:Nebulous/Server/SOAP#find_instances\"\r\n\r\n<?"..., n=65536) at stdsoap2.c:955
#2  0x00007f9b0dd59e88 in soap_recv_raw (soap=0x7) at stdsoap2.c:1201
#3  0x00007f9b0dd5a1d6 in soap_recv (soap=0x484ea70) at stdsoap2.c:1318
#4  0x00007f9b0dd5a335 in soap_getchar (soap=0x7) at stdsoap2.c:1335
#5  0x00007f9b0dd67246 in soap_begin_recv (soap=0x484ea70) at stdsoap2.c:12925
#6  0x00007f9b0dd57109 in soap_call_ns1__find_USCOREinstances (soap=0x484ea70, soap_endpoint=0x3d093e0 "http://ippc75/nebulous", soap_action=0x7f9b0dd715d0 "urn:Nebulous/Server/SOAP#find_instances", key=<value optimized out>, volume=<value optimized out>, _param_3=0x7fff867cba10) at soapClient.c:684
#7  0x00007f9b0dd4715f in nebFindInstances (server=0x14692e0, key=0xfffffffffffffe00 <Address 0xfffffffffffffe00 out of bounds>, volume=<value optimized out>) at nebclient.c:480
#8  0x00007f9b0dd47667 in nebFind (server=0x14692e0, key=0x3d43040 "neb://ipp117.0/gpc1/OSS.nt/2018/05/31//o8269g0257o.1392342/o8269g0257o.1392342.ch.2074968.XY11.cmf") at nebclient.c:548
#9  0x00007f9b0dfaba15 in pmConfigConvertFilename (filename=0x3d43040 "neb://ipp117.0/gpc1/OSS.nt/2018/05/31//o8269g0257o.1392342/o8269g0257o.1392342.ch.2074968.XY11.cmf", config=0x624760, create=false, trunc=false) at pmConfig.c:1828
#10 0x00007f9b0dfe713f in readPHUfromFilename (filename=0x7 <Address 0x7 out of bounds>, config=0x4854b98) at pmFPAfileDefine.c:458
#11 0x00007f9b0dfe8cd7 in fpaFileDefineFromArray (outConfig=<value optimized out>, sysConfig=0x4775ad0, bind=0x0, name=0x403f91 "PSASTRO.INPUT", filenames=0x3d42640) at pmFPAfileDefine.c:645
#12 0x00007f9b0dfe9be0 in pmFPAfileDefineFromArgs (success=0x7fff867cbe7f, config=0x624760, filename=0x403f91 "PSASTRO.INPUT", argname=0x403f99 "INPUT") at pmFPAfileDefine.c:741
#13 0x00000000004028df in psastroParseCamera (config=0x624760) at psastroParseCamera.c:20
#14 0x0000000000401fe5 in main (argc=22, argv=<value optimized out>) at psastro.c:39
}}}

=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===